You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-30 - 23:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Oct 30, 2025 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
505021580,4sleep11056199cyclictest10:58:381
3061721380,5sleep01056099cyclictest10:20:500
1677721340,1sleep316778-21bash11:40:123
3184021300,4sleep31056399cyclictest10:14:233
3103721280,1sleep00-21swapper/012:05:100
2423821260,3sleep224236-21sshd12:22:562
3174421110,1sleep20-21swapper/211:15:062
10211210833,46sleep30-21swapper/307:08:593
10211210833,46sleep30-21swapper/307:08:593
3082021070,2sleep230819-21sshd11:28:212
1429021020,3sleep10-21swapper/109:28:151
179252960,0sleep11846-21nfsd09:56:181
251982950,1sleep025182-21sshd11:07:230
91142940,1sleep09055-21sshd09:35:010
5552920,2sleep10-21swapper/111:31:491
207052920,0sleep00-21swapper/011:23:540
116732920,2sleep10-21swapper/110:52:331
169802910,2sleep30-21swapper/312:39:443
233902900,0sleep00-21swapper/009:50:080
32382890,1sleep03234-21bash12:35:290
143392880,2sleep114337-21bash10:12:331
136662870,2sleep11847-21nfsd09:52:251
131902870,1sleep00-21swapper/010:02:340
281082850,4sleep01056099cyclictest11:51:120
151772840,1sleep20-21swapper/210:15:592
130892840,1sleep013085-21sshd11:16:260
1004628432,48sleep10-21swapper/107:06:531
1004628432,48sleep10-21swapper/107:06:531
164672830,2sleep20-21swapper/210:12:462
116992830,2sleep20-21swapper/210:49:172
44932820,1sleep20-21swapper/211:12:022
226902820,1sleep20-21swapper/212:31:272
106352800,2sleep10-21swapper/112:36:111
245992780,3sleep10-21swapper/112:31:371
108372780,2sleep310829-21sshd10:25:263
287252770,1sleep00-21swapper/009:16:160
196232770,1sleep21056299cyclictest12:00:282
284262760,0sleep328425-21sshd10:37:323
296842750,1sleep029682-21bash12:23:260
110132750,2sleep30-21swapper/310:59:163
282502740,2sleep30-21swapper/311:07:423
120342740,2sleep312033-21sshd10:45:543
239572730,2sleep323907-21sshd11:37:283
1001327333,11sleep20-21swapper/207:06:302
1001327333,11sleep20-21swapper/207:06:302
97572710,3sleep31056399cyclictest09:35:043
294652710,4sleep21056299cyclictest09:50:382
181092660,2sleep31848-21nfsd09:42:403
159472660,1sleep30-21swapper/309:25:063
249982590,0sleep00-21swapper/009:36:330
979725327,14sleep00-21swapper/007:05:270
979725327,14sleep00-21swapper/007:05:270
130342480,43sleep3135650irq/27-eth011:23:063
217712330,3sleep20-21swapper/211:20:352
111272330,31sleep1135650irq/27-eth012:15:511
10563993218,5cyclictest10950irq/23-ehci_hcd11:45:213
249462300,0sleep224941-21bash11:47:332
10563993015,4cyclictest20563-21fschecks_time11:00:143
1056099300,20cyclictest0-21swapper/011:33:590
1056399270,19cyclictest44-21ksoftirqd/312:05:263
1056099274,20cyclictest14460-21sshd10:46:100
1056099270,24cyclictest32646-21sshd12:26:330
10563992612,2cyclictest10231-21needreboot12:30:203
253102250,2sleep125313-21nfsd407:40:181
227222250,2sleep122720-21bash10:47:051
123292250,1sleep012326-21sshd11:26:190
1056399252,20cyclictest44-21ksoftirqd/311:57:213
1056399251,18cyclictest44-21ksoftirqd/310:01:493
1056399250,24cyclictest1847-21nfsd10:31:153
10561992512,5cyclictest10950irq/23-ehci_hcd12:04:401
10560992513,6cyclictest3-21ksoftirqd/011:42:040
10560992510,6cyclictest0-21swapper/010:26:330
1056099250,2cyclictest13675-21sshd10:52:450
11032240,1sleep20-21swapper/210:31:142
10563992413,7cyclictest5016-21bash10:21:343
1056299240,5cyclictest26764-21sshd12:14:252
1056199248,5cyclictest10950irq/23-ehci_hcd10:03:451
1056099240,22cyclictest0-21swapper/012:04:400
21932230,3sleep10-21swapper/111:38:421
1056399233,1cyclictest16530-21sshd12:19:233
10563992319,2cyclictest135650irq/27-eth009:50:443
10563992318,3cyclictest27574-21sshd11:14:413
10563992317,3cyclictest0-21swapper/310:51:093
10563992314,6cyclictest20053-21sshd11:53:453
1056299239,6cyclictest10950irq/23-ehci_hcd11:44:112
1056199237,4cyclictest27544-21sshd10:44:131
1056099231,20cyclictest0-21swapper/010:17:270
1056099231,18cyclictest0-21swapper/010:33:470
1056099230,13cyclictest0-21swapper/011:02:490
1056399228,6cyclictest135650irq/27-eth009:49:183
1056399227,7cyclictest1846-21nfsd12:04:343
10563992215,5cyclictest13410-21sshd11:29:523
10563992215,4cyclictest0-21swapper/309:58:403
10563992213,7cyclictest1671-21sshd11:15:173
10563992211,5cyclictest10950irq/23-ehci_hcd12:14:053
1056099221,7cyclictest0-21swapper/012:19:400
10560992214,5cyclictest3-21ksoftirqd/010:09:550
1056099220,9cyclictest4872-21id11:45:290
92712210,18sleep3135650irq/27-eth010:42:183
60272210,2sleep21056299cyclictest09:30:382
47872210,2sleep30-21swapper/309:23:543
210552214,15sleep110950irq/23-ehci_hcd11:57:191
10563992116,3cyclictest1846-21nfsd11:30:033
10563992113,4cyclictest1959-21sshd12:26:333
1056399210,19cyclictest44-21ksoftirqd/310:08:553
10562992111,4cyclictest10950irq/23-ehci_hcd10:36:592
1056099211,2cyclictest0-21swapper/007:30:120
1056099211,17cyclictest0-21swapper/011:36:220
1056099210,2cyclictest0-21swapper/011:55:050
1056099210,20cyclictest32152-21sshd10:41:110
1056099210,14cyclictest32390-21sshd12:11:440
1056099210,10cyclictest16445-21sshd10:59:510
1056399201,17cyclictest44-21ksoftirqd/312:21:093
1056299207,5cyclictest26950irq/26-ahci[00010:05:472
1056299204,8cyclictest28214-21sshd12:29:072
1056299201,8cyclictest7594-21sshd09:38:112
10562992014,5cyclictest10136-21id12:06:182
10562992013,4cyclictest135650irq/27-eth010:40:582
1056199206,2cyclictest5256-21bash11:45:321
10561992013,5cyclictest26419-21sshd11:21:061
10561992011,2cyclictest10950irq/23-ehci_hcd12:26:321
10561992011,2cyclictest10950irq/23-ehci_hcd12:22:041
1056099204,9cyclictest0-21swapper/009:43:460
10560992014,4cyclictest3-21ksoftirqd/011:11:480
1056099201,11cyclictest0-21swapper/012:31:510
1056099200,2cyclictest0-21swapper/009:45:420
1056099200,14cyclictest0-21swapper/010:11:130
7962190,4sleep21056299cyclictest10:54:542
10562991914,4cyclictest1847-21nfsd12:35:592
10562991912,5cyclictest1927-21snmpd09:42:432
10562991912,5cyclictest17603-21cp10:56:282
1056199196,2cyclictest18503-21bash09:46:041
1056199195,9cyclictest29506-21bash10:17:271
1056199192,2cyclictest0-21swapper/111:15:491
1056199191,1cyclictest28621-21sshd11:28:081
1056099198,4cyclictest3-21ksoftirqd/010:39:250
1056099191,17cyclictest0-21swapper/009:56:130
1056099190,1cyclictest0-21swapper/009:25:220
1056099190,16cyclictest0-21swapper/007:36:570
1056099190,15cyclictest0-21swapper/007:15:280
65722180,16sleep226950irq/26-ahci[00012:18:292
10563991812,4cyclictest6088-21sshd10:15:123
1056299188,5cyclictest10950irq/23-ehci_hcd11:00:232
1056299185,3cyclictest10137-21sshd11:05:472
1056199189,4cyclictest25205-21sshd11:50:531
1056199185,6cyclictest135650irq/27-eth010:36:051
1056199183,3cyclictest13950-21sshd11:09:411
1056199180,4cyclictest10950irq/23-ehci_hcd07:20:181
1056199180,3cyclictest20823-21sshd10:30:051
1056099183,14cyclictest19076-21sshd09:21:580
1056099180,17cyclictest0-21swapper/007:14:210
1056099180,14cyclictest0-21swapper/009:11:320
1056099180,14cyclictest0-21swapper/009:11:320
319942170,2sleep10-21swapper/109:37:181
1056299178,4cyclictest1959-21sshd10:00:382
1056299174,3cyclictest21161-21bash09:49:552
1056299172,8cyclictest1848-21nfsd11:35:192
1056299171,4cyclictest20520-21bash09:15:232
10562991712,4cyclictest832-21sshd11:58:372
1056299170,15cyclictest0-21swapper/209:56:112
1056199176,0cyclictest0-21swapper/111:44:321
1056199173,3cyclictest27957-21sshd09:33:301
1056199171,14cyclictest18195-21bash11:00:011
1056199171,0cyclictest0-21swapper/112:05:511
10561991710,5cyclictest31074-21sshd10:20:531
10560991711,5cyclictest5345-21perf08:10:000
1056099170,2cyclictest0-21swapper/008:10:350
1056099170,16cyclictest0-21swapper/008:53:490
87072160,14sleep1135650irq/27-eth009:24:211
219362160,14sleep110950irq/23-ehci_hcd10:06:451
1056399161,6cyclictest12556-21sshd09:11:083
1056399161,6cyclictest12556-21sshd09:11:083
10563991611,3cyclictest4437-21ntp_states08:05:213
1056399160,3cyclictest21578-21bash09:15:293
1056299163,3cyclictest27290-21iostat_ios07:45:152
10562991611,4cyclictest1959-21sshd11:52:252
10562991610,2cyclictest135650irq/27-eth011:31:152
1056199161,6cyclictest0-21swapper/111:13:361
1056199160,6cyclictest1846-21nfsd12:14:301
1056199160,14cyclictest0-21swapper/108:25:141
1056199160,14cyclictest0-21swapper/108:04:361
1056099165,10cyclictest10473-21kworker/0:008:22:570
1056099161,12cyclictest0-21swapper/007:21:170
1056099160,1cyclictest0-21swapper/008:45:020
1056099160,1cyclictest0-21swapper/007:55:090
1056099160,15cyclictest0-21swapper/009:04:300
1056099160,15cyclictest0-21swapper/008:42:040
1056099160,15cyclictest0-21swapper/008:31:340
1056099160,15cyclictest0-21swapper/007:42:270
1056099160,11cyclictest0-21swapper/008:25:040
1056399150,14cyclictest0-21swapper/308:58:533
1056399150,13cyclictest0-21swapper/307:23:353
1056299157,6cyclictest0-21swapper/208:00:132
1056299157,4cyclictest13600-21sshd10:25:442
1056299152,12cyclictest144550irq/28-eth1-rx-09:21:062
1056299152,12cyclictest144550irq/28-eth1-rx-07:28:402
1056299152,12cyclictest135650irq/27-eth009:05:252
1056299151,9cyclictest8331-21sshd10:21:552
10562991511,1cyclictest0-21swapper/208:44:402
1056299150,6cyclictest7599-21bash09:27:332
1056299150,11cyclictest144550irq/28-eth1-rx-07:40:132
1056299150,11cyclictest13130-21sshd09:11:112
1056299150,11cyclictest13130-21sshd09:11:102
1056199151,12cyclictest2761-21sshd09:16:561
1056199151,12cyclictest1959-21sshd09:12:061
1056199151,12cyclictest1959-21sshd09:12:051
1056199151,12cyclictest1199-21sshd09:40:511
1056199150,1cyclictest14735-21sshd10:25:511
1056099156,5cyclictest0-21swapper/007:45:080
1056099150,8cyclictest0-21swapper/008:00:500
1056099150,2cyclictest0-21swapper/008:35:050
1056099150,1cyclictest0-21swapper/007:25:150
1056099150,14cyclictest0-21swapper/008:55:160
1056099150,14cyclictest0-21swapper/007:54:220
1056099150,12cyclictest0-21swapper/009:05:230
1056399143,10cyclictest10950irq/23-ehci_hcd08:37:493
1056399143,10cyclictest10950irq/23-ehci_hcd08:17:243
1056399140,12cyclictest30649-21munin-node09:05:163
1056399140,12cyclictest12248-21bash09:31:173
1056299149,4cyclictest10950irq/23-ehci_hcd08:06:552
1056299145,5cyclictest10950irq/23-ehci_hcd09:00:142
1056299142,11cyclictest144550irq/28-eth1-rx-07:32:292
1056299140,13cyclictest0-21swapper/208:50:182
1056299140,12cyclictest0-21swapper/208:25:532
1056299140,12cyclictest0-21swapper/207:20:182
1056199143,3cyclictest10950irq/23-ehci_hcd07:55:121
1056199141,5cyclictest0-21swapper/108:30:141
1056199141,5cyclictest0-21swapper/107:12:071
1056199141,4cyclictest28412-21runrttasks07:48:101
1056199141,11cyclictest1848-21nfsd08:55:231
10561991410,3cyclictest0-21swapper/108:20:011
1056199140,13cyclictest0-21swapper/108:35:141
1056199140,12cyclictest29609-21uname07:50:181
1056099148,5cyclictest0-21swapper/008:15:120
232772130,11sleep1135650irq/27-eth008:46:291
1056399137,5cyclictest0-21swapper/307:50:433
10563991311,1cyclictest0-21swapper/307:16:233
1056399130,4cyclictest31355-21sh07:55:103
1056399130,12cyclictest0-21swapper/309:00:293
1056399130,12cyclictest0-21swapper/308:49:013
1056399130,12cyclictest0-21swapper/308:11:183
1056399130,12cyclictest0-21swapper/307:29:073
1056399130,11cyclictest26941-21munin-node07:45:133
1056399130,11cyclictest24528-21df_abs07:40:123
1056399130,11cyclictest20022-21df_inode07:30:123
1056399130,11cyclictest1828-21memory08:00:173
1056399130,11cyclictest11296-21ls07:10:153
1056299138,4cyclictest16962-21munin-node08:35:192
1056299138,0cyclictest0-21swapper/207:35:202
1056299135,7cyclictest144550irq/28-eth1-rx-08:10:152
1056299134,8cyclictest144550irq/28-eth1-rx-08:46:032
1056299131,11cyclictest135650irq/27-eth008:21:152
10562991310,1cyclictest0-21swapper/208:56:072
1056299130,12cyclictest1848-21nfsd08:16:242
1056299130,12cyclictest0-21swapper/208:31:002
1056299130,12cyclictest0-21swapper/207:16:452
1056299130,12cyclictest0-21swapper/207:13:362
1056199137,5cyclictest0-21swapper/107:35:521
1056199131,11cyclictest1848-21nfsd09:01:101
1056199131,11cyclictest0-21swapper/108:17:301
1056199131,11cyclictest0-21swapper/107:25:491
1056199130,4cyclictest20391-21ntp_states08:40:191
1056199130,12cyclictest0-21swapper/108:10:161
1056199130,12cyclictest0-21swapper/108:07:191
1056199130,12cyclictest0-21swapper/107:15:341
1056199130,11cyclictest25632-21chrt08:52:261
1056199130,11cyclictest20379-21hddtemp_smartct07:30:151
1056399121,10cyclictest135650irq/27-eth007:35:073
1056399120,3cyclictest12734-21diskstats08:25:143
1056399120,11cyclictest135650irq/27-eth008:41:053
1056399120,11cyclictest0-21swapper/308:20:013
1056399120,10cyclictest24555-21munin-node08:50:153
1056399120,10cyclictest146812sleep308:30:083
1056299128,3cyclictest29085-21df07:50:132
1056299120,3cyclictest32078-21munin-node07:55:162
1056199129,2cyclictest135650irq/27-eth009:05:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional