You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 17:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Nov 05, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3251021580,1sleep20-21swapper/212:00:022
135921500,1sleep21349-21sshd12:15:372
1659121490,1sleep01959-21sshd12:01:320
2255921460,4sleep32106199cyclictest10:33:583
2402821300,2sleep010-21rcuc/011:14:230
2921521290,1sleep329203-21sshd11:56:343
106621280,1sleep22105799cyclictest09:36:532
834221270,4sleep32106199cyclictest12:06:573
3039821270,3sleep12105299cyclictest12:15:201
792421250,1sleep07921-21sshd12:34:070
2027021210,2sleep30-21swapper/312:17:303
2642821140,1sleep11847-21nfsd12:21:141
866821130,4sleep22105799cyclictest11:12:442
2746821080,1sleep03944-21kworker/0:012:38:440
613921050,2sleep26117-21sshd12:09:562
901221030,2sleep29000-21sshd09:44:392
1232521010,2sleep212309-21sshd11:58:052
98902960,0sleep20-21swapper/211:09:282
182672960,3sleep12105299cyclictest09:24:301
2080129224,39sleep30-21swapper/307:09:453
94952900,1sleep20-21swapper/211:45:272
37692900,2sleep21848-21nfsd09:57:532
19552900,2sleep02104899cyclictest09:29:500
275572880,1sleep227558-21sshd11:40:542
2078228838,45sleep10-21swapper/107:09:321
70842870,1sleep37085-21sshd10:12:013
262492870,2sleep126247-21sshd09:15:121
70312850,2sleep21848-21nfsd09:12:562
133512850,2sleep00-21swapper/012:28:500
289912840,1sleep21846-21nfsd11:01:182
232122840,2sleep123213-21sshd11:04:101
169982840,3sleep30-21swapper/311:43:073
57522830,2sleep10-21swapper/112:36:441
250022810,2sleep31848-21nfsd11:53:093
238322810,2sleep32405-21runrttasks12:35:263
197922810,2sleep119793-21sshd10:16:401
197922810,2sleep119793-21sshd10:16:401
17292800,2sleep22105799cyclictest11:35:132
194422790,0sleep00-21swapper/010:03:070
235342780,1sleep00-21swapper/012:20:560
276462770,2sleep227623-21sshd10:34:292
312512750,2sleep30-21swapper/312:12:173
199812750,2sleep219980-21bash11:20:302
126002750,2sleep312582-21sshd10:15:543
126002750,2sleep312582-21sshd10:15:543
224472740,2sleep10-21swapper/112:26:421
46082730,0sleep00-21swapper/009:19:440
269002730,1sleep010-21rcuc/010:24:170
35172710,3sleep22105799cyclictest11:51:042
326942700,1sleep032679-21sshd12:12:260
260762700,2sleep10-21swapper/111:40:451
195172700,1sleep20-21swapper/209:24:392
246812680,1sleep12105299cyclictest11:53:071
212342680,1sleep10-21swapper/111:58:571
49572630,3sleep22105799cyclictest12:30:522
2060126332,18sleep20-21swapper/207:07:322
197382630,2sleep319737-21bash10:47:083
2104899600,58cyclictest15466-21sshd10:09:280
108832600,1sleep12105299cyclictest10:59:321
150692580,1sleep20-21swapper/210:36:212
21057995550,3cyclictest7808-21sshd10:08:322
2104899550,49cyclictest10157-21bash10:12:200
2104899550,41cyclictest26709-21sshd10:27:340
2077125532,11sleep00-21swapper/007:09:220
2104899540,48cyclictest24023-21sshd11:30:510
2104899521,46cyclictest28248-21sshd10:34:320
2104899520,51cyclictest0-21swapper/009:45:150
2104899519,37cyclictest19806-21sshd11:03:480
2104899510,47cyclictest14897-21sshd10:56:330
21057995045,3cyclictest22782-21bash10:20:252
2104899500,49cyclictest24073-21id09:21:400
2104899497,30cyclictest17687-21bash11:23:470
2104899490,46cyclictest1404-21sshd09:36:540
2104899490,45cyclictest29540-21sshd11:08:060
21057994842,3cyclictest0-21swapper/211:15:252
21057994840,5cyclictest0-21swapper/210:26:432
21057994840,4cyclictest645-21bash09:33:122
2104899481,46cyclictest19415-21bash10:40:090
2104899480,34cyclictest1846-21nfsd10:51:430
21057994743,2cyclictest1848-21nfsd11:25:492
21057994741,3cyclictest1846-21nfsd09:47:392
2104899471,32cyclictest0-21swapper/009:41:530
2104899470,45cyclictest7680-21id11:54:370
2104899470,45cyclictest1847-21nfsd10:47:180
2104899470,37cyclictest598-21sshd09:50:270
21061994642,3cyclictest16015-21sshd11:33:233
21057994643,1cyclictest0-21swapper/212:39:332
21057994642,2cyclictest9040-21sshd10:55:582
21057994642,2cyclictest1847-21nfsd10:02:432
21057994642,2cyclictest1847-21nfsd09:25:222
21057994640,4cyclictest1846-21nfsd10:17:282
21057994640,4cyclictest1846-21nfsd10:17:282
21057994637,7cyclictest0-21swapper/212:29:572
21057994637,6cyclictest18910-21id12:23:342
2104899461,43cyclictest20684-21bash09:56:020
2104899460,37cyclictest26834-21sshd12:15:040
21061994541,2cyclictest0-21swapper/311:16:443
21057994540,3cyclictest1847-21nfsd09:54:422
2104899451,39cyclictest13254-21sshd11:36:180
2104899450,42cyclictest16165-21sshd11:55:200
21057994440,2cyclictest18991-21sshd09:17:502
21057994440,2cyclictest15166-21sshd10:50:042
2104899441,37cyclictest0-21swapper/011:29:110
2104899440,42cyclictest6680-21sshd10:35:280
21057994339,2cyclictest1848-21nfsd11:33:282
21057994338,3cyclictest0-21swapper/212:10:402
236542420,3sleep30-21swapper/311:27:403
21057994238,2cyclictest0-21swapper/210:40:282
21057994234,6cyclictest1848-21nfsd10:11:452
2104899425,36cyclictest13046-21sshd12:07:240
2104899421,40cyclictest0-21swapper/011:44:150
2104899420,41cyclictest1848-21nfsd09:12:100
2104899420,40cyclictest6171-21id09:33:490
2104899420,40cyclictest11301-21sshd10:15:460
2104899420,40cyclictest11301-21sshd10:15:460
2104899410,40cyclictest0-21swapper/011:46:380
2104899410,33cyclictest1848-21nfsd11:16:500
21061993933,3cyclictest25973-21bash09:39:333
21057993935,2cyclictest27221-21sshd10:47:562
21061993834,3cyclictest135650irq/27-eth011:13:583
21061993832,4cyclictest3914-21sshd10:52:083
21061993631,3cyclictest12780-21bash11:03:013
21061993529,3cyclictest0-21swapper/309:49:293
21061993429,3cyclictest30191-21bash09:22:203
21061993414,7cyclictest18311-21sshd10:43:213
21061993228,3cyclictest19741-21sshd10:57:053
21061993223,5cyclictest6914-21id12:25:213
21061993215,7cyclictest29079-21sshd09:53:363
21052993224,3cyclictest1848-21nfsd11:34:161
2106199319,9cyclictest20208-21sshd09:10:503
21061993128,2cyclictest135650irq/27-eth009:58:233
21061993125,3cyclictest0-21swapper/309:34:223
21061993024,4cyclictest1848-21nfsd09:25:203
21061992924,3cyclictest0-21swapper/310:01:033
21061992920,5cyclictest18062-21sshd12:20:243
2105299290,20cyclictest22-21ksoftirqd/109:58:001
21061992822,4cyclictest7367-21sshd10:25:263
21061992820,6cyclictest8995-21sshd11:05:553
21061992820,5cyclictest28443-21sshd12:02:433
21061992819,7cyclictest12212-21sshd10:36:033
21061992818,5cyclictest15886-21sshd11:36:343
2104899286,10cyclictest30923-21munin-node08:40:210
2104899280,26cyclictest0-21swapper/009:10:010
2104899280,24cyclictest8590-21perf09:05:010
2104899280,23cyclictest3404-21nfsd407:40:190
219362270,4sleep12105299cyclictest12:14:361
2106199278,11cyclictest17218-21sshd10:09:443
2106199273,11cyclictest21176-21bash12:32:233
21061992719,5cyclictest6148-21sshd10:22:073
21061992719,5cyclictest1848-21nfsd09:41:103
2104899270,9cyclictest6840-21sort07:49:590
267312260,3sleep30-21swapper/309:18:383
2104899261,15cyclictest0-21swapper/007:26:520
2104899260,8cyclictest20413-21dump-pmu-power08:24:550
2104899260,22cyclictest0-21swapper/007:18:440
2104899260,17cyclictest0-21swapper/007:30:130
231702250,23sleep1135650irq/27-eth009:45:591
2104899250,21cyclictest7373-21fschecks_count07:50:130
21061992414,6cyclictest0-21swapper/311:45:213
21052992410,4cyclictest4205-21sshd12:06:311
21061992317,4cyclictest0-21swapper/311:23:473
21052992310,5cyclictest36-21rcuop/210:21:321
2104899230,8cyclictest0-21swapper/007:55:200
2104899230,20cyclictest0-21swapper/008:18:560
21052992211,2cyclictest0-21swapper/110:00:571
21052992210,9cyclictest19558-21sshd11:07:021
2105299220,7cyclictest0-21swapper/109:35:191
2104899222,10cyclictest2643-21munin-node08:50:130
2104899221,8cyclictest0-21swapper/008:58:030
2104899220,21cyclictest1184-21munin-node07:35:230
273202210,0sleep127318-21sshd10:44:181
267912212,17sleep1135650irq/27-eth011:47:111
2105299219,5cyclictest10950irq/23-ehci_hcd10:52:531
2105299218,5cyclictest135650irq/27-eth011:35:071
2105299212,4cyclictest0-21swapper/112:03:571
21052992114,3cyclictest20859-21sshd10:10:061
21052992110,1cyclictest0-21swapper/110:30:241
2104899210,7cyclictest32186-21cpu08:45:120
2104899210,19cyclictest27269-21munin-run08:34:590
2104899210,16cyclictest0-21swapper/008:00:160
166782210,19sleep1135650irq/27-eth011:16:531
88422200,2sleep10-21swapper/109:51:191
2105299207,5cyclictest1847-21nfsd09:34:401
21052992010,1cyclictest1848-21nfsd10:26:111
2104899200,18cyclictest0-21swapper/008:05:170
2104899200,17cyclictest0-21swapper/007:21:040
2104899200,15cyclictest0-21swapper/008:10:130
44702190,1sleep10-21swapper/110:45:221
2105299197,5cyclictest10950irq/23-ehci_hcd11:24:351
21052991912,5cyclictest31112-21sshd09:25:481
21052991912,3cyclictest23375-21sshd10:37:131
2105299190,9cyclictest0-21swapper/111:10:401
2104899190,18cyclictest27526-21atenall_r5power08:35:120
2104899190,18cyclictest0-21swapper/008:28:200
59832180,16sleep1135650irq/27-eth010:05:071
2105799182,14cyclictest0-21swapper/207:53:342
21052991812,3cyclictest0-21swapper/109:41:061
21052991810,4cyclictest1346-21sshd12:30:331
2104899187,7cyclictest0-21swapper/007:12:220
2105799171,7cyclictest25-21rcuop/108:01:482
2105299176,6cyclictest10950irq/23-ehci_hcd11:28:081
2105299175,4cyclictest135650irq/27-eth009:14:161
271482161,14sleep2135650irq/27-eth008:33:432
2106199169,4cyclictest0-21swapper/309:10:013
2106199167,2cyclictest0-21swapper/307:55:223
2106199161,14cyclictest44-21ksoftirqd/308:52:593
2106199160,14cyclictest0-21swapper/308:40:153
21057991612,2cyclictest0-21swapper/208:15:172
180152160,8sleep10-21swapper/108:13:391
2106199159,5cyclictest0-21swapper/308:18:413
2106199151,13cyclictest135650irq/27-eth007:46:073
21061991511,3cyclictest10950irq/23-ehci_hcd08:49:533
2106199150,6cyclictest0-21swapper/308:20:133
2106199150,13cyclictest28255-21sh08:35:153
2106199150,13cyclictest0-21swapper/307:34:143
2105799153,10cyclictest30898-21hddtemp_smartct07:30:132
2105799151,13cyclictest0-21swapper/208:51:292
2105799150,13cyclictest0-21swapper/208:20:152
2105799150,13cyclictest0-21swapper/207:15:152
21052991511,3cyclictest10950irq/23-ehci_hcd08:09:321
2105299150,13cyclictest0-21swapper/109:03:041
2106199149,4cyclictest0-21swapper/308:25:093
2106199144,2cyclictest0-21swapper/307:26:423
2106199141,12cyclictest0-21swapper/308:56:273
2106199141,12cyclictest0-21swapper/308:30:043
2106199141,12cyclictest0-21swapper/307:53:343
21061991410,3cyclictest10950irq/23-ehci_hcd09:02:083
2106199140,12cyclictest23376-21munin-node07:15:173
2106199140,0cyclictest0-21swapper/307:35:553
2105799140,13cyclictest0-21swapper/207:20:172
2105299147,6cyclictest0-21swapper/109:05:111
2105299146,3cyclictest10950irq/23-ehci_hcd07:36:031
2105299144,2cyclictest10950irq/23-ehci_hcd07:56:371
2105299143,3cyclictest10950irq/23-ehci_hcd08:27:101
21052991412,1cyclictest0-21swapper/107:10:151
2105299140,13cyclictest0-21swapper/108:45:451
2105299140,12cyclictest21877-21ps08:20:211
2106199139,3cyclictest135650irq/27-eth007:10:133
2106199132,8cyclictest2748-21fschecks_count07:40:143
2106199132,2cyclictest0-21swapper/308:00:113
2106199131,11cyclictest0-21swapper/308:05:093
2106199130,12cyclictest0-21swapper/308:10:483
2106199130,12cyclictest0-21swapper/307:20:393
2105799139,3cyclictest135650irq/27-eth007:25:242
2105799132,2cyclictest14588-21irqstats08:05:202
2105799132,10cyclictest25-21rcuop/108:25:142
2105799132,10cyclictest135650irq/27-eth008:36:492
2105799131,4cyclictest0-21swapper/207:37:412
2105799130,5cyclictest0-21swapper/207:45:462
2105799130,12cyclictest0-21swapper/209:07:242
2105799130,12cyclictest0-21swapper/209:02:242
2105799130,12cyclictest0-21swapper/208:58:512
2105799130,12cyclictest0-21swapper/208:10:452
2105799130,12cyclictest0-21swapper/207:55:182
2105299138,4cyclictest30484-21df07:30:121
2105299132,10cyclictest10950irq/23-ehci_hcd08:00:171
2105299130,4cyclictest20370-21runrttasks08:19:381
2105299130,12cyclictest0-21swapper/108:57:201
2105299130,12cyclictest0-21swapper/108:50:121
2105299130,12cyclictest0-21swapper/108:32:141
2105299130,12cyclictest0-21swapper/107:54:561
2105299130,11cyclictest3179-21irqstats07:40:161
2105299130,11cyclictest30106-21diskstats08:40:151
2105299130,11cyclictest24254-21memory07:15:181
2105299130,10cyclictest135650irq/27-eth008:36:421
2105799120,4cyclictest0-21swapper/207:42:042
2105799120,3cyclictest32694-21perl08:45:142
2105799120,3cyclictest21423-21diskstats07:10:122
2105799120,11cyclictest135650irq/27-eth008:41:002
2105299127,3cyclictest0-21swapper/107:25:161
2105299120,3cyclictest0-21swapper/107:20:131
2105299120,11cyclictest5005-21sh07:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional