You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 04:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sat Aug 30, 2025 00:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
184052219157,49sleep20-21swapper/219:08:402
184582210151,47sleep30-21swapper/319:09:213
184452206157,24sleep00-21swapper/019:09:100
181902204166,25sleep10-21swapper/119:05:491
251012600,0sleep10-21swapper/120:30:011
231882590,0sleep20-21swapper/222:50:552
1860099140,14cyclictest0-21swapper/021:45:150
18620991211,1cyclictest35-21ksoftirqd/320:19:593
1861499129,2cyclictest7955-21kernelversion21:00:162
18614991110,1cyclictest28-21ksoftirqd/221:15:002
1860099110,2cyclictest254-21systemd-journal22:06:560
239272100,0sleep20-21swapper/221:25:172
19022100,0sleep011496-21diskmemload22:22:460
1862099109,1cyclictest35-21ksoftirqd/321:50:153
1862099109,1cyclictest35-21ksoftirqd/321:45:243
1862099109,1cyclictest35-21ksoftirqd/320:25:003
1861499108,1cyclictest28-21ksoftirqd/221:10:002
1861499100,9cyclictest14588-21kworker/u8:021:17:052
1861499100,6cyclictest29132-21apt-get19:30:112
1860099109,1cyclictest9-21ksoftirqd/022:12:280
186209998,1cyclictest35-21ksoftirqd/323:25:133
186209998,1cyclictest35-21ksoftirqd/322:40:003
186209997,1cyclictest35-21ksoftirqd/322:50:013
186209996,3cyclictest23043-21kworker/u8:121:23:163
186209993,4cyclictest35-21ksoftirqd/321:15:253
186209990,6cyclictest15198-21apt-get00:10:153
186149990,5cyclictest18575-21chrt22:00:202
186089990,5cyclictest0-21swapper/121:30:171
186009998,1cyclictest9-21ksoftirqd/023:05:000
186009998,1cyclictest9-21ksoftirqd/000:40:000
186009998,1cyclictest9-21ksoftirqd/000:30:130
186009998,1cyclictest9-21ksoftirqd/000:30:130
186009993,5cyclictest1449-21ntpd23:14:070
186009992,6cyclictest27461-21date20:35:010
186009991,4cyclictest18588-21cat00:15:000
186009990,5cyclictest11496-21diskmemload23:54:070
186009990,4cyclictest28277-21date23:00:000
186209988,0cyclictest35-21ksoftirqd/300:05:003
186209987,1cyclictest35-21ksoftirqd/322:05:003
186209987,1cyclictest35-21ksoftirqd/319:55:003
186209983,4cyclictest819-21lldpd19:56:183
186209981,4cyclictest27638-21apt-get20:35:123
186209980,2cyclictest26870-21/usr/sbin/munin21:30:243
186149988,0cyclictest0-21swapper/223:42:232
186149986,1cyclictest60950irq/123-eno123:20:212
186149986,1cyclictest60950irq/123-eno123:00:222
186149986,1cyclictest60950irq/123-eno100:25:342
186149986,1cyclictest28-21ksoftirqd/200:05:282
186149986,1cyclictest26039-21ntpq22:55:202
186149980,6cyclictest32169-21apt-get23:05:122
186149980,6cyclictest28-21ksoftirqd/219:40:142
186149980,6cyclictest19003-21apt19:10:122
186149980,6cyclictest0-21swapper/223:50:082
186149980,1cyclictest254-21systemd-journal22:17:572
186009987,1cyclictest9-21ksoftirqd/022:30:000
186009986,1cyclictest9-21ksoftirqd/019:10:120
186009985,1cyclictest9-21ksoftirqd/020:14:550
186009983,1cyclictest8703-21/usr/sbin/munin19:55:170
186009983,1cyclictest12762-21munin-run21:55:000
186009981,4cyclictest17553-21/usr/sbin/munin22:45:180
186009980,7cyclictest9306-21ssh23:16:500
186009980,7cyclictest21451-21ssh21:21:320
186009980,7cyclictest1913-21ssh23:06:290
186009980,7cyclictest14149-21ssh21:12:320
186009980,7cyclictest0-21swapper/022:25:190
186009980,4cyclictest25083-21perf20:30:000
186009980,1cyclictest30653-21ssh22:17:460
186009980,1cyclictest19868-21ssh23:30:450
186009980,1cyclictest19170-21taskset22:01:040
186209977,0cyclictest35-21ksoftirqd/322:15:123
186209977,0cyclictest35-21ksoftirqd/320:35:003
186209976,1cyclictest35-21ksoftirqd/322:15:013
186209976,1cyclictest35-21ksoftirqd/320:14:593
186209976,1cyclictest35-21ksoftirqd/319:50:003
186209976,1cyclictest35-21ksoftirqd/300:30:003
186209976,1cyclictest11496-21diskmemload22:58:343
186209976,0cyclictest35-21ksoftirqd/300:05:193
186209975,1cyclictest2906-21ssh23:52:373
186209974,1cyclictest35-21ksoftirqd/319:17:533
186209972,2cyclictest12485-21/usr/sbin/munin20:00:223
186209970,5cyclictest0-21swapper/323:24:443
186149976,1cyclictest60950irq/123-eno123:55:272
186149976,1cyclictest60950irq/123-eno123:55:272
186149976,1cyclictest60950irq/123-eno122:49:462
186149976,1cyclictest60950irq/123-eno122:43:492
186149976,1cyclictest60950irq/123-eno122:10:182
186149976,1cyclictest60950irq/123-eno121:47:262
186149976,1cyclictest60950irq/123-eno121:30:472
186149976,1cyclictest60950irq/123-eno100:36:302
186149976,1cyclictest60950irq/123-eno100:30:542
186149976,1cyclictest60950irq/123-eno100:30:532
186149976,1cyclictest60950irq/123-eno100:04:012
186149976,1cyclictest18596-21cyclictest21:40:572
186149976,0cyclictest60950irq/123-eno122:20:132
186149976,0cyclictest60950irq/123-eno100:15:122
186149975,1cyclictest8461-21cron19:55:002
186149975,1cyclictest60950irq/123-eno123:45:122
186149975,1cyclictest60950irq/123-eno123:15:122
186149975,1cyclictest60950irq/123-eno121:55:162
186149975,1cyclictest60950irq/123-eno120:40:202
186149975,1cyclictest60950irq/123-eno119:50:002
186149975,1cyclictest22748-21ssh22:05:542
186149973,3cyclictest60950irq/123-eno123:38:252
186149972,4cyclictest11496-21diskmemload23:25:112
186149972,2cyclictest25892-21munin-run00:25:002
186149971,5cyclictest18714-21sed00:15:012
186149970,5cyclictest0-21swapper/221:35:142
186089970,4cyclictest0-21swapper/100:06:061
186009975,1cyclictest9-21ksoftirqd/023:40:000
186009974,1cyclictest570-21systemd-logind20:49:100
186009974,1cyclictest254-21systemd-journal19:55:000
186009974,1cyclictest254-21systemd-journal19:45:010
186009973,1cyclictest2291-21/usr/sbin/munin20:50:120
186009972,5cyclictest13430-21/usr/sbin/munin20:05:170
186009972,1cyclictest2128-21/usr/sbin/munin21:40:100
186009971,2cyclictest11496-21diskmemload00:20:100
186009971,0cyclictest31885-21ssh23:48:160
186009970,7cyclictest9621-21ssh00:00:490
186009970,7cyclictest29052-21ssh21:31:240
186009970,6cyclictest737-21ssh21:37:070
186009970,6cyclictest6603-21ssh23:57:440
186009970,6cyclictest6603-21ssh23:57:440
186009970,6cyclictest5913-21munin-run19:50:000
186009970,6cyclictest30175-21grep20:40:120
186009970,6cyclictest25320-21ssh21:26:360
186009970,6cyclictest18058-21ssh21:17:430
186009970,6cyclictest0-21swapper/000:05:540
186009970,4cyclictest0-21swapper/021:55:160
186009970,1cyclictest590-21timerandwakeup19:35:220
186009970,1cyclictest25263-21ssh23:40:090
186009970,1cyclictest21208-21apt-get22:50:110
186009970,1cyclictest15989-21ssh22:41:120
186009970,1cyclictest10840-21fschecks_count22:35:160
186009970,1cyclictest10696-21ssh23:20:150
186209965,1cyclictest9822-21ssh23:18:223
186209965,1cyclictest8743-21ssh22:31:223
186209965,1cyclictest35-21ksoftirqd/321:40:133
186209965,1cyclictest35-21ksoftirqd/321:05:003
186209965,1cyclictest35-21ksoftirqd/321:00:003
186209965,1cyclictest35-21ksoftirqd/320:30:003
186209965,1cyclictest31696-21ssh00:30:343
186209965,1cyclictest31696-21ssh00:30:343
186209965,1cyclictest30039-21cat23:45:163
186209965,1cyclictest27179-21ssh23:40:413
186209965,1cyclictest23655-21ssh21:25:153
186209965,1cyclictest21722-21ssh22:50:133
186209965,1cyclictest16339-21ssh22:42:153
186209965,1cyclictest13209-21ssh21:55:053
186209965,1cyclictest11496-21diskmemload00:17:483
186209964,1cyclictest4954-21/usr/sbin/munin23:55:173
186209964,1cyclictest4954-21/usr/sbin/munin23:55:173
186209964,1cyclictest35-21ksoftirqd/321:35:143
186209964,1cyclictest3307-21cstates22:25:143
186209964,1cyclictest29877-21grep19:30:163
186209963,2cyclictest0-21swapper/323:10:123
186209962,2cyclictest26780-21apt-get19:25:103
186209962,1cyclictest254-21systemd-journal22:00:013
186209961,4cyclictest12943-21ntp_states21:10:183
186209961,3cyclictest11496-21diskmemload23:35:043
186209961,1cyclictest2663-21/usr/sbin/munin00:35:223
186209960,3cyclictest0-21swapper/323:30:363
186209960,1cyclictest0-21swapper/323:05:123
186209960,0cyclictest11496-21diskmemload22:20:433
186149966,0cyclictest60950irq/123-eno123:10:142
186149966,0cyclictest60950irq/123-eno122:35:192
186149966,0cyclictest60950irq/123-eno122:31:092
186149966,0cyclictest60950irq/123-eno122:25:222
186149966,0cyclictest60950irq/123-eno121:53:172
186149966,0cyclictest60950irq/123-eno121:20:012
186149966,0cyclictest60950irq/123-eno120:10:152
186149966,0cyclictest60950irq/123-eno119:26:562
186149966,0cyclictest60950irq/123-eno119:20:382
186149965,1cyclictest60950irq/123-eno123:30:042
186149965,1cyclictest60950irq/123-eno120:55:152
186149964,1cyclictest60950irq/123-eno120:35:202
186149964,1cyclictest60950irq/123-eno120:25:142
186149964,1cyclictest60950irq/123-eno120:00:132
186149964,1cyclictest28-21ksoftirqd/219:20:002
186149962,3cyclictest4408-21cron20:55:002
186149962,2cyclictest570-21systemd-logind19:55:192
186149961,3cyclictest0-21swapper/219:35:132
186089965,0cyclictest0-21swapper/123:12:511
186089962,1cyclictest0-21swapper/100:00:531
186089961,3cyclictest0-21swapper/120:14:591
186089961,2cyclictest0-21swapper/122:05:011
186089961,1cyclictest0-21swapper/122:49:591
186089960,6cyclictest0-21swapper/122:07:071
186089960,6cyclictest0-21swapper/121:40:111
186089960,6cyclictest0-21swapper/100:37:541
186089960,4cyclictest0-21swapper/123:02:401
186089960,4cyclictest0-21swapper/120:15:201
186089960,4cyclictest0-21swapper/100:14:531
186089960,2cyclictest0-21swapper/121:53:281
186089960,0cyclictest0-21swapper/123:15:121
186089960,0cyclictest0-21swapper/122:10:051
186089960,0cyclictest0-21swapper/120:50:101
186089960,0cyclictest0-21swapper/100:26:491
186009964,1cyclictest24161-21cron19:19:590
186009964,1cyclictest20648-21aten2.4-expect20:20:130
186009963,2cyclictest546-21irqbalance19:33:050
186009963,1cyclictest254-21systemd-journal20:55:540
186009962,1cyclictest27635-21/usr/sbin/munin20:35:130
186009961,2cyclictest15130-21hddtemp_smartct23:25:150
186009960,5cyclictest0-21swapper/000:15:220
186009960,2cyclictest0-21swapper/019:20:200
186009960,0cyclictest0-21swapper/021:07:170
186009960,0cyclictest0-21swapper/020:18:210
186009960,0cyclictest0-21swapper/000:26:480
186209954,1cyclictest35-21ksoftirqd/319:40:173
186209954,1cyclictest29431-21cat23:00:153
186209952,1cyclictest35-21ksoftirqd/321:05:403
186209952,1cyclictest35-21ksoftirqd/320:44:553
186209952,1cyclictest35-21ksoftirqd/320:07:243
186209952,1cyclictest35-21ksoftirqd/319:38:383
186209952,1cyclictest35-21ksoftirqd/319:11:233
186209952,1cyclictest0-21swapper/320:50:093
186209950,5cyclictest0-21swapper/320:45:323
186209950,4cyclictest24427-21apt-get19:20:123
186209950,1cyclictest0-21swapper/300:21:433
186149955,0cyclictest60950irq/123-eno120:05:122
186149953,1cyclictest710-21tail20:45:172
186149952,2cyclictest27411-21dump-pmu-power20:35:002
186149950,2cyclictest0-21swapper/220:15:162
186149950,1cyclictest0-21swapper/220:20:142
186089955,0cyclictest0-21swapper/123:56:251
186089955,0cyclictest0-21swapper/123:56:241
186089955,0cyclictest0-21swapper/123:20:041
186089951,2cyclictest0-21swapper/123:50:111
186089951,2cyclictest0-21swapper/120:05:191
186089951,1cyclictest0-21swapper/119:55:211
186089951,0cyclictest0-21swapper/123:09:211
186089950,5cyclictest0-21swapper/122:32:071
186089950,5cyclictest0-21swapper/122:25:341
186089950,5cyclictest0-21swapper/122:16:011
186089950,5cyclictest0-21swapper/121:45:131
186089950,5cyclictest0-21swapper/120:02:441
186089950,4cyclictest0-21swapper/122:36:401
186089950,3cyclictest0-21swapper/121:57:401
186089950,3cyclictest0-21swapper/121:25:391
186089950,2cyclictest0-21swapper/123:45:021
186089950,2cyclictest0-21swapper/123:40:131
186089950,2cyclictest0-21swapper/123:36:561
186089950,2cyclictest0-21swapper/123:34:001
186089950,2cyclictest0-21swapper/122:55:011
186089950,2cyclictest0-21swapper/122:40:251
186089950,2cyclictest0-21swapper/121:21:061
186089950,1cyclictest0-21swapper/120:25:001
186009954,1cyclictest9-21ksoftirqd/020:00:170
186009950,2cyclictest7825-21gltestperf21:00:150
186009950,1cyclictest26765-21taskset19:25:010
186089944,0cyclictest0-21swapper/121:35:101
186089940,4cyclictest0-21swapper/119:20:191
186089940,4cyclictest0-21swapper/119:14:581
186089940,4cyclictest0-21swapper/100:20:101
186089940,3cyclictest0-21swapper/121:15:571
186089940,3cyclictest0-21swapper/119:25:101
186089940,2cyclictest0-21swapper/123:27:301
186089940,2cyclictest0-21swapper/122:20:161
186089940,2cyclictest0-21swapper/121:10:141
186089940,2cyclictest0-21swapper/100:15:211
186089940,1cyclictest0-21swapper/122:50:511
186089940,1cyclictest0-21swapper/121:05:151
186089940,1cyclictest0-21swapper/121:00:161
186089940,1cyclictest0-21swapper/119:45:161
186089940,1cyclictest0-21swapper/119:30:111
186089940,1cyclictest0-21swapper/100:30:191
186089940,1cyclictest0-21swapper/100:30:181
186089940,0cyclictest0-21swapper/119:35:211
186089932,1cyclictest261972sleep120:30:161
186089931,1cyclictest0-21swapper/120:45:131
186089930,3cyclictest0-21swapper/119:15:111
186089930,2cyclictest0-21swapper/120:35:131
186089930,2cyclictest0-21swapper/119:40:211
186089930,1cyclictest0-21swapper/120:55:161
186089930,1cyclictest0-21swapper/120:40:131
186089930,1cyclictest0-21swapper/119:50:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional