You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 06:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sun Nov 23, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
61242216150,23sleep20-21swapper/219:09:202
59762207156,25sleep00-21swapper/019:07:250
61012201163,25sleep10-21swapper/119:09:031
58382199162,24sleep30-21swapper/319:05:393
214722610,0sleep20-21swapper/221:38:052
134452600,0sleep10-21swapper/123:44:211
319892220,0sleep10-21swapper/122:39:001
81162150,1sleep38123-21timerwakeupswit00:20:243
626399143,5cyclictest32420-21diskmemload21:15:000
269772130,0sleep20-21swapper/221:45:182
322832120,0sleep00-21swapper/020:00:150
627899115,5cyclictest125542sleep200:27:372
626399113,4cyclictest29255-21cat21:50:000
626399108,1cyclictest9-21ksoftirqd/023:47:000
626399108,1cyclictest9-21ksoftirqd/021:05:010
626399102,4cyclictest25713-21cut21:45:000
303952100,0sleep00-21swapper/000:06:280
62869990,6cyclictest19881-1kworker/u9:223:55:143
62869990,6cyclictest0-21swapper/300:11:023
62869990,4cyclictest1497-21sendmail-mta23:20:133
62789996,1cyclictest28-21ksoftirqd/220:55:002
62789994,1cyclictest32420-21diskmemload21:55:132
62789990,6cyclictest32420-21diskmemload21:20:002
62639998,1cyclictest9-21ksoftirqd/022:30:000
62639995,3cyclictest9-21ksoftirqd/021:52:190
62639994,3cyclictest254-21systemd-journal21:40:010
62639991,0cyclictest32420-21diskmemload22:20:130
62869984,2cyclictest0-21swapper/321:15:203
62869980,4cyclictest0-21swapper/321:47:113
62789987,0cyclictest28-21ksoftirqd/200:11:342
62789986,1cyclictest60950irq/123-eno122:50:192
62789986,1cyclictest60950irq/123-eno122:05:202
62789986,1cyclictest60950irq/123-eno120:45:222
62789982,4cyclictest0-21swapper/223:15:272
62789980,6cyclictest0-21swapper/221:11:052
62789980,2cyclictest0-21swapper/221:21:042
62709980,6cyclictest0-21swapper/121:40:131
62639981,6cyclictest7655-21ssh22:50:160
62639980,7cyclictest5835-21ssh22:46:240
62639980,7cyclictest24716-21ssh00:00:070
62639980,7cyclictest2014-21ssh22:40:270
62639980,1cyclictest254-21systemd-journal23:40:010
62639980,1cyclictest21953-21apt-get19:40:140
1228280,0sleep032420-21diskmemload00:10:320
62869976,1cyclictest35-21ksoftirqd/323:10:213
62869975,1cyclictest27686-21ssh22:31:313
62869975,1cyclictest27686-21ssh22:31:313
62869975,1cyclictest22001-21sshd22:25:093
62869973,3cyclictest32420-21diskmemload22:19:393
62869973,2cyclictest32420-21diskmemload23:50:183
62869973,2cyclictest254-21systemd-journal21:45:003
62869973,2cyclictest254-21systemd-journal21:36:573
62869972,3cyclictest32420-21diskmemload21:12:253
62869972,1cyclictest7281-21ssh22:50:143
62869972,1cyclictest12589-21ntpq21:25:193
62869970,5cyclictest0-21swapper/322:00:353
62869970,5cyclictest0-21swapper/321:33:133
62869970,4cyclictest254-21systemd-journal20:00:003
62869970,4cyclictest15654-21unixbench_multi23:45:223
62869970,3cyclictest0-21swapper/323:27:083
62789976,1cyclictest60950irq/123-eno123:10:462
62789976,1cyclictest60950irq/123-eno123:09:322
62789976,1cyclictest60950irq/123-eno122:43:532
62789976,1cyclictest60950irq/123-eno122:31:382
62789976,1cyclictest60950irq/123-eno122:31:372
62789976,1cyclictest60950irq/123-eno122:25:172
62789976,1cyclictest60950irq/123-eno122:19:572
62789976,1cyclictest60950irq/123-eno121:26:492
62789976,1cyclictest60950irq/123-eno100:35:162
62789976,0cyclictest60950irq/123-eno122:57:342
62789976,0cyclictest60950irq/123-eno121:31:152
62789975,1cyclictest8336-21ssh00:20:262
62789975,1cyclictest60950irq/123-eno123:55:162
62789975,1cyclictest60950irq/123-eno123:40:142
62789975,1cyclictest60950irq/123-eno123:35:202
62789975,1cyclictest60950irq/123-eno123:00:142
62789975,1cyclictest60950irq/123-eno121:50:162
62789975,1cyclictest60950irq/123-eno100:15:192
62789975,1cyclictest31282-21ssh22:36:432
62789974,2cyclictest61612sleep222:00:252
62789973,2cyclictest570-21systemd-logind21:00:202
62789973,0cyclictest32420-21diskmemload23:50:132
62789972,4cyclictest11661-21perf19:20:012
62789970,6cyclictest0-21swapper/219:35:142
62789970,4cyclictest4726-21sed22:45:162
62789970,1cyclictest0-21swapper/200:31:192
62709970,5cyclictest0-21swapper/122:41:021
62709970,4cyclictest0-21swapper/123:35:041
62709970,4cyclictest0-21swapper/122:25:181
62709970,4cyclictest0-21swapper/120:25:151
62709970,3cyclictest0-21swapper/123:16:281
62639976,1cyclictest9-21ksoftirqd/020:59:590
62639976,1cyclictest9-21ksoftirqd/020:25:000
62639976,1cyclictest742-21runrttasks22:35:300
62639976,1cyclictest24882-1kworker/u9:022:30:440
62639976,1cyclictest24882-1kworker/u9:022:30:440
62639976,1cyclictest10210-21ssh23:40:010
62639975,1cyclictest32420-21diskmemload00:25:130
62639975,1cyclictest25199-21cat19:45:160
62639975,1cyclictest16431-21nscd21:22:060
62639975,1cyclictest12097-21/usr/sbin/munin19:20:200
62639972,2cyclictest32420-21diskmemload21:25:200
62639972,2cyclictest254-21systemd-journal20:10:010
62639970,6cyclictest9904-21ssh22:06:050
62639970,6cyclictest6049-21ssh21:16:150
62639970,6cyclictest32420-21diskmemload23:20:110
62639970,6cyclictest32185-21ssh23:25:020
62639970,6cyclictest27095-21ssh23:15:520
62639970,6cyclictest18001-21diskstats23:50:130
62639970,6cyclictest17677-1kworker/u9:222:55:130
62639970,6cyclictest16739-21ssh00:34:380
62639970,6cyclictest16703-21ssh21:30:200
62639970,6cyclictest14841-21cat23:00:130
62639970,6cyclictest0-21swapper/023:13:060
62639970,6cyclictest0-21swapper/023:05:180
62639970,6cyclictest0-21swapper/000:35:150
62639970,6cyclictest0-21swapper/000:22:390
62639970,1cyclictest2949-21apt-get00:15:120
62639970,1cyclictest13544-21/usr/sbin/munin20:30:150
62639970,1cyclictest0-21swapper/023:30:150
10436270,0sleep10-21swapper/121:23:071
7759260,2sleep10-21swapper/100:20:231
62869966,0cyclictest35-21ksoftirqd/323:35:363
62869966,0cyclictest32420-21diskmemload22:05:023
62869965,1cyclictest7686-21ssh21:20:113
62869965,1cyclictest745-21ssh21:55:013
62869965,1cyclictest5947-21sshd20:11:503
62869965,1cyclictest4839-21ssh00:15:413
62869965,1cyclictest31478-21ssh21:50:583
62869965,1cyclictest31444-21ssh22:37:153
62869965,1cyclictest26990-21ssh23:15:323
62869965,1cyclictest12736-21ssh00:28:123
62869965,1cyclictest12475-21ssh23:41:143
62869963,1cyclictest4401-21missed_timers23:30:153
62869963,1cyclictest254-21systemd-journal19:37:093
62869963,0cyclictest32420-21diskmemload00:08:183
62869962,3cyclictest1250-21/usr/sbin/munin22:40:173
62869962,1cyclictest0-21swapper/319:20:013
62869961,3cyclictest32420-21diskmemload22:57:163
62869960,6cyclictest20873-21ssh22:22:163
62869960,6cyclictest0-21swapper/322:10:413
62869960,4cyclictest24755-21/usr/sbin/munin00:00:233
62869960,4cyclictest23087-21ntp_kernel_pll_19:40:203
62869960,3cyclictest0-21swapper/323:00:583
62869960,2cyclictest19601-21rt-features20:40:203
62869960,2cyclictest0-21swapper/322:46:323
62869960,2cyclictest0-21swapper/300:39:543
62869960,2cyclictest0-21swapper/300:30:113
62789966,0cyclictest60950irq/123-eno123:47:042
62789966,0cyclictest60950irq/123-eno123:20:112
62789966,0cyclictest60950irq/123-eno122:10:132
62789966,0cyclictest60950irq/123-eno121:40:412
62789966,0cyclictest60950irq/123-eno120:36:402
62789966,0cyclictest60950irq/123-eno120:30:002
62789966,0cyclictest60950irq/123-eno120:15:132
62789966,0cyclictest60950irq/123-eno119:46:552
62789966,0cyclictest60950irq/123-eno119:33:192
62789966,0cyclictest60950irq/123-eno119:25:002
62789966,0cyclictest60950irq/123-eno100:05:462
62789966,0cyclictest60950irq/123-eno100:00:012
62789965,1cyclictest60950irq/123-eno123:25:122
62789965,1cyclictest60950irq/123-eno120:20:152
62789965,1cyclictest60950irq/123-eno119:24:022
62789965,1cyclictest60950irq/123-eno119:10:182
62789964,1cyclictest60950irq/123-eno122:20:142
62789962,3cyclictest8624-21munin-node20:55:432
62789962,2cyclictest570-21systemd-logind20:25:232
62789961,3cyclictest0-21swapper/220:10:132
62789961,2cyclictest28986-21turbostat19:55:002
62789961,0cyclictest0-21swapper/223:30:022
62789960,1cyclictest0-21swapper/219:55:142
62709965,1cyclictest0-21swapper/122:18:461
62709962,2cyclictest0-21swapper/119:15:151
62709961,3cyclictest0-21swapper/100:18:441
62709960,6cyclictest28468-21taskset22:34:001
62709960,6cyclictest28468-21taskset22:33:591
62709960,6cyclictest0-21swapper/122:57:281
62709960,6cyclictest0-21swapper/121:29:341
62709960,6cyclictest0-21swapper/119:25:171
62709960,5cyclictest0-21swapper/122:45:161
62709960,4cyclictest0-21swapper/123:34:251
62709960,4cyclictest0-21swapper/123:26:561
62709960,4cyclictest0-21swapper/122:08:001
62709960,4cyclictest0-21swapper/120:35:131
62709960,3cyclictest0-21swapper/123:05:101
62709960,3cyclictest0-21swapper/122:51:141
62709960,3cyclictest0-21swapper/121:05:171
62709960,2cyclictest0-21swapper/122:04:501
62709960,0cyclictest0-21swapper/100:36:081
62639965,1cyclictest3327-1kworker/u9:022:00:040
62639964,1cyclictest7600-21ntpq20:15:200
62639964,1cyclictest11681-21sendmail-msp19:20:010
62639964,1cyclictest0-21swapper/019:50:130
62639963,1cyclictest254-21systemd-journal21:05:560
62639962,1cyclictest254-21systemd-journal22:10:430
62639960,6cyclictest0-21swapper/020:52:300
62639960,6cyclictest0-21swapper/019:32:550
62639960,6cyclictest0-21swapper/019:10:180
62639960,5cyclictest11191-21/usr/sbin/munin20:25:220
62639960,5cyclictest0-21swapper/020:45:130
62639960,5cyclictest0-21swapper/019:37:250
62639960,2cyclictest0-21swapper/022:15:190
62639960,1cyclictest254-21systemd-journal20:14:560
62639960,1cyclictest0-21swapper/021:58:230
62639960,0cyclictest0-21swapper/023:55:160
62639960,0cyclictest0-21swapper/019:57:140
62639960,0cyclictest0-21swapper/019:28:460
62869954,1cyclictest9076-21sensors19:15:013
62869954,1cyclictest20059-21ssh23:05:573
62869953,1cyclictest26564-21wc19:50:003
62869953,1cyclictest26380-21sed20:55:163
62869953,1cyclictest15404-21sshd20:31:503
62869953,1cyclictest1444-21taskset20:04:333
62869952,1cyclictest254-21systemd-journal21:09:563
62869950,5cyclictest0-21swapper/320:39:263
62869950,5cyclictest0-21swapper/319:50:053
62869950,2cyclictest28736-21hddtemp_smartct21:00:163
62869950,1cyclictest7634-21ntp_states19:10:193
62789955,0cyclictest60950irq/123-eno121:05:142
62789955,0cyclictest60950irq/123-eno120:08:102
62789955,0cyclictest60950irq/123-eno119:44:362
62789952,2cyclictest20390-21cron20:45:002
62789950,1cyclictest0-21swapper/220:00:172
62709952,2cyclictest0-21swapper/123:22:171
62709951,2cyclictest0-21swapper/121:30:201
62709951,1cyclictest0-21swapper/121:53:181
62709951,1cyclictest0-21swapper/100:10:191
62709950,5cyclictest0-21swapper/100:05:141
62709950,4cyclictest0-21swapper/121:36:301
62709950,3cyclictest0-21swapper/123:55:451
62709950,3cyclictest0-21swapper/123:45:121
62709950,3cyclictest0-21swapper/123:11:001
62709950,3cyclictest0-21swapper/123:04:381
62709950,3cyclictest0-21swapper/121:45:131
62709950,3cyclictest0-21swapper/120:00:161
62709950,3cyclictest0-21swapper/100:02:221
62709950,2cyclictest0-21swapper/122:22:041
62709950,2cyclictest0-21swapper/122:10:121
62709950,2cyclictest0-21swapper/121:55:481
62709950,2cyclictest0-21swapper/100:31:041
62709950,0cyclictest0-21swapper/121:15:551
62639950,5cyclictest0-21swapper/020:39:110
62639950,2cyclictest0-21swapper/020:40:130
62869943,1cyclictest2773-21grep20:05:183
62869942,1cyclictest8966-21aten_r1power_vo20:20:153
62869942,1cyclictest6575-21aten_r1power_po20:15:153
62869942,1cyclictest11520-21cstates20:25:173
62869942,1cyclictest0-21swapper/319:25:163
62869940,2cyclictest20634-21/usr/sbin/munin20:45:173
62869940,1cyclictest254-21systemd-journal20:50:113
62869940,0cyclictest0-21swapper/319:30:173
62709943,1cyclictest108922sleep120:24:221
62709943,1cyclictest0-21swapper/100:25:191
62709942,1cyclictest6175-21chrt20:14:461
62709942,1cyclictest0-21swapper/121:00:121
62709941,2cyclictest0-21swapper/120:15:141
62709940,4cyclictest0-21swapper/121:10:111
62709940,4cyclictest0-21swapper/120:50:211
62709940,4cyclictest0-21swapper/119:30:211
62709940,3cyclictest0-21swapper/119:50:191
62709940,2cyclictest0-21swapper/123:50:131
62709940,2cyclictest0-21swapper/119:20:021
62709940,1cyclictest0-21swapper/119:12:071
62709931,1cyclictest0-21swapper/120:55:121
62709931,1cyclictest0-21swapper/120:45:121
62709931,1cyclictest0-21swapper/120:30:171
62709931,1cyclictest0-21swapper/119:45:101
62709930,3cyclictest0-21swapper/120:40:201
62709930,2cyclictest0-21swapper/120:05:131
62709930,2cyclictest0-21swapper/119:35:001
62709930,1cyclictest0-21swapper/119:55:131
62709930,1cyclictest0-21swapper/119:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional