You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 12:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 19, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
713322540,7sleep121-21ksoftirqd/119:05:191
83222227156,56sleep00-21swapper/019:07:410
81992218154,23sleep20-21swapper/219:06:052
82602204159,31sleep30-21swapper/319:06:513
164922600,0sleep00-21swapper/022:14:440
117482600,0sleep30-21swapper/321:22:073
859499140,13cyclictest0-21swapper/222:10:182
858599140,13cyclictest0-21swapper/123:40:151
859499119,1cyclictest28-21ksoftirqd/219:40:002
858599110,10cyclictest0-21swapper/119:35:131
857799119,1cyclictest9-21ksoftirqd/019:55:000
858599100,7cyclictest0-21swapper/122:45:161
857799108,1cyclictest9-21ksoftirqd/019:45:000
86019999,0cyclictest26341-21kworker/u8:021:55:013
86019992,4cyclictest16574-21apt-get19:25:133
86019990,4cyclictest3058-21irqstats22:40:183
85949990,8cyclictest60950irq/123-eno100:11:052
85949990,4cyclictest0-21swapper/200:15:142
85779997,1cyclictest9-21ksoftirqd/000:05:000
86019988,0cyclictest35-21ksoftirqd/321:33:183
86019986,1cyclictest35-21ksoftirqd/320:49:593
86019986,1cyclictest19110-21snmpd21:06:553
86019986,1cyclictest13793-21cat20:25:163
86019983,1cyclictest1509-21diskmemload22:19:263
86019981,7cyclictest1509-21diskmemload23:27:513
86019980,3cyclictest0-21swapper/321:53:193
85949988,0cyclictest0-21swapper/223:29:342
85949987,1cyclictest28-21ksoftirqd/223:58:552
85949987,1cyclictest28-21ksoftirqd/223:40:012
85949987,1cyclictest28-21ksoftirqd/223:24:502
85949987,1cyclictest28-21ksoftirqd/221:37:412
85949986,1cyclictest60950irq/123-eno121:20:162
85949986,1cyclictest60950irq/123-eno100:30:122
85949986,1cyclictest60950irq/123-eno100:07:402
85949986,1cyclictest60950irq/123-eno100:00:212
85949986,1cyclictest28-21ksoftirqd/222:24:242
85949986,1cyclictest24753-21ntpq23:10:272
85949985,2cyclictest8572-21cyclictest21:27:092
85949980,7cyclictest0-21swapper/200:37:442
85859980,5cyclictest0-21swapper/100:07:051
85859980,4cyclictest0-21swapper/121:40:411
85779986,1cyclictest9-21ksoftirqd/000:20:150
85779986,1cyclictest19110-21snmpd19:45:190
85779981,6cyclictest31692-21ssh22:35:160
85779980,4cyclictest31603-21perf21:05:010
85779980,2cyclictest5662-21ssh22:45:160
85779980,1cyclictest8362-21cat00:20:000
85779980,1cyclictest14566-21runrttasks00:27:420
14479284,0sleep20-21swapper/223:40:502
86019976,1cyclictest19110-21snmpd23:44:563
86019976,1cyclictest19110-21snmpd23:04:563
86019976,1cyclictest19110-21snmpd22:07:023
86019976,1cyclictest19110-21snmpd19:18:033
86019975,1cyclictest7604-21ssh21:16:003
86019975,1cyclictest19110-21snmpd23:18:553
86019975,1cyclictest19110-21snmpd20:16:273
86019975,1cyclictest18781-21ntpq20:35:203
86019973,3cyclictest12045-21/usr/sbin/munin00:25:213
86019972,2cyclictest20436-21apt-get22:20:133
86019971,3cyclictest1509-21diskmemload22:10:133
86019971,1cyclictest1509-21diskmemload00:12:143
86019970,6cyclictest10460-21cut20:20:133
86019970,2cyclictest0-21swapper/323:51:013
86019970,2cyclictest0-21swapper/323:45:453
86019970,2cyclictest0-21swapper/322:46:153
86019970,2cyclictest0-21swapper/322:04:273
86019970,2cyclictest0-21swapper/321:35:013
86019970,2cyclictest0-21swapper/300:37:393
86019970,2cyclictest0-21swapper/300:03:193
85949976,1cyclictest60950irq/123-eno123:05:152
85949976,1cyclictest60950irq/123-eno121:45:102
85949976,1cyclictest60950irq/123-eno121:31:552
85949976,1cyclictest60950irq/123-eno121:15:282
85949976,1cyclictest19110-21snmpd20:11:302
85949976,0cyclictest60950irq/123-eno123:51:172
85949976,0cyclictest60950irq/123-eno123:48:402
85949976,0cyclictest60950irq/123-eno123:31:422
85949976,0cyclictest60950irq/123-eno123:31:412
85949976,0cyclictest60950irq/123-eno122:25:022
85949975,1cyclictest60950irq/123-eno122:30:162
85949975,1cyclictest60950irq/123-eno121:55:222
85949975,1cyclictest60950irq/123-eno121:40:122
85949975,1cyclictest28-21ksoftirqd/220:45:002
85949975,1cyclictest28-21ksoftirqd/220:20:022
85949975,1cyclictest19110-21snmpd20:48:432
85949975,1cyclictest18067-21ntpq22:15:202
85949975,1cyclictest1171-21ssh21:50:532
85949972,2cyclictest28380-21apt-get19:50:132
85949970,6cyclictest0-21swapper/220:16:022
85949970,1cyclictest32594-21cat22:35:222
85949970,1cyclictest0-21swapper/219:25:142
85859970,5cyclictest0-21swapper/121:35:201
85859970,5cyclictest0-21swapper/121:33:461
85859970,4cyclictest0-21swapper/123:17:251
85859970,4cyclictest0-21swapper/122:32:441
85859970,4cyclictest0-21swapper/122:15:211
85859970,4cyclictest0-21swapper/100:30:191
85859970,3cyclictest0-21swapper/121:10:131
85859970,3cyclictest0-21swapper/100:15:371
85859970,1cyclictest0-21swapper/120:24:591
85859970,0cyclictest0-21swapper/123:50:121
85779976,1cyclictest3746-1kworker/u9:223:26:550
85779976,1cyclictest19110-21snmpd23:38:180
85779976,1cyclictest19110-21snmpd20:58:450
85779976,1cyclictest19110-21snmpd20:44:580
85779976,1cyclictest19110-21snmpd20:16:350
85779976,0cyclictest0-21swapper/020:50:150
85779975,1cyclictest9804-21ssh22:50:150
85779975,1cyclictest26795-21cron23:19:560
85779975,1cyclictest19110-21snmpd21:40:020
85779975,1cyclictest19110-21snmpd21:09:080
85779975,1cyclictest19110-21snmpd19:55:010
85779975,1cyclictest19110-21snmpd00:34:110
85779975,0cyclictest1509-21diskmemload00:06:330
85779974,1cyclictest22135-21ssh00:39:040
85779971,5cyclictest16875-21/usr/sbin/munin22:15:140
85779970,7cyclictest0-21swapper/021:25:160
85779970,6cyclictest9819-21ssh22:05:080
85779970,6cyclictest663-21ssh23:22:330
85779970,6cyclictest4720-21ssh21:55:540
85779970,6cyclictest3252-21ssh00:10:420
85779970,6cyclictest3210-21sed22:40:190
85779970,6cyclictest30379-21ssh21:46:540
85779970,6cyclictest26166-21ssh23:59:170
85779970,6cyclictest24374-21gltestperf23:10:240
85779970,6cyclictest21847-21ssh23:06:130
85779970,6cyclictest21175-21df21:35:150
85779970,6cyclictest20841-21cstates22:20:160
85779970,6cyclictest19787-21telnet23:50:130
85779970,6cyclictest17986-21sed23:00:240
85779970,6cyclictest14990-1kworker/u9:021:30:260
85779970,6cyclictest14731-1kworker/u9:023:45:150
85779970,6cyclictest0-21swapper/023:30:250
85779970,6cyclictest0-21swapper/023:30:240
85779970,6cyclictest0-21swapper/019:25:160
85779970,3cyclictest5396-21apt-key21:15:010
85779970,3cyclictest27491-21ssh22:30:140
85779970,1cyclictest8342-21ssh22:01:120
85779970,1cyclictest254-21systemd-journal21:54:560
85779970,1cyclictest2207-21cstates21:10:140
85779970,1cyclictest13585-21sort22:55:180
85779970,1cyclictest12442-21ssh21:24:040
85779970,1cyclictest12046-21apt-get23:40:010
85779970,1cyclictest0-21swapper/022:27:320
85779970,1cyclictest0-21swapper/019:30:160
86019965,1cyclictest4036-21ssh21:12:003
86019965,1cyclictest32736-21sshd19:58:423
86019965,1cyclictest32432-21ssh00:06:383
86019965,1cyclictest19110-21snmpd19:41:233
86019965,1cyclictest19110-21snmpd19:35:393
86019965,1cyclictest19110-21snmpd19:31:133
86019964,1cyclictest28070-21ssh21:45:023
86019964,1cyclictest19804-21apt-get23:05:123
86019964,1cyclictest1509-21diskmemload23:35:033
86019964,1cyclictest1509-21diskmemload23:33:223
86019964,1cyclictest1509-21diskmemload23:33:213
86019964,1cyclictest1509-21diskmemload23:21:273
86019964,1cyclictest10627-21sensors_temp22:50:203
86019963,1cyclictest254-21systemd-journal20:04:563
86019962,2cyclictest254-21systemd-journal19:15:013
86019962,1cyclictest1509-21diskmemload23:55:163
86019961,3cyclictest1509-21diskmemload00:21:463
86019961,3cyclictest0-21swapper/321:25:243
86019961,2cyclictest1509-21diskmemload22:35:203
86019960,3cyclictest0-21swapper/321:40:293
86019960,2cyclictest0-21swapper/323:10:213
86019960,1cyclictest0-21swapper/322:55:133
86019960,1cyclictest0-21swapper/322:27:363
86019960,1cyclictest0-21swapper/300:16:593
86019960,0cyclictest1509-21diskmemload22:30:373
85949966,0cyclictest60950irq/123-eno122:46:422
85949966,0cyclictest60950irq/123-eno122:05:152
85949966,0cyclictest60950irq/123-eno122:00:432
85949966,0cyclictest60950irq/123-eno121:00:422
85949966,0cyclictest60950irq/123-eno120:28:522
85949966,0cyclictest60950irq/123-eno120:00:072
85949966,0cyclictest60950irq/123-eno119:40:152
85949966,0cyclictest60950irq/123-eno119:34:182
85949966,0cyclictest60950irq/123-eno119:18:232
85949966,0cyclictest60950irq/123-eno100:25:112
85949965,1cyclictest60950irq/123-eno123:00:032
85949965,1cyclictest60950irq/123-eno121:10:142
85949965,1cyclictest60950irq/123-eno120:55:182
85949965,1cyclictest3042-21cat22:40:192
85949965,1cyclictest28-21ksoftirqd/220:35:132
85949964,1cyclictest60950irq/123-eno119:45:192
85949964,1cyclictest30353-21systemctl23:20:002
85949964,1cyclictest0-21swapper/219:55:212
85949963,2cyclictest1509-21diskmemload22:50:202
85949963,2cyclictest10924-21turbostat.cron19:15:002
85949962,2cyclictest3046-21apt-get20:05:122
85949961,4cyclictest12669-21ssh22:55:032
85949960,6cyclictest0-21swapper/220:30:182
85949960,3cyclictest0-21swapper/200:20:042
85859965,1cyclictest0-21swapper/121:22:021
85859962,2cyclictest0-21swapper/121:25:141
85859961,3cyclictest0-21swapper/119:45:141
85859961,3cyclictest0-21swapper/119:25:191
85859961,1cyclictest0-21swapper/121:05:001
85859961,1cyclictest0-21swapper/120:25:221
85859960,6cyclictest0-21swapper/123:45:151
85859960,6cyclictest0-21swapper/121:07:551
85859960,6cyclictest0-21swapper/120:46:371
85859960,6cyclictest0-21swapper/100:00:181
85859960,5cyclictest0-21swapper/122:20:181
85859960,5cyclictest0-21swapper/122:01:551
85859960,5cyclictest0-21swapper/120:40:181
85859960,5cyclictest0-21swapper/120:07:111
85859960,4cyclictest0-21swapper/123:27:181
85859960,4cyclictest0-21swapper/122:50:151
85859960,4cyclictest0-21swapper/121:55:581
85859960,4cyclictest0-21swapper/100:21:511
85859960,4cyclictest0-21swapper/100:10:501
85859960,3cyclictest0-21swapper/123:35:151
85859960,3cyclictest0-21swapper/123:32:041
85859960,3cyclictest0-21swapper/123:32:041
85859960,3cyclictest0-21swapper/122:40:001
85859960,3cyclictest0-21swapper/100:27:591
85859960,2cyclictest0-21swapper/121:50:151
85859960,1cyclictest0-21swapper/123:55:061
85859960,1cyclictest0-21swapper/122:57:551
85859960,1cyclictest0-21swapper/122:05:191
85859960,1cyclictest0-21swapper/119:32:551
85859960,0cyclictest0-21swapper/123:22:061
85779965,1cyclictest14068-21ntp_states20:25:190
85779964,1cyclictest22353-21/usr/sbin/munin20:45:220
85779961,1cyclictest0-21swapper/020:35:130
85779960,5cyclictest0-21swapper/020:22:150
85779960,4cyclictest677-21/usr/sbin/munin20:00:210
85779960,1cyclictest10191-21sensors19:10:190
85779960,0cyclictest0-21swapper/020:30:140
85779960,0cyclictest0-21swapper/019:15:160
86019954,1cyclictest31210-21sshd21:00:413
86019954,1cyclictest19110-21snmpd20:12:533
86019954,1cyclictest19110-21snmpd19:21:133
86019953,1cyclictest3072-21aten2.4-expect20:05:143
86019950,4cyclictest25876-21ntp_states20:50:213
86019950,1cyclictest0-21swapper/300:30:063
86019950,0cyclictest0-21swapper/319:50:163
85949955,0cyclictest60950irq/123-eno121:05:142
85949955,0cyclictest60950irq/123-eno119:22:382
85949953,2cyclictest24795-21cut20:50:152
85859955,0cyclictest0-21swapper/119:10:161
85859952,3cyclictest0-21swapper/123:05:121
85859950,5cyclictest0-21swapper/123:10:381
85859950,5cyclictest0-21swapper/119:55:561
85859950,5cyclictest0-21swapper/119:50:051
85859950,4cyclictest0-21swapper/120:10:211
85859950,4cyclictest0-21swapper/119:18:391
85859950,3cyclictest0-21swapper/122:27:181
85859950,3cyclictest0-21swapper/122:10:061
85859950,3cyclictest0-21swapper/121:45:021
85859950,2cyclictest0-21swapper/123:03:071
85859950,2cyclictest0-21swapper/121:19:001
85859950,1cyclictest0-21swapper/100:35:191
85779950,5cyclictest0-21swapper/019:20:360
85779950,4cyclictest0-21swapper/019:35:140
85779950,2cyclictest0-21swapper/020:10:210
86019943,1cyclictest35-21ksoftirqd/319:48:473
86019942,1cyclictest20157-21sh20:40:183
86019942,1cyclictest15367-21cut20:30:133
86019941,1cyclictest0-21swapper/320:55:123
85859944,0cyclictest0-21swapper/120:30:091
85859944,0cyclictest0-21swapper/119:43:291
85859944,0cyclictest0-21swapper/119:20:031
85859940,2cyclictest0-21swapper/120:50:151
85859940,1cyclictest0-21swapper/122:35:301
85859940,1cyclictest0-21swapper/120:55:131
85859940,0cyclictest0-21swapper/120:35:231
85779942,1cyclictest3065-21basename20:05:130
85859932,1cyclictest99022sleep120:17:461
85859930,2cyclictest0-21swapper/120:00:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional