You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 08:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Tue Nov 18, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1823019992515,6cyclictest2281110-21missed_timers00:05:410
1823019992414,6cyclictest2336369-21munin-run00:40:010
1823021992320,1cyclictest0-21swapper/222:05:002
1823021992219,1cyclictest0-21swapper/223:40:002
1823019992212,6cyclictest2055383-21ptp4l-jitter21:55:440
18862682210,2sleep20-21swapper/220:00:022
1823019992118,2cyclictest1635-21dbus-daemon19:15:020
1823019992114,6cyclictest2145468-21systemd22:50:020
1823019992114,2cyclictest0-21swapper/000:00:020
1823019992110,6cyclictest0-21swapper/022:35:390
302487291200,3phc2sys0-21swapper/319:15:453
22685212200,2sleep30-21swapper/300:00:373
1823021992017,1cyclictest0-21swapper/221:05:002
1823021992017,1cyclictest0-21swapper/219:15:012
1823021992017,1cyclictest0-21swapper/200:15:002
1823020992013,2cyclictest170550irq/121-eno121:35:021
1823020992011,5cyclictest2266450-21gpgv00:00:021
1823020992011,4cyclictest0-21swapper/122:55:321
1823019992017,2cyclictest2092992-21latency_hist22:20:000
1823019992010,4cyclictest2081680-21timerwakeupswit22:10:450
835298190,3rtkit-daemon1829112-21munin-node23:27:270
1823021991917,1cyclictest0-21swapper/200:40:012
1823020991916,2cyclictest2049506-21apt-config21:55:001
1823020991912,3cyclictest2079138-21kthreadcore22:10:401
182301999199,5cyclictest0-21swapper/000:00:350
182301999198,6cyclictest0-21swapper/021:10:430
1823019991917,1cyclictest1958874-21perf21:00:010
1823019991915,3cyclictest1939869-21mailstats20:40:430
1823019991910,5cyclictest2180510-21tail23:10:320
1823019991910,5cyclictest2032981-21/usr/sbin/munin21:45:320
1823019991910,4cyclictest0-21swapper/023:25:010
302487291180,2phc2sys0-21swapper/300:17:383
1823021991815,1cyclictest0-21swapper/223:10:012
1823021991810,4cyclictest0-21swapper/222:00:012
1823020991815,2cyclictest2336388-21gpgv00:40:011
1823020991815,2cyclictest2138336-21irqrtprio22:45:411
1823020991815,2cyclictest0-21swapper/121:55:391
1823020991815,2cyclictest0-21swapper/100:05:011
182302099180,2cyclictest1849527-21munin-run19:30:001
1823019991815,2cyclictest2197200-21idleruntime-cro23:20:000
1823019991815,2cyclictest1994807-21unixbench_singl21:20:450
1823019991815,2cyclictest1635-21dbus-daemon21:05:000
1823019991815,2cyclictest0-21swapper/021:45:010
1823019991814,2cyclictest0-21swapper/019:30:010
182301999180,4cyclictest2224995-21ps23:35:360
182301999180,3cyclictest1873096-21seq19:45:460
302487291171,4phc2sys0-21swapper/319:45:343
302487291170,3phc2sys0-21swapper/322:15:553
302487291170,3phc2sys0-21swapper/322:00:343
302487291170,2phc2sys0-21swapper/322:48:363
302487291170,2phc2sys0-21swapper/322:36:473
302487291170,2phc2sys0-21swapper/300:35:493
1823021991714,1cyclictest0-21swapper/223:00:002
1823021991714,1cyclictest0-21swapper/222:20:012
1823021991714,1cyclictest0-21swapper/221:48:472
1823021991714,1cyclictest0-21swapper/221:35:002
1823021991714,1cyclictest0-21swapper/219:50:012
1823021991714,1cyclictest0-21swapper/219:30:352
1823021991714,1cyclictest0-21swapper/200:35:012
1823021991714,1cyclictest0-21swapper/200:20:012
1823021991714,1cyclictest0-21swapper/200:10:002
182302099177,6cyclictest1823017-21cyclictest23:29:091
1823020991714,2cyclictest2254365-21kthreadcore23:50:431
1823020991714,2cyclictest2219719-21kthreadcore23:30:391
1823020991714,2cyclictest1700-21systemd-logind19:50:001
1823020991713,3cyclictest1717645-21kworker/u16:2+nfsiod21:27:461
182301999179,5cyclictest1928852-21tail20:35:360
182301999179,4cyclictest2067675-21/usr/sbin/munin22:05:460
182301999178,5cyclictest0-21swapper/000:35:010
182301999178,2cyclictest0-21swapper/022:25:410
182301999172,10cyclictest0-21swapper/021:35:100
182301999171,7cyclictest1999363-21irqstats21:25:410
1823019991714,2cyclictest8351-21rtkit-daemon20:50:320
1823019991714,2cyclictest1988779-21systemd-run21:20:010
1823019991714,2cyclictest1867710-21latency_hist19:45:000
1823019991714,2cyclictest1631-21gmain23:55:010
1823019991711,1cyclictest601rcuop/322:24:350
182301999170,16cyclictest1898128-21perf20:10:010
835298160,1rtkit-daemon0-21swapper/122:38:181
302487291160,2phc2sys0-21swapper/323:50:323
302487291160,2phc2sys0-21swapper/323:48:483
302487291160,2phc2sys0-21swapper/322:27:163
302487291160,2phc2sys0-21swapper/321:53:383
21540352160,2sleep0171ktimers/022:55:020
1823021991613,1cyclictest0-21swapper/223:15:412
1823021991613,1cyclictest0-21swapper/222:35:002
1823021991613,1cyclictest0-21swapper/221:15:002
1823021991613,1cyclictest0-21swapper/220:55:012
1823021991613,1cyclictest0-21swapper/200:25:462
1823021991613,1cyclictest0-21swapper/200:05:002
1823021991612,2cyclictest0-21swapper/221:55:002
1823021991611,2cyclictest0-21swapper/222:13:132
1823021991610,1cyclictest0-21swapper/222:05:462
182302099169,3cyclictest2026525-21kthreadcore21:40:391
1823020991614,1cyclictest8351-21rtkit-daemon20:43:371
1823020991613,2cyclictest2174953-21kthreadcore23:05:421
1823020991613,2cyclictest2061570-21kthreadcore22:00:381
1823020991613,2cyclictest1963482-21kthreadcore21:00:411
1823020991613,2cyclictest1661-21polkitd21:25:011
1823020991613,2cyclictest1635-21dbus-daemon22:30:441
1823020991613,2cyclictest1635-21dbus-daemon19:15:021
1823020991613,2cyclictest0-21swapper/123:20:001
1823020991612,3cyclictest2225845-21kthreadcore23:35:381
1823020991612,2cyclictest1635-21dbus-daemon19:20:021
1823020991610,2cyclictest170550irq/121-eno122:20:351
182301999168,4cyclictest2294020-21cstates00:15:340
182301999168,4cyclictest0-21swapper/022:00:440
182301999167,4cyclictest0-21swapper/000:25:320
182301999166,5cyclictest0-21swapper/023:40:350
182301999165,6cyclictest0-21swapper/023:05:340
1823019991615,1cyclictest0-21swapper/020:49:220
1823019991613,2cyclictest2128834-21cpuspeed_turbos22:40:360
1823019991613,2cyclictest2111393-21cstates22:30:350
1823019991613,2cyclictest1971216-21diskmemload23:50:010
1823019991613,2cyclictest1882612-21kthreadcore19:55:410
1823019991613,2cyclictest1861648-21perf19:40:000
302487291151,2phc2sys0-21swapper/323:35:003
302487291150,3phc2sys0-21swapper/300:28:483
1823021991513,1cyclictest0-21swapper/223:55:352
1823021991513,1cyclictest0-21swapper/223:55:022
1823021991513,1cyclictest0-21swapper/223:25:392
1823021991513,1cyclictest0-21swapper/221:30:012
1823021991513,1cyclictest0-21swapper/221:25:022
1823021991512,1cyclictest0-21swapper/222:35:462
1823021991512,1cyclictest0-21swapper/220:45:002
1823021991512,1cyclictest0-21swapper/219:45:012
1823021991511,2cyclictest0-21swapper/220:45:442
182302099159,2cyclictest170550irq/121-eno120:50:331
182302099157,4cyclictest2104840-21kthreadcore22:25:401
1823020991512,2cyclictest8351-21rtkit-daemon20:27:221
1823020991512,2cyclictest2294152-21cstates00:15:341
1823020991512,2cyclictest2020514-21ssh21:35:451
1823020991512,2cyclictest1916374-21systemd20:25:001
1823020991512,2cyclictest1916374-21systemd20:25:001
1823020991512,2cyclictest1717645-21kworker/u16:2-rpciod21:45:291
1823020991512,2cyclictest1652-1atopacctd00:30:381
1823020991512,2cyclictest1635-21dbus-daemon21:15:011
1823020991512,2cyclictest0-21swapper/123:45:011
1823020991512,2cyclictest0-21swapper/100:30:001
1823020991511,3cyclictest2145292-21kworker/u16:3+nfsiod23:02:261
182301999159,5cyclictest1823017-21cyclictest23:00:310
182301999158,5cyclictest2158846-21tr22:55:410
182301999157,2cyclictest0-21swapper/021:33:420
182301999153,6cyclictest1898592-21aten2.4-expect20:10:340
182301999152,8cyclictest0-21swapper/019:50:450
1823019991512,2cyclictest2042117-21tail21:50:380
302487291142,3phc2sys0-21swapper/321:21:483
302487291141,3phc2sys0-21swapper/323:20:113
302487291140,4phc2sys0-21swapper/321:10:343
302487291140,3phc2sys0-21swapper/322:12:463
302487291140,2phc2sys0-21swapper/323:15:023
302487291140,2phc2sys0-21swapper/321:41:353
302487291140,2phc2sys0-21swapper/321:29:343
302487291140,2phc2sys0-21swapper/300:00:023
19172522140,3sleep30-21swapper/320:25:363
182302199142,4cyclictest0-21swapper/221:00:012
182302199141,6cyclictest0-21swapper/222:50:012
1823021991412,1cyclictest0-21swapper/221:10:022
1823021991411,1cyclictest0-21swapper/223:30:392
1823021991411,1cyclictest0-21swapper/223:10:382
1823021991411,1cyclictest0-21swapper/223:01:482
1823021991411,1cyclictest0-21swapper/222:20:402
1823021991411,1cyclictest0-21swapper/220:10:432
1823021991411,1cyclictest0-21swapper/220:06:552
1823021991411,1cyclictest0-21swapper/219:40:012
1823021991411,1cyclictest0-21swapper/200:20:422
182302199141,10cyclictest0-21swapper/222:40:342
182302199140,2cyclictest0-21swapper/223:45:232
182302099147,5cyclictest260-21systemd-journal22:45:001
182302099147,2cyclictest170550irq/121-eno123:50:011
182302099146,2cyclictest0-21swapper/100:20:331
1823020991412,1cyclictest1823017-21cyclictest00:05:041
1823020991411,2cyclictest2072905-21wc22:05:461
1823020991411,2cyclictest2067267-21kworker/u16:1-rpciod23:25:021
1823020991411,2cyclictest1900129-21kthreadcore20:10:391
1823020991411,2cyclictest1893092-21gltestperf20:05:371
1823020991411,2cyclictest1892206-21sh20:05:011
1823020991411,2cyclictest1875451-21sed19:50:391
1823020991411,2cyclictest1867738-21systemd-run19:45:001
1823020991411,2cyclictest1856182-21cpuspeed_turbos19:35:341
1823020991411,2cyclictest1850612-21head19:30:361
1823020991411,2cyclictest1661-21polkitd21:05:431
1823020991411,2cyclictest1-21systemd21:18:251
1823020991410,3cyclictest2184367-21kthreadcore23:10:391
182302099140,12cyclictest2284978-21ssh00:10:301
182301999145,5cyclictest0-21swapper/021:09:170
182301999145,1cyclictest0-21swapper/023:30:380
182301999141,8cyclictest0-21swapper/020:30:320
182301999141,5cyclictest1-21systemd00:15:020
1823019991411,2cyclictest1834542-21kthreadcore19:15:380
1823019991411,2cyclictest0-21swapper/020:25:000
1823019991411,2cyclictest0-21swapper/020:25:000
302487291130,4phc2sys0-21swapper/319:30:323
302487291130,3phc2sys0-21swapper/322:50:083
302487291130,2phc2sys0-21swapper/321:32:463
302487291130,2phc2sys0-21swapper/321:18:193
302487291130,2phc2sys0-21swapper/319:08:133
302487291130,2phc2sys0-21swapper/300:32:173
302487291130,2phc2sys0-21swapper/300:11:133
22840412130,3sleep30-21swapper/300:09:363
182302199139,2cyclictest0-21swapper/221:40:392
182302199139,1cyclictest0-21swapper/223:40:342
182302199131,7cyclictest0-21swapper/222:30:012
1823021991311,1cyclictest0-21swapper/220:20:322
1823021991311,1cyclictest0-21swapper/220:20:322
1823021991310,1cyclictest0-21swapper/221:15:322
1823021991310,1cyclictest0-21swapper/220:40:012
1823021991310,1cyclictest0-21swapper/219:55:352
1823021991310,1cyclictest0-21swapper/219:29:562
1823021991310,1cyclictest0-21swapper/219:20:352
182302099136,5cyclictest1803-21gdbus20:35:021
182302099132,4cyclictest1941051-21head20:45:331
1823020991310,2cyclictest2089476-21kthreadcore22:15:441
1823020991310,2cyclictest1954046-21irqcore20:55:411
1823020991310,2cyclictest1928882-21head20:35:361
1823020991310,2cyclictest1908958-21kthreadcore20:15:401
1823020991310,2cyclictest1823017-21cyclictest19:55:411
182301999135,2cyclictest0-21swapper/020:00:320
182301999133,1cyclictest191rcu_preempt00:20:340
182301999131,7cyclictest1905300-21hddtemp_smartct20:15:360
1823019991310,2cyclictest1919225-21kthreadcore20:25:400
1823019991310,2cyclictest1850875-21irqcore19:30:370
302487291120,3phc2sys0-21swapper/319:20:343
302487291120,2phc2sys0-21swapper/320:21:453
302487291120,2phc2sys0-21swapper/320:21:453
302487291120,2phc2sys0-21swapper/320:16:403
302487291120,2phc2sys0-21swapper/320:07:383
302487291120,2phc2sys0-21swapper/319:51:553
21544932120,3sleep30-21swapper/322:55:333
182302199129,1cyclictest0-21swapper/223:20:402
182302199129,1cyclictest0-21swapper/220:30:382
182302199129,1cyclictest0-21swapper/220:25:412
182302199129,1cyclictest0-21swapper/220:15:392
182302199128,2cyclictest0-21swapper/219:50:342
1823021991210,1cyclictest0-21swapper/221:35:372
182302099129,2cyclictest2108009-21kworker/u16:0-events_unbound22:50:201
182302099129,2cyclictest1837775-21aten_repower_en19:20:341
182301999129,2cyclictest1837693-21/usr/sbin/munin19:20:370
182301999121,6cyclictest1823093-21latency_hist19:10:010
302487291115,2phc2sys0-21swapper/322:42:313
302487291113,2phc2sys0-21swapper/319:44:583
302487291111,4phc2sys0-21swapper/321:05:323
302487291111,3phc2sys0-21swapper/300:20:223
302487291110,4phc2sys0-21swapper/323:43:073
302487291110,4phc2sys0-21swapper/322:20:313
302487291110,3phc2sys0-21swapper/322:05:323
302487291110,3phc2sys0-21swapper/321:55:023
302487291110,2phc2sys0-21swapper/321:47:043
302487291110,2phc2sys0-21swapper/321:37:363
302487291110,2phc2sys0-21swapper/320:50:553
182302199119,1cyclictest0-21swapper/222:50:392
182302199119,1cyclictest0-21swapper/219:15:032
182302099114,5cyclictest1803-21gdbus19:10:011
302487291102,2phc2sys0-21swapper/323:05:243
302487291101,4phc2sys0-21swapper/320:45:323
302487291101,3phc2sys0-21swapper/320:30:343
302487291101,2phc2sys0-21swapper/323:25:163
302487291100,3phc2sys0-21swapper/323:15:063
302487291100,2phc2sys0-21swapper/323:35:303
302487291100,2phc2sys0-21swapper/323:01:153
302487291100,2phc2sys0-21swapper/322:33:583
302487291100,2phc2sys0-21swapper/321:04:563
302487291100,2phc2sys0-21swapper/320:55:393
302487291100,2phc2sys0-21swapper/320:38:113
302487291100,2phc2sys0-21swapper/320:10:353
30248729190,3phc2sys0-21swapper/319:25:033
30248729190,2phc2sys0-21swapper/320:40:203
30248729190,2phc2sys0-21swapper/320:00:093
30248729190,2phc2sys0-21swapper/319:55:403
30248729190,2phc2sys0-21swapper/319:35:453
30248729190,2phc2sys0-21swapper/319:10:483
18230219986,1cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional