You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 05:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Mon Nov 24, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124265921110,2sleep30-21swapper/321:05:303
15334022560,0sleep11533403-21cat23:55:011
1097559992515,5cyclictest0-21swapper/022:50:270
1097559992421,2cyclictest1700-21systemd-logind22:25:010
1097560992320,2cyclictest1652-1atopacctd21:30:021
1097559992320,2cyclictest1368338-21apt-key22:20:010
1097559992218,3cyclictest1702-21in:imuxsock21:20:000
1097559992218,3cyclictest1702-21in:imuxsock21:20:000
1097559992215,6cyclictest1513384-21wc23:40:430
1097559992214,7cyclictest0-21swapper/021:40:010
1097560992114,3cyclictest1572690-21kthreadcore00:15:351
1097560992114,3cyclictest1372538-21kthreadcore22:20:321
1097560992114,3cyclictest1317946-21kthreadcore21:50:301
1097560992112,3cyclictest1562887-21kthreadcore00:10:341
1097559992110,6cyclictest0-21swapper/000:40:020
1097560992017,2cyclictest1197577-21systemd-run20:30:001
1097560992017,2cyclictest0-21swapper/121:25:001
1097560992014,2cyclictest170550irq/121-eno122:05:001
1097560992010,6cyclictest1545779-21kthreadcore00:00:301
302487291190,2phc2sys0-21swapper/319:25:253
1097561991917,1cyclictest0-21swapper/222:25:022
1097561991917,1cyclictest0-21swapper/200:20:022
1097561991916,1cyclictest0-21swapper/223:40:002
1097561991916,1cyclictest0-21swapper/222:15:002
1097561991916,1cyclictest0-21swapper/222:00:002
109756199191,5cyclictest0-21swapper/200:40:012
1097560991916,2cyclictest1368325-21munin-run22:20:011
1097559991916,2cyclictest1603150-21apt-config00:35:010
1097559991916,2cyclictest1234591-21gpgconf21:00:010
302487291180,4phc2sys0-21swapper/322:56:323
302487291180,2phc2sys0-21swapper/323:25:513
302487291180,2phc2sys0-21swapper/300:10:203
1097561991815,1cyclictest0-21swapper/220:50:012
1097561991815,1cyclictest0-21swapper/220:25:292
109756199181,10cyclictest0-21swapper/200:00:012
109756099186,4cyclictest1255603-21/usr/sbin/munin21:15:301
109756099186,4cyclictest1255603-21/usr/sbin/munin21:15:301
109756099182,6cyclictest1524811-21kworker/1:2-mm_percpu_wq00:24:321
1097560991815,2cyclictest1234509-21apt-key21:00:011
1097560991815,2cyclictest1161122-21idleruntime-cro20:00:001
1097560991815,2cyclictest1145585-21kthreadcore19:45:311
1097560991815,2cyclictest1145585-21kthreadcore19:45:311
1097560991814,3cyclictest1218905-21kthreadcore20:45:311
1097559991815,2cyclictest1411912-21systemd-run22:45:000
1097559991810,4cyclictest1415192-21kthreadcore22:45:290
835298170,2rtkit-daemon0-21swapper/122:38:501
302487291170,2phc2sys0-21swapper/322:35:133
302487291170,2phc2sys0-21swapper/300:35:523
1097561991715,1cyclictest0-21swapper/222:20:022
109756199170,14cyclictest0-21swapper/200:20:222
109756099172,2cyclictest191rcu_preempt22:30:011
1097560991714,2cyclictest1595960-21sort00:30:291
1097560991714,2cyclictest1453053-21head23:05:361
1097560991714,2cyclictest1307453-21latency_hist21:45:011
1097560991714,2cyclictest1128239-21kthreadcore19:30:321
1097560991713,3cyclictest1178393-21pmu-power20:10:351
1097560991713,1cyclictest191rcu_preempt21:55:481
1097560991712,4cyclictest1098425-21fschecks_time19:10:291
1097560991711,2cyclictest1587598-21kthreadcore00:25:321
109755999178,4cyclictest0-21swapper/021:25:250
109755999178,2cyclictest0-21swapper/021:20:270
109755999171,6cyclictest1474812-21irqstats23:20:320
109755999171,4cyclictest1129681-21/usr/sbin/munin19:30:370
1097559991714,2cyclictest8351-21rtkit-daemon21:11:580
1097559991714,2cyclictest1576710-21apt-get00:20:000
1097559991714,2cyclictest1403367-21/usr/sbin/munin22:40:020
1097559991714,2cyclictest1394494-21dump-pmu-power22:35:010
1097559991714,2cyclictest1136562-21apt-key19:40:010
1097559991714,2cyclictest1136562-21apt-key19:40:010
1097559991714,2cyclictest1111970-21perf19:20:000
1097559991714,2cyclictest1103760-21vmstat19:15:010
109755999171,12cyclictest1246623-21diskmemload23:50:550
109755999171,12cyclictest0-21swapper/023:09:000
302487291160,2phc2sys0-21swapper/322:34:173
302487291160,2phc2sys0-21swapper/321:55:373
11018562160,2sleep30-21swapper/319:10:333
1097561991614,1cyclictest0-21swapper/223:20:022
1097561991614,1cyclictest0-21swapper/200:05:302
1097561991613,1cyclictest0-21swapper/222:50:292
1097561991613,1cyclictest0-21swapper/222:10:002
1097561991613,1cyclictest0-21swapper/221:45:012
1097561991613,1cyclictest0-21swapper/221:35:002
1097561991613,1cyclictest0-21swapper/220:55:012
1097561991613,1cyclictest0-21swapper/200:35:012
109756099165,2cyclictest491rcuog/223:15:011
1097560991613,2cyclictest1661-21polkitd00:10:001
1097560991613,2cyclictest1420618-21apt-key22:50:001
1097560991613,2cyclictest1202872-21mailstats20:30:331
1097560991613,2cyclictest1118126-21systemd-run19:25:011
1097560991613,2cyclictest0-21swapper/121:15:021
1097560991612,3cyclictest1704-21rs:main1
1097560991612,3cyclictest1426595-21kworker/u16:2+nfsiod22:55:111
1097560991612,3cyclictest1357704-21kworker/u16:3+nfsiod23:59:071
1097560991612,3cyclictest1104221-21kthreadcore19:15:021
109755999168,4cyclictest0-21swapper/023:40:020
109755999167,4cyclictest0-21swapper/000:00:300
109755999166,5cyclictest0-21swapper/021:45:270
1097559991613,2cyclictest1629-21avahi-daemon00:10:000
1097559991613,2cyclictest1538612-21latency23:55:310
1097559991613,2cyclictest1222188-21gpgconf20:50:010
1097559991613,2cyclictest1097557-21cyclictest23:10:310
1097559991613,2cyclictest0-21swapper/021:35:010
1097559991612,3cyclictest1236160-21kthreadcore21:00:320
109755999161,11cyclictest1155371-21/usr/sbin/munin19:55:330
109755999160,8cyclictest0-21swapper/020:20:240
302487291151,2phc2sys0-21swapper/300:00:343
302487291150,3phc2sys0-21swapper/322:44:303
302487291150,2phc2sys0-21swapper/323:39:133
302487291150,2phc2sys0-21swapper/321:33:533
302487291150,2phc2sys0-21swapper/300:25:463
1097561991513,1cyclictest0-21swapper/221:25:332
1097561991512,1cyclictest0-21swapper/223:30:322
1097561991512,1cyclictest0-21swapper/223:25:002
1097561991512,1cyclictest0-21swapper/223:10:012
1097561991512,1cyclictest0-21swapper/222:45:302
1097561991512,1cyclictest0-21swapper/222:39:382
1097561991512,1cyclictest0-21swapper/221:35:272
1097561991512,1cyclictest0-21swapper/220:45:002
1097561991512,1cyclictest0-21swapper/219:45:002
1097561991511,2cyclictest0-21swapper/222:05:022
1097561991511,2cyclictest0-21swapper/200:25:362
109756099159,1cyclictest501rcuop/219:50:231
109756099159,1cyclictest191rcu_preempt00:39:411
109756099157,3cyclictest501rcuop/222:41:211
109756099152,6cyclictest1421427-21telnet22:50:241
1097560991512,2cyclictest1635-21dbus-daemon20:10:011
1097560991512,2cyclictest1498924-21sh23:35:011
1097560991512,2cyclictest1467100-21kthreadcore23:15:291
1097560991512,2cyclictest1446791-21apt-key23:05:011
1097560991512,2cyclictest1237671-21kthreadcore21:00:321
1097560991512,2cyclictest0-21swapper/120:25:021
1097560991511,3cyclictest1519527-21kthreadcore23:45:301
1097560991511,3cyclictest1484456-21kthreadcore23:25:311
1097560991511,3cyclictest1291938-21kthreadcore21:35:301
109755999159,1cyclictest501rcuop/223:16:470
109755999158,5cyclictest260-21systemd-journal20:40:000
109755999158,2cyclictest0-21swapper/021:55:260
109755999155,5cyclictest0-21swapper/022:25:330
109755999154,5cyclictest0-21swapper/023:45:350
109755999152,8cyclictest2025-21snmpd19:40:240
1097559991512,2cyclictest1587837-21kthreadcore00:25:310
1097559991512,2cyclictest1446855-21apt-key23:05:010
1097559991512,2cyclictest1351494-21cpuspeed_turbos22:10:260
1097559991512,2cyclictest1324744-21true21:55:010
1097559991512,2cyclictest0-21swapper/000:25:000
1097559991511,3cyclictest1432850-21kthreadcore22:55:320
302487291141,3phc2sys0-21swapper/323:17:253
302487291140,3phc2sys0-21swapper/322:04:553
302487291140,2phc2sys0-21swapper/321:16:023
302487291140,2phc2sys0-21swapper/321:16:023
302487291140,2phc2sys0-21swapper/300:32:023
302487291140,2phc2sys0-21swapper/300:21:023
109756199148,4cyclictest1098365-21taskset19:10:282
1097561991412,1cyclictest0-21swapper/221:15:292
1097561991412,1cyclictest0-21swapper/221:15:292
1097561991412,1cyclictest0-21swapper/200:15:012
1097561991411,1cyclictest0-21swapper/223:43:372
1097561991411,1cyclictest0-21swapper/223:25:262
1097561991411,1cyclictest0-21swapper/221:50:312
1097561991411,1cyclictest0-21swapper/221:00:382
1097561991411,1cyclictest0-21swapper/221:00:012
1097561991411,1cyclictest0-21swapper/220:30:292
1097561991411,1cyclictest0-21swapper/200:00:302
1097561991410,2cyclictest0-21swapper/220:05:312
109756199140,10cyclictest0-21swapper/221:45:232
109756099148,1cyclictest601rcuop/321:33:041
109756099147,1cyclictest601rcuop/323:38:201
109756099146,3cyclictest0-21swapper/119:45:001
109756099141,7cyclictest1136293-21latency_hist19:40:011
109756099141,7cyclictest1136293-21latency_hist19:40:011
1097560991412,1cyclictest8351-21rtkit-daemon19:28:521
1097560991411,2cyclictest1510641-21kthreadcore23:40:301
1097560991411,2cyclictest1387652-21irqrtprio22:30:281
1097560991411,2cyclictest1242240-21kthreadcore21:05:301
1097560991411,2cyclictest1227159-21missed_timers20:50:321
1097560991411,2cyclictest1183391-21kthreadcore20:15:331
1097560991411,2cyclictest1162779-21kthreadcore20:00:301
1097560991410,3cyclictest1474240-21head23:20:301
1097560991410,3cyclictest1310043-21kthreadcore21:45:301
109755999148,5cyclictest1299216-21apt-get21:40:220
109755999145,4cyclictest1196764-21find20:25:340
109755999142,7cyclictest0-21swapper/020:15:260
109755999141,8cyclictest1560518-21/usr/sbin/munin00:10:300
109755999141,8cyclictest1481936-21sh23:25:110
1097559991412,1cyclictest1338275-21kthreadcore22:00:330
1097559991412,1cyclictest1173242-21idleruntime-cro20:10:000
1097559991410,3cyclictest1211263-21irqrtprio20:40:290
109755999140,9cyclictest1347869-21sed22:05:350
109755999140,9cyclictest1225207-21cut20:50:310
302487291137,2phc2sys0-21swapper/320:00:543
302487291136,3phc2sys0-21swapper/319:55:003
302487291130,2phc2sys0-21swapper/323:52:063
302487291130,2phc2sys0-21swapper/322:54:333
302487291130,2phc2sys0-21swapper/322:47:193
302487291130,2phc2sys0-21swapper/322:07:003
302487291130,2phc2sys0-21swapper/320:41:523
302487291130,2phc2sys0-21swapper/320:25:023
302487291130,2phc2sys0-21swapper/319:20:013
109756199131,4cyclictest0-21swapper/220:40:012
109756199131,2cyclictest0-21swapper/222:30:012
1097561991311,1cyclictest0-21swapper/223:50:242
1097561991310,1cyclictest0-21swapper/223:45:262
1097561991310,1cyclictest0-21swapper/222:35:012
1097561991310,1cyclictest0-21swapper/221:15:012
1097561991310,1cyclictest0-21swapper/219:35:292
1097561991310,1cyclictest0-21swapper/219:35:292
109756099139,3cyclictest1211200-21irqrtprio20:40:291
109756099135,3cyclictest501rcuop/220:35:091
1097560991310,2cyclictest1097727-21true19:10:021
109755999139,3cyclictest1143315-21aten_repower_en19:45:250
109755999139,3cyclictest1143315-21aten_repower_en19:45:250
109755999139,3cyclictest1115079-21kthreadcore19:20:320
109755999132,7cyclictest1096330-21kworker/u16:3+events_unbound19:25:260
1097559991311,1cyclictest8351-21rtkit-daemon21:05:040
1097559991310,2cyclictest1494067-21kthreadcore23:30:320
1097559991310,2cyclictest1164252-21kthreadcore20:00:310
302487291124,2phc2sys0-21swapper/320:50:293
302487291121,5phc2sys0-21swapper/319:35:223
302487291121,5phc2sys0-21swapper/319:35:223
302487291121,2phc2sys0-21swapper/323:20:263
302487291121,2phc2sys0-21swapper/322:15:013
302487291121,2phc2sys0-21swapper/320:30:303
302487291120,2phc2sys0-21swapper/323:11:043
302487291120,2phc2sys0-21swapper/323:02:023
302487291120,2phc2sys0-21swapper/322:16:493
302487291120,1phc2sys1299097-21chrt21:40:133
109756199129,1cyclictest0-21swapper/223:00:012
109756199129,1cyclictest0-21swapper/222:40:232
109756199129,1cyclictest0-21swapper/221:05:252
109756199129,1cyclictest0-21swapper/219:58:582
109756199129,1cyclictest0-21swapper/219:53:512
109756199129,1cyclictest0-21swapper/219:20:312
1097561991210,1cyclictest0-21swapper/223:10:242
1097561991210,1cyclictest0-21swapper/223:05:012
1097561991210,1cyclictest0-21swapper/221:20:312
1097561991210,1cyclictest0-21swapper/220:10:322
1097561991210,1cyclictest0-21swapper/220:05:012
1097561991210,1cyclictest0-21swapper/219:45:302
1097561991210,1cyclictest0-21swapper/219:45:302
1097561991210,1cyclictest0-21swapper/219:25:302
109756099129,2cyclictest1351201-21aten_repower_cu22:10:241
109755999129,2cyclictest1200364-21kthreadcore20:30:290
109755999129,2cyclictest1150780-21kthreadcore19:50:310
109755999128,3cyclictest1176359-21kthreadcore20:10:320
302487291111,3phc2sys0-21swapper/323:43:593
302487291111,3phc2sys0-21swapper/320:25:373
302487291111,2phc2sys0-21swapper/319:55:303
302487291110,5phc2sys0-21swapper/323:45:223
302487291110,3phc2sys0-21swapper/321:12:003
302487291110,3phc2sys0-21swapper/320:55:223
302487291110,3phc2sys0-21swapper/300:07:193
302487291110,1phc2sys0-21swapper/322:25:433
109756199119,1cyclictest0-21swapper/220:20:292
109756199119,1cyclictest0-21swapper/220:15:212
109756199119,1cyclictest0-21swapper/219:15:302
109755999114,5cyclictest1097754-21latency_hist19:10:020
302487291101,4phc2sys0-21swapper/323:05:223
302487291101,2phc2sys0-21swapper/321:54:133
302487291101,2phc2sys0-21swapper/321:25:323
302487291100,7phc2sys1117809-21chrt19:22:233
302487291100,3phc2sys0-21swapper/322:23:353
302487291100,3phc2sys0-21swapper/320:35:313
302487291100,3phc2sys0-21swapper/319:30:343
302487291100,2phc2sys0-21swapper/323:59:503
302487291100,2phc2sys0-21swapper/321:46:163
302487291100,2phc2sys0-21swapper/321:24:113
302487291100,2phc2sys0-21swapper/300:19:343
109756199108,1cyclictest0-21swapper/219:30:272
109756199101,3cyclictest0-21swapper/219:10:012
30248729194,2phc2sys0-21swapper/319:45:313
30248729194,2phc2sys0-21swapper/319:45:313
30248729191,3phc2sys0-21swapper/319:10:013
30248729190,3phc2sys0-21swapper/320:10:243
30248729190,2phc2sys0-21swapper/323:30:203
30248729190,2phc2sys0-21swapper/321:35:303
30248729190,2phc2sys0-21swapper/321:00:273
30248729190,2phc2sys0-21swapper/320:45:283
30248729190,2phc2sys0-21swapper/320:19:553
30248729190,2phc2sys0-21swapper/320:05:123
30248729190,2phc2sys0-21swapper/319:43:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional