You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-12 - 14:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Thu Jun 12, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1840542310,1sleep1184057-21kthreadcore00:35:241
25010912618,3phc2sys0-21swapper/321:13:443
25010912518,3phc2sys0-21swapper/321:32:393
3864954992416,3cyclictest0-21swapper/122:50:001
25010912419,2phc2sys0-21swapper/300:30:193
25010912418,3phc2sys0-21swapper/322:17:113
25010912418,3phc2sys0-21swapper/319:30:273
25010912418,3phc2sys0-21swapper/300:05:263
25010912418,2phc2sys0-21swapper/321:36:163
25010912418,2phc2sys0-21swapper/321:25:063
25010912418,2phc2sys0-21swapper/321:24:063
25010912418,2phc2sys0-21swapper/321:24:053
25010912418,2phc2sys0-21swapper/320:54:283
25010912418,2phc2sys0-21swapper/320:40:503
25010912418,2phc2sys0-21swapper/320:40:493
25010912418,2phc2sys0-21swapper/320:08:083
25010912418,2phc2sys0-21swapper/319:46:443
25010912418,2phc2sys0-21swapper/300:25:103
25010912417,2phc2sys0-21swapper/323:30:073
25010912417,2phc2sys0-21swapper/321:58:413
41085122230,2sleep30-21swapper/322:01:513
25010912318,3phc2sys0-21swapper/323:55:283
25010912318,3phc2sys0-21swapper/323:09:103
25010912318,3phc2sys0-21swapper/321:48:303
25010912318,3phc2sys0-21swapper/319:20:253
25010912318,3phc2sys0-21swapper/300:20:393
25010912317,3phc2sys0-21swapper/323:14:273
25010912317,2phc2sys0-21swapper/323:50:513
25010912317,2phc2sys0-21swapper/323:41:573
25010912317,2phc2sys0-21swapper/323:21:133
25010912317,2phc2sys0-21swapper/323:00:403
25010912317,2phc2sys0-21swapper/322:28:273
25010912317,2phc2sys0-21swapper/322:08:433
25010912317,2phc2sys0-21swapper/321:51:103
25010912317,2phc2sys0-21swapper/321:42:133
25010912317,2phc2sys0-21swapper/320:31:513
25010912317,2phc2sys0-21swapper/319:36:463
25010912317,2phc2sys0-21swapper/319:13:493
25010912317,2phc2sys0-21swapper/300:12:153
25010912317,2phc2sys0-21swapper/300:03:053
6456622218,2sleep30-21swapper/323:27:503
418901922218,2sleep20-21swapper/222:49:142
418699122218,2sleep30-21swapper/322:45:543
417957022218,2sleep30-21swapper/322:43:003
415189522218,2sleep20-21swapper/222:26:132
409159422218,2sleep20-21swapper/221:52:452
404622222218,2sleep20-21swapper/221:25:572
402921922218,2sleep20-21swapper/221:17:142
402066222218,2sleep20-21swapper/221:12:432
401022218,2sleep30-21swapper/322:54:313
394065922218,2sleep20-21swapper/220:10:102
25010912217,3phc2sys0-21swapper/323:46:223
25010912217,3phc2sys0-21swapper/322:55:193
25010912217,3phc2sys0-21swapper/322:14:583
25010912217,3phc2sys0-21swapper/320:46:293
25010912217,3phc2sys0-21swapper/320:35:363
25010912217,3phc2sys0-21swapper/320:24:293
25010912217,3phc2sys0-21swapper/320:01:053
25010912217,3phc2sys0-21swapper/319:16:543
25010912217,2phc2sys0-21swapper/321:01:263
17936522218,2sleep30-21swapper/300:35:043
15153222218,2sleep30-21swapper/300:17:203
14235022218,2sleep20-21swapper/200:11:302
9833822117,2sleep20-21swapper/223:45:452
9074222117,2sleep20-21swapper/223:42:352
8138422117,2sleep20-21swapper/223:36:352
7227222117,2sleep20-21swapper/223:31:052
6388422117,2sleep20-21swapper/223:26:452
5578822117,2sleep20-21swapper/223:22:512
417237922117,2sleep20-21swapper/222:40:072
417053222117,2sleep20-21swapper/222:38:072
417027922117,2sleep30-21swapper/322:37:403
414281922117,2sleep20-21swapper/222:20:392
413520122117,2sleep20-21swapper/222:17:352
410944722117,2sleep20-21swapper/222:03:282
409936122117,2sleep20-21swapper/221:56:072
408250422117,2sleep20-21swapper/221:47:412
406553122117,2sleep20-21swapper/221:38:442
405564122117,2sleep20-21swapper/221:31:532
402608622118,2sleep30-21swapper/321:15:233
397837822117,2sleep20-21swapper/220:40:252
397837822117,2sleep20-21swapper/220:40:242
395227422117,2sleep20-21swapper/220:18:082
3864954992118,2cyclictest4084044-21apt-key21:50:011
3864954992118,2cyclictest4022139-21cron21:15:011
3864954992118,2cyclictest3864951-21cyclictest21:10:001
3864954992116,4cyclictest3864951-21cyclictest21:40:011
3864953992115,5cyclictest4177498-21proc_pri22:40:280
3864953992114,6cyclictest0-21swapper/023:00:000
3864953992113,6cyclictest0-21swapper/021:40:010
3864953992110,6cyclictest0-21swapper/021:25:180
3702622117,2sleep20-21swapper/223:11:012
25010912118,2phc2sys0-21swapper/319:53:373
25010912117,3phc2sys0-21swapper/320:15:483
25010912117,3phc2sys0-21swapper/319:43:133
25010912117,2phc2sys0-21swapper/323:35:183
25010912117,2phc2sys0-21swapper/322:32:243
2225522117,2sleep20-21swapper/223:05:052
220522117,2sleep20-21swapper/222:51:332
1965822117,2sleep20-21swapper/223:01:232
18644722117,2sleep20-21swapper/200:37:512
17752122117,2sleep20-21swapper/200:32:332
16869822117,2sleep20-21swapper/200:27:332
16048722117,2sleep20-21swapper/200:22:432
15056722117,2sleep20-21swapper/200:15:432
12850122117,2sleep20-21swapper/200:05:242
1276922117,2sleep20-21swapper/222:59:322
12573522117,2sleep20-21swapper/200:02:482
11783422117,2sleep20-21swapper/223:59:142
10883522117,2sleep20-21swapper/223:53:422
412522622017,2sleep20-21swapper/222:10:332
403927422017,2sleep20-21swapper/221:23:532
403927422017,2sleep20-21swapper/221:23:522
401316522017,2sleep20-21swapper/221:08:172
400108322017,2sleep20-21swapper/220:58:512
399494222017,2sleep20-21swapper/220:53:032
398883222017,2sleep20-21swapper/220:47:332
397675522017,2sleep20-21swapper/220:38:122
397072422017,2sleep20-21swapper/220:33:102
396463122017,2sleep20-21swapper/220:27:422
394619222017,2sleep30-21swapper/320:12:273
392774522017,2sleep30-21swapper/319:57:063
392764922017,2sleep20-21swapper/219:55:522
391557822017,2sleep20-21swapper/219:46:152
389806622017,2sleep20-21swapper/219:35:162
389745822017,2sleep20-21swapper/219:31:232
389168222017,2sleep20-21swapper/219:30:002
388555322017,2sleep20-21swapper/219:24:012
387072622017,2sleep20-21swapper/219:12:192
3864954992017,2cyclictest48416-21/usr/sbin/munin23:20:001
3864954992017,2cyclictest4127945-21grep22:15:011
3864954992017,2cyclictest3983080-21systemd-run20:45:011
3864954992017,2cyclictest3983080-21systemd-run20:45:001
3864954992017,2cyclictest1707-21polkitd21:30:011
3864954992017,2cyclictest0-21swapper/123:11:451
3864954992011,4cyclictest0-21swapper/121:30:281
386495399209,6cyclictest3922637-21cstates19:55:180
3864953992017,2cyclictest57151-21systemd-run23:25:010
3864953992014,5cyclictest0-21swapper/021:50:010
25010912017,2phc2sys0-21swapper/323:16:263
25010912017,2phc2sys0-21swapper/321:06:553
25010912017,2phc2sys0-21swapper/320:27:203
25010912017,2phc2sys0-21swapper/319:26:223
25010912017,2phc2sys0-21swapper/319:07:063
25010912014,1phc2sys0-21swapper/320:55:243
3864955991916,1cyclictest0-21swapper/223:20:022
3864954991916,2cyclictest4145468-21latency_hist22:25:011
3864954991916,2cyclictest1726-21systemd-logind22:05:011
3864954991916,2cyclictest112571-21kthreadcore23:55:261
3864954991913,2cyclictest178850irq/121-eno123:50:011
3864953991916,2cyclictest74983-21systemd23:35:020
3864953991916,2cyclictest3904056-21cut19:40:020
3864953991916,2cyclictest3871070-21apt-key19:15:000
395820021816,1sleep20-21swapper/220:21:122
3864954991815,2cyclictest2240602-1atopacctd23:35:071
3864954991815,2cyclictest1726-21systemd-logind21:55:001
3864954991815,2cyclictest1726-21systemd-logind00:25:021
3864954991815,2cyclictest1695-21dbus-daemon23:35:001
3864954991815,2cyclictest131570-21kthreadcore00:05:251
3864954991815,2cyclictest1-21systemd21:19:591
3864954991814,3cyclictest1731-21in:imuxsock23:10:011
3864954991811,3cyclictest4110855-21/usr/sbin/munin22:05:241
3864954991810,3cyclictest0-21swapper/122:00:021
3864953991816,1cyclictest0-21swapper/022:30:010
3864953991815,2cyclictest3874470-21fschecks_time19:15:210
3864953991810,4cyclictest88379-21kthreadcore23:40:260
386495399180,17cyclictest162130-21/usr/sbin/munin00:25:210
3864955991715,1cyclictest0-21swapper/219:15:042
3864954991714,2cyclictest144555-21latency_hist00:15:011
3864954991713,3cyclictest4172190-21kworker/u16:2+nfsiod22:58:231
386495399178,4cyclictest0-21swapper/021:35:010
386495399177,5cyclictest0-21swapper/022:10:000
3864953991714,2cyclictest9244-21rtkit-daemon23:38:300
3864953991714,2cyclictest66325-21kworker/u16:0-rpciod00:35:020
3864953991714,2cyclictest3966053-21irqcore20:30:240
3864953991712,4cyclictest2240602-1atopacctd22:45:180
386495399170,13cyclictest0-21swapper/020:45:270
3864955991614,1cyclictest0-21swapper/220:10:022
386495499164,11cyclictest3946750-21apt-get20:15:161
3864954991613,2cyclictest4001187-21sendmail21:00:001
3864954991613,2cyclictest0-21swapper/122:30:001
3864954991612,3cyclictest4075445-21kworker/u16:3+nfsiod23:25:371
3864954991612,3cyclictest17302-21kthreadcore23:00:261
3864954991610,5cyclictest4069743-21kthreadcore21:40:271
386495399167,5cyclictest4014434-21fschecks_time21:10:190
386495399167,4cyclictest0-21swapper/000:00:210
386495399165,5cyclictest141689-21grep00:10:310
386495399162,7cyclictest0-21swapper/023:05:170
3864953991613,2cyclictest4096338-21kthreadcore21:55:230
3864953991613,2cyclictest3958631-21apt-key20:25:010
3864953991613,2cyclictest3940612-21systemd-run20:10:020
3864953991613,2cyclictest3885667-21perf19:25:000
3864953991613,2cyclictest2240602-1atopacctd23:00:290
3864953991613,1cyclictest0-21swapper/023:50:010
3864953991612,3cyclictest4120411-21gltestperf22:10:220
3864953991612,3cyclictest118467-21kworker/u16:3+nfsiod00:17:400
3864953991612,2cyclictest3983174-21latency_hist20:45:020
3864953991612,2cyclictest3983174-21latency_hist20:45:010
3864953991611,4cyclictest3995157-21kworker/u16:0-nfsiod21:16:030
414304021511,2sleep30-21swapper/322:21:003
3864955991512,1cyclictest0-21swapper/222:05:222
386495499158,3cyclictest53666-21/usr/sbin/munin23:20:281
3864954991513,1cyclictest9244-21rtkit-daemon19:52:301
3864954991513,1cyclictest3864951-21cyclictest00:17:221
3864954991512,2cyclictest4172756-21cpuspeed22:40:191
3864954991512,2cyclictest3974378-21kthreadcore20:35:261
3864954991512,2cyclictest3926687-21kthreadcore19:55:251
3864954991512,2cyclictest3864951-21cyclictest23:50:081
3864954991512,2cyclictest3864951-21cyclictest19:45:461
3864954991512,2cyclictest3699507-21kworker/u16:0-events_unbound19:40:011
3864954991511,3cyclictest84153-21kworker/u16:1+nfsiod23:40:441
3864954991511,3cyclictest84153-21kworker/u16:1+nfsiod00:02:131
3864954991511,3cyclictest3969339-21kthreadcore20:30:251
3864954991511,3cyclictest3938031-21kthreadcore20:05:241
3864954991511,3cyclictest3881873-21kthreadcore19:20:221
3864954991511,3cyclictest2240602-1atopacctd20:20:251
386495399158,1cyclictest0-21swapper/021:20:250
386495399158,1cyclictest0-21swapper/021:20:240
386495399157,4cyclictest0-21swapper/020:55:190
386495399157,4cyclictest0-21swapper/000:40:000
386495399156,4cyclictest128724-21irqrtprio00:05:230
386495399152,4cyclictest4160943-21sshd22:31:410
386495399151,7cyclictest1-21systemd19:49:590
386495399151,2cyclictest0-21swapper/023:17:550
3864953991512,2cyclictest4110558-21systemd22:05:010
3864953991512,2cyclictest3952499-21systemd-run20:20:000
3864953991512,2cyclictest3933321-21sendmail_mailtr20:00:300
3864953991512,2cyclictest358-21kthreadcore22:50:270
3864953991512,2cyclictest1695-21dbus-daemon22:25:020
3864953991512,2cyclictest0-21swapper/022:40:020
3864953991511,3cyclictest4047508-21kworker/u16:2+nfsiod21:41:260
386495399150,4cyclictest39705-21latency_hist23:15:020
3864955991411,2cyclictest0-21swapper/220:00:212
3864955991411,1cyclictest0-21swapper/219:50:222
3864955991411,1cyclictest0-21swapper/219:45:012
386495499148,2cyclictest178850irq/121-eno100:35:021
3864954991412,1cyclictest0-21swapper/120:30:011
3864954991411,2cyclictest4156001-21irqrtprio22:30:231
3864954991411,2cyclictest4154561-21kworker/u16:1-flush-8:022:55:011
3864954991411,2cyclictest4128398-21acpi22:15:161
3864954991411,2cyclictest3991404-21kthreadcore20:50:241
3864954991411,2cyclictest3868393-21kthreadcore19:10:241
3864954991411,2cyclictest164205-21kthreadcore00:25:261
3864954991411,2cyclictest0-21swapper/119:35:011
3864954991410,3cyclictest4002086-21sh21:00:211
3864954991410,3cyclictest3890597-21latency19:25:241
386495399147,2cyclictest0-21swapper/023:50:180
386495399145,2cyclictest0-21swapper/023:25:060
386495399144,5cyclictest4013322-21latency_hist21:10:020
3864953991411,2cyclictest4001887-21cpuspeed_turbos21:00:190
3864953991411,2cyclictest3943011-21kthreadcore20:10:260
3864953991411,2cyclictest3897962-21latency_hist19:35:020
3864953991411,2cyclictest112556-21kthreadcore23:55:260
3864953991411,2cyclictest0-21swapper/020:30:010
3864953991411,2cyclictest0-21swapper/019:25:260
3864953991410,3cyclictest4075445-21kworker/u16:3+nfsiod21:52:520
3864953991410,3cyclictest3871099-21kworker/u16:1+nfsiod22:16:400
386495399140,4cyclictest154341-21cut00:20:220
386495399140,1cyclictest0-21swapper/019:50:260
386495599137,2cyclictest0-21swapper/221:00:242
386495499139,3cyclictest3984988-21kthreadcore20:45:231
386495499139,3cyclictest3907003-21kthreadcore19:40:231
386495499139,2cyclictest0-21swapper/119:20:021
386495499137,5cyclictest3931773-21tr20:00:251
386495499134,8cyclictest4163350-1ssh22:35:061
3864954991310,2cyclictest4032318-21fschecks_time21:20:211
3864954991310,2cyclictest4032318-21fschecks_time21:20:201
386495499130,8cyclictest3864962-21systemctl19:10:011
3864953991310,2cyclictest3972640-21kthreadcore20:35:240
386495599128,2cyclictest0-21swapper/221:40:242
3864955991210,1cyclictest0-21swapper/222:30:192
386495499123,2cyclictest3940793-21head20:10:191
386495399127,4cyclictest178850irq/121-eno120:50:170
386495399126,4cyclictest3865018-21pluginstate19:10:020
386495399118,2cyclictest3904482-21grep19:40:190
386495599101,7cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional