You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 13:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Thu Nov 27, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3124221660,6sleep22982499cyclictest22:07:588
709921410,1sleep147097-21sshd00:09:526
594121310,0sleep00-21swapper/021:17:070
594121310,0sleep00-21swapper/021:17:070
29136212191,25sleep90-21swapper/919:10:1715
290462121103,12sleep100-21swapper/1019:08:572
28958211189,17sleep10-21swapper/119:08:001
29049211090,16sleep130-21swapper/1319:09:005
1148321090,1sleep30-21swapper/323:25:179
28999210883,19sleep150-21swapper/1519:08:307
28967210685,16sleep80-21swapper/819:08:0714
2459021050,1sleep20-21swapper/222:14:408
29115210390,8sleep50-21swapper/519:09:5711
1520421020,6sleep112983699cyclictest22:51:433
2912321010,2sleep35464-21packagekitd22:45:429
1085721000,0sleep90-21swapper/923:43:3515
1085721000,0sleep90-21swapper/923:43:3515
73682990,1sleep100-21swapper/1021:46:272
2905329884,10sleep00-21swapper/019:09:030
221372980,1sleep3391rcuc/300:07:499
194782980,2sleep30-21swapper/321:25:289
67312970,8sleep62982999cyclictest22:23:4912
127682950,1sleep10-21swapper/122:20:481
63842940,1sleep140-21swapper/1422:54:116
241992940,6sleep02982299cyclictest00:29:100
212552930,0sleep150-21swapper/1521:25:407
58442920,0sleep70-21swapper/723:24:3313
39842920,1sleep23986-21systemd-cgroups21:49:478
133242920,1sleep150-21swapper/1522:28:317
270652900,0sleep120-21swapper/1222:03:204
264622900,1sleep100-21swapper/1021:12:282
264622900,1sleep100-21swapper/1021:12:282
2917728981,4sleep110-21swapper/1119:10:513
209562890,1sleep920954-21sshd22:14:1515
167162890,2sleep110-21swapper/1100:36:023
124212890,2sleep112419-21sshd21:21:091
124212890,2sleep112419-21sshd21:21:091
125532880,2sleep20-21swapper/221:17:418
125532880,2sleep20-21swapper/221:17:418
2916228774,9sleep140-21swapper/1419:10:386
174272870,1sleep417416-21sshd22:21:2310
300992860,1sleep150-21swapper/1521:52:417
239612860,0sleep30-21swapper/321:48:129
208022860,0sleep40-21swapper/421:58:5510
147362850,1sleep10-21swapper/123:40:301
147362850,1sleep10-21swapper/123:40:301
2922828375,4sleep30-21swapper/319:11:319
2909528375,4sleep40-21swapper/419:09:4010
2905928375,4sleep60-21swapper/619:09:0912
2932928275,3sleep20-21swapper/219:12:188
319862810,0sleep150-21swapper/1521:34:297
2904828165,4sleep120-21swapper/1219:08:594
132542810,0sleep10-21swapper/121:36:081
2589028072,4sleep70-21swapper/719:07:3413
188872780,1sleep91-21systemd00:07:3915
84622750,5sleep112983699cyclictest21:32:013
144632680,7sleep62982999cyclictest00:24:2712
245962650,6sleep82983399cyclictest21:48:1714
107822510,1sleep60-21swapper/622:43:2112
1139099500,25rtkit-daemon1068-21dbus-daemon00:21:1313
1139099480,2rtkit-daemon11389-21rtkit-daemon21:16:2013
1139099480,2rtkit-daemon11389-21rtkit-daemon21:16:2013
256542450,12sleep130-21swapper/1300:12:485
29840993917,20cyclictest0-21swapper/1423:12:396
29829993917,19cyclictest0-21swapper/623:12:3912
1139099390,23rtkit-daemon0-21swapper/721:47:1613
2982599381,10cyclictest1350-21nfsd21:32:399
36422370,15sleep20-21swapper/223:53:538
36422370,15sleep20-21swapper/223:53:538
29825993615,3cyclictest827-21nfsd400:37:519
178402360,3sleep102983599cyclictest22:02:292
1139099360,3rtkit-daemon986-21systemctl23:27:4713
84862350,1sleep90-21swapper/921:42:4115
181112340,9sleep618108-21systemd-cgroups22:17:4012
299512330,30sleep31068-21dbus-daemon23:00:589
59072320,1sleep130-21swapper/1300:27:145
251532320,1sleep141291ktimersoftd/1423:19:036
222312320,28sleep150-21swapper/1522:25:527
210942320,2sleep51-21systemd23:48:3511
210942320,2sleep51-21systemd23:48:3511
45782310,2sleep10-21swapper/122:12:311
92262300,23sleep50-21swapper/522:32:0711
302212300,1sleep100-21swapper/1023:53:142
302212300,1sleep100-21swapper/1023:53:142
29825993013,4cyclictest13035-21uname21:17:439
29825993013,4cyclictest13035-21uname21:17:439
223352300,1sleep90-21swapper/923:41:2715
223352300,1sleep90-21swapper/923:41:2715
208492300,26sleep00-21swapper/021:33:110
183912300,1sleep40-21swapper/400:21:1210
1139099300,22rtkit-daemon0-21swapper/719:50:4213
1139099300,0rtkit-daemon0-21swapper/1523:14:177
1139099300,0rtkit-daemon0-21swapper/1522:17:207
58652290,1sleep50-21swapper/521:20:2611
58652290,1sleep50-21swapper/521:20:2611
3702290,1sleep4362-21users22:22:5910
306882290,1sleep20-21swapper/221:45:148
291732290,5sleep52982899cyclictest00:18:3311
193682290,0sleep60-21swapper/621:33:0012
178382290,2sleep140-21swapper/1422:10:206
159822290,1sleep40-21swapper/422:47:5310
159362290,2sleep101072-21ModemManager21:14:372
159362290,2sleep101072-21ModemManager21:14:372
115832290,2sleep110-21swapper/1122:05:443
1139099290,12rtkit-daemon0-21swapper/1500:36:197
1139099290,0rtkit-daemon0-21swapper/723:34:2613
1139099290,0rtkit-daemon0-21swapper/723:34:2613
72762280,24sleep20-21swapper/222:58:008
19482280,1sleep00-21swapper/000:37:590
1139099280,2rtkit-daemon11389-21rtkit-daemon19:18:4313
304562270,2sleep00-21swapper/021:45:130
29839992720,3cyclictest16230-21systemd21:54:475
198792270,1sleep80-21swapper/821:02:5014
188002270,23sleep100-21swapper/1022:59:292
181512270,23sleep20-21swapper/200:28:258
161082270,1sleep80-21swapper/823:10:4014
143462270,1sleep90-21swapper/922:36:1115
135772270,1sleep50-21swapper/500:39:2511
1139099270,0rtkit-daemon0-21swapper/722:42:4113
100542270,23sleep140-21swapper/1421:54:016
76042261,3sleep91245-21gdbus00:38:4115
68942260,1sleep150-21swapper/1523:02:147
60742260,1sleep90-21swapper/923:24:3615
29842992621,3cyclictest21010-21sshd23:22:397
215472260,2sleep11069-21NetworkManager21:25:421
195872260,6sleep112983699cyclictest21:47:483
16572260,0sleep120-21swapper/1223:35:044
16572260,0sleep120-21swapper/1223:35:044
162212260,2sleep1216326-21systemd21:25:064
1139099260,2rtkit-daemon11389-21rtkit-daemon23:12:2613
1139099260,2rtkit-daemon11389-21rtkit-daemon21:58:2213
1139099260,0rtkit-daemon0-21swapper/722:58:4313
7682250,1sleep30-21swapper/300:19:039
303002250,2sleep930421-21sshd21:41:3815
29837992519,4cyclictest18353-21rm23:10:574
2983799251,5cyclictest0-21swapper/1200:22:284
281222250,22sleep20-21swapper/200:41:158
218352250,1sleep110-21swapper/1123:48:423
218352250,1sleep110-21swapper/1123:48:423
216892250,23sleep00-21swapper/019:38:280
213982250,21sleep70-21swapper/700:03:5313
208822250,21sleep00-21swapper/023:30:040
151812250,21sleep110-21swapper/1122:10:013
1139099250,1rtkit-daemon0-21swapper/723:51:477
1139099250,1rtkit-daemon0-21swapper/723:51:477
1139099250,1rtkit-daemon0-21swapper/721:24:0713
103842250,1sleep130-21swapper/1322:47:285
90822240,1sleep31068-21dbus-daemon22:35:339
80162240,0sleep50-21swapper/500:23:3811
45102240,1sleep60-21swapper/621:16:5812
45102240,1sleep60-21swapper/621:16:5812
32112240,1sleep10-21swapper/122:57:431
2982999241,20cyclictest0-21swapper/623:02:3012
2982299240,22cyclictest20654-21kworker/0:021:30:500
296532240,1sleep121131ktimersoftd/1200:37:394
268342240,2sleep21234-21polkitd22:45:268
174332240,1sleep00-21swapper/022:59:180
141542240,2sleep60-21swapper/621:43:1112
1139099240,21rtkit-daemon11389-21rtkit-daemon22:37:267
110822240,2sleep40-21swapper/400:39:0910
105382240,1sleep150-21swapper/1521:57:477
48142230,20sleep120-21swapper/1223:20:384
43812230,0sleep20-21swapper/223:39:118
43812230,0sleep20-21swapper/223:39:118
326662230,4sleep12982399cyclictest00:41:451
29842992318,3cyclictest1068-21dbus-daemon00:27:407
29839992319,2cyclictest1282-21snmpd23:28:195
2983999231,20cyclictest29134-21kworker/13:322:54:035
29837992316,4cyclictest28736-21systemd00:01:084
29833992319,2cyclictest0-21swapper/823:49:2414
29833992319,2cyclictest0-21swapper/823:49:2414
29830992315,3cyclictest31621-21systemd22:11:5613
262862230,20sleep1426440-21sshd21:41:116
221542230,1sleep140-21swapper/1421:59:066
198012230,1sleep40-21swapper/423:18:2210
184252230,0sleep140-21swapper/1421:29:076
173322230,1sleep40-21swapper/421:25:1410
172062230,2sleep20-21swapper/221:02:288
142092230,1sleep6651ktimersoftd/622:13:2312
1139099230,0rtkit-daemon0-21swapper/723:43:3213
1139099230,0rtkit-daemon0-21swapper/723:43:3213
11232230,19sleep120-21swapper/1222:19:234
96072220,18sleep60-21swapper/600:15:5412
319992220,19sleep110-21swapper/1122:27:083
31592220,2sleep83160-21env23:31:4714
29842992217,3cyclictest525-21systemd-journal23:19:177
29833992217,2cyclictest0-21swapper/822:42:3914
29833992215,4cyclictest4990-21sshd23:39:1614
29833992215,4cyclictest4990-21sshd23:39:1614
29833992214,2cyclictest12686-21sshd21:32:2914
2983099221,2cyclictest0-21swapper/719:12:4013
2983099220,19cyclictest9259-21systemctl21:53:5413
2982999220,3cyclictest7621-21sshd22:27:5012
2982999220,3cyclictest0-21swapper/623:41:4912
2982999220,3cyclictest0-21swapper/623:41:4912
2982899220,16cyclictest0-21swapper/522:51:0511
2982599221,19cyclictest1070-21avahi-daemon23:49:279
2982599221,19cyclictest1070-21avahi-daemon23:49:279
29822992216,3cyclictest1233-21gdbus22:14:010
297432220,1sleep20-21swapper/222:57:128
295292220,0sleep130-21swapper/1323:34:335
295292220,0sleep130-21swapper/1323:34:335
275992220,1sleep00-21swapper/021:48:410
269642220,0sleep00-21swapper/000:25:570
252952220,19sleep90-21swapper/900:00:4315
246262220,1sleep10-21swapper/123:15:221
217642220,1sleep10-21swapper/119:39:171
173692220,1sleep60-21swapper/600:03:2012
152172220,2sleep215210-2110-uname22:47:508
133502220,0sleep10-21swapper/121:50:501
1139099220,2rtkit-daemon16916-21systemd-cgroups22:25:1013
1139099220,1rtkit-daemon0-21swapper/723:52:317
1139099220,1rtkit-daemon0-21swapper/723:52:317
1139099220,1rtkit-daemon0-21swapper/720:42:3613
91492210,1sleep80-21swapper/822:20:2414
316512210,1sleep774-21ksoftirqd/722:38:0113
309992210,17sleep10-21swapper/100:05:071
2984299213,15cyclictest525-21systemd-journal23:40:527
2984299213,15cyclictest525-21systemd-journal23:40:527
29842992116,3cyclictest22853-21sshd00:00:237
2984099210,17cyclictest96350irq/41-eth0-TxR00:18:406
2983999211,3cyclictest1-21systemd00:34:475
2983999211,3cyclictest0-21swapper/1300:29:475
29837992115,4cyclictest24211-21uname22:37:264
29837992115,3cyclictest1069-21NetworkManager00:34:394
29835992116,3cyclictest1-21systemd23:07:372
29834992116,3cyclictest22952-21sshd22:29:4615
2983399210,19cyclictest0-21swapper/821:40:0414
2983399210,18cyclictest6591-21sshd00:19:4214
2983099211,3cyclictest13818-21df_inode22:47:4313
2982999212,2cyclictest525-21systemd-journal00:37:5012
29829992115,4cyclictest525-21systemd-journal21:48:1712
2982999210,2cyclictest0-21swapper/622:48:1812
29828992117,2cyclictest1967-21sshd23:42:4111
29828992117,2cyclictest1967-21sshd23:42:4111
29825992114,4cyclictest18457-21sshd21:14:549
29825992114,4cyclictest18457-21sshd21:14:549
2982499214,14cyclictest145-21kauditd21:26:308
29824992116,3cyclictest28254-21grep22:22:418
2982399211,2cyclictest0-21swapper/123:10:551
272892210,0sleep110-21swapper/1123:27:183
267902210,1sleep20-21swapper/200:12:548
255592210,1sleep130-21swapper/1323:11:505
206842210,18sleep140-21swapper/1422:40:496
199542210,1sleep100-21swapper/1021:33:052
195332210,0sleep130-21swapper/1323:52:125
195332210,0sleep130-21swapper/1323:52:125
189382210,7sleep112983699cyclictest22:59:293
149472210,3sleep111-21systemd23:06:593
123232210,17sleep30-21swapper/322:01:519
82722200,0sleep20-21swapper/222:20:178
64902200,1sleep10-21swapper/123:58:101
59832200,1sleep130-21swapper/1320:00:215
2984299200,2cyclictest0-21swapper/1522:06:587
29840992016,2cyclictest0-21swapper/1400:27:466
29840992015,3cyclictest1-21systemd23:51:506
29840992015,3cyclictest1-21systemd23:51:506
29840992014,4cyclictest11508-21systemd23:54:556
29840992014,4cyclictest11508-21systemd23:54:556
29840992014,4cyclictest10281-21systemd21:17:326
29840992014,4cyclictest10281-21systemd21:17:326
29840992014,4cyclictest0-21swapper/1421:36:486
2984099201,3cyclictest5467-21gdbus00:32:406
2984099200,2cyclictest0-21swapper/1400:26:336
2984099200,18cyclictest12016-21sshd22:58:346
2984099200,18cyclictest0-21swapper/1423:23:596
29839992015,3cyclictest5957-21systemd22:31:435
29839992015,3cyclictest16690-21sshd23:03:015
29839992013,5cyclictest3299-21sshd23:20:275
2983999200,18cyclictest7082-21bash21:17:155
2983999200,18cyclictest7082-21bash21:17:155
2983799201,5cyclictest28994-21run-parts23:23:234
2983799201,3cyclictest525-21systemd-journal21:52:284
2983799201,3cyclictest21353-21systemd23:37:294
2983799201,3cyclictest21353-21systemd23:37:294
2983799201,16cyclictest525-21systemd-journal21:16:014
2983799201,16cyclictest525-21systemd-journal21:16:014
2983799201,16cyclictest1-21systemd23:48:284
2983799201,16cyclictest1-21systemd23:48:284
2983799201,16cyclictest1068-21dbus-daemon00:27:074
29836992014,3cyclictest21424-21sshd23:18:343
29835992014,4cyclictest31230-21systemd23:23:402
29835992013,4cyclictest14473-21systemd00:02:592
29834992014,4cyclictest23278-21systemd00:04:0715
29833992015,3cyclictest95850irq/36-eth0-TxR23:32:4114
29833992015,3cyclictest95850irq/36-eth0-TxR23:32:4114
29833992014,4cyclictest7006-21systemd00:31:0714
29833992010,7cyclictest12496-2110-uname22:09:4214
2983399200,17cyclictest28865-21kworker/8:223:03:5614
2983399200,17cyclictest12649-21kworker/8:121:29:0414
2983399200,15cyclictest1068-21dbus-daemon23:42:4014
2983399200,15cyclictest1068-21dbus-daemon23:42:4014
29830992013,4cyclictest25916-21sshd22:30:1013
29830992011,6cyclictest0-21swapper/700:34:0113
29829992015,3cyclictest1032-17auditd23:19:4312
29829992014,4cyclictest17037-21sd-pam22:40:2312
2982999201,3cyclictest18862-21sshd21:40:1512
29829992013,4cyclictest27104-2110-uname21:59:4312
29829992013,4cyclictest12267-21systemd21:54:1612
29829992013,3cyclictest4751-21env21:23:3712
29828992015,3cyclictest20595-21cstates00:32:4211
29828992014,4cyclictest28394-21cp22:26:3811
2982899200,18cyclictest2176-21cp21:52:5911
29827992016,2cyclictest0-21swapper/423:40:5010
29827992016,2cyclictest0-21swapper/423:40:5010
2982599203,14cyclictest59802chrt23:09:309
29825992014,4cyclictest26813-2110-uname00:37:229
29825992014,4cyclictest20982-21sh00:28:449
29825992013,4cyclictest30554-21systemd22:07:539
29824992014,4cyclictest10307-21sh22:35:408
29823992013,4cyclictest17787-21systemd22:40:281
29822992014,3cyclictest1297-21sshd23:42:270
29822992014,3cyclictest1297-21sshd23:42:270
2982299201,3cyclictest2582-21kill23:24:100
2982299201,16cyclictest1297-21sshd22:01:300
2982299200,17cyclictest11299-21kworker/0:323:07:200
276742200,16sleep20-21swapper/223:19:248
265302200,17sleep90-21swapper/923:19:1515
261492200,17sleep1326284-21env21:41:105
218872200,2sleep521886-21sshd23:18:3811
206002200,17sleep00-21swapper/022:52:210
197392200,0sleep120-21swapper/1221:43:484
182662200,1sleep110-21swapper/1123:29:423
173282200,3sleep817333-21run-parts22:06:2814
1139099200,2rtkit-daemon25610-21systemctl22:45:157
1139099200,2rtkit-daemon1068-21dbus-daemon00:26:367
1139099200,1rtkit-daemon0-21swapper/1523:58:4913
1139099200,0rtkit-daemon0-21swapper/1521:02:5713
63842190,0sleep150-21swapper/1523:47:097
63842190,0sleep150-21swapper/1523:47:097
310392190,1sleep30-21swapper/322:27:009
29842991913,4cyclictest8708-21run-parts23:09:487
29842991913,4cyclictest29205-21systemd22:18:507
2984299191,15cyclictest525-21systemd-journal21:16:057
2984299191,15cyclictest525-21systemd-journal21:16:057
2984299190,17cyclictest25232-21sshd23:30:367
2984299190,17cyclictest1348-21nfsd22:51:147
2984299190,17cyclictest1-21systemd00:02:367
29840991914,3cyclictest28629-21systemd-cgroups22:22:416
2984099190,2cyclictest0-21swapper/1423:36:206
2984099190,2cyclictest0-21swapper/1423:36:206
2984099190,2cyclictest0-21swapper/1400:41:396
2984099190,2cyclictest0-21swapper/1400:02:396
2984099190,17cyclictest0-21swapper/1422:18:396
29839991914,3cyclictest4183-21sshd00:38:125
2983999191,3cyclictest1245-21gdbus00:22:255
29839991913,4cyclictest5837-21uname23:58:045
2983999190,4cyclictest8547-21sshd00:10:035
2983999190,1cyclictest0-21swapper/1321:32:325
2983999190,17cyclictest0-21swapper/1323:25:365
2983999190,17cyclictest0-21swapper/1323:13:175
29837991915,2cyclictest0-21swapper/1222:22:594
29837991913,4cyclictest4921-21sshd23:28:054
29837991913,3cyclictest1-21systemd22:39:484
2983799191,2cyclictest0-21swapper/1222:30:254
29836991914,3cyclictest27257-21sshd21:19:123
29836991914,3cyclictest27257-21sshd21:19:123
29836991913,4cyclictest23716-21systemd00:00:293
29836991913,3cyclictest19850-21sh00:25:063
29836991912,4cyclictest27939-21sh21:41:203
29836991912,4cyclictest18010-21sshd21:43:363
2983599191,4cyclictest1238-21gdbus23:37:502
2983599191,4cyclictest1238-21gdbus23:37:502
29835991914,3cyclictest3989-21sshd21:27:342
29835991914,3cyclictest1073-21systemd-logind22:15:512
29835991913,4cyclictest11158-21systemd21:24:272
2983599191,15cyclictest12056-21systemd23:06:372
29834991913,4cyclictest27262-21systemd22:22:3515
29834991913,4cyclictest26531-21sshd22:41:3215
29834991910,3cyclictest1297-21sshd21:24:3815
2983499190,17cyclictest0-21swapper/922:04:0515
2983399199,5cyclictest13476-21systemd23:21:4314
29833991912,4cyclictest2321-21sh00:26:5114
2983399191,15cyclictest1069-21NetworkManager23:24:3614
29833991911,3cyclictest1297-21sshd23:53:4214
29833991911,3cyclictest1297-21sshd23:53:4214
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional