You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 16:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Jun 13, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
286562990,1sleep341-21ksoftirqd/311:41:503
70232870,0sleep00-21swapper/009:45:580
202172830,0sleep02338299cyclictest11:16:240
171312800,0sleep017134-21switchtime09:48:220
5282760,2sleep42338899cyclictest12:27:004
212592710,0sleep1231rcuc/111:33:391
212592710,0sleep1231rcuc/111:33:391
253412690,0sleep30-21swapper/312:20:433
10452690,2sleep22338699cyclictest10:46:392
94642570,0sleep20-21swapper/211:19:392
293012570,0sleep329299-21sshd11:11:073
2308125726,18sleep50-21swapper/507:05:405
2306125727,18sleep70-21swapper/707:05:267
9402550,1sleep6942-21sshd10:31:216
315972540,0sleep50-21swapper/511:46:015
55062530,0sleep70-21swapper/712:25:197
150752510,0sleep40-21swapper/412:00:334
2310025025,8sleep60-21swapper/607:05:576
150482500,0sleep60-21swapper/610:20:406
296142480,1sleep09-21ksoftirqd/010:40:360
26342480,0sleep20-21swapper/212:32:512
254712480,1sleep225469-21grep10:30:532
2297224825,8sleep30-21swapper/307:04:103
144412480,0sleep70-21swapper/709:40:367
144412480,0sleep70-21swapper/709:40:367
131292480,0sleep40-21swapper/409:09:184
124152480,2sleep32338799cyclictest12:29:323
41322460,0sleep50-21swapper/512:19:255
245932460,0sleep50-21swapper/509:33:295
233222460,0sleep50-21swapper/510:17:265
2303624624,8sleep00-21swapper/007:05:030
232132450,0sleep40-21swapper/411:31:584
16322450,2sleep1231rcuc/111:24:501
89572440,0sleep30-21swapper/310:35:343
89572440,0sleep30-21swapper/310:35:343
88642440,0sleep00-21swapper/011:50:200
169512440,0sleep60-21swapper/611:31:366
45422430,0sleep20-21swapper/210:35:172
45422430,0sleep20-21swapper/210:35:172
275972430,0sleep70-21swapper/711:49:317
247532430,1sleep341-21ksoftirqd/312:05:053
165262430,1sleep7721ktimersoftd/710:28:267
92252420,0sleep30-21swapper/310:31:503
310932420,1sleep131090-21sshd09:54:561
198912420,0sleep10-21swapper/110:17:141
195972420,0sleep00-21swapper/010:45:490
28072410,0sleep70-21swapper/710:02:557
169652410,0sleep516964-21systemd-cgroups11:58:425
12922410,0sleep00-21swapper/010:06:320
12532410,0sleep50-21swapper/511:42:085
124312410,0sleep50-21swapper/510:28:165
274762400,0sleep50-21swapper/509:26:005
2300124027,9sleep40-21swapper/407:04:354
221302400,0sleep60-21swapper/612:24:226
163942400,0sleep30-21swapper/310:05:313
110442400,0sleep70-21swapper/710:26:097
10252400,0sleep00-21swapper/011:32:340
98022390,1sleep39800-21kill09:49:533
295312390,0sleep40-21swapper/412:05:224
2321023928,8sleep20-21swapper/207:07:302
2320723927,8sleep10-21swapper/107:07:291
304332380,0sleep10-21swapper/111:18:571
139952360,0sleep20-21swapper/211:58:312
229892280,0sleep00-21swapper/011:03:030
2338899248,4cyclictest49-21ksoftirqd/410:52:064
23388992411,3cyclictest49-21ksoftirqd/409:33:374
2338899237,2cyclictest49-21ksoftirqd/411:40:034
23388992210,3cyclictest49-21ksoftirqd/411:18:344
23388992210,1cyclictest49-21ksoftirqd/412:30:574
23388992210,1cyclictest49-21ksoftirqd/411:23:544
2338899221,2cyclictest49-21ksoftirqd/410:16:214
268152210,0sleep40-21swapper/410:44:164
2338899218,3cyclictest49-21ksoftirqd/412:13:524
2338899218,1cyclictest49-21ksoftirqd/412:20:224
2338899218,1cyclictest49-21ksoftirqd/409:51:504
2338899217,4cyclictest49-21ksoftirqd/410:23:154
2338899217,3cyclictest49-21ksoftirqd/411:53:374
2338899217,3cyclictest49-21ksoftirqd/411:45:504
2338899217,3cyclictest49-21ksoftirqd/409:47:224
2338899217,1cyclictest49-21ksoftirqd/412:08:224
2338899217,1cyclictest49-21ksoftirqd/409:38:424
2338899217,1cyclictest49-21ksoftirqd/409:38:424
23388992111,1cyclictest49-21ksoftirqd/410:57:474
2338899208,3cyclictest49-21ksoftirqd/411:13:464
2338899207,3cyclictest49-21ksoftirqd/409:29:394
2338899207,2cyclictest49-21ksoftirqd/411:37:284
2338899207,2cyclictest49-21ksoftirqd/411:37:284
2338899205,2cyclictest49-21ksoftirqd/410:09:384
2338899204,2cyclictest49-21ksoftirqd/410:38:514
23388992010,1cyclictest49-21ksoftirqd/411:04:094
2338899199,4cyclictest49-21ksoftirqd/411:01:194
2338899199,3cyclictest49-21ksoftirqd/410:01:134
2338899199,1cyclictest49-21ksoftirqd/409:27:374
2338899197,1cyclictest49-21ksoftirqd/411:50:554
2338899196,3cyclictest49-21ksoftirqd/411:10:584
2338899196,3cyclictest49-21ksoftirqd/409:21:084
2338899195,1cyclictest49-21ksoftirqd/409:56:494
2338899194,1cyclictest49-21ksoftirqd/410:07:494
23388991914,1cyclictest49-21ksoftirqd/409:17:344
23388991910,3cyclictest49-21ksoftirqd/410:29:254
2338999183,4cyclictest0-21swapper/509:58:055
2338999180,2cyclictest0-21swapper/509:50:035
2338899188,3cyclictest49-21ksoftirqd/410:19:034
2338899184,1cyclictest49-21ksoftirqd/410:36:314
2338899184,1cyclictest49-21ksoftirqd/410:36:314
2338799180,5cyclictest26495-21sshd09:56:353
23382991816,1cyclictest9-21ksoftirqd/011:04:260
2338999173,1cyclictest8544-21systemd10:05:035
2338999170,2cyclictest0-21swapper/510:51:335
2338899170,2cyclictest828-21sshd12:34:434
2338899170,2cyclictest828-21sshd12:34:434
2338299179,3cyclictest9-21ksoftirqd/012:06:230
23382991715,1cyclictest9-21ksoftirqd/012:36:350
23382991715,1cyclictest9-21ksoftirqd/012:36:350
2338299170,2cyclictest13164-21sshd12:23:470
97412160,0sleep00-21swapper/011:34:580
97412160,0sleep00-21swapper/011:34:580
64952160,0sleep10-21swapper/110:35:241
64952160,0sleep10-21swapper/110:35:241
2338999163,4cyclictest464-21systemd-journal12:31:055
23389991610,5cyclictest32709-21sshd10:21:455
2338999160,3cyclictest0-21swapper/510:26:075
2338799161,2cyclictest0-21swapper/312:26:183
2338799161,1cyclictest8933-21sshd10:52:473
2338799161,1cyclictest0-21swapper/311:56:053
2338799161,1cyclictest0-21swapper/309:33:143
2338799160,5cyclictest25953-21grepconf.sh11:14:473
23382991614,1cyclictest9-21ksoftirqd/010:12:460
23382991610,3cyclictest9-21ksoftirqd/010:19:090
192172160,1sleep5758-21runrttasks09:17:515
137782160,1sleep713754-21sshd09:17:297
93412150,1sleep665-21ksoftirqd/610:24:086
23391991512,1cyclictest73-21ksoftirqd/711:27:247
2338999158,1cyclictest15813-21systemd-cgroups12:04:335
2338999153,2cyclictest28147-21sshd10:36:455
2338999153,2cyclictest28147-21sshd10:36:455
2338999152,1cyclictest10936-21grep11:04:075
2338999151,2cyclictest14450-21bash11:29:255
2338999151,1cyclictest1-21systemd11:27:455
2338999150,4cyclictest709-21systemd-logind12:23:415
2338999150,0cyclictest0-21swapper/509:40:575
2338999150,0cyclictest0-21swapper/509:40:575
2338799152,12cyclictest11673-21grep10:22:293
2338799151,5cyclictest721-21dbus-daemon11:07:253
2338799151,2cyclictest0-21swapper/310:02:403
2338799151,1cyclictest0-21swapper/311:27:453
2338799150,5cyclictest14796-21systemd09:23:173
23386991513,2cyclictest33-21ksoftirqd/211:08:032
23382991513,1cyclictest9-21ksoftirqd/012:29:230
23382991513,1cyclictest9-21ksoftirqd/011:23:240
23382991513,1cyclictest9-21ksoftirqd/010:49:500
23382991513,1cyclictest9-21ksoftirqd/009:18:010
23382991513,1cyclictest9-21ksoftirqd/009:10:160
23382991512,2cyclictest9-21ksoftirqd/009:23:440
23382991511,3cyclictest9-21ksoftirqd/011:58:080
23382991510,3cyclictest9-21ksoftirqd/010:33:450
23382991510,3cyclictest9-21ksoftirqd/010:33:450
116642150,1sleep711663-21id12:33:207
116642150,1sleep711663-21id12:33:207
2339199148,3cyclictest73-21ksoftirqd/711:33:397
2339199148,3cyclictest73-21ksoftirqd/711:33:397
23390991412,1cyclictest65-21ksoftirqd/611:23:136
2339099140,14cyclictest11231-21kworker/6:710:54:316
2339099140,10cyclictest6715-21systemd09:51:376
2338999149,3cyclictest57-21ksoftirqd/510:43:145
2338999143,2cyclictest30922-21sshd11:51:475
2338999143,2cyclictest0-21swapper/512:37:035
2338999143,2cyclictest0-21swapper/512:37:035
2338999143,2cyclictest0-21swapper/512:14:595
23389991412,1cyclictest57-21ksoftirqd/512:08:115
2338999141,1cyclictest859-21gdbus11:55:155
2338999141,1cyclictest12511-21bash11:15:575
2338999140,4cyclictest0-21swapper/510:57:415
2338999140,1cyclictest0-21swapper/509:53:315
2338799141,2cyclictest0-21swapper/311:00:293
2338799141,1cyclictest41-21ksoftirqd/310:13:543
2338799141,1cyclictest1-21systemd09:13:503
2338799141,1cyclictest0-21swapper/309:46:103
2338799140,5cyclictest18658-21sshd10:38:063
2338799140,3cyclictest17721-21systemd09:21:383
2338799140,2cyclictest0-21swapper/310:09:303
2338799140,1cyclictest8497-21sshd09:11:213
2338699142,11cyclictest32170-21systemd12:15:222
2338699142,11cyclictest11999-21sshd12:23:432
23386991410,1cyclictest33-21ksoftirqd/211:27:242
2338299149,2cyclictest9-21ksoftirqd/009:19:470
23382991413,1cyclictest9-21ksoftirqd/011:46:320
23382991412,1cyclictest9-21ksoftirqd/012:08:090
23382991412,1cyclictest9-21ksoftirqd/011:08:140
23382991412,1cyclictest9-21ksoftirqd/010:16:180
23382991412,1cyclictest9-21ksoftirqd/009:41:190
23382991412,1cyclictest9-21ksoftirqd/009:41:190
23382991410,3cyclictest9-21ksoftirqd/011:20:390
23382991410,3cyclictest9-21ksoftirqd/009:32:450
137942140,0sleep70-21swapper/710:35:557
137942140,0sleep70-21swapper/710:35:557
294442130,0sleep10-21swapper/110:10:021
2339199139,4cyclictest73-21ksoftirqd/709:27:307
23390991311,1cyclictest65-21ksoftirqd/612:02:516
23390991311,1cyclictest65-21ksoftirqd/611:43:156
23390991311,1cyclictest65-21ksoftirqd/610:10:506
2338999133,1cyclictest0-21swapper/509:47:415
2338999132,2cyclictest0-21swapper/511:18:575
2338999132,1cyclictest464-21systemd-journal11:33:155
2338999132,1cyclictest464-21systemd-journal11:33:155
2338999132,1cyclictest16690-21sshd11:02:415
2338999130,2cyclictest464-21systemd-journal10:09:275
2338799131,4cyclictest0-21swapper/312:35:513
2338799131,4cyclictest0-21swapper/312:35:513
2338799131,4cyclictest0-21swapper/309:29:203
2338799131,3cyclictest0-21swapper/311:45:533
2338799131,2cyclictest6992-21sshd10:56:263
2338799131,2cyclictest0-21swapper/312:14:013
2338799131,2cyclictest0-21swapper/310:45:173
2338799131,1cyclictest0-21swapper/312:10:003
2338799131,1cyclictest0-21swapper/311:49:523
2338799130,6cyclictest20514-21grepconf.sh11:33:373
2338799130,6cyclictest20514-21grepconf.sh11:33:373
2338799130,5cyclictest15732-21sshd12:00:363
2338799130,3cyclictest1-21systemd11:22:333
2338799130,1cyclictest0-21swapper/311:29:183
2338799130,1cyclictest0-21swapper/310:26:093
2338699133,4cyclictest14083-21sshd10:09:052
23386991311,1cyclictest12704-21systemd09:15:312
23383991311,1cyclictest25-21ksoftirqd/110:30:181
2338299139,3cyclictest9-21ksoftirqd/010:24:540
2338299139,1cyclictest9-21ksoftirqd/011:55:020
2338299132,5cyclictest8295-21sshd12:19:420
23382991311,1cyclictest9-21ksoftirqd/012:13:420
23382991311,1cyclictest9-21ksoftirqd/011:40:060
23382991311,1cyclictest9-21ksoftirqd/010:54:560
23382991311,1cyclictest9-21ksoftirqd/009:58:160
23382991311,1cyclictest9-21ksoftirqd/009:54:220
23382991311,1cyclictest9-21ksoftirqd/009:33:100
254212120,0sleep70-21swapper/711:45:397
2339199128,3cyclictest73-21ksoftirqd/712:05:187
2339199126,3cyclictest73-21ksoftirqd/711:02:377
2339199125,4cyclictest709-21systemd-logind09:50:467
2339199120,11cyclictest21136-21kworker/7:411:22:447
2339199120,1cyclictest0-21swapper/709:37:457
2339099125,6cyclictest721-21dbus-daemon10:07:256
23390991211,1cyclictest65-21ksoftirqd/611:17:506
23390991211,1cyclictest65-21ksoftirqd/609:57:466
23390991210,1cyclictest65-21ksoftirqd/611:54:576
2338999120,3cyclictest0-21swapper/510:38:495
2338999120,3cyclictest0-21swapper/508:49:275
2338999120,3cyclictest0-21swapper/508:03:135
2338999120,3cyclictest0-21swapper/507:48:135
2338999120,1cyclictest1519-21systemd-cgroups09:28:175
2338999120,1cyclictest0-21swapper/508:53:395
2338999120,0cyclictest0-21swapper/511:09:535
2338999120,0cyclictest0-21swapper/509:19:015
2338999120,0cyclictest0-21swapper/509:11:575
2338799121,1cyclictest0-21swapper/309:38:413
2338799121,1cyclictest0-21swapper/309:38:413
2338699124,7cyclictest1-21systemd12:09:282
2338699123,4cyclictest721-21dbus-daemon09:23:532
2338699122,4cyclictest709-21systemd-logind09:50:442
2338699122,4cyclictest23736-21bash10:51:442
2338699122,4cyclictest0-21swapper/209:53:312
2338699122,4cyclictest0-21swapper/209:35:132
2338699121,5cyclictest16307-21bash09:19:302
2338699120,5cyclictest12506-21bash11:31:202
2338699120,12cyclictest23633-21kworker/2:010:02:212
2338399124,5cyclictest8803-21bash11:00:151
23383991210,1cyclictest859-21gdbus12:08:111
2338399120,12cyclictest10605-21kworker/1:609:34:421
23382991210,1cyclictest9-21ksoftirqd/010:28:090
161412120,0sleep10-21swapper/110:26:271
2339199119,1cyclictest73-21ksoftirqd/711:39:077
2339199119,1cyclictest73-21ksoftirqd/709:31:557
2339199115,4cyclictest888-21sshd10:54:057
2339199114,4cyclictest2901-21sshd12:11:447
2339199113,5cyclictest15311-21bash12:02:327
2339199110,1cyclictest22978-21systemd-cgroups10:03:587
2339099119,1cyclictest65-21ksoftirqd/611:42:036
2339099119,1cyclictest65-21ksoftirqd/611:19:236
2339099119,1cyclictest65-21ksoftirqd/610:58:356
2339099119,1cyclictest65-21ksoftirqd/609:46:056
2339099119,1cyclictest65-21ksoftirqd/609:38:156
2339099119,1cyclictest65-21ksoftirqd/609:38:156
2339099119,1cyclictest65-21ksoftirqd/609:13:486
2339099118,2cyclictest65-21ksoftirqd/612:33:136
2339099118,2cyclictest65-21ksoftirqd/612:33:136
2339099117,1cyclictest65-21ksoftirqd/610:52:136
2339099117,1cyclictest15-21kswork12:15:176
2339099115,4cyclictest23942-21bash11:37:446
2339099115,4cyclictest23942-21bash11:37:446
2339099115,3cyclictest6407-21systemd11:03:516
2339099113,5cyclictest10742-21systemd12:10:036
23390991110,1cyclictest65-21ksoftirqd/611:10:536
2339099110,10cyclictest21541-21systemd-cgroups09:35:136
2339099110,10cyclictest2152-21bash10:38:596
2338999113,8cyclictest0-21swapper/509:01:315
2338999110,2cyclictest0-21swapper/508:33:235
2338999110,2cyclictest0-21swapper/508:33:235
2338999110,2cyclictest0-21swapper/508:18:155
2338999110,2cyclictest0-21swapper/507:24:215
2338999110,0cyclictest0-21swapper/508:44:055
2338999110,0cyclictest0-21swapper/508:13:135
2338899119,1cyclictest49-21ksoftirqd/408:08:034
2338899113,1cyclictest49-21ksoftirqd/407:53:154
2338699119,1cyclictest33-21ksoftirqd/210:27:082
2338699119,1cyclictest33-21ksoftirqd/210:03:232
2338699114,1cyclictest730-21NetworkManager09:40:122
2338699114,1cyclictest730-21NetworkManager09:40:122
2338699113,7cyclictest1-21systemd11:13:352
2338699112,4cyclictest26089-21sshd11:39:442
2338699112,4cyclictest21257-21sshd09:09:542
2338699112,4cyclictest10641-21systemd10:58:272
2338699111,4cyclictest6236-21sshd12:07:512
2338699111,4cyclictest17190-21systemd-cgroups10:18:522
2338699110,5cyclictest721-21dbus-daemon11:45:272
2338699110,11cyclictest534-21kworker/2:212:37:052
2338699110,11cyclictest534-21kworker/2:212:37:052
2338699110,11cyclictest26688-21kworker/2:609:44:372
2338699110,11cyclictest21327-21kworker/2:011:34:572
2338699110,11cyclictest21327-21kworker/2:011:34:572
2338399119,1cyclictest25-21ksoftirqd/110:43:151
2338399119,1cyclictest25-21ksoftirqd/109:22:341
2338399119,1cyclictest20806-21sd-pam11:53:051
2338399117,1cyclictest25-21ksoftirqd/110:57:111
2338399111,4cyclictest0-21swapper/109:38:271
2338399111,4cyclictest0-21swapper/109:38:271
2338399110,1cyclictest22819-21bash10:02:091
2338399110,1cyclictest22450-21sshd11:16:341
23362110,0sleep70-21swapper/710:08:237
2339199109,1cyclictest73-21ksoftirqd/712:15:257
2339199108,1cyclictest73-21ksoftirqd/711:56:387
2339199108,1cyclictest73-21ksoftirqd/711:28:177
2339199108,1cyclictest73-21ksoftirqd/711:07:347
2339199104,3cyclictest709-21systemd-logind10:39:487
2339199103,4cyclictest18211-21systemd12:28:047
2339199102,5cyclictest721-21dbus-daemon11:08:597
2339199100,9cyclictest27463-21kworker/7:009:08:157
2339199100,9cyclictest13888-21kworker/7:410:48:167
2339199100,2cyclictest13411-21grepconf.sh09:55:497
2339199100,10cyclictest29515-21sshd09:43:287
2339199100,10cyclictest0-21swapper/711:17:167
2339099108,1cyclictest65-21ksoftirqd/611:49:036
2339099107,3cyclictest65-21ksoftirqd/612:21:536
2339099107,2cyclictest65-21ksoftirqd/609:12:476
2339099106,1cyclictest29337-21sshd10:36:506
2339099106,1cyclictest29337-21sshd10:36:506
2339099105,3cyclictest65-21ksoftirqd/609:20:106
2339099103,5cyclictest8237-21sshd10:45:076
2339099102,5cyclictest0-21swapper/609:59:326
2339099102,4cyclictest22210-21grep12:28:156
2339099100,7cyclictest7867-21systemd10:14:336
2339099100,5cyclictest14344-21rm09:31:006
2338999103,0cyclictest0-21swapper/507:12:335
2338999102,2cyclictest0-21swapper/507:38:315
2338999100,9cyclictest0-21swapper/508:27:495
2338999100,9cyclictest0-21swapper/508:08:255
2338999100,9cyclictest0-21swapper/507:14:595
2338999100,9cyclictest0-21swapper/507:14:595
2338999100,4cyclictest0-21swapper/507:53:395
2338999100,2cyclictest25731-21irqstats09:03:195
2338999100,10cyclictest0-21swapper/508:01:455
2338999100,1cyclictest0-21swapper/508:30:235
2338999100,0cyclictest0-21swapper/507:30:035
2338899109,1cyclictest49-21ksoftirqd/408:28:154
2338899108,1cyclictest49-21ksoftirqd/409:08:034
2338899108,1cyclictest49-21ksoftirqd/408:43:164
2338899108,1cyclictest49-21ksoftirqd/407:38:024
2338899108,1cyclictest49-21ksoftirqd/407:28:164
2338799101,3cyclictest41-21ksoftirqd/308:33:233
2338799101,3cyclictest41-21ksoftirqd/308:33:233
2338699109,1cyclictest33-21ksoftirqd/210:56:282
2338699103,1cyclictest27195-21sshd11:55:202
2338699100,4cyclictest721-21dbus-daemon10:40:052
2338699100,4cyclictest30764-21sshd12:19:032
2338699100,4cyclictest0-21swapper/211:03:202
2338699100,10cyclictest23633-21kworker/2:010:13:282
2338699100,10cyclictest0-21swapper/209:28:162
2338399109,1cyclictest0-21swapper/112:18:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional