You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 16:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Mar 10, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2572421010,0sleep3401ktimersoftd/311:54:433
78192550,2sleep3540299cyclictest11:48:103
318542530,0sleep40-21swapper/409:54:224
129682530,0sleep20-21swapper/209:35:062
118242520,1sleep0686-21dbus-daemon11:21:000
118242520,1sleep0686-21dbus-daemon11:21:000
272482510,2sleep4540399cyclictest12:09:334
505625025,9sleep70-21swapper/707:04:187
316522490,1sleep231651-21sshd09:41:392
504024827,18sleep00-21swapper/007:04:030
298452480,0sleep50-21swapper/511:34:515
278282480,0sleep10-21swapper/112:18:441
210822480,2sleep3540299cyclictest10:26:413
84832470,1sleep78473-21bash11:28:047
197242470,0sleep10-21swapper/109:19:031
153572470,0sleep215358-21sshd09:57:082
283072460,0sleep70-21swapper/709:48:417
225512460,0sleep30-21swapper/312:05:403
313882450,1sleep031390-21bash11:14:430
271382450,0sleep70-21swapper/712:24:107
271382450,0sleep70-21swapper/712:24:107
246972450,0sleep40-21swapper/412:14:544
144872450,0sleep40-21swapper/410:26:184
45002440,0sleep10-21swapper/111:04:031
150402440,1sleep2492-21systemd-journal11:19:182
150402440,1sleep2492-21systemd-journal11:19:182
63252430,0sleep10-21swapper/111:11:321
513024334,2sleep50-21swapper/507:05:205
260452430,0sleep40-21swapper/411:54:444
24862420,0sleep00-21swapper/008:52:200
178472420,0sleep30-21swapper/310:00:543
513924129,8sleep10-21swapper/107:05:241
511024129,8sleep30-21swapper/307:05:023
504424129,9sleep40-21swapper/407:04:074
304782410,2sleep1540099cyclictest12:02:181
132382410,1sleep2686-21dbus-daemon09:15:042
120292410,0sleep50-21swapper/511:57:335
86302400,1sleep28631-21grep10:02:132
62422400,0sleep20-21swapper/212:02:432
51522400,0sleep30-21swapper/311:04:053
299582400,0sleep10-21swapper/111:27:261
501023926,9sleep60-21swapper/607:03:366
496623928,8sleep20-21swapper/207:03:002
275392390,0sleep30-21swapper/309:15:533
163262380,0sleep10-21swapper/110:11:491
100322380,0sleep10-21swapper/112:15:551
16062370,0sleep00-21swapper/011:31:250
108052370,0sleep20-21swapper/209:20:242
97682360,0sleep40-21swapper/411:06:144
309482360,2sleep0539999cyclictest09:23:190
222082360,0sleep70-21swapper/710:24:537
324052300,0sleep60-21swapper/612:09:526
249522270,0sleep20-21swapper/211:16:132
5400992315,3cyclictest25-21ksoftirqd/112:10:341
5400992112,1cyclictest131rcu_sched12:36:311
5400992015,3cyclictest25-21ksoftirqd/111:53:221
540099200,1cyclictest131rcu_sched09:53:151
5404991917,1cyclictest57-21ksoftirqd/511:50:435
5404991916,1cyclictest57-21ksoftirqd/509:52:155
5403991915,1cyclictest49-21ksoftirqd/412:21:004
5403991913,3cyclictest49-21ksoftirqd/409:27:334
5400991915,3cyclictest25-21ksoftirqd/111:13:181
118382190,0sleep00-21swapper/010:46:160
5404991816,1cyclictest9111-21kworker/5:310:31:485
5404991815,1cyclictest57-21ksoftirqd/511:01:405
5404991811,5cyclictest57-21ksoftirqd/510:02:025
5404991810,3cyclictest57-21ksoftirqd/511:22:225
5403991816,1cyclictest49-21ksoftirqd/411:38:514
5403991816,1cyclictest49-21ksoftirqd/410:55:204
5403991816,1cyclictest49-21ksoftirqd/409:42:384
540399180,1cyclictest131rcu_sched10:02:364
5400991816,1cyclictest25-21ksoftirqd/111:23:241
5400991816,1cyclictest25-21ksoftirqd/111:21:341
5400991816,1cyclictest25-21ksoftirqd/111:21:341
5400991816,1cyclictest25-21ksoftirqd/109:47:301
5400991815,1cyclictest25-21ksoftirqd/111:47:221
5400991815,1cyclictest25-21ksoftirqd/110:22:061
286442180,6sleep428902-21grepconf.sh11:49:244
5412991714,3cyclictest65-21ksoftirqd/610:28:386
540499177,5cyclictest57-21ksoftirqd/511:31:285
5404991715,1cyclictest57-21ksoftirqd/512:28:225
5404991715,1cyclictest57-21ksoftirqd/510:12:455
5404991715,1cyclictest57-21ksoftirqd/509:21:135
5404991714,1cyclictest57-21ksoftirqd/509:39:335
5404991713,3cyclictest492-21systemd-journal10:52:455
540499170,1cyclictest121rcu_preempt10:26:345
5403991715,2cyclictest49-21ksoftirqd/410:35:594
5403991715,2cyclictest49-21ksoftirqd/410:35:594
5403991715,1cyclictest49-21ksoftirqd/411:27:554
5403991715,1cyclictest49-21ksoftirqd/411:17:024
5403991715,1cyclictest49-21ksoftirqd/410:49:344
5403991715,1cyclictest49-21ksoftirqd/410:12:034
5403991715,1cyclictest49-21ksoftirqd/409:57:174
5403991715,1cyclictest49-21ksoftirqd/409:37:144
5403991715,1cyclictest24389-21kworker/4:411:42:084
5403991714,1cyclictest49-21ksoftirqd/411:21:304
5403991714,1cyclictest49-21ksoftirqd/411:21:304
5403991712,4cyclictest49-21ksoftirqd/410:37:574
5400991716,1cyclictest25-21ksoftirqd/110:48:131
5400991716,1cyclictest25-21ksoftirqd/109:28:511
5400991716,1cyclictest25-21ksoftirqd/109:11:001
5400991716,1cyclictest16325-21kworker/1:510:32:231
5400991716,1cyclictest16325-21kworker/1:510:32:231
5400991715,1cyclictest25-21ksoftirqd/112:28:191
5400991715,1cyclictest25-21ksoftirqd/110:52:081
5400991715,1cyclictest25-21ksoftirqd/110:42:211
5400991715,1cyclictest25-21ksoftirqd/110:37:411
5400991715,1cyclictest25-21ksoftirqd/110:27:191
5400991715,1cyclictest25-21ksoftirqd/110:17:151
5400991715,1cyclictest25-21ksoftirqd/110:12:271
5400991715,1cyclictest25-21ksoftirqd/110:00:251
5400991715,1cyclictest25-21ksoftirqd/109:40:321
5400991715,1cyclictest25-21ksoftirqd/109:22:151
5400991715,1cyclictest25-21ksoftirqd/109:13:591
5400991714,1cyclictest686-21dbus-daemon10:02:511
5400991714,1cyclictest25-21ksoftirqd/111:40:151
5400991712,2cyclictest25-21ksoftirqd/109:32:161
540099170,4cyclictest25-21ksoftirqd/111:01:511
540099170,16cyclictest16356-21kworker/1:511:58:361
5399991715,1cyclictest9-21ksoftirqd/010:16:340
5412991614,1cyclictest691-21systemd-logind12:25:376
5412991614,1cyclictest691-21systemd-logind12:25:376
540499165,7cyclictest57-21ksoftirqd/511:09:265
5404991614,1cyclictest57-21ksoftirqd/512:33:375
5404991614,1cyclictest57-21ksoftirqd/512:04:075
5404991614,1cyclictest57-21ksoftirqd/511:04:185
5404991614,1cyclictest57-21ksoftirqd/509:49:545
5404991614,1cyclictest57-21ksoftirqd/509:29:325
5404991610,3cyclictest57-21ksoftirqd/509:09:185
540499161,1cyclictest121rcu_preempt10:51:565
540499160,1cyclictest131rcu_sched11:19:155
540499160,1cyclictest131rcu_sched11:19:155
540499160,1cyclictest0-21swapper/511:13:285
540499160,0cyclictest121rcu_preempt12:12:055
5403991615,1cyclictest49-21ksoftirqd/410:31:424
5403991615,1cyclictest49-21ksoftirqd/409:33:414
5403991615,1cyclictest49-21ksoftirqd/409:23:474
5403991615,1cyclictest49-21ksoftirqd/409:21:384
5403991614,1cyclictest49-21ksoftirqd/412:23:544
5403991614,1cyclictest49-21ksoftirqd/412:23:544
5403991614,1cyclictest49-21ksoftirqd/411:33:164
5403991614,1cyclictest49-21ksoftirqd/411:22:324
5403991614,1cyclictest49-21ksoftirqd/411:09:534
5403991614,1cyclictest49-21ksoftirqd/410:42:184
5403991614,1cyclictest49-21ksoftirqd/409:50:594
5403991612,3cyclictest49-21ksoftirqd/409:10:044
540399161,2cyclictest49-21ksoftirqd/412:04:164
540299169,6cyclictest7655-21sshd10:35:013
540299169,6cyclictest7655-21sshd10:35:013
5401991616,0cyclictest0-21swapper/210:23:442
5400991614,1cyclictest25-21ksoftirqd/111:42:501
5400991614,1cyclictest25-21ksoftirqd/111:33:091
5399991614,1cyclictest9-21ksoftirqd/011:23:400
5399991614,1cyclictest28830-21kworker/0:410:24:380
539999160,15cyclictest4595-21kworker/0:510:07:240
237142160,2sleep7541399cyclictest09:39:207
231822160,0sleep20-21swapper/210:28:322
5404991514,1cyclictest57-21ksoftirqd/510:38:045
5404991514,1cyclictest57-21ksoftirqd/510:20:375
5404991513,2cyclictest57-21ksoftirqd/512:24:335
5404991513,2cyclictest57-21ksoftirqd/512:24:335
5404991513,2cyclictest57-21ksoftirqd/510:07:275
5404991513,1cyclictest57-21ksoftirqd/512:18:465
5404991513,1cyclictest57-21ksoftirqd/512:09:065
5404991513,1cyclictest57-21ksoftirqd/511:39:495
5404991513,1cyclictest57-21ksoftirqd/509:42:515
5404991513,1cyclictest57-21ksoftirqd/509:34:515
5404991513,1cyclictest57-21ksoftirqd/509:22:245
5404991512,2cyclictest57-21ksoftirqd/510:43:435
540499151,2cyclictest131rcu_sched09:13:065
5403991514,1cyclictest49-21ksoftirqd/410:17:134
5403991513,1cyclictest49-21ksoftirqd/411:58:074
5403991513,1cyclictest49-21ksoftirqd/409:16:424
5403991513,1cyclictest32656-21kworker/4:112:33:584
5403991512,2cyclictest49-21ksoftirqd/412:29:554
540399151,2cyclictest131rcu_sched10:59:004
5400991513,1cyclictest25-21ksoftirqd/112:22:361
5400991513,1cyclictest25-21ksoftirqd/112:22:361
5400991513,1cyclictest25-21ksoftirqd/109:42:191
539999157,3cyclictest9-21ksoftirqd/012:28:270
5399991514,1cyclictest9-21ksoftirqd/011:47:140
5399991514,1cyclictest1-21systemd12:09:180
5399991513,1cyclictest9-21ksoftirqd/009:40:310
5399991512,2cyclictest1-21systemd10:40:500
5399991512,1cyclictest1-21systemd11:03:060
5399991510,5cyclictest9-21ksoftirqd/009:52:300
296472150,0sleep00-21swapper/010:30:460
282052150,0sleep20-21swapper/210:58:032
188772150,1sleep665-21ksoftirqd/609:13:326
5412991413,1cyclictest65-21ksoftirqd/611:11:286
5412991413,1cyclictest65-21ksoftirqd/610:12:536
5412991412,1cyclictest65-21ksoftirqd/611:47:376
5412991412,1cyclictest65-21ksoftirqd/611:35:376
5412991412,1cyclictest65-21ksoftirqd/609:53:436
5404991413,1cyclictest57-21ksoftirqd/510:35:285
5404991413,1cyclictest57-21ksoftirqd/510:35:285
5404991413,1cyclictest57-21ksoftirqd/510:02:225
5404991412,1cyclictest57-21ksoftirqd/511:42:135
5404991410,2cyclictest57-21ksoftirqd/511:53:195
5403991412,1cyclictest49-21ksoftirqd/410:07:274
540299144,4cyclictest885-21polkitd09:20:363
5402991412,1cyclictest41-21ksoftirqd/310:17:443
540299140,1cyclictest0-21swapper/310:48:533
5401991412,1cyclictest33-21ksoftirqd/211:27:202
5399991412,2cyclictest20028-21kworker/0:209:33:400
5399991412,2cyclictest11384-21kworker/u16:409:49:020
5399991412,1cyclictest9-21ksoftirqd/012:35:150
5399991412,1cyclictest9-21ksoftirqd/012:23:570
5399991412,1cyclictest9-21ksoftirqd/012:23:570
5399991412,1cyclictest9-21ksoftirqd/012:20:490
5399991412,1cyclictest9-21ksoftirqd/009:18:430
5399991412,1cyclictest9-21ksoftirqd/009:13:220
5399991411,2cyclictest21369-21systemd-cgroups12:03:400
5399991411,1cyclictest23070-21kworker/u16:110:48:400
5399991410,2cyclictest27656-21kworker/u16:011:00:080
3352140,0sleep70-21swapper/711:38:377
17542140,0sleep20-21swapper/212:17:162
168722140,0sleep20-21swapper/210:09:582
6362130,0sleep60-21swapper/610:36:296
6362130,0sleep60-21swapper/610:36:296
5413991311,1cyclictest73-21ksoftirqd/709:45:167
5413991311,1cyclictest73-21ksoftirqd/709:16:547
5413991310,2cyclictest73-21ksoftirqd/710:53:187
541299139,3cyclictest65-21ksoftirqd/611:58:086
541299139,3cyclictest65-21ksoftirqd/609:45:036
541299137,3cyclictest885-21polkitd12:17:226
5412991311,1cyclictest65-21ksoftirqd/611:30:496
5412991311,1cyclictest65-21ksoftirqd/611:18:266
5412991311,1cyclictest65-21ksoftirqd/611:18:266
5412991311,1cyclictest65-21ksoftirqd/610:48:236
5412991311,1cyclictest65-21ksoftirqd/609:40:196
540299135,7cyclictest6721-21sshd12:21:163
540299134,3cyclictest18548-21sshd10:46:393
540299134,2cyclictest29060-21sshd09:25:043
540299133,2cyclictest24574-21id11:23:293
5402991311,1cyclictest492-21systemd-journal09:11:213
540199134,4cyclictest492-21systemd-journal09:26:532
5401991311,1cyclictest33-21ksoftirqd/211:59:232
539999139,1cyclictest5969-21kworker/u16:109:30:360
5399991312,1cyclictest9-21ksoftirqd/011:39:430
5399991312,1cyclictest9-21ksoftirqd/009:10:090
5399991311,1cyclictest9-21ksoftirqd/012:12:250
5399991311,1cyclictest9-21ksoftirqd/011:59:530
5399991311,1cyclictest9-21ksoftirqd/011:33:330
5399991311,1cyclictest9-21ksoftirqd/011:07:300
5399991311,1cyclictest9-21ksoftirqd/010:55:010
35722130,0sleep7721ktimersoftd/711:09:307
34142130,0sleep60-21swapper/612:28:186
196552130,0sleep20-21swapper/209:07:352
168232130,0sleep216821-21sshd10:55:392
144472130,0sleep30-21swapper/312:23:263
144472130,0sleep30-21swapper/312:23:263
541399124,5cyclictest13710-21sshd09:33:167
541399124,4cyclictest1033-21bash09:19:517
541399123,5cyclictest9243-21sshd11:53:457
541399123,4cyclictest797-21sshd11:01:477
5413991211,1cyclictest73-21ksoftirqd/712:00:117
5413991210,1cyclictest73-21ksoftirqd/711:16:497
5413991210,1cyclictest73-21ksoftirqd/710:34:277
5413991210,1cyclictest73-21ksoftirqd/710:34:277
5413991210,1cyclictest73-21ksoftirqd/709:57:347
5413991210,1cyclictest73-21ksoftirqd/709:52:427
5413991210,1cyclictest21956-21systemd-cgroups11:23:207
541399120,11cyclictest6096-21sshd11:44:277
541299128,1cyclictest65-21ksoftirqd/610:25:426
5412991211,1cyclictest65-21ksoftirqd/612:04:336
5412991211,1cyclictest65-21ksoftirqd/611:46:306
5412991211,1cyclictest65-21ksoftirqd/611:03:416
5412991211,1cyclictest65-21ksoftirqd/609:23:246
5412991210,1cyclictest65-21ksoftirqd/612:34:086
5412991210,1cyclictest65-21ksoftirqd/612:13:026
5412991210,1cyclictest65-21ksoftirqd/609:19:116
5412991210,1cyclictest65-21ksoftirqd/609:07:496
541299121,4cyclictest0-21swapper/610:38:376
540299124,7cyclictest7113-21id10:58:423
540299124,7cyclictest17565-21grepconf.sh09:48:033
540299124,2cyclictest6269-21grep12:13:493
540299124,2cyclictest29553-21bash09:47:003
540299124,2cyclictest26386-21bash11:12:333
540299124,2cyclictest19116-21grep12:07:173
540299124,2cyclictest17942-21grep09:37:143
540299123,3cyclictest11939-21sshd11:17:193
540299123,3cyclictest11939-21sshd11:17:193
540299123,2cyclictest691-21systemd-logind10:55:133
540299123,2cyclictest691-21systemd-logind10:28:233
540299123,2cyclictest3263-21sshd09:32:393
540299122,2cyclictest885-21polkitd11:32:263
540299120,4cyclictest0-21swapper/311:43:283
540299120,3cyclictest27089-21sshd11:58:263
540299120,2cyclictest20400-21grepconf.sh11:08:353
540199122,4cyclictest30458-21sshd12:09:452
540199122,4cyclictest13752-21sshd11:33:542
5401991210,1cyclictest33-21ksoftirqd/211:24:352
540199120,11cyclictest21307-21rm09:52:012
540199120,11cyclictest10693-21kworker/2:410:17:352
5399991210,1cyclictest9-21ksoftirqd/010:20:200
90782110,0sleep20-21swapper/211:07:572
541399119,1cyclictest73-21ksoftirqd/712:10:367
541399119,1cyclictest73-21ksoftirqd/709:27:307
541399116,2cyclictest28912-21kill10:05:097
541399114,4cyclictest32493-21sshd10:18:067
5413991110,1cyclictest73-21ksoftirqd/712:17:207
541399110,1cyclictest29698-21sshd11:34:507
541299119,1cyclictest65-21ksoftirqd/611:55:036
541299119,1cyclictest65-21ksoftirqd/610:56:196
541299119,1cyclictest65-21ksoftirqd/610:42:246
541299119,1cyclictest65-21ksoftirqd/610:11:586
541299119,1cyclictest65-21ksoftirqd/610:04:186
541299117,3cyclictest65-21ksoftirqd/609:59:126
541299113,4cyclictest3005-21hddtemp_smartct09:27:156
5412991110,1cyclictest65-21ksoftirqd/611:38:326
5412991110,1cyclictest65-21ksoftirqd/609:33:026
541299110,10cyclictest0-21swapper/610:20:526
541299110,1cyclictest0-21swapper/611:23:466
541299110,1cyclictest0-21swapper/610:57:266
540299114,2cyclictest21740-21sshd12:27:293
540299114,2cyclictest12604-21grepconf.sh10:02:223
540299113,2cyclictest691-21systemd-logind10:37:503
540299113,2cyclictest30678-21awk07:47:233
540299113,2cyclictest30678-21awk07:47:233
540299113,2cyclictest27380-21sshd09:28:353
540299113,2cyclictest25664-21bash10:08:363
540299113,2cyclictest23048-21bash09:52:063
540299113,2cyclictest15416-21bash11:28:283
5402991110,1cyclictest41-21ksoftirqd/311:37:043
540299111,4cyclictest0-21swapper/310:12:083
540299110,10cyclictest686-21dbus-daemon12:32:173
540199114,6cyclictest0-21swapper/211:04:162
540199112,5cyclictest22786-21systemd09:52:052
540199112,4cyclictest0-21swapper/211:45:372
540199112,3cyclictest4257-21sshd11:55:212
540199111,4cyclictest0-21swapper/211:50:022
540199111,4cyclictest0-21swapper/210:14:442
540199110,5cyclictest686-21dbus-daemon10:43:442
540199110,5cyclictest5062-21grepconf.sh10:38:302
540199110,5cyclictest25023-21kill09:28:272
540199110,11cyclictest9402-21kworker/2:312:14:262
540099119,1cyclictest0-21swapper/107:07:141
539999119,1cyclictest9-21ksoftirqd/010:05:380
539999119,1cyclictest8370-21systemd11:53:420
539999119,1cyclictest23070-21kworker/u16:110:34:200
539999119,1cyclictest23070-21kworker/u16:110:34:200
539999117,1cyclictest9-21ksoftirqd/009:58:130
5399991110,1cyclictest9-21ksoftirqd/011:42:350
5399991110,1cyclictest9-21ksoftirqd/009:45:390
541399108,1cyclictest73-21ksoftirqd/712:04:167
541399108,1cyclictest73-21ksoftirqd/711:06:167
541399108,1cyclictest73-21ksoftirqd/710:38:217
541399108,1cyclictest73-21ksoftirqd/710:30:157
541399108,1cyclictest73-21ksoftirqd/710:13:077
541399108,1cyclictest0-21swapper/709:25:247
541399106,4cyclictest73-21ksoftirqd/712:32:597
541399106,3cyclictest691-21systemd-logind10:47:287
541399104,3cyclictest709-21nscd09:08:327
541399103,4cyclictest885-21polkitd11:20:257
541399103,4cyclictest885-21polkitd11:20:257
541399103,3cyclictest8151-21cp12:13:567
541399102,6cyclictest492-21systemd-journal10:43:397
541399102,5cyclictest1-21systemd10:07:457
540499109,1cyclictest57-21ksoftirqd/508:52:025
540299103,1cyclictest786-21snmpd08:47:433
540299103,1cyclictest32409-21grep07:52:173
540299103,1cyclictest0-21swapper/307:39:123
540299103,1cyclictest0-21swapper/307:34:123
540299100,5cyclictest20823-21sensors_temp08:27:213
540199103,1cyclictest0-21swapper/209:44:502
540199101,3cyclictest0-21swapper/212:24:352
540199101,3cyclictest0-21swapper/212:24:352
540199100,10cyclictest9969-21kworker/2:012:33:462
540199100,1cyclictest0-21swapper/211:37:382
540099109,1cyclictest231rcuc/108:42:161
540099109,1cyclictest231rcuc/108:42:161
540099108,1cyclictest25-21ksoftirqd/108:07:191
5400991010,0cyclictest24551-21kworker/1:209:05:431
317672100,0sleep70-21swapper/711:49:347
54139991,4cyclictest12739-21bash12:27:047
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional