You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 18:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Jul 29, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158242940,1sleep315815-21sshd09:22:403
252632870,2sleep11980199cyclictest12:24:351
113312780,2sleep51981799cyclictest11:34:495
113312780,2sleep51981799cyclictest11:34:495
121362760,7sleep09-21ksoftirqd/012:00:150
37892740,1sleep73786-21sshd10:49:027
172092700,0sleep50-21swapper/511:46:035
38502570,0sleep10-21swapper/112:06:571
190462550,0sleep40-21swapper/412:20:384
168492550,0sleep60-21swapper/612:15:036
157792540,0sleep10-21swapper/110:24:211
101222500,0sleep00-21swapper/009:36:470
279362480,0sleep127899-21sshd10:01:231
1962724825,8sleep50-21swapper/507:05:265
1957424825,9sleep00-21swapper/007:04:410
158622480,2sleep0111rcuc/011:47:420
120412480,0sleep30-21swapper/310:49:303
265712470,0sleep70-21swapper/711:26:347
265712470,0sleep70-21swapper/711:26:347
20692470,0sleep20-21swapper/212:17:472
200412470,0sleep70-21swapper/712:24:177
72442460,0sleep60-21swapper/609:18:356
14452460,0sleep40-21swapper/410:32:334
310012450,1sleep71982899cyclictest09:23:327
296572450,0sleep20-21swapper/209:39:452
226542450,0sleep10-21swapper/112:31:401
145552450,0sleep314551-21sshd10:27:523
127282450,0sleep70-21swapper/709:40:387
116312450,1sleep665-21ksoftirqd/610:31:236
229462430,0sleep4481ktimersoftd/411:08:134
45742420,0sleep14555-21sshd11:16:191
239962420,0sleep10-21swapper/110:08:271
1932924223,4sleep10-21swapper/107:02:021
29672410,0sleep50-21swapper/511:14:235
256812410,1sleep585250irq/26-em1-tx-010:41:155
256812410,1sleep585250irq/26-em1-tx-010:41:155
1957224129,8sleep70-21swapper/707:04:407
1942724130,8sleep30-21swapper/307:03:243
132912410,0sleep00-21swapper/012:27:310
108012410,1sleep010796-21sshd12:18:170
324732400,1sleep665-21ksoftirqd/611:34:106
324732400,1sleep665-21ksoftirqd/611:34:106
203132400,0sleep60-21swapper/609:31:566
1942624029,8sleep20-21swapper/207:03:232
1937424028,8sleep60-21swapper/607:02:396
189232400,0sleep00-21swapper/010:55:200
100652400,0sleep70-21swapper/712:05:357
295952390,2sleep71982899cyclictest10:28:447
210582390,0sleep30-21swapper/311:15:253
1941723926,9sleep40-21swapper/407:03:174
47662380,0sleep50-21swapper/510:56:215
276122380,0sleep70-21swapper/709:32:217
12212380,0sleep70-21swapper/709:59:527
19824992212,2cyclictest131rcu_sched10:21:266
66432200,0sleep50-21swapper/511:29:055
66432200,0sleep50-21swapper/511:29:055
51332200,1sleep0464-21systemd-journal10:07:220
212462200,0sleep2311rcuc/211:22:372
1982499207,4cyclictest65-21ksoftirqd/609:13:216
1982499207,1cyclictest65-21ksoftirqd/610:26:376
1982499206,1cyclictest65-21ksoftirqd/609:11:036
19824992014,4cyclictest65-21ksoftirqd/610:18:136
19824992010,1cyclictest65-21ksoftirqd/611:16:356
198472190,0sleep70-21swapper/710:22:437
1982899192,6cyclictest0-21swapper/709:54:077
1982899190,1cyclictest0-21swapper/710:17:027
19824991914,2cyclictest464-21systemd-journal11:47:066
19815991914,4cyclictest49-21ksoftirqd/409:10:414
201912180,1sleep220180-21cp10:11:492
1982899180,2cyclictest2424-21sshd10:57:587
1982899180,1cyclictest0-21swapper/711:07:257
1982899180,1cyclictest0-21swapper/710:06:547
1982499188,1cyclictest65-21ksoftirqd/611:31:046
1982499188,1cyclictest65-21ksoftirqd/611:31:046
1982499187,1cyclictest65-21ksoftirqd/612:30:006
1982499187,1cyclictest65-21ksoftirqd/611:07:226
1982499186,1cyclictest65-21ksoftirqd/611:01:506
1982499186,1cyclictest65-21ksoftirqd/610:45:246
1982499182,1cyclictest65-21ksoftirqd/610:00:246
19824991816,1cyclictest65-21ksoftirqd/612:17:466
19824991816,1cyclictest65-21ksoftirqd/610:01:326
280372170,2sleep31980799cyclictest11:19:263
1982899170,6cyclictest10257-21sshd12:29:137
1982899170,2cyclictest26325-21bash11:42:517
1982499177,1cyclictest65-21ksoftirqd/609:37:066
1982499174,3cyclictest65-21ksoftirqd/610:56:536
1982499174,1cyclictest65-21ksoftirqd/609:29:196
19824991715,1cyclictest65-21ksoftirqd/611:12:576
19824991714,3cyclictest65-21ksoftirqd/610:06:386
19824991714,1cyclictest65-21ksoftirqd/611:46:206
19824991714,1cyclictest65-21ksoftirqd/610:41:206
19824991713,1cyclictest65-21ksoftirqd/610:55:126
1982499171,1cyclictest131rcu_sched09:50:216
1982499170,1cyclictest0-21swapper/611:36:596
19815991716,1cyclictest49-21ksoftirqd/412:32:164
19801991716,1cyclictest25-21ksoftirqd/109:35:031
19801991715,1cyclictest25-21ksoftirqd/111:34:231
19801991715,1cyclictest25-21ksoftirqd/111:34:231
7122160,1sleep2641-21sshd11:52:162
28152160,0sleep50-21swapper/510:14:325
1982899160,1cyclictest857-21polkitd09:19:417
1982899160,1cyclictest0-21swapper/711:39:397
1982499165,11cyclictest65-21ksoftirqd/612:09:426
1982499165,1cyclictest65-21ksoftirqd/609:43:336
1982499165,1cyclictest65-21ksoftirqd/609:43:336
1982499164,3cyclictest65-21ksoftirqd/611:22:396
1982499164,1cyclictest65-21ksoftirqd/612:26:026
19824991614,1cyclictest65-21ksoftirqd/612:01:386
19824991614,1cyclictest65-21ksoftirqd/611:59:206
19824991614,1cyclictest65-21ksoftirqd/610:36:356
19824991614,1cyclictest65-21ksoftirqd/610:15:396
19824991613,3cyclictest65-21ksoftirqd/609:53:056
19824991612,3cyclictest65-21ksoftirqd/612:31:226
19824991612,1cyclictest65-21ksoftirqd/609:24:016
19824991610,4cyclictest65-21ksoftirqd/611:53:146
19815991615,1cyclictest49-21ksoftirqd/411:59:084
19815991615,1cyclictest49-21ksoftirqd/411:30:394
19815991615,1cyclictest49-21ksoftirqd/411:30:394
19815991614,1cyclictest49-21ksoftirqd/412:04:444
19815991614,1cyclictest49-21ksoftirqd/410:58:324
19815991614,1cyclictest49-21ksoftirqd/410:56:154
19815991614,1cyclictest49-21ksoftirqd/410:30:314
19815991614,1cyclictest49-21ksoftirqd/409:44:474
19815991614,1cyclictest49-21ksoftirqd/409:44:474
19815991613,2cyclictest17690-21grepconf.sh10:15:244
19807991614,1cyclictest41-21ksoftirqd/311:56:083
19801991614,1cyclictest25-21ksoftirqd/111:58:361
19801991614,1cyclictest25-21ksoftirqd/110:17:101
19801991614,1cyclictest25-21ksoftirqd/109:19:371
99912150,0sleep10-21swapper/111:16:351
46072150,0sleep70-21swapper/711:54:227
222302150,0sleep00-21swapper/011:02:410
1982899150,2cyclictest15103-21systemd10:13:237
1982899150,1cyclictest752-21snmpd09:29:297
1982899150,1cyclictest0-21swapper/710:37:197
1982899150,1cyclictest0-21swapper/710:37:197
1982499153,3cyclictest65-21ksoftirqd/610:48:486
1981799150,14cyclictest1-21systemd10:54:405
19815991514,1cyclictest49-21ksoftirqd/411:15:064
19815991514,1cyclictest49-21ksoftirqd/410:39:184
19815991514,1cyclictest49-21ksoftirqd/410:39:184
19815991513,1cyclictest49-21ksoftirqd/410:47:254
1981599150,2cyclictest131rcu_sched11:22:514
19807991513,2cyclictest41-21ksoftirqd/312:10:283
19801991514,1cyclictest25-21ksoftirqd/111:27:071
19801991514,1cyclictest25-21ksoftirqd/111:27:071
19801991513,1cyclictest25-21ksoftirqd/111:10:211
14812150,0sleep20-21swapper/210:10:532
143462150,3sleep5561ktimersoftd/509:51:345
142192150,0sleep30-21swapper/309:11:433
279082140,0sleep00-21swapper/009:52:170
1982899143,7cyclictest29030-21grepconf.sh11:33:597
1982899143,7cyclictest29030-21grepconf.sh11:33:597
1982899142,9cyclictest20579-21rm10:51:437
1982899140,3cyclictest30156-21sshd12:32:067
1982899140,2cyclictest18107-21sshd11:47:507
1982899140,1cyclictest0-21swapper/711:16:367
19817991413,1cyclictest57-21ksoftirqd/511:25:385
19815991413,1cyclictest49-21ksoftirqd/412:14:284
19815991413,1cyclictest49-21ksoftirqd/411:19:114
19815991412,1cyclictest49-21ksoftirqd/410:20:064
19815991412,1cyclictest49-21ksoftirqd/410:06:584
19815991412,1cyclictest49-21ksoftirqd/409:20:014
19815991411,1cyclictest49-21ksoftirqd/409:51:544
198132140,0sleep30-21swapper/311:56:583
1980799140,13cyclictest9860-21systemd09:36:463
19801991413,1cyclictest25-21ksoftirqd/111:55:501
19801991412,1cyclictest25-21ksoftirqd/112:14:261
19801991412,1cyclictest25-21ksoftirqd/111:49:301
19801991412,1cyclictest25-21ksoftirqd/110:31:091
19801991412,1cyclictest25-21ksoftirqd/109:30:141
19801991412,1cyclictest25-21ksoftirqd/109:24:241
124852140,0sleep233-21ksoftirqd/209:53:152
77582130,0sleep50-21swapper/510:23:535
65902130,1sleep21-21systemd10:45:372
50502130,0sleep30-21swapper/310:01:493
283352130,0sleep228328-21sshd12:06:342
265342130,0sleep2709-21systemd-logind10:37:362
265342130,0sleep2709-21systemd-logind10:37:362
208572130,1sleep520847-21sshd12:02:295
1982899133,7cyclictest30878-21bash09:50:437
1982899133,4cyclictest857-21polkitd11:03:547
1982899130,1cyclictest31222-21grepconf.sh10:45:107
19817991311,1cyclictest57-21ksoftirqd/509:31:335
1981799130,2cyclictest28838-21kill09:16:155
19815991312,1cyclictest49-21ksoftirqd/411:02:014
19815991312,1cyclictest49-21ksoftirqd/409:48:494
19815991311,1cyclictest49-21ksoftirqd/412:26:524
19815991311,1cyclictest49-21ksoftirqd/411:55:554
19815991311,1cyclictest49-21ksoftirqd/411:46:564
19815991311,1cyclictest49-21ksoftirqd/411:43:074
19815991311,1cyclictest49-21ksoftirqd/411:32:214
19815991311,1cyclictest49-21ksoftirqd/411:32:214
19815991311,1cyclictest49-21ksoftirqd/410:21:284
19815991311,1cyclictest49-21ksoftirqd/409:28:434
19807991312,1cyclictest41-21ksoftirqd/309:54:343
19807991311,1cyclictest41-21ksoftirqd/310:36:583
19807991311,1cyclictest41-21ksoftirqd/310:36:583
19807991310,3cyclictest41-21ksoftirqd/312:02:423
1980299132,5cyclictest721-21dbus-daemon11:28:532
1980299132,5cyclictest721-21dbus-daemon11:28:532
19801991312,1cyclictest25-21ksoftirqd/112:16:221
19801991312,1cyclictest25-21ksoftirqd/110:38:061
19801991312,1cyclictest25-21ksoftirqd/110:38:061
19801991312,1cyclictest25-21ksoftirqd/109:51:311
19801991312,1cyclictest25-21ksoftirqd/109:49:491
19801991311,1cyclictest25-21ksoftirqd/112:01:321
19801991311,1cyclictest25-21ksoftirqd/111:06:191
19801991311,1cyclictest25-21ksoftirqd/110:56:321
19801991311,1cyclictest25-21ksoftirqd/110:12:531
19801991311,1cyclictest25-21ksoftirqd/109:45:071
19801991311,1cyclictest25-21ksoftirqd/109:45:071
1980199130,13cyclictest15624-21kworker/1:209:41:121
1980099132,5cyclictest11664-21sshd10:35:000
1980099130,13cyclictest10139-21kworker/0:010:29:060
1980099130,12cyclictest11602-21kworker/0:409:42:310
1980099130,12cyclictest11602-21kworker/0:409:42:310
166222130,0sleep30-21swapper/312:25:573
61892120,0sleep10-21swapper/110:43:441
1982899125,6cyclictest22774-21grepconf.sh10:04:467
1982899123,8cyclictest3486-21sshd12:16:097
1982899122,9cyclictest14683-21sshd12:18:317
1982899120,2cyclictest721-21dbus-daemon09:13:027
1982899120,2cyclictest19114-21sshd10:31:427
1982899120,2cyclictest1-21systemd11:24:307
1982899120,11cyclictest21289-21sshd11:13:357
1982899120,1cyclictest0-21swapper/712:06:587
1982899120,1cyclictest0-21swapper/709:06:347
1981799123,8cyclictest0-21swapper/512:13:165
1981799123,4cyclictest0-21swapper/509:26:535
19817991211,1cyclictest57-21ksoftirqd/512:18:585
19817991211,1cyclictest0-21swapper/510:43:265
1981799121,5cyclictest721-21dbus-daemon09:40:285
1981799121,5cyclictest30601-21bash10:19:445
1981799121,5cyclictest22954-21sd-pam12:22:355
1981799120,12cyclictest24403-21kworker/5:010:28:345
1981799120,12cyclictest22334-21kworker/5:312:31:555
1981799120,11cyclictest21151-21kworker/5:009:17:005
19815991211,1cyclictest49-21ksoftirqd/410:42:094
19815991210,1cyclictest49-21ksoftirqd/412:22:194
19815991210,1cyclictest49-21ksoftirqd/411:38:074
19815991210,1cyclictest49-21ksoftirqd/409:59:154
19815991210,1cyclictest49-21ksoftirqd/409:31:254
19815991210,1cyclictest49-21ksoftirqd/409:22:514
19815991210,1cyclictest49-21ksoftirqd/409:13:054
1981599120,10cyclictest26638-21kworker/4:412:09:384
19807991211,1cyclictest41-21ksoftirqd/312:11:553
19807991210,1cyclictest736-21gdbus11:07:363
19807991210,1cyclictest41-21ksoftirqd/312:33:513
19807991210,1cyclictest41-21ksoftirqd/311:23:473
1980799120,11cyclictest32403-21kworker/3:112:30:423
1980799120,11cyclictest29867-21sshd10:08:483
19802991210,1cyclictest721-21dbus-daemon10:06:082
19802991210,1cyclictest33-21ksoftirqd/211:11:332
1980299121,5cyclictest752-21snmpd10:56:152
1980299121,5cyclictest27856-21bash09:59:332
1980299120,11cyclictest8454-21kworker/2:112:13:452
1980299120,11cyclictest32715-21kworker/2:211:07:032
1980299120,11cyclictest32715-21kworker/2:210:59:332
1980299120,10cyclictest23264-21sshd10:35:402
19801991211,1cyclictest22326-21sshd11:37:111
19801991210,1cyclictest25-21ksoftirqd/111:23:111
19801991210,1cyclictest25-21ksoftirqd/110:34:021
19801991210,1cyclictest25-21ksoftirqd/109:59:511
19801991210,1cyclictest25-21ksoftirqd/109:11:401
19801991210,1cyclictest25-21ksoftirqd/109:10:351
1980099124,4cyclictest11683-21sshd11:36:370
1980099122,4cyclictest1806-21sshd10:38:020
1980099122,4cyclictest1806-21sshd10:38:020
1980099122,4cyclictest1-21systemd11:56:060
1980099120,11cyclictest23726-21kworker/0:009:34:180
1980099120,11cyclictest10139-21kworker/0:010:15:450
242322118,1sleep09-21ksoftirqd/012:04:330
1982899113,7cyclictest721-21dbus-daemon09:41:377
1982899113,7cyclictest721-21dbus-daemon09:41:377
1982899110,1cyclictest13004-21needreboot11:56:387
1982899110,1cyclictest0-21swapper/708:01:427
1981799119,1cyclictest57-21ksoftirqd/512:29:275
1981799119,1cyclictest57-21ksoftirqd/512:07:555
1981799114,6cyclictest859-21gdbus09:49:295
1981799112,4cyclictest721-21dbus-daemon09:42:295
1981799112,4cyclictest721-21dbus-daemon09:42:295
19817991110,1cyclictest57-21ksoftirqd/510:06:415
1981799111,4cyclictest1755-21systemd-cgroups11:59:395
1981799111,4cyclictest15035-21sshd10:06:135
1981799111,4cyclictest0-21swapper/511:36:225
1981799110,6cyclictest14961-21sshd10:33:205
1981799110,5cyclictest12808-21systemd09:07:385
1981799110,11cyclictest810-21kworker/5:110:01:095
1981799110,1cyclictest0-21swapper/511:19:185
19815991110,1cyclictest49-21ksoftirqd/410:01:504
1981599110,11cyclictest0-21swapper/409:37:114
1980799119,1cyclictest41-21ksoftirqd/311:34:123
1980799119,1cyclictest41-21ksoftirqd/311:34:123
1980799119,1cyclictest41-21ksoftirqd/311:26:393
1980799119,1cyclictest41-21ksoftirqd/311:26:393
1980799119,1cyclictest41-21ksoftirqd/311:01:363
1980799119,1cyclictest41-21ksoftirqd/310:56:503
1980799119,1cyclictest41-21ksoftirqd/310:54:013
1980799119,1cyclictest41-21ksoftirqd/310:16:493
1980799119,1cyclictest41-21ksoftirqd/309:08:493
1980799118,3cyclictest41-21ksoftirqd/309:45:013
1980799118,3cyclictest41-21ksoftirqd/309:45:013
19807991110,1cyclictest41-21ksoftirqd/309:19:053
1980299119,1cyclictest5548-21sshd12:05:192
1980299119,1cyclictest33-21ksoftirqd/211:59:082
1980299119,1cyclictest0-21swapper/211:01:282
1980299113,7cyclictest5834-21systemd-cgroups11:47:072
1980299111,4cyclictest857-21polkitd10:27:032
1980299111,4cyclictest721-21dbus-daemon11:38:032
1980299111,4cyclictest29769-21df10:21:312
1980299111,4cyclictest18500-21sshd11:20:442
1980299111,4cyclictest13042-21systemd-cgroups09:49:422
1980299111,4cyclictest0-21swapper/210:16:382
1980299111,4cyclictest0-21swapper/209:11:292
1980299110,11cyclictest5583-21kworker/2:009:25:442
1980299110,11cyclictest30587-21kworker/2:509:34:462
1980299110,11cyclictest25742-21kworker/2:309:42:032
1980299110,11cyclictest25742-21kworker/2:309:42:032
1980299110,11cyclictest0-21swapper/211:36:192
1980299110,11cyclictest0-21swapper/211:36:192
1980299110,10cyclictest0-21swapper/211:41:352
1980199119,1cyclictest25-21ksoftirqd/112:30:461
1980199119,1cyclictest25-21ksoftirqd/110:51:241
1980199119,1cyclictest25-21ksoftirqd/110:49:371
19801991110,1cyclictest25-21ksoftirqd/111:41:401
1980099119,1cyclictest9-21ksoftirqd/009:47:100
1980099112,4cyclictest0-21swapper/010:17:000
19800991110,1cyclictest9-21ksoftirqd/010:42:560
1980099111,4cyclictest26441-21sshd11:19:200
1980099111,4cyclictest2246-21sshd12:16:040
1980099111,4cyclictest0-21swapper/009:14:540
1980099110,5cyclictest25135-21bash09:57:320
1980099110,11cyclictest8647-21kworker/0:011:41:380
1980099110,11cyclictest30112-21kworker/0:310:50:420
1980099110,11cyclictest28403-21kworker/0:412:09:400
1980099110,11cyclictest23726-21kworker/0:009:19:440
1980099110,11cyclictest10139-21kworker/0:010:03:470
1980099110,10cyclictest5370-21sshd12:34:230
1980099110,10cyclictest23726-21kworker/0:009:22:490
1980099110,10cyclictest13374-21sshd11:34:560
1980099110,10cyclictest13374-21sshd11:34:560
1980099110,1cyclictest0-21swapper/011:08:080
1982899103,6cyclictest752-21snmpd08:29:537
1982899103,6cyclictest752-21snmpd07:56:137
1982899103,6cyclictest752-21snmpd07:40:187
1982899103,6cyclictest10654-21cat08:41:347
1982899100,1cyclictest16498-21latency08:51:347
1982899100,1cyclictest0-21swapper/708:46:387
1982899100,1cyclictest0-21swapper/708:06:387
1982899100,1cyclictest0-21swapper/707:41:347
1981799103,4cyclictest0-21swapper/511:52:405
1981799102,4cyclictest24145-21sshd09:21:245
1981799101,4cyclictest30493-21sshd11:06:475
1981799100,4cyclictest85250irq/26-em1-tx-011:46:405
1981799100,4cyclictest0-21swapper/510:50:045
1980799109,1cyclictest41-21ksoftirqd/309:28:053
1980799108,1cyclictest41-21ksoftirqd/311:48:143
1980799108,1cyclictest41-21ksoftirqd/310:33:423
1980799108,1cyclictest41-21ksoftirqd/310:13:243
1980799108,1cyclictest41-21ksoftirqd/309:31:483
1980799100,10cyclictest0-21swapper/310:24:243
1980799100,1cyclictest0-21swapper/311:37:053
1980299103,4cyclictest23794-21sshd12:26:212
1980299103,1cyclictest0-21swapper/210:51:132
1980299102,7cyclictest32056-21grep09:27:112
1980299100,4cyclictest756-21sshd09:06:492
1980299100,4cyclictest6768-21grepconf.sh12:21:402
1980299100,4cyclictest5542-21systemd-cgroups12:34:232
1980299100,4cyclictest29944-21sshd09:19:532
1980099108,1cyclictest9-21ksoftirqd/011:28:310
1980099108,1cyclictest9-21ksoftirqd/011:28:310
1980099103,6cyclictest709-21systemd-logind11:11:300
1980099103,6cyclictest20219-21sshd10:24:370
1980099100,4cyclictest9155-21sshd11:23:470
1980099100,4cyclictest30424-21sshd12:24:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional