You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 11:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Jun 04, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135721010,2sleep12308799cyclictest00:05:361
282282670,0sleep70-21swapper/722:15:297
2262225826,28sleep70-21swapper/719:04:077
2045725429,9sleep20-21swapper/219:03:302
165072530,0sleep00-21swapper/023:29:150
21702520,0sleep22159-21sshd00:28:042
140642520,2sleep12308799cyclictest23:18:031
64312510,0sleep00-21swapper/021:16:440
10132510,0sleep40-21swapper/422:49:144
311602500,0sleep50-21swapper/521:25:305
226192490,0sleep30-21swapper/323:22:133
132992490,0sleep70-21swapper/722:55:347
73322480,1sleep09-21ksoftirqd/021:57:360
2272524823,9sleep00-21swapper/019:05:280
119792480,0sleep20-21swapper/222:31:182
155302470,1sleep715532-21bash00:26:577
110352470,0sleep6631rcuc/600:32:166
296612450,0sleep10-21swapper/100:14:411
26022450,0sleep70-21swapper/721:57:197
199732450,0sleep119972-21systemd-cgroups21:34:071
80902440,0sleep70-21swapper/700:15:197
327112440,0sleep732703-21sshd23:41:237
270682440,0sleep70-21swapper/723:33:397
138932440,2sleep12308799cyclictest22:55:361
113842440,0sleep30-21swapper/322:14:293
254502430,0sleep00-21swapper/021:30:450
2285324330,9sleep30-21swapper/319:07:163
115052430,0sleep50-21swapper/500:17:265
257222420,0sleep60-21swapper/623:22:246
294352410,1sleep665-21ksoftirqd/622:49:006
237112410,0sleep30-21swapper/321:38:093
2263424129,8sleep60-21swapper/619:04:146
148952410,0sleep50-21swapper/500:21:185
107372410,2sleep62310699cyclictest22:44:126
65432400,0sleep40-21swapper/400:30:064
303092400,2sleep22309899cyclictest22:06:192
239282400,0sleep20-21swapper/223:55:442
2282424029,8sleep50-21swapper/519:06:545
2268024027,9sleep40-21swapper/419:04:524
148582400,0sleep30-21swapper/323:49:363
117792400,0sleep10-21swapper/123:08:341
101662400,0sleep30-21swapper/323:36:233
34022390,0sleep00-21swapper/021:48:070
318552390,0sleep50-21swapper/500:37:125
2261423927,9sleep10-21swapper/119:04:011
119882370,2sleep02308099cyclictest23:42:050
225042340,0sleep30-21swapper/321:21:193
326272320,0sleep70-21swapper/722:47:257
214032320,0sleep70-21swapper/723:22:097
36342310,0sleep2758-21runrttasks21:10:372
16032310,0sleep40-21swapper/423:48:494
2308799257,2cyclictest25-21ksoftirqd/122:13:171
2308799249,2cyclictest25-21ksoftirqd/121:39:591
2308799249,2cyclictest25-21ksoftirqd/121:39:591
23087992411,3cyclictest25-21ksoftirqd/123:29:141
23087992410,3cyclictest25-21ksoftirqd/122:51:181
2308799237,3cyclictest25-21ksoftirqd/121:27:021
23087992310,3cyclictest25-21ksoftirqd/123:55:501
23087992310,3cyclictest25-21ksoftirqd/123:03:411
79852220,0sleep20-21swapper/223:41:512
2308799228,3cyclictest25-21ksoftirqd/100:29:371
2308799228,1cyclictest25-21ksoftirqd/122:06:131
2308799227,2cyclictest25-21ksoftirqd/123:44:071
2308799227,1cyclictest25-21ksoftirqd/121:47:281
2308799226,2cyclictest25-21ksoftirqd/121:20:481
23087992212,3cyclictest25-21ksoftirqd/123:00:281
2308799219,2cyclictest25-21ksoftirqd/121:52:561
2308799219,1cyclictest25-21ksoftirqd/100:37:581
2308799217,2cyclictest25-21ksoftirqd/123:59:281
2308799216,3cyclictest25-21ksoftirqd/121:32:291
23087992115,3cyclictest25-21ksoftirqd/122:43:541
23080992114,2cyclictest9-21ksoftirqd/000:32:200
2308799209,2cyclictest25-21ksoftirqd/122:28:391
2308799208,1cyclictest25-21ksoftirqd/122:42:111
2308799208,1cyclictest25-21ksoftirqd/100:13:141
2308799207,2cyclictest25-21ksoftirqd/123:41:011
2308799206,3cyclictest25-21ksoftirqd/121:55:181
2308799206,1cyclictest25-21ksoftirqd/122:02:361
2308799206,1cyclictest25-21ksoftirqd/100:23:421
2308799201,3cyclictest19017-21systemd-cgroups23:20:061
2308799200,3cyclictest25-21ksoftirqd/123:35:231
2308799198,2cyclictest25-21ksoftirqd/100:18:441
2308799197,1cyclictest25-21ksoftirqd/122:36:491
2308799194,2cyclictest25-21ksoftirqd/121:10:351
2308799194,1cyclictest25-21ksoftirqd/122:14:291
23087991915,3cyclictest25-21ksoftirqd/122:21:041
2308099190,1cyclictest131rcu_sched21:58:410
2308799187,1cyclictest25-21ksoftirqd/123:48:441
2308799187,1cyclictest25-21ksoftirqd/123:28:061
2308799186,3cyclictest25-21ksoftirqd/121:14:121
23080991815,2cyclictest9-21ksoftirqd/022:05:190
23080991814,3cyclictest9-21ksoftirqd/021:22:200
2308799175,3cyclictest25-21ksoftirqd/122:24:191
2308799175,3cyclictest25-21ksoftirqd/122:24:191
23080991716,1cyclictest9-21ksoftirqd/000:21:400
23080991715,1cyclictest9-21ksoftirqd/023:23:300
23080991715,1cyclictest9-21ksoftirqd/023:01:470
23080991715,1cyclictest9-21ksoftirqd/000:13:240
23080991715,1cyclictest9-21ksoftirqd/000:09:230
23080991714,2cyclictest20460-21sshd22:31:490
305632160,1sleep630561-21systemd-cgroups22:26:506
305632160,1sleep630561-21systemd-cgroups22:26:506
23098991611,4cyclictest33-21ksoftirqd/222:52:092
23080991615,1cyclictest9-21ksoftirqd/023:14:320
23080991615,1cyclictest9-21ksoftirqd/022:22:540
23080991614,1cyclictest9-21ksoftirqd/023:57:260
23080991614,1cyclictest9-21ksoftirqd/023:45:190
23080991614,1cyclictest9-21ksoftirqd/023:10:110
23080991614,1cyclictest9-21ksoftirqd/021:24:590
23080991613,1cyclictest9-21ksoftirqd/000:37:020
23080991610,4cyclictest9-21ksoftirqd/022:09:070
2308099160,16cyclictest32735-21kworker/0:200:06:280
118672160,1sleep411828-21systemd23:58:424
84432150,1sleep6758-21runrttasks22:18:096
301312150,0sleep60-21swapper/600:11:026
2310499150,3cyclictest3725-21sshd22:19:394
23087991514,1cyclictest25-21ksoftirqd/120:48:231
23080991514,1cyclictest9-21ksoftirqd/023:33:480
23080991514,1cyclictest9-21ksoftirqd/000:00:460
23080991513,1cyclictest9-21ksoftirqd/023:19:060
23080991513,1cyclictest9-21ksoftirqd/023:03:380
23080991513,1cyclictest9-21ksoftirqd/022:54:110
23080991513,1cyclictest9-21ksoftirqd/021:52:270
23080991513,1cyclictest9-21ksoftirqd/021:39:290
23080991513,1cyclictest9-21ksoftirqd/021:39:290
23080991513,1cyclictest9-21ksoftirqd/021:33:590
23080991510,4cyclictest9-21ksoftirqd/023:50:400
223912150,0sleep30-21swapper/300:36:383
201742150,1sleep420172-21sshd23:16:304
171582150,1sleep217088-21sshd22:53:532
269552140,0sleep665-21ksoftirqd/623:50:206
2310599142,4cyclictest19941-21sshd23:29:275
2310599142,1cyclictest1-21systemd22:21:225
2310599140,2cyclictest26251-21sshd22:56:195
23103991412,1cyclictest41-21ksoftirqd/300:29:503
2309899147,4cyclictest33-21ksoftirqd/223:09:542
23098991412,1cyclictest33-21ksoftirqd/200:33:452
23098991411,3cyclictest33-21ksoftirqd/221:43:502
23098991410,3cyclictest33-21ksoftirqd/222:14:122
2308099143,0cyclictest0-21swapper/019:15:230
23080991412,2cyclictest9-21ksoftirqd/000:23:580
23080991412,1cyclictest9-21ksoftirqd/022:49:520
23080991412,1cyclictest9-21ksoftirqd/022:44:110
23080991412,1cyclictest9-21ksoftirqd/022:38:490
23080991412,1cyclictest9-21ksoftirqd/022:34:050
23080991412,1cyclictest9-21ksoftirqd/022:13:360
2308099140,13cyclictest4769-21kworker/0:422:26:330
2308099140,13cyclictest4769-21kworker/0:422:26:330
14112140,0sleep30-21swapper/300:11:153
2310799139,4cyclictest73-21ksoftirqd/723:57:187
23107991311,2cyclictest15037-21sshd22:03:367
2310799130,12cyclictest3607-21kworker/7:300:09:327
2310699130,13cyclictest30745-21kworker/6:522:21:196
2310599133,2cyclictest464-21systemd-journal21:16:565
23105991310,2cyclictest29685-21sshd21:34:415
2310599131,6cyclictest23251-21sshd23:48:195
2310599130,8cyclictest30776-21kworker/5:121:11:545
2310599130,13cyclictest5164-21kworker/5:623:34:395
23104991311,1cyclictest49-21ksoftirqd/422:44:594
23104991310,1cyclictest49-21ksoftirqd/421:44:514
2310499130,12cyclictest7529-21kworker/4:321:41:314
2310499130,12cyclictest7529-21kworker/4:321:41:314
23103991311,1cyclictest41-21ksoftirqd/323:01:263
23103991311,1cyclictest41-21ksoftirqd/322:47:013
2310399130,13cyclictest0-21swapper/321:58:343
2309899139,3cyclictest33-21ksoftirqd/223:26:402
2309899136,3cyclictest13568-21kworker/2:100:20:332
23098991312,1cyclictest33-21ksoftirqd/223:48:262
23098991311,1cyclictest33-21ksoftirqd/223:35:252
23098991311,1cyclictest33-21ksoftirqd/221:37:582
23098991311,1cyclictest33-21ksoftirqd/200:05:032
23080991311,1cyclictest9-21ksoftirqd/021:08:380
68072120,0sleep30-21swapper/300:22:443
23107991210,1cyclictest73-21ksoftirqd/723:17:027
23107991210,1cyclictest73-21ksoftirqd/722:12:427
2310799120,2cyclictest2906-21nscd00:33:227
2310699129,2cyclictest1-21systemd23:30:176
2310699122,4cyclictest31745-21sshd23:13:266
2310699122,4cyclictest28486-21systemd-cgroups21:32:516
2310699122,4cyclictest12005-21systemd-cgroups22:07:096
2310699122,4cyclictest0-21swapper/622:42:366
23106991210,2cyclictest65-21ksoftirqd/622:29:356
23106991210,1cyclictest65-21ksoftirqd/623:09:356
23106991210,1cyclictest32698-21systemd23:59:566
2310699121,5cyclictest27799-21bash23:55:586
2310699121,5cyclictest1599-21systemd21:27:356
2310699120,11cyclictest11388-21bash23:25:156
2310599129,2cyclictest12600-21sshd23:27:145
2310599129,2cyclictest10723-21bash22:51:445
2310599122,4cyclictest4769-21sshd00:30:005
2310599122,4cyclictest4258-21bash22:47:405
2310599122,4cyclictest12474-21sshd22:31:205
2310599122,2cyclictest29884-21sshd00:12:555
2310599121,2cyclictest0-21swapper/522:39:015
2310599121,11cyclictest1844-21nfsd21:44:525
2310599120,6cyclictest12173-21systemd00:24:515
2310599120,11cyclictest9161-21grepconf.sh22:05:045
2310599120,11cyclictest0-21swapper/522:11:415
2310499124,4cyclictest26616-21grep22:11:424
23104991210,1cyclictest49-21ksoftirqd/421:33:524
23104991210,1cyclictest49-21ksoftirqd/421:24:424
2310499120,11cyclictest3449-21kworker/4:400:06:594
2310399126,3cyclictest41-21ksoftirqd/323:44:573
2310399125,4cyclictest1-21systemd21:25:173
23103991211,1cyclictest41-21ksoftirqd/323:07:473
23103991211,1cyclictest0-21swapper/321:31:543
23103991210,1cyclictest41-21ksoftirqd/322:36:483
23103991210,1cyclictest41-21ksoftirqd/322:19:493
23103991210,1cyclictest0-21swapper/323:17:163
2310399120,12cyclictest20457-21kworker/3:500:05:483
2310399120,1cyclictest721-21dbus-daemon00:26:353
2309899128,3cyclictest33-21ksoftirqd/200:30:312
2309899128,1cyclictest33-21ksoftirqd/222:02:242
2309899124,5cyclictest1-21systemd23:48:182
2309899122,9cyclictest0-21swapper/221:40:012
2309899122,9cyclictest0-21swapper/221:40:012
2309899122,4cyclictest2993-21sshd21:49:522
23098991210,1cyclictest33-21ksoftirqd/222:44:132
23098991210,1cyclictest33-21ksoftirqd/200:09:122
2309899120,11cyclictest1-21systemd22:23:322
2309899120,11cyclictest1-21systemd22:23:322
23087991210,1cyclictest27660-21gltestperf19:18:331
23087991210,1cyclictest25-21ksoftirqd/119:08:421
223472120,9sleep557-21ksoftirqd/522:37:305
179942120,0sleep3391rcuc/321:48:503
174132120,0sleep60-21swapper/621:59:596
169932120,0sleep20-21swapper/221:30:152
118372129,1sleep665-21ksoftirqd/621:20:436
112752120,0sleep30-21swapper/322:40:323
2310799119,1cyclictest73-21ksoftirqd/722:32:057
2310799119,1cyclictest73-21ksoftirqd/700:03:467
2310799114,4cyclictest4382-21sshd21:29:317
2310799113,5cyclictest1-21systemd23:07:167
2310799110,11cyclictest3607-21kworker/7:323:49:047
2310799110,11cyclictest0-21swapper/721:27:177
2310699119,1cyclictest709-21systemd-logind00:37:086
2310699119,1cyclictest65-21ksoftirqd/622:58:536
2310699119,1cyclictest65-21ksoftirqd/621:35:386
2310699119,1cyclictest21208-21sshd21:39:476
2310699119,1cyclictest21208-21sshd21:39:476
2310699117,1cyclictest65-21ksoftirqd/622:08:436
2310699112,9cyclictest0-21swapper/621:45:376
2310699112,4cyclictest31816-21bash21:18:136
2310699111,4cyclictest4720-21systemd23:37:586
2310699111,4cyclictest21919-21grepconf.sh23:05:226
2310699111,4cyclictest0-21swapper/600:05:286
2310699110,11cyclictest22502-21kworker/6:200:18:336
2310699110,10cyclictest376-21kworker/6:100:16:346
2310599119,1cyclictest57-21ksoftirqd/523:13:135
2310599119,1cyclictest5324-21sshd23:21:135
2310599111,4cyclictest9649-21sshd00:08:005
2310599111,4cyclictest22750-21sshd23:53:465
2310599111,4cyclictest0-21swapper/523:15:465
2310599111,4cyclictest0-21swapper/521:29:415
2310599110,10cyclictest24513-21grepconf.sh23:01:495
2310499119,2cyclictest49-21ksoftirqd/421:55:494
2310499119,1cyclictest49-21ksoftirqd/422:54:124
2310499119,1cyclictest49-21ksoftirqd/400:18:584
2310499114,3cyclictest5533-21kworker/4:121:59:374
2310499113,4cyclictest721-21dbus-daemon21:21:204
23104991110,1cyclictest49-21ksoftirqd/422:23:424
23104991110,1cyclictest49-21ksoftirqd/422:23:424
23104991110,1cyclictest0-21swapper/423:31:474
2310499110,11cyclictest17025-21kworker/4:323:19:194
2310399119,1cyclictest41-21ksoftirqd/321:17:273
2310399119,1cyclictest20943-21kworker/3:221:58:123
2310399110,10cyclictest0-21swapper/321:44:153
2309899119,1cyclictest33-21ksoftirqd/223:14:212
2309899119,1cyclictest33-21ksoftirqd/221:24:172
2309899117,3cyclictest33-21ksoftirqd/222:33:342
2309899117,3cyclictest33-21ksoftirqd/221:53:392
2309899116,2cyclictest15510-21sshd23:21:482
2309899114,5cyclictest24170-21nscd22:10:262
2309899113,3cyclictest16956-21systemd-cgroups00:13:552
2309899112,4cyclictest1-21systemd00:02:032
23098991110,1cyclictest33-21ksoftirqd/222:39:002
23098991110,1cyclictest33-21ksoftirqd/221:13:432
2309899111,3cyclictest18117-21sshd23:29:212
2309899110,11cyclictest6888-21kworker/2:223:02:292
2309899110,11cyclictest17818-21kworker/2:122:23:052
2308799119,1cyclictest464-21systemd-journal20:18:231
2308799119,1cyclictest25-21ksoftirqd/120:58:231
23087991110,1cyclictest25-21ksoftirqd/119:48:361
23087991110,1cyclictest25-21ksoftirqd/119:48:361
2308099118,2cyclictest21525-21smart_sda20:28:390
111352110,0sleep30-21swapper/300:00:343
251682100,0sleep425163-21sshd00:10:444
2310799109,1cyclictest73-21ksoftirqd/722:58:407
2310799109,1cyclictest721-21dbus-daemon21:18:087
2310799108,1cyclictest73-21ksoftirqd/723:26:007
2310799106,2cyclictest73-21ksoftirqd/722:18:357
2310799105,4cyclictest6121-21sshd00:00:167
2310799103,4cyclictest11637-21sshd21:18:477
2310799102,5cyclictest3801-21systemd23:47:117
2310799100,1cyclictest0-21swapper/722:02:237
2310699109,1cyclictest65-21ksoftirqd/600:25:066
2310699103,6cyclictest27023-21sshd23:46:386
2310699103,4cyclictest857-21polkitd21:54:056
2310699101,4cyclictest0-21swapper/623:42:066
2310699101,1cyclictest0-21swapper/621:50:006
2310699100,4cyclictest721-21dbus-daemon22:55:126
2310599109,1cyclictest12055-21sshd21:52:185
2310599108,1cyclictest57-21ksoftirqd/523:48:565
2310599108,1cyclictest57-21ksoftirqd/522:14:555
2310599108,1cyclictest57-21ksoftirqd/521:43:165
2310599108,1cyclictest57-21ksoftirqd/521:43:165
2310599107,2cyclictest57-21ksoftirqd/521:58:545
2310599104,4cyclictest30639-21sshd21:19:545
2310599101,6cyclictest19451-21sshd23:03:255
2310599101,4cyclictest16990-21grep23:59:005
2310599100,5cyclictest24438-21sshd22:24:335
2310599100,5cyclictest24438-21sshd22:24:335
2310599100,4cyclictest5855-21sshd21:55:375
2310599100,10cyclictest5164-21kworker/5:623:38:425
2310499109,1cyclictest49-21ksoftirqd/423:39:334
2310499109,1cyclictest49-21ksoftirqd/422:37:404
2310499109,1cyclictest49-21ksoftirqd/422:28:544
2310499109,1cyclictest28957-21sshd21:29:034
2310499109,1cyclictest16806-21sshd00:38:134
2310499108,1cyclictest49-21ksoftirqd/423:56:494
2310499108,1cyclictest49-21ksoftirqd/423:23:584
2310499108,1cyclictest49-21ksoftirqd/423:04:314
2310499108,1cyclictest49-21ksoftirqd/422:17:384
2310499108,1cyclictest49-21ksoftirqd/421:53:074
2310499108,1cyclictest49-21ksoftirqd/421:10:394
2310499108,1cyclictest0-21swapper/421:17:134
2310499105,1cyclictest16975-21grepconf.sh22:40:534
2310499103,3cyclictest1-21systemd23:02:544
2310499100,9cyclictest3449-21kworker/4:400:26:594
2310499100,9cyclictest17025-21kworker/4:323:46:304
2310499100,10cyclictest0-21swapper/422:07:404
2310499100,10cyclictest0-21swapper/400:16:004
2310399108,1cyclictest41-21ksoftirqd/322:30:443
2310399108,1cyclictest15918-21cp22:52:023
2310399107,2cyclictest9328-21sshd22:55:203
2310399107,2cyclictest28409-21bash21:38:253
2310399107,2cyclictest28409-21bash21:38:253
2310399106,3cyclictest41-21ksoftirqd/323:40:073
2310399104,3cyclictest366-21jbd2/sda2-800:14:383
2310399101,5cyclictest10202-21bash21:13:103
2310399100,6cyclictest7705-21bash23:30:393
2310399100,10cyclictest0-21swapper/323:25:463
2309899105,3cyclictest19290-21grep23:05:122
2308799106,1cyclictest25-21ksoftirqd/119:40:241
2308099106,4cyclictest9-21ksoftirqd/020:28:150
6823290,1sleep70-21swapper/700:18:577
231079997,1cyclictest73-21ksoftirqd/722:34:147
231079997,1cyclictest73-21ksoftirqd/721:46:097
231079997,1cyclictest73-21ksoftirqd/721:09:177
231079994,4cyclictest6684-21sshd22:25:257
231079994,4cyclictest6684-21sshd22:25:257
231079993,3cyclictest721-21dbus-daemon23:09:317
231079993,3cyclictest11724-21grep23:28:587
231079992,4cyclictest721-21dbus-daemon22:48:507
231079990,9cyclictest29715-21kworker/7:421:34:377
231079990,8cyclictest30595-21kworker/7:521:48:297
231079990,8cyclictest30595-21kworker/7:521:40:057
231079990,8cyclictest30595-21kworker/7:521:40:057
231079990,8cyclictest24097-21kworker/7:422:39:257
231079990,5cyclictest9947-21cp00:33:597
231069993,3cyclictest857-21polkitd22:34:326
231069993,1cyclictest0-21swapper/621:08:296
231049994,3cyclictest49-21ksoftirqd/423:34:104
231049994,2cyclictest8676-21bash23:08:234
231039998,1cyclictest41-21ksoftirqd/322:03:313
231039993,2cyclictest1650-21grep22:25:073
231039993,2cyclictest1650-21grep22:25:073
231039992,3cyclictest10915-21sshd22:08:523
231039990,9cyclictest0-21swapper/323:54:183
230989994,4cyclictest3943-21grepconf.sh21:18:272
230989990,9cyclictest0-21swapper/219:28:332
230879998,1cyclictest27672-21kworker/1:219:32:121
230879998,1cyclictest25-21ksoftirqd/120:23:231
230879991,1cyclictest25-21ksoftirqd/120:24:361
230879990,1cyclictest27748-21perl20:48:331
230879990,0cyclictest121rcu_preempt20:58:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional