You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 10:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Sep 01, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59242950,1sleep449-21ksoftirqd/422:29:514
81332920,1sleep58124-21cp23:02:205
240282710,2sleep3401ktimersoftd/321:08:043
315942590,1sleep431593-21sshd21:46:184
322192540,0sleep10-21swapper/121:14:031
214542510,0sleep50-21swapper/522:55:475
325472490,0sleep70-21swapper/700:08:307
221102490,1sleep422103-21bash23:13:564
439124837,8sleep70-21swapper/719:02:147
180842480,0sleep50-21swapper/521:25:455
5362460,0sleep50-21swapper/522:40:175
42582460,0sleep00-21swapper/023:20:090
42582460,0sleep00-21swapper/023:20:090
302962460,0sleep0756-21sshd23:41:150
194952460,0sleep40-21swapper/422:37:444
58112450,0sleep50-21swapper/522:20:475
108082450,0sleep610807-21systemd-cgroups22:55:166
69082440,0sleep20-21swapper/223:47:102
53622440,0sleep70-21swapper/722:33:227
45492440,0sleep30-21swapper/321:41:123
30392440,1sleep0111rcuc/000:30:170
292502440,0sleep00-21swapper/019:45:220
195662440,0sleep70-21swapper/722:59:257
130972440,1sleep113091-21sshd00:23:371
10582440,0sleep20-21swapper/223:52:152
85842430,0sleep00-21swapper/000:26:570
434224332,8sleep20-21swapper/219:01:372
27782430,1sleep22772-21bash23:21:472
27782430,1sleep22772-21bash23:21:472
190332430,2sleep3474499cyclictest21:22:143
165452430,0sleep10-21swapper/123:13:371
439724230,9sleep40-21swapper/419:02:194
438024230,8sleep50-21swapper/519:02:045
293452420,1sleep029336-21sshd21:30:040
145682420,0sleep70-21swapper/721:27:237
107802420,0sleep10-21swapper/123:18:421
69882410,0sleep30-21swapper/322:44:163
440524129,9sleep10-21swapper/119:02:241
78172400,0sleep00-21swapper/022:53:180
301092400,0sleep20-21swapper/221:21:012
292262400,2sleep1473599cyclictest21:19:161
212824028,8sleep00-21swapper/019:00:150
69972390,0sleep10-21swapper/122:10:101
66782390,2sleep4475199cyclictest22:53:144
439923926,9sleep60-21swapper/619:02:216
269792390,0sleep20-21swapper/222:41:422
212223927,9sleep30-21swapper/319:00:103
10712390,0sleep10-21swapper/122:24:111
232092380,0sleep30-21swapper/300:13:223
4757992512,2cyclictest73-21ksoftirqd/722:18:137
75912230,0sleep20-21swapper/222:35:182
475799239,3cyclictest73-21ksoftirqd/723:21:167
475799239,3cyclictest73-21ksoftirqd/723:21:167
4757992311,2cyclictest73-21ksoftirqd/721:15:537
4757992310,3cyclictest73-21ksoftirqd/723:03:557
475799228,1cyclictest73-21ksoftirqd/722:50:127
4757992212,3cyclictest73-21ksoftirqd/722:00:087
4757992210,3cyclictest73-21ksoftirqd/700:13:537
475799219,4cyclictest73-21ksoftirqd/723:50:377
475799218,3cyclictest73-21ksoftirqd/722:40:207
475799217,3cyclictest73-21ksoftirqd/722:26:157
475799217,1cyclictest73-21ksoftirqd/721:35:057
4757992117,3cyclictest73-21ksoftirqd/721:05:557
4757992112,3cyclictest73-21ksoftirqd/722:23:317
4757992112,3cyclictest73-21ksoftirqd/721:35:077
4757992111,3cyclictest73-21ksoftirqd/723:30:057
4757992110,1cyclictest73-21ksoftirqd/700:29:007
475799208,3cyclictest73-21ksoftirqd/700:04:027
475799208,1cyclictest73-21ksoftirqd/722:36:547
475799206,3cyclictest73-21ksoftirqd/722:47:447
475799206,2cyclictest73-21ksoftirqd/700:30:277
4757992010,3cyclictest73-21ksoftirqd/723:58:227
475799201,3cyclictest73-21ksoftirqd/722:13:537
475799201,2cyclictest0-21swapper/723:38:337
475799199,3cyclictest73-21ksoftirqd/723:09:497
475799199,3cyclictest73-21ksoftirqd/721:47:137
475799196,1cyclictest73-21ksoftirqd/721:22:557
475799195,3cyclictest73-21ksoftirqd/721:52:547
475799194,2cyclictest73-21ksoftirqd/723:46:097
4757991910,3cyclictest73-21ksoftirqd/722:07:427
475799190,2cyclictest0-21swapper/721:13:467
475799189,1cyclictest73-21ksoftirqd/721:40:547
475799188,3cyclictest73-21ksoftirqd/723:32:207
475799188,3cyclictest73-21ksoftirqd/723:32:207
475799188,1cyclictest73-21ksoftirqd/700:19:247
475799181,2cyclictest13430-21sshd21:59:457
4735991815,2cyclictest25-21ksoftirqd/123:06:431
475799177,3cyclictest73-21ksoftirqd/723:40:217
475799177,1cyclictest73-21ksoftirqd/723:15:367
475799171,3cyclictest1508-21sshd23:12:467
475799171,1cyclictest73-21ksoftirqd/700:22:167
4735991715,1cyclictest25-21ksoftirqd/123:48:201
4735991715,1cyclictest25-21ksoftirqd/123:38:291
4735991714,2cyclictest25-21ksoftirqd/123:02:171
297642170,1sleep665-21ksoftirqd/623:23:196
297642170,1sleep665-21ksoftirqd/623:23:196
228562170,0sleep40-21swapper/400:22:204
186812170,0sleep20-21swapper/222:19:482
4753991613,1cyclictest57-21ksoftirqd/521:40:135
4753991612,3cyclictest57-21ksoftirqd/522:50:595
4735991615,1cyclictest25-21ksoftirqd/100:04:281
4735991614,1cyclictest25-21ksoftirqd/123:55:411
4735991614,1cyclictest25-21ksoftirqd/122:57:241
4735991614,1cyclictest25-21ksoftirqd/122:43:521
4735991614,1cyclictest25-21ksoftirqd/122:38:471
4735991614,1cyclictest25-21ksoftirqd/121:23:331
4735991614,1cyclictest25-21ksoftirqd/121:08:411
4735991614,1cyclictest25-21ksoftirqd/100:16:411
4735991613,2cyclictest25-21ksoftirqd/100:14:521
475699156,4cyclictest85150irq/25-em1-rx-022:49:426
475399150,14cyclictest16389-21kworker/5:200:20:285
4735991514,1cyclictest25-21ksoftirqd/123:25:201
4735991514,1cyclictest25-21ksoftirqd/122:02:201
4735991514,1cyclictest25-21ksoftirqd/121:25:251
4735991513,1cyclictest25-21ksoftirqd/123:40:191
4735991513,1cyclictest25-21ksoftirqd/121:46:151
4735991513,1cyclictest25-21ksoftirqd/100:31:381
4735991513,1cyclictest25-21ksoftirqd/100:25:371
4735991510,3cyclictest25-21ksoftirqd/122:46:151
473599150,14cyclictest10097-21kworker/1:000:06:441
473599150,1cyclictest131rcu_sched21:55:461
4733991511,1cyclictest9-21ksoftirqd/023:27:250
278662150,1sleep1758-21runrttasks21:44:231
25352150,1sleep32532-21grepconf.sh22:18:533
219502150,0sleep20-21swapper/223:15:382
163432150,0sleep20-21swapper/221:43:442
161872150,0sleep40-21swapper/422:42:574
147202150,0sleep1241ktimersoftd/122:50:061
4753991411,3cyclictest57-21ksoftirqd/523:29:305
475399140,13cyclictest11707-21kworker/5:322:49:525
4735991413,1cyclictest25-21ksoftirqd/122:30:271
4735991413,1cyclictest25-21ksoftirqd/122:17:061
4735991413,1cyclictest25-21ksoftirqd/121:50:271
4735991412,2cyclictest27151-21sshd21:35:181
4735991412,1cyclictest25-21ksoftirqd/123:53:431
4735991412,1cyclictest25-21ksoftirqd/123:33:151
4735991412,1cyclictest25-21ksoftirqd/123:33:151
4735991412,1cyclictest25-21ksoftirqd/122:28:471
4735991412,1cyclictest25-21ksoftirqd/121:30:431
4735991411,2cyclictest25-21ksoftirqd/122:05:121
473399140,13cyclictest26918-21kworker/0:023:03:540
473399140,12cyclictest0-21swapper/021:56:550
263652140,0sleep60-21swapper/623:28:326
225252140,0sleep40-21swapper/421:56:354
176922140,1sleep226146-1kworker/2:0H00:00:242
169662140,0sleep416969-21bash22:48:254
136052140,0sleep40-21swapper/422:15:494
4753991312,1cyclictest57-21ksoftirqd/521:37:455
4753991311,1cyclictest57-21ksoftirqd/523:48:095
4753991311,1cyclictest57-21ksoftirqd/523:32:345
4753991311,1cyclictest57-21ksoftirqd/523:32:345
4753991311,1cyclictest57-21ksoftirqd/523:18:305
4753991311,1cyclictest57-21ksoftirqd/521:55:465
4753991311,1cyclictest57-21ksoftirqd/521:15:255
4753991310,2cyclictest709-21systemd-logind23:44:525
4753991310,2cyclictest57-21ksoftirqd/500:33:195
4753991310,1cyclictest57-21ksoftirqd/522:07:385
4744991311,1cyclictest41-21ksoftirqd/323:52:173
474499130,12cyclictest32612-21systemd22:04:243
474499130,1cyclictest0-21swapper/322:23:453
4739991312,1cyclictest33-21ksoftirqd/222:56:092
473999130,3cyclictest28441-21sshd21:35:212
473999130,12cyclictest3463-21sshd00:14:052
4735991311,1cyclictest25-21ksoftirqd/123:20:261
4735991311,1cyclictest25-21ksoftirqd/123:20:261
4733991311,1cyclictest9-21ksoftirqd/022:07:520
4733991311,1cyclictest9-21ksoftirqd/000:15:030
473399130,5cyclictest0-21swapper/021:23:370
275952130,0sleep40-21swapper/421:10:144
236422130,0sleep30-21swapper/323:48:073
165362130,0sleep30-21swapper/323:20:443
165362130,0sleep30-21swapper/323:20:443
132112130,0sleep40-21swapper/423:24:134
132112130,0sleep40-21swapper/423:24:134
126392130,0sleep0473399cyclictest21:11:060
475799121,1cyclictest73-21ksoftirqd/719:05:207
475699122,4cyclictest709-21systemd-logind23:49:586
475699122,4cyclictest416-21sshd21:37:256
475699122,4cyclictest30745-21sshd22:18:386
475699122,4cyclictest21874-21cp22:00:136
475699122,4cyclictest17637-21sshd21:07:396
475699122,4cyclictest13312-21sshd21:50:396
475699122,4cyclictest1-21systemd21:44:306
475699122,4cyclictest1-21systemd00:13:426
4756991210,1cyclictest21367-21bash00:15:066
475699121,5cyclictest11571-21systemd22:39:076
475699120,11cyclictest15806-21bash23:18:596
475699120,11cyclictest14969-21kworker/6:522:34:236
475699120,11cyclictest13736-21grep00:34:306
475399129,2cyclictest14952-21grepconf.sh22:35:385
475399129,1cyclictest57-21ksoftirqd/500:08:505
475399127,4cyclictest57-21ksoftirqd/523:25:005
475399127,4cyclictest57-21ksoftirqd/523:25:005
475399127,3cyclictest57-21ksoftirqd/500:28:515
475399122,4cyclictest10483-21sshd22:31:495
4753991211,1cyclictest57-21ksoftirqd/521:20:235
4753991211,1cyclictest57-21ksoftirqd/500:00:415
4753991210,1cyclictest57-21ksoftirqd/522:03:045
4753991210,1cyclictest57-21ksoftirqd/521:09:095
475399121,10cyclictest709-21systemd-logind00:14:205
475199129,2cyclictest9766-21grep23:33:004
475199129,2cyclictest9766-21grep23:33:004
475199122,4cyclictest709-21systemd-logind21:31:154
475199122,4cyclictest24832-21sshd00:17:034
475199122,4cyclictest19396-21sshd23:29:584
475199122,4cyclictest17964-21sshd00:07:404
4751991210,1cyclictest49-21ksoftirqd/423:57:314
4751991210,1cyclictest49-21ksoftirqd/421:53:474
474499129,2cyclictest21603-21bash00:18:433
474499129,2cyclictest16859-21bash21:27:313
474499124,4cyclictest736-21gdbus23:01:123
474499120,1cyclictest29333-21sshd23:12:303
474499120,1cyclictest0-21swapper/323:16:313
473999125,1cyclictest721-21dbus-daemon00:16:052
473999122,4cyclictest30253-21sshd22:22:102
473999120,2cyclictest24113-21systemd23:39:122
473999120,11cyclictest14764-21grep21:34:402
473999120,11cyclictest11070-21kworker/2:023:10:072
4733991210,1cyclictest721-21dbus-daemon22:34:030
473399121,3cyclictest5880-21sshd21:39:350
473399121,1cyclictest0-21swapper/021:50:390
473399120,1cyclictest756-21sshd21:43:570
161122120,1sleep416050-21sshd23:35:114
160512120,0sleep40-21swapper/422:57:224
475799114,1cyclictest73-21ksoftirqd/720:58:297
475799114,1cyclictest73-21ksoftirqd/720:33:387
475799114,1cyclictest73-21ksoftirqd/720:25:177
475799114,1cyclictest73-21ksoftirqd/720:12:587
475799114,1cyclictest73-21ksoftirqd/720:05:517
475799114,1cyclictest73-21ksoftirqd/720:00:197
475799114,1cyclictest73-21ksoftirqd/719:34:507
475799114,1cyclictest73-21ksoftirqd/719:20:457
475799114,1cyclictest73-21ksoftirqd/719:20:457
475799113,1cyclictest73-21ksoftirqd/720:35:187
4757991110,1cyclictest73-21ksoftirqd/719:25:227
4757991110,1cyclictest73-21ksoftirqd/719:25:227
475799110,1cyclictest1887-21perl19:55:197
475699119,1cyclictest65-21ksoftirqd/622:50:076
475699118,2cyclictest9984-21grepconf.sh21:45:116
475699112,4cyclictest23911-21sshd21:13:356
475699112,4cyclictest21811-21systemd-cgroups21:31:236
475699112,4cyclictest14123-21sshd23:56:326
475699112,4cyclictest0-21swapper/623:38:036
475699112,3cyclictest0-21swapper/622:05:266
4756991110,1cyclictest65-21ksoftirqd/600:22:006
475699111,5cyclictest487-21bash00:04:576
475699111,4cyclictest21347-21sshd21:18:486
475699111,4cyclictest15126-21sshd00:29:106
475699111,4cyclictest0-21swapper/600:06:066
475699110,5cyclictest4649-21systemd23:52:276
475699110,11cyclictest10628-21kworker/6:421:25:146
475699110,11cyclictest1042-21kworker/6:023:33:026
475699110,11cyclictest1042-21kworker/6:023:33:026
475699110,1cyclictest0-21swapper/623:02:356
475399119,1cyclictest57-21ksoftirqd/522:12:055
475399119,1cyclictest57-21ksoftirqd/521:31:595
475399119,1cyclictest57-21ksoftirqd/521:14:355
475399117,3cyclictest57-21ksoftirqd/523:12:325
475399112,3cyclictest3210-21sshd21:50:125
475399110,11cyclictest18032-21kworker/5:122:16:195
475399110,10cyclictest21096-21kworker/5:123:36:325
475399110,10cyclictest1-21systemd23:56:455
475399110,10cyclictest0-21swapper/500:15:505
475199116,3cyclictest12465-21kworker/4:422:33:574
475199113,4cyclictest28994-21sshd22:23:564
475199112,4cyclictest4453-21sshd23:02:094
475199112,4cyclictest32359-21sshd23:43:134
4751991110,1cyclictest49-21ksoftirqd/421:25:224
4751991110,1cyclictest49-21ksoftirqd/400:25:434
475199111,4cyclictest0-21swapper/400:04:074
475199110,10cyclictest20164-21systemd23:17:234
475199110,10cyclictest1-21systemd23:47:014
475199110,10cyclictest0-21swapper/423:09:114
475199110,1cyclictest25719-21grepconf.sh00:13:304
474499119,1cyclictest721-21dbus-daemon22:51:513
474499119,1cyclictest41-21ksoftirqd/323:08:243
474499119,1cyclictest1-21systemd22:31:123
474499118,2cyclictest8147-21id22:10:143
474499118,2cyclictest41-21ksoftirqd/321:53:303
474499116,2cyclictest721-21dbus-daemon21:56:293
474499112,6cyclictest12237-21sshd00:34:253
474499110,6cyclictest9094-21sshd23:56:153
474499110,11cyclictest0-21swapper/300:22:583
474499110,10cyclictest10379-21perf19:15:053
473999119,2cyclictest33-21ksoftirqd/223:41:182
473999119,1cyclictest33-21ksoftirqd/223:07:272
473999119,1cyclictest33-21ksoftirqd/222:51:472
473999119,1cyclictest0-21swapper/222:10:272
473999117,1cyclictest33-21ksoftirqd/223:02:542
473999112,4cyclictest0-21swapper/222:48:472
473999112,4cyclictest0-21swapper/200:21:482
4739991110,1cyclictest33-21ksoftirqd/222:25:552
4739991110,1cyclictest33-21ksoftirqd/221:15:192
473999111,4cyclictest721-21dbus-daemon22:09:312
473999111,4cyclictest25207-21sshd00:29:452
473999111,4cyclictest0-21swapper/200:32:272
473999110,11cyclictest878-21kworker/2:521:54:162
473999110,11cyclictest27500-21sshd21:47:542
473999110,11cyclictest15823-21kworker/2:222:30:562
473999110,1cyclictest0-21swapper/223:32:352
473999110,1cyclictest0-21swapper/223:32:352
473399119,1cyclictest9-21ksoftirqd/023:12:060
473399119,1cyclictest9-21ksoftirqd/022:55:160
473399119,1cyclictest9-21ksoftirqd/022:21:500
473399119,1cyclictest9-21ksoftirqd/021:46:530
473399119,1cyclictest730-21NetworkManager22:42:150
473399115,4cyclictest0-21swapper/000:17:070
473399114,4cyclictest464-21systemd-journal22:03:430
473399110,7cyclictest0-21swapper/023:31:170
473399110,7cyclictest0-21swapper/023:31:170
473399110,1cyclictest0-21swapper/023:48:560
475799109,1cyclictest73-21ksoftirqd/719:50:057
475799103,3cyclictest73-21ksoftirqd/720:15:217
475799103,1cyclictest73-21ksoftirqd/720:41:357
475799103,1cyclictest73-21ksoftirqd/720:22:087
475799103,1cyclictest73-21ksoftirqd/719:44:127
475799103,1cyclictest73-21ksoftirqd/719:19:447
475799101,2cyclictest73-21ksoftirqd/721:00:267
475699109,1cyclictest65-21ksoftirqd/622:40:526
475699103,6cyclictest31566-21sshd23:43:106
475699102,3cyclictest13559-21grepconf.sh23:06:136
475699101,4cyclictest26607-21sshd23:10:316
475699100,4cyclictest85150irq/25-em1-rx-021:57:486
475699100,4cyclictest0-21swapper/622:11:286
475699100,10cyclictest22516-21sshd22:27:076
475699100,10cyclictest0-21swapper/621:25:006
475399109,1cyclictest57-21ksoftirqd/523:53:015
475399109,1cyclictest57-21ksoftirqd/522:25:455
475399108,2cyclictest3753-21sshd23:07:305
475399108,1cyclictest57-21ksoftirqd/521:45:465
475199109,1cyclictest0-21swapper/423:54:264
475199108,1cyclictest49-21ksoftirqd/422:03:124
475199104,3cyclictest29963-21kworker/4:021:40:294
475199103,6cyclictest22075-21sshd21:17:024
475199103,6cyclictest12962-21sshd21:09:264
475199103,6cyclictest12428-21sshd22:06:484
475199103,1cyclictest0-21swapper/400:31:214
475199101,4cyclictest10665-21sshd21:36:094
475199100,4cyclictest10256-21bash21:21:444
475199100,10cyclictest19262-21kworker/4:222:11:594
474499109,1cyclictest0-21swapper/323:26:323
474499109,1cyclictest0-21swapper/322:05:113
474499108,1cyclictest5439-21sshd21:12:323
474499108,1cyclictest41-21ksoftirqd/323:36:383
474499108,1cyclictest41-21ksoftirqd/322:35:333
474499108,1cyclictest41-21ksoftirqd/300:02:393
474499103,4cyclictest31657-21grepconf.sh00:06:363
474499102,5cyclictest26681-21sshd21:33:313
474499102,4cyclictest1-21systemd21:15:173
474499101,6cyclictest28422-21sshd21:46:073
474499100,9cyclictest19022-21kworker/3:322:56:113
474499100,1cyclictest0-21swapper/322:45:143
473999109,1cyclictest25500-21iostat22:00:222
473999103,6cyclictest13550irq/24-ahci[00021:11:562
473999101,4cyclictest0-21swapper/223:58:352
473999100,10cyclictest709-21systemd-logind21:26:562
473999100,10cyclictest0-21swapper/223:25:582
473999100,10cyclictest0-21swapper/200:08:032
473399109,1cyclictest9-21ksoftirqd/000:01:490
473399108,1cyclictest9-21ksoftirqd/023:36:200
473399108,1cyclictest9-21ksoftirqd/022:46:540
473399104,0cyclictest0-21swapper/000:08:410
473399101,4cyclictest19827-21sshd23:51:280
473399100,7cyclictest0-21swapper/022:17:430
473399100,6cyclictest18076-21systemd23:17:160
473399100,6cyclictest0-21swapper/022:11:290
473399100,10cyclictest25761-21kworker/0:522:35:090
473399100,10cyclictest0-21swapper/021:30:400
473399100,10cyclictest0-21swapper/000:20:280
47579991,1cyclictest9965-21awk19:10:267
47579990,1cyclictest0-21swapper/719:35:177
47579990,0cyclictest121rcu_preempt20:45:237
47569997,1cyclictest65-21ksoftirqd/620:10:056
47569992,1cyclictest857-21polkitd22:20:426
47449997,1cyclictest41-21ksoftirqd/322:27:433
47449993,2cyclictest10024-21sshd00:25:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional