You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 02:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue May 26, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2384321040,0sleep70-21swapper/722:28:067
2384321040,0sleep70-21swapper/722:28:067
127252770,2sleep62412899cyclictest00:16:186
202712730,1sleep1241ktimersoftd/100:29:351
262952720,1sleep326290-21sshd23:05:033
195832690,0sleep00-21swapper/021:32:410
195832690,0sleep00-21swapper/021:32:410
213122620,0sleep40-21swapper/400:16:484
98332530,0sleep40-21swapper/421:57:524
274432520,2sleep02408599cyclictest21:38:420
2371625127,8sleep60-21swapper/619:05:386
2360625025,9sleep50-21swapper/519:04:095
127362500,1sleep6758-21runrttasks22:45:526
3192490,1sleep233-21ksoftirqd/222:06:312
283342490,0sleep00-21swapper/022:33:520
230912480,1sleep125-21ksoftirqd/100:35:191
2380824726,17sleep00-21swapper/019:06:520
177782470,0sleep50-21swapper/521:36:145
208732460,0sleep50-21swapper/500:00:075
50262450,0sleep30-21swapper/323:26:013
292842450,1sleep529283-21sshd00:24:345
164522450,0sleep20-21swapper/221:39:482
78592440,0sleep50-21swapper/522:56:405
17842440,1sleep31-21systemd00:00:533
284602430,0sleep60-21swapper/622:09:556
192982430,0sleep40-21swapper/421:27:084
136302420,0sleep10-21swapper/123:08:051
130912420,0sleep20-21swapper/221:12:012
28602410,0sleep30-21swapper/322:21:223
256322410,1sleep725631-21sshd23:14:127
2379424129,9sleep40-21swapper/419:06:404
2379224130,8sleep20-21swapper/219:06:382
2372624129,8sleep70-21swapper/719:05:477
214172410,1sleep3758-21runrttasks22:37:083
282932400,0sleep30-21swapper/323:55:013
240242400,0sleep50-21swapper/500:07:445
240242400,0sleep50-21swapper/500:07:445
2392724027,9sleep30-21swapper/319:08:323
228812400,0sleep00-21swapper/022:44:330
177422400,0sleep60-21swapper/623:24:526
176932400,0sleep60-21swapper/623:17:316
204262390,0sleep00-21swapper/021:27:120
2364923827,8sleep10-21swapper/119:04:451
88282370,1sleep58829-21grepconf.sh22:29:015
35932370,0sleep00-21swapper/021:13:270
193562360,2sleep42411999cyclictest23:17:374
24127992117,3cyclictest57-21ksoftirqd/521:22:055
24127992017,1cyclictest57-21ksoftirqd/523:23:575
198622200,1sleep519861-21grepconf.sh00:14:495
24127991912,3cyclictest57-21ksoftirqd/521:44:325
274522180,1sleep449-21ksoftirqd/422:30:044
24127991816,1cyclictest57-21ksoftirqd/523:07:325
24127991816,1cyclictest57-21ksoftirqd/522:47:095
24127991815,1cyclictest57-21ksoftirqd/523:56:575
24127991814,3cyclictest57-21ksoftirqd/523:03:355
259472170,1sleep525946-21grepconf.sh22:09:465
24127991716,1cyclictest57-21ksoftirqd/523:11:385
24127991715,1cyclictest57-21ksoftirqd/523:21:275
24127991715,1cyclictest57-21ksoftirqd/523:15:375
24127991715,1cyclictest57-21ksoftirqd/522:33:495
24127991713,3cyclictest57-21ksoftirqd/500:33:535
24127991713,3cyclictest57-21ksoftirqd/500:19:365
24127991710,4cyclictest57-21ksoftirqd/522:26:495
24127991710,4cyclictest57-21ksoftirqd/522:26:495
2412799170,1cyclictest57-21ksoftirqd/523:39:505
2411399176,5cyclictest20700-21bash23:01:023
24085991716,1cyclictest9-21ksoftirqd/021:42:130
9782160,0sleep50-21swapper/523:33:165
322292160,0sleep60-21swapper/600:22:596
24129991615,1cyclictest0-21swapper/721:21:547
2412799169,4cyclictest57-21ksoftirqd/522:03:545
24127991615,1cyclictest57-21ksoftirqd/521:40:255
24127991614,1cyclictest57-21ksoftirqd/523:48:535
24127991614,1cyclictest57-21ksoftirqd/522:52:205
24127991614,1cyclictest57-21ksoftirqd/522:42:055
24127991613,2cyclictest57-21ksoftirqd/523:43:505
24127991613,2cyclictest57-21ksoftirqd/521:18:245
24127991613,2cyclictest57-21ksoftirqd/500:31:355
24127991611,3cyclictest57-21ksoftirqd/521:08:495
24127991610,2cyclictest57-21ksoftirqd/500:12:295
2412799161,1cyclictest131rcu_sched22:23:265
24085991614,1cyclictest9-21ksoftirqd/023:23:310
24085991613,3cyclictest9-21ksoftirqd/022:52:510
156182160,0sleep30-21swapper/322:03:443
136502160,0sleep7758-21runrttasks21:13:587
78212150,1sleep47820-21grepconf.sh21:39:184
7672150,1sleep0766-21grepconf.sh00:10:030
252852150,0sleep20-21swapper/222:59:252
24127991513,1cyclictest57-21ksoftirqd/522:00:205
24127991513,1cyclictest57-21ksoftirqd/521:26:425
24127991511,1cyclictest57-21ksoftirqd/521:30:295
24127991511,1cyclictest57-21ksoftirqd/521:30:295
24093991513,1cyclictest25-21ksoftirqd/121:28:241
24085991514,1cyclictest9-21ksoftirqd/023:15:040
15962150,1sleep41594-21bash22:54:234
65462140,0sleep60-21swapper/622:34:226
293382140,0sleep7721ktimersoftd/721:40:337
24127991413,1cyclictest57-21ksoftirqd/522:15:285
24127991413,1cyclictest57-21ksoftirqd/521:56:345
24127991412,1cyclictest57-21ksoftirqd/523:34:245
24127991412,1cyclictest57-21ksoftirqd/521:52:235
24105991412,1cyclictest33-21ksoftirqd/223:58:512
24105991412,1cyclictest33-21ksoftirqd/222:34:152
2409399143,5cyclictest4451-21grep22:36:081
24093991412,1cyclictest25-21ksoftirqd/100:06:361
24093991412,1cyclictest25-21ksoftirqd/100:06:361
2409399140,13cyclictest23891-21sshd21:40:141
24085991413,1cyclictest9-21ksoftirqd/023:47:300
24085991413,1cyclictest9-21ksoftirqd/023:11:150
24085991413,1cyclictest9-21ksoftirqd/023:06:390
24085991412,1cyclictest9-21ksoftirqd/023:50:410
24085991412,1cyclictest9-21ksoftirqd/023:24:020
24085991412,1cyclictest9-21ksoftirqd/023:00:380
24085991412,1cyclictest9-21ksoftirqd/021:46:510
24085991412,1cyclictest9-21ksoftirqd/000:26:190
24085991411,2cyclictest9-21ksoftirqd/022:57:340
2408599140,13cyclictest31254-21kworker/0:021:23:220
158432140,3sleep2321ktimersoftd/222:25:452
158432140,3sleep2321ktimersoftd/222:25:452
128682140,0sleep10-21swapper/122:01:411
83182130,0sleep10-21swapper/122:49:151
2412899133,4cyclictest20740-21sshd22:02:096
2412899132,1cyclictest85150irq/25-em1-rx-021:18:136
24128991312,1cyclictest65-21ksoftirqd/600:26:336
24128991310,2cyclictest1-21systemd21:48:106
24119991312,1cyclictest49-21ksoftirqd/400:13:114
24119991311,1cyclictest49-21ksoftirqd/423:34:594
24119991311,1cyclictest49-21ksoftirqd/423:28:504
2411399133,4cyclictest3740-21sshd23:40:433
2411399132,5cyclictest27130-21cp21:56:593
24113991311,1cyclictest41-21ksoftirqd/322:52:153
2409399133,4cyclictest23403-21sshd23:23:271
24093991312,1cyclictest25-21ksoftirqd/121:32:491
24093991312,1cyclictest25-21ksoftirqd/121:32:491
24093991310,1cyclictest7122-21sshd22:30:461
2409399130,13cyclictest5421-21kworker/1:623:31:471
2409399130,13cyclictest0-21swapper/123:51:501
24085991312,1cyclictest9-21ksoftirqd/023:28:540
24085991312,1cyclictest9-21ksoftirqd/022:28:030
24085991312,1cyclictest9-21ksoftirqd/022:28:030
24085991312,1cyclictest9-21ksoftirqd/000:21:350
24085991311,1cyclictest9-21ksoftirqd/023:58:190
24085991311,1cyclictest9-21ksoftirqd/023:39:350
24085991311,1cyclictest9-21ksoftirqd/023:37:110
24085991311,1cyclictest9-21ksoftirqd/022:22:290
24085991311,1cyclictest9-21ksoftirqd/000:37:170
138252130,1sleep613776-21sshd21:23:106
2412999122,4cyclictest721-21dbus-daemon22:44:297
2412999122,4cyclictest18750-21sshd22:36:587
2412999122,4cyclictest1398-21sshd21:53:437
2412999122,4cyclictest13364-21sshd23:59:417
2412999122,4cyclictest1-21systemd00:30:377
2412999122,4cyclictest0-21swapper/722:38:507
24129991210,1cyclictest73-21ksoftirqd/723:28:147
2412999121,5cyclictest6187-21sshd23:13:127
2412999120,11cyclictest4359-21kworker/7:222:53:467
2412999120,11cyclictest24035-21grepconf.sh23:47:267
2412899122,4cyclictest7781-21sshd22:21:396
24128991210,1cyclictest65-21ksoftirqd/622:27:206
24128991210,1cyclictest65-21ksoftirqd/622:27:206
24128991210,1cyclictest65-21ksoftirqd/622:05:436
2412899120,11cyclictest12161-21systemd23:02:256
24119991211,1cyclictest49-21ksoftirqd/422:49:384
24119991210,2cyclictest49-21ksoftirqd/400:38:404
24119991210,1cyclictest49-21ksoftirqd/423:44:054
24119991210,1cyclictest49-21ksoftirqd/423:06:234
24119991210,1cyclictest49-21ksoftirqd/422:15:414
24119991210,1cyclictest49-21ksoftirqd/422:00:454
24119991210,1cyclictest49-21ksoftirqd/421:44:414
24119991210,1cyclictest49-21ksoftirqd/421:30:514
24119991210,1cyclictest49-21ksoftirqd/421:30:514
2411399123,4cyclictest15598-21sshd21:30:343
2411399123,4cyclictest15598-21sshd21:30:343
2411399122,5cyclictest6079-21bash21:20:513
2411399122,4cyclictest7708-21sshd00:36:193
2411399122,4cyclictest3747-21grep23:44:223
2410599125,6cyclictest1-21systemd22:02:282
2410599122,4cyclictest19228-21bash00:20:192
2410599122,4cyclictest1-21systemd23:46:372
2410599122,4cyclictest0-21swapper/221:37:052
2410599120,11cyclictest32420-21kworker/2:100:11:352
2410599120,11cyclictest28242-21kworker/2:322:20:572
2409399129,2cyclictest10933-21sshd22:08:571
2409399124,7cyclictest13540-21sshd22:05:231
2409399122,4cyclictest2458-21sshd23:44:171
24093991210,1cyclictest25-21ksoftirqd/121:54:481
24085991210,1cyclictest9-21ksoftirqd/022:41:320
24085991210,1cyclictest9-21ksoftirqd/022:06:260
24085991210,1cyclictest9-21ksoftirqd/021:54:100
24085991210,1cyclictest9-21ksoftirqd/021:52:350
24085991210,1cyclictest9-21ksoftirqd/000:02:560
14842120,2sleep22410599cyclictest23:38:502
112302120,2sleep72412999cyclictest23:31:587
104142120,0sleep00-21swapper/021:15:350
315632110,0sleep10-21swapper/123:36:481
296572110,0sleep60-21swapper/623:31:096
2412999119,1cyclictest73-21ksoftirqd/723:19:177
2412999119,1cyclictest73-21ksoftirqd/721:35:127
2412999114,1cyclictest73-21ksoftirqd/700:12:037
2412999113,4cyclictest11375-21sshd22:23:437
2412999112,4cyclictest0-21swapper/723:07:097
24129991110,1cyclictest73-21ksoftirqd/721:48:407
2412999111,5cyclictest0-21swapper/700:26:577
2412999111,4cyclictest32451-21sshd21:11:077
2412999111,4cyclictest28230-21sshd23:42:097
2412999111,4cyclictest25083-21sshd23:51:107
2412999111,4cyclictest24115-21sshd22:00:287
2412999111,4cyclictest18556-21sshd00:20:177
2412999111,4cyclictest14617-21sshd22:05:277
2412999110,5cyclictest30731-21sshd22:59:447
2412999110,11cyclictest14599-21kworker/7:200:17:017
2412899119,1cyclictest65-21ksoftirqd/621:39:206
2412899113,4cyclictest730-21NetworkManager00:06:236
2412899113,4cyclictest730-21NetworkManager00:06:236
2412899112,4cyclictest19020-21sshd22:16:476
2412899112,4cyclictest18776-21sshd23:41:366
2412899112,4cyclictest0-21swapper/622:52:276
2412899111,5cyclictest18708-21grep23:21:156
2412899110,11cyclictest6531-21kworker/6:323:47:036
2412899110,11cyclictest30549-21kworker/6:022:56:286
2412899110,11cyclictest16508-21kworker/6:000:35:546
2412899110,11cyclictest1407-21kworker/6:222:39:176
2412899110,1cyclictest0-21swapper/621:54:556
2411999119,2cyclictest49-21ksoftirqd/422:28:264
2411999119,2cyclictest49-21ksoftirqd/422:28:264
2411999119,1cyclictest49-21ksoftirqd/423:50:564
2411999119,1cyclictest49-21ksoftirqd/423:10:504
2411999119,1cyclictest49-21ksoftirqd/422:37:564
2411999119,1cyclictest49-21ksoftirqd/421:36:404
2411999119,1cyclictest49-21ksoftirqd/421:09:514
2411999119,1cyclictest49-21ksoftirqd/400:00:544
2411999119,1cyclictest0-21swapper/400:30:034
2411999114,5cyclictest709-21systemd-logind21:13:464
2411999113,5cyclictest27146-21sshd21:20:114
24119991110,1cyclictest49-21ksoftirqd/422:18:564
2411399119,1cyclictest41-21ksoftirqd/321:36:253
2411399112,4cyclictest721-21dbus-daemon00:26:143
2411399112,4cyclictest17056-21sshd22:05:363
2411399112,4cyclictest1079-21sshd00:15:373
2411399112,4cyclictest0-21swapper/323:21:443
2411399112,4cyclictest0-21swapper/322:44:573
2411399111,4cyclictest857-21polkitd21:53:083
2411399111,4cyclictest721-21dbus-daemon21:12:543
2411399111,4cyclictest10772-21sd-pam00:29:033
2411399111,4cyclictest0-21swapper/322:39:483
2410599119,1cyclictest11520-21systemd23:06:052
2410599113,7cyclictest17248-21sshd23:54:222
2410599112,4cyclictest25757-21sshd21:33:032
2410599112,4cyclictest25757-21sshd21:33:032
2410599112,4cyclictest0-21swapper/223:50:182
2410599112,4cyclictest0-21swapper/221:15:002
2410599111,4cyclictest709-21systemd-logind22:16:302
2410599111,4cyclictest29093-21sshd21:46:022
2410599111,4cyclictest25659-21sshd23:25:202
2410599111,4cyclictest23679-21grepconf.sh22:52:022
2410599111,4cyclictest10545-21id23:09:402
2410599110,11cyclictest8255-21kworker/2:121:49:172
2410599110,11cyclictest4138-21kworker/2:122:46:392
2410599110,10cyclictest5763-21kworker/2:422:54:232
2410599110,10cyclictest26827-21bash23:32:532
2410599110,10cyclictest25822-21kworker/2:621:20:062
2409399119,1cyclictest25-21ksoftirqd/122:44:251
2409399119,1cyclictest18588-21systemd-cgroups21:10:091
2409399118,2cyclictest3569-21grepconf.sh23:00:021
2409399112,3cyclictest0-21swapper/122:39:031
24093991110,1cyclictest25-21ksoftirqd/123:09:321
24093991110,1cyclictest25-21ksoftirqd/100:20:431
24093991110,1cyclictest0-21swapper/121:23:421
2409399111,4cyclictest4239-21sshd22:17:491
2409399111,4cyclictest30636-21sshd21:36:591
2409399111,4cyclictest0-21swapper/121:51:431
2409399110,5cyclictest25780-21grepconf.sh21:45:511
2409399110,11cyclictest4527-21kworker/1:122:54:581
2409399110,10cyclictest15938-21kworker/1:123:24:211
2409399110,10cyclictest14632-21kworker/1:300:03:421
2408599119,1cyclictest9-21ksoftirqd/022:29:260
2408599119,1cyclictest9-21ksoftirqd/022:13:560
2408599119,1cyclictest9-21ksoftirqd/022:10:360
2408599119,1cyclictest9-21ksoftirqd/021:59:020
2408599119,1cyclictest9-21ksoftirqd/000:14:380
2408599118,2cyclictest9-21ksoftirqd/000:28:590
24085991110,1cyclictest9-21ksoftirqd/000:08:110
24085991110,1cyclictest9-21ksoftirqd/000:08:110
226422110,0sleep40-21swapper/422:39:014
163712110,0sleep40-21swapper/423:58:064
127742110,0sleep212771-21sshd00:32:562
267562100,0sleep60-21swapper/620:08:556
2412999108,1cyclictest73-21ksoftirqd/700:06:427
2412999108,1cyclictest73-21ksoftirqd/700:06:427
2412999108,1cyclictest1-21systemd00:35:047
2412999103,6cyclictest13378-21sshd21:30:277
2412999103,6cyclictest13378-21sshd21:30:277
2412999103,1cyclictest20311-21sshd22:14:597
2412999102,4cyclictest12251-21bash22:09:007
2412999101,5cyclictest11797-21sshd21:54:117
2412999101,4cyclictest0-21swapper/722:32:517
2412999101,4cyclictest0-21swapper/721:23:447
2412999100,4cyclictest29160-21sshd23:55:037
2412999100,4cyclictest0-21swapper/723:34:357
2412899108,1cyclictest65-21ksoftirqd/623:55:036
2412899105,1cyclictest0-21swapper/623:59:566
2412899103,6cyclictest0-21swapper/623:36:006
2412899102,2cyclictest857-21polkitd21:50:486
2412899101,4cyclictest8346-21sshd21:24:366
2412899101,4cyclictest20943-21bash23:10:166
2412899101,4cyclictest0-21swapper/621:28:566
2412899101,4cyclictest0-21swapper/621:28:566
2412899100,4cyclictest8138-21sshd21:35:416
2412899100,4cyclictest2604-21sed21:09:036
2412899100,10cyclictest0-21swapper/623:52:056
2411999109,1cyclictest49-21ksoftirqd/423:19:464
2411999108,1cyclictest49-21ksoftirqd/421:50:064
2411999108,1cyclictest49-21ksoftirqd/400:06:414
2411999108,1cyclictest49-21ksoftirqd/400:06:414
2411999104,3cyclictest20977-21bash22:13:164
2411999104,3cyclictest1-21systemd23:26:394
2411999103,4cyclictest17392-21bash00:22:064
2411999100,10cyclictest0-21swapper/420:29:004
2411399109,1cyclictest41-21ksoftirqd/323:49:583
2411399109,1cyclictest41-21ksoftirqd/322:31:103
2411399109,1cyclictest41-21ksoftirqd/322:09:483
2411399109,1cyclictest41-21ksoftirqd/321:38:573
2411399108,1cyclictest41-21ksoftirqd/300:13:423
2411399108,1cyclictest0-21swapper/321:47:173
2411399104,5cyclictest857-21polkitd23:10:353
2411399103,6cyclictest12417-21sshd21:13:553
2411399103,6cyclictest11985-21sshd22:18:163
2411399103,1cyclictest730-21NetworkManager00:23:153
2411399103,1cyclictest0-21swapper/323:34:513
2411399102,7cyclictest15138-21grepconf.sh23:17:223
2411399100,4cyclictest18880-21sshd00:05:323
2411399100,4cyclictest18880-21sshd00:05:323
2411399100,10cyclictest10216-21kworker/3:522:24:323
2411399100,10cyclictest10216-21kworker/3:522:24:323
2410599108,1cyclictest33-21ksoftirqd/220:08:432
2410599103,6cyclictest10759-21sshd22:29:092
2410599103,1cyclictest0-21swapper/222:39:412
2410599102,7cyclictest11835-21bash00:14:212
2410599102,4cyclictest2900-21bash21:55:342
2410599102,4cyclictest28562-21systemd23:14:222
2410599100,4cyclictest11503-21sshd23:18:582
2410599100,4cyclictest10937-21bash21:24:452
2410599100,1cyclictest0-21swapper/223:34:272
2409399109,1cyclictest25-21ksoftirqd/122:20:441
2409399109,1cyclictest25-21ksoftirqd/121:17:441
2409399108,1cyclictest25-21ksoftirqd/100:09:381
2409399100,4cyclictest922-21sshd23:16:331
2409399100,4cyclictest721-21dbus-daemon23:57:111
2409399100,4cyclictest18388-21sshd00:23:591
2409399100,1cyclictest0-21swapper/122:24:051
2409399100,1cyclictest0-21swapper/122:24:051
241299991,4cyclictest669-21avahi-daemon22:48:467
241289997,1cyclictest65-21ksoftirqd/623:04:136
241289997,1cyclictest65-21ksoftirqd/622:29:116
241289997,1cyclictest13740-21sshd00:08:576
241289991,2cyclictest663-21in:imjournal00:29:236
241279998,1cyclictest57-21ksoftirqd/519:28:435
241279997,1cyclictest57-21ksoftirqd/520:48:445
241279990,9cyclictest0-21swapper/519:48:455
241199998,1cyclictest49-21ksoftirqd/423:00:134
241199998,1cyclictest49-21ksoftirqd/422:44:004
241199997,1cyclictest49-21ksoftirqd/400:24:564
241199993,3cyclictest6091-21kworker/4:123:38:484
241199992,3cyclictest14418-21sshd22:05:264
241199990,9cyclictest0-21swapper/419:19:004
241139997,1cyclictest41-21ksoftirqd/322:53:473
241139992,4cyclictest13493-21grep23:30:123
241139990,4cyclictest25708-21sshd21:23:513
241059993,1cyclictest0-21swapper/200:35:002
241059992,6cyclictest24569-21sshd00:05:532
241059992,6cyclictest24569-21sshd00:05:532
241059992,6cyclictest1-21systemd00:23:492
241059990,4cyclictest0-21swapper/222:09:312
240939997,1cyclictest25-21ksoftirqd/123:39:441
240939997,1cyclictest25-21ksoftirqd/100:14:431
240859990,3cyclictest0-21swapper/020:22:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional