You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 01:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Jun 12, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
308572840,0sleep10-21swapper/122:14:211
77812830,1sleep71-21systemd21:09:087
181932760,2sleep71871599cyclictest21:27:107
235412640,1sleep341-21ksoftirqd/323:12:383
276582590,1sleep773-21ksoftirqd/721:49:047
276582590,1sleep773-21ksoftirqd/721:49:047
58762580,2sleep01868999cyclictest21:13:170
207652580,10sleep685150irq/25-em1-rx-023:49:096
5212560,0sleep60-21swapper/623:38:206
321652540,1sleep032160-21systemd22:10:360
144572540,2sleep71871599cyclictest21:13:407
280642530,0sleep30-21swapper/321:14:323
232522530,0sleep20-21swapper/221:35:142
317232520,2sleep41869399cyclictest22:45:324
1608725240,8sleep30-21swapper/319:03:093
115972510,0sleep70-21swapper/723:00:087
313642490,0sleep60-21swapper/623:45:576
1846424925,9sleep50-21swapper/519:06:405
136902490,0sleep40-21swapper/423:54:364
136902490,0sleep40-21swapper/423:54:364
1856524825,8sleep10-21swapper/119:08:041
1839424825,8sleep20-21swapper/219:05:412
180342480,0sleep30-21swapper/322:54:363
142932480,0sleep30-21swapper/323:50:423
31362470,1sleep1231rcuc/122:28:071
249502470,1sleep424954-21bash21:21:544
176692470,0sleep10-21swapper/100:35:331
200652460,1sleep116622-21kworker/u16:021:12:141
11632460,0sleep40-21swapper/421:10:574
290172450,0sleep20-21swapper/223:14:452
1852624533,8sleep00-21swapper/019:07:310
1836824432,9sleep70-21swapper/719:05:217
1833024431,9sleep40-21swapper/419:04:544
166322440,1sleep3758-21runrttasks00:15:573
73002430,0sleep50-21swapper/523:59:575
311922420,0sleep4758-21runrttasks21:27:554
291782420,0sleep30-21swapper/322:45:233
215162420,0sleep70-21swapper/722:50:397
215162420,0sleep70-21swapper/722:50:397
188822420,0sleep50-21swapper/523:53:015
151962420,0sleep50-21swapper/523:39:075
148842420,0sleep10-21swapper/123:48:481
122832420,0sleep40-21swapper/422:11:204
118022420,0sleep00-21swapper/021:32:230
264582410,0sleep20-21swapper/221:23:442
244762410,0sleep30-21swapper/322:27:293
165612410,0sleep60-21swapper/621:42:396
97032400,0sleep20-21swapper/219:48:162
297612400,0sleep129762-21systemd-cgroups21:45:221
286692400,0sleep70-21swapper/721:18:217
181872400,0sleep60-21swapper/600:29:386
89532390,0sleep60-21swapper/621:32:136
66002390,0sleep10-21swapper/122:55:541
1855023926,9sleep60-21swapper/619:07:536
9032380,0sleep40-21swapper/423:34:254
41872370,2sleep61870999cyclictest22:32:046
204432370,0sleep50-21swapper/521:40:535
193902350,0sleep40-21swapper/423:39:224
1870199268,1cyclictest57-21ksoftirqd/523:01:445
18701992210,3cyclictest57-21ksoftirqd/522:58:035
212442210,0sleep10-21swapper/123:04:351
18709992116,4cyclictest65-21ksoftirqd/622:16:106
112812200,2sleep4481ktimersoftd/423:19:284
61932190,1sleep46186-21sshd22:30:104
1870199199,1cyclictest57-21ksoftirqd/522:21:385
1870199197,1cyclictest57-21ksoftirqd/500:20:055
1870199192,3cyclictest57-21ksoftirqd/522:35:535
1870199192,1cyclictest57-21ksoftirqd/500:24:305
18701991917,1cyclictest57-21ksoftirqd/522:30:495
18701991917,1cyclictest57-21ksoftirqd/521:31:175
18701991916,3cyclictest57-21ksoftirqd/500:10:195
18701991915,1cyclictest57-21ksoftirqd/523:44:475
18701991914,4cyclictest57-21ksoftirqd/521:20:325
18701991914,1cyclictest57-21ksoftirqd/523:03:285
18701991913,3cyclictest57-21ksoftirqd/522:08:065
18701991913,3cyclictest57-21ksoftirqd/521:27:545
1869099199,2cyclictest25-21ksoftirqd/123:15:311
18690991915,3cyclictest25-21ksoftirqd/121:28:561
18689991915,3cyclictest9-21ksoftirqd/021:35:390
249202180,0sleep70-21swapper/700:22:267
222992180,0sleep20-21swapper/200:26:052
1870999184,3cyclictest65-21ksoftirqd/600:22:506
18709991817,1cyclictest65-21ksoftirqd/622:08:426
18709991814,3cyclictest65-21ksoftirqd/621:26:186
18709991813,3cyclictest65-21ksoftirqd/600:23:536
1870999181,4cyclictest65-21ksoftirqd/622:44:426
18701991816,1cyclictest57-21ksoftirqd/523:18:565
18701991815,2cyclictest57-21ksoftirqd/500:37:225
18701991815,1cyclictest57-21ksoftirqd/500:05:565
18701991814,3cyclictest57-21ksoftirqd/521:12:405
18701991813,3cyclictest57-21ksoftirqd/523:33:215
18690991817,1cyclictest25-21ksoftirqd/123:47:571
18690991816,1cyclictest25-21ksoftirqd/122:42:561
18690991813,3cyclictest25-21ksoftirqd/121:35:471
18690991813,2cyclictest25-21ksoftirqd/123:00:261
1869099180,17cyclictest7667-21kworker/1:522:07:231
272552170,0sleep60-21swapper/622:35:256
18715991715,1cyclictest73-21ksoftirqd/723:30:237
18709991715,1cyclictest65-21ksoftirqd/623:02:246
18709991714,3cyclictest65-21ksoftirqd/621:37:466
18709991711,4cyclictest65-21ksoftirqd/623:29:306
1870999170,3cyclictest131rcu_sched23:22:466
18701991716,1cyclictest57-21ksoftirqd/523:32:545
18701991716,1cyclictest57-21ksoftirqd/522:06:075
18701991715,1cyclictest57-21ksoftirqd/500:30:465
18701991715,1cyclictest57-21ksoftirqd/500:16:145
18701991714,3cyclictest57-21ksoftirqd/522:50:165
18701991714,3cyclictest57-21ksoftirqd/522:50:165
18701991714,1cyclictest57-21ksoftirqd/523:10:295
18701991714,1cyclictest57-21ksoftirqd/522:43:215
18701991713,2cyclictest57-21ksoftirqd/521:45:415
18701991713,1cyclictest57-21ksoftirqd/522:15:285
18701991713,1cyclictest57-21ksoftirqd/521:52:315
18701991713,1cyclictest57-21ksoftirqd/521:52:315
1870199170,1cyclictest121rcu_preempt22:42:015
1869099174,1cyclictest25-21ksoftirqd/123:38:341
18690991714,2cyclictest25-21ksoftirqd/122:20:141
18690991712,2cyclictest25-21ksoftirqd/122:37:581
18690991712,2cyclictest25-21ksoftirqd/121:25:141
18690991711,3cyclictest464-21systemd-journal00:09:111
18689991713,1cyclictest9-21ksoftirqd/022:02:000
85562160,0sleep10-21swapper/100:19:321
1870999164,1cyclictest65-21ksoftirqd/621:13:376
1870999163,1cyclictest65-21ksoftirqd/622:40:556
18709991615,1cyclictest65-21ksoftirqd/622:50:066
18709991615,1cyclictest65-21ksoftirqd/622:50:066
18709991615,1cyclictest65-21ksoftirqd/600:07:006
18709991614,2cyclictest65-21ksoftirqd/622:57:256
18709991614,1cyclictest65-21ksoftirqd/621:59:476
18709991614,1cyclictest631rcuc/623:56:056
18709991614,1cyclictest631rcuc/623:56:056
18709991612,3cyclictest65-21ksoftirqd/623:59:036
18709991612,1cyclictest65-21ksoftirqd/621:51:566
18709991612,1cyclictest65-21ksoftirqd/621:51:566
18709991611,3cyclictest65-21ksoftirqd/623:04:346
18709991610,4cyclictest65-21ksoftirqd/623:34:056
1870999161,3cyclictest1-21systemd21:47:236
18701991615,1cyclictest57-21ksoftirqd/523:54:285
18701991615,1cyclictest57-21ksoftirqd/523:54:285
18701991615,1cyclictest57-21ksoftirqd/523:24:105
18701991614,1cyclictest57-21ksoftirqd/523:13:425
18701991614,1cyclictest57-21ksoftirqd/521:58:485
18701991614,1cyclictest57-21ksoftirqd/521:53:105
18701991613,1cyclictest57-21ksoftirqd/521:34:505
18701991611,4cyclictest57-21ksoftirqd/521:13:405
1870199160,2cyclictest57-21ksoftirqd/522:23:245
18691991614,1cyclictest33-21ksoftirqd/200:14:502
1869099166,1cyclictest25-21ksoftirqd/123:33:251
18690991614,2cyclictest25-21ksoftirqd/100:05:431
18690991614,1cyclictest25-21ksoftirqd/123:29:071
18690991614,1cyclictest25-21ksoftirqd/122:49:311
18690991614,1cyclictest25-21ksoftirqd/122:49:311
18690991614,1cyclictest25-21ksoftirqd/122:44:091
18690991614,1cyclictest25-21ksoftirqd/121:54:171
18690991614,1cyclictest25-21ksoftirqd/121:48:561
18690991614,1cyclictest25-21ksoftirqd/121:48:561
18690991614,1cyclictest25-21ksoftirqd/121:22:351
18690991613,1cyclictest25-21ksoftirqd/123:08:501
1869099161,4cyclictest25-21ksoftirqd/123:58:251
1869099160,1cyclictest131rcu_sched22:26:201
1869099160,1cyclictest12664-21sshd22:01:411
18715991513,1cyclictest73-21ksoftirqd/721:31:037
1870999159,4cyclictest65-21ksoftirqd/623:25:426
1870999156,4cyclictest65-21ksoftirqd/623:15:246
1870999152,1cyclictest65-21ksoftirqd/623:11:256
18709991513,1cyclictest65-21ksoftirqd/622:23:266
18709991513,1cyclictest65-21ksoftirqd/621:53:566
18709991513,1cyclictest65-21ksoftirqd/621:18:516
18709991513,1cyclictest65-21ksoftirqd/621:08:336
18709991513,1cyclictest65-21ksoftirqd/600:13:216
18709991513,1cyclictest464-21systemd-journal22:06:146
18701991513,1cyclictest57-21ksoftirqd/521:08:065
18691991513,2cyclictest33-21ksoftirqd/222:13:112
18690991513,1cyclictest25-21ksoftirqd/123:18:141
18690991513,1cyclictest25-21ksoftirqd/121:13:201
18690991513,1cyclictest25-21ksoftirqd/100:29:401
18690991513,1cyclictest25-21ksoftirqd/100:25:071
18690991513,1cyclictest25-21ksoftirqd/100:13:371
18690991510,2cyclictest25-21ksoftirqd/123:53:231
18690991510,2cyclictest25-21ksoftirqd/123:53:231
1869099151,3cyclictest131rcu_sched23:23:441
1869099150,1cyclictest121rcu_preempt22:09:401
18689991513,1cyclictest9-21ksoftirqd/023:09:340
18689991513,1cyclictest9-21ksoftirqd/023:03:060
18689991513,1cyclictest9-21ksoftirqd/021:56:120
235822140,1sleep223579-21systemd23:29:592
1871599140,1cyclictest0-21swapper/721:40:387
18709991412,1cyclictest65-21ksoftirqd/600:36:036
18709991412,1cyclictest65-21ksoftirqd/600:09:186
1870999140,1cyclictest65-21ksoftirqd/622:18:246
18701991412,1cyclictest57-21ksoftirqd/520:38:055
1870199140,14cyclictest0-21swapper/519:58:255
1869399142,5cyclictest17624-21grepconf.sh00:06:174
18691991413,1cyclictest33-21ksoftirqd/223:05:202
18691991413,1cyclictest33-21ksoftirqd/221:21:052
18691991413,1cyclictest33-21ksoftirqd/221:10:312
18691991412,1cyclictest33-21ksoftirqd/223:38:282
18691991412,1cyclictest33-21ksoftirqd/222:03:332
18691991412,1cyclictest33-21ksoftirqd/221:40:062
1869199140,13cyclictest6843-21kworker/2:422:09:352
18690991412,1cyclictest25-21ksoftirqd/121:41:371
18689991413,1cyclictest9-21ksoftirqd/000:27:130
18689991413,1cyclictest9-21ksoftirqd/000:16:200
18689991412,1cyclictest9-21ksoftirqd/023:54:200
18689991412,1cyclictest9-21ksoftirqd/023:54:200
18689991412,1cyclictest9-21ksoftirqd/023:14:020
18689991412,1cyclictest9-21ksoftirqd/022:42:560
171372140,2sleep01868999cyclictest21:42:410
18715991311,1cyclictest73-21ksoftirqd/722:20:517
1871599130,2cyclictest1-21systemd22:25:187
18693991311,1cyclictest49-21ksoftirqd/422:21:334
18693991311,1cyclictest49-21ksoftirqd/422:14:284
1869299139,2cyclictest41-21ksoftirqd/323:01:243
1869299130,12cyclictest17744-21bash00:10:053
1869199139,3cyclictest33-21ksoftirqd/223:46:342
1869199137,3cyclictest33-21ksoftirqd/222:36:552
18691991312,1cyclictest33-21ksoftirqd/223:24:582
18691991311,2cyclictest33-21ksoftirqd/223:34:292
18691991311,1cyclictest33-21ksoftirqd/222:22:442
1868999139,4cyclictest22766-21sshd22:19:350
1868999139,1cyclictest9-21ksoftirqd/022:32:010
18689991312,1cyclictest9-21ksoftirqd/023:52:060
18689991312,1cyclictest9-21ksoftirqd/000:05:370
18689991311,1cyclictest9-21ksoftirqd/023:59:510
18689991311,1cyclictest9-21ksoftirqd/022:56:020
18689991311,1cyclictest9-21ksoftirqd/000:29:340
49132120,0sleep40-21swapper/422:49:404
49132120,0sleep40-21swapper/422:49:404
27842120,0sleep42783-21sshd00:34:324
1871599129,1cyclictest73-21ksoftirqd/722:10:447
1871599125,4cyclictest721-21dbus-daemon00:31:167
1871599124,4cyclictest721-21dbus-daemon22:07:127
18715991210,1cyclictest73-21ksoftirqd/723:50:427
1871599120,2cyclictest1-21systemd23:05:217
1871599120,11cyclictest709-21systemd-logind22:33:207
18709991210,1cyclictest65-21ksoftirqd/621:08:066
18701991210,1cyclictest57-21ksoftirqd/520:08:215
18701991210,1cyclictest57-21ksoftirqd/520:08:065
1869399123,4cyclictest1-21systemd22:36:004
1869399122,4cyclictest8020-21sshd23:13:304
1869399122,4cyclictest12472-21sshd00:23:304
1869399120,3cyclictest0-21swapper/420:48:194
1869399120,12cyclictest0-21swapper/421:42:444
1869399120,11cyclictest26133-21sshd00:14:364
1869299129,2cyclictest1871-21grepconf.sh21:57:183
1869299122,4cyclictest4607-21sshd21:33:593
18692991211,1cyclictest41-21ksoftirqd/321:26:153
18692991210,1cyclictest41-21ksoftirqd/322:30:573
18692991210,1cyclictest41-21ksoftirqd/321:49:253
18692991210,1cyclictest41-21ksoftirqd/321:49:253
18692991210,1cyclictest1-21systemd21:58:293
1869299120,11cyclictest1-21systemd22:41:033
1869299120,1cyclictest0-21swapper/321:45:093
1869199129,2cyclictest6166-21systemd21:57:342
1869199129,2cyclictest33-21ksoftirqd/223:53:252
1869199129,2cyclictest33-21ksoftirqd/223:53:252
1869199129,2cyclictest33-21ksoftirqd/200:30:152
1869199129,2cyclictest20946-21sshd21:18:002
1869199128,2cyclictest33-21ksoftirqd/222:30:522
18691991211,1cyclictest33-21ksoftirqd/222:47:362
18691991210,1cyclictest33-21ksoftirqd/222:42:422
18691991210,1cyclictest33-21ksoftirqd/200:36:382
1869199120,11cyclictest9886-21kworker/2:321:51:162
1869199120,11cyclictest9886-21kworker/2:321:51:162
1869199120,11cyclictest0-21swapper/223:52:392
1868999129,2cyclictest20083-21sshd00:33:370
1868999128,3cyclictest9-21ksoftirqd/023:31:230
1868999123,8cyclictest0-21swapper/021:52:030
1868999123,8cyclictest0-21swapper/021:52:030
18689991211,1cyclictest9-21ksoftirqd/023:23:070
18689991211,1cyclictest9-21ksoftirqd/022:33:190
18689991211,1cyclictest9-21ksoftirqd/022:06:410
18689991210,1cyclictest9-21ksoftirqd/023:00:420
18689991210,1cyclictest9-21ksoftirqd/021:08:490
18689991210,1cyclictest9-21ksoftirqd/000:22:030
18689991210,1cyclictest0-21swapper/022:27:300
153792120,0sleep70-21swapper/723:58:317
7732110,1sleep2766-21systemd23:01:322
1871599119,1cyclictest73-21ksoftirqd/723:13:207
1871599119,1cyclictest73-21ksoftirqd/700:11:357
1871599118,2cyclictest1999-21bash23:09:087
1871599116,2cyclictest28245-21sshd21:58:447
1871599114,4cyclictest8500-21sshd22:32:227
1871599113,5cyclictest23453-21systemd00:26:107
1871599112,5cyclictest0-21swapper/723:23:237
18715991110,1cyclictest73-21ksoftirqd/723:37:347
1871599110,11cyclictest15633-21kworker/7:521:33:287
1871599110,10cyclictest27614-21kworker/7:322:43:567
1870999119,1cyclictest65-21ksoftirqd/620:43:056
18701991110,1cyclictest57-21ksoftirqd/520:13:225
1869399119,1cyclictest49-21ksoftirqd/423:06:524
1869399119,1cyclictest0-21swapper/400:29:374
18693991110,1cyclictest49-21ksoftirqd/422:26:474
18693991110,1cyclictest49-21ksoftirqd/421:49:004
18693991110,1cyclictest49-21ksoftirqd/421:49:004
1869399111,4cyclictest31267-21bash21:43:274
1869399110,5cyclictest30478-21systemd00:08:544
1869399110,5cyclictest20430-21grep21:56:274
1869399110,2cyclictest29770-21sshd23:30:214
1869399110,11cyclictest1074-21kworker/4:421:37:014
1869399110,10cyclictest8344-21smartctl22:03:194
1869399110,10cyclictest23845-21kworker/4:621:58:154
1869299119,1cyclictest41-21ksoftirqd/321:21:053
1869299114,1cyclictest709-21systemd-logind21:42:053
1869299113,5cyclictest22144-21sshd23:58:553
1869299112,4cyclictest24942-21bash22:14:003
1869299112,4cyclictest2096-21sshd23:46:083
1869299112,4cyclictest0-21swapper/300:28:383
18692991110,1cyclictest41-21ksoftirqd/323:35:373
1869299111,4cyclictest26702-21cp22:12:113
1869299111,4cyclictest19619-21sshd23:54:573
1869299111,4cyclictest19619-21sshd23:54:573
1869299110,11cyclictest4650-21kworker/3:122:07:223
1869299110,10cyclictest31231-21sshd23:42:033
1869299110,1cyclictest1-21systemd23:08:003
1869199119,2cyclictest33-21ksoftirqd/222:52:462
1869199119,2cyclictest33-21ksoftirqd/222:52:462
1869199119,2cyclictest33-21ksoftirqd/200:19:022
1869199119,1cyclictest33-21ksoftirqd/222:26:162
1869199119,1cyclictest33-21ksoftirqd/222:02:032
1869199119,1cyclictest33-21ksoftirqd/200:04:392
1869199118,2cyclictest33-21ksoftirqd/221:43:482
1869199115,3cyclictest704-21nscd23:09:272
18691991110,1cyclictest33-21ksoftirqd/222:53:292
18690991111,0cyclictest16915-21sensors19:58:251
1868999119,2cyclictest9-21ksoftirqd/021:43:340
1868999119,1cyclictest9-21ksoftirqd/023:44:500
1868999119,1cyclictest9-21ksoftirqd/023:42:280
1868999119,1cyclictest9-21ksoftirqd/022:51:460
1868999119,1cyclictest9-21ksoftirqd/022:51:460
1868999119,1cyclictest9-21ksoftirqd/021:24:330
1868999119,1cyclictest9-21ksoftirqd/021:19:010
1868999119,1cyclictest9-21ksoftirqd/000:10:070
1868999116,0cyclictest0-21swapper/019:09:110
18689991110,1cyclictest9-21ksoftirqd/023:33:090
18689991110,1cyclictest9-21ksoftirqd/022:43:330
18689991110,1cyclictest9-21ksoftirqd/022:14:260
1868999110,5cyclictest0-21swapper/023:19:290
1871599109,1cyclictest73-21ksoftirqd/721:53:477
1871599109,1cyclictest73-21ksoftirqd/700:13:437
1871599108,1cyclictest73-21ksoftirqd/723:42:307
1871599108,1cyclictest73-21ksoftirqd/722:53:277
1871599108,1cyclictest0-21swapper/723:54:417
1871599108,1cyclictest0-21swapper/723:54:417
1871599103,4cyclictest23370-21systemd00:33:497
1871599103,4cyclictest1-21systemd23:20:477
1871599102,5cyclictest730-21NetworkManager22:39:017
1871599101,1cyclictest709-21systemd-logind21:43:117
1871599100,6cyclictest14742-21systemd23:43:077
1870199109,1cyclictest57-21ksoftirqd/520:28:175
1870199109,1cyclictest57-21ksoftirqd/519:43:055
18701991010,0cyclictest0-21swapper/519:36:225
1870199100,10cyclictest6163-21kworker/5:120:23:105
1869399108,1cyclictest49-21ksoftirqd/423:58:074
1869399108,1cyclictest49-21ksoftirqd/422:39:334
1869399108,1cyclictest3184-21bash22:53:374
1869399107,2cyclictest8688-21wc21:13:234
1869399103,6cyclictest6759-21sshd23:09:284
1869399103,6cyclictest14222-21sshd22:58:204
1869399100,4cyclictest721-21dbus-daemon23:44:444
1869399100,4cyclictest30277-21sshd23:49:434
1869399100,1cyclictest0-21swapper/423:23:254
1869299108,1cyclictest41-21ksoftirqd/323:16:443
1869299108,1cyclictest10689-21sshd21:32:203
1869299104,3cyclictest23031-21sshd23:28:053
1869299103,6cyclictest721-21dbus-daemon21:08:223
1869299101,4cyclictest4423-21grepconf.sh22:20:293
1869299100,9cyclictest22700-21kworker/3:622:50:553
1869299100,9cyclictest22700-21kworker/3:622:50:553
1869299100,9cyclictest20033-21sshd23:22:013
1869299100,5cyclictest16462-21bash00:33:253
1869299100,10cyclictest0-21swapper/322:35:413
1869199109,1cyclictest33-21ksoftirqd/223:58:252
1869199108,1cyclictest33-21ksoftirqd/200:08:342
1869199108,1cyclictest0-21swapper/221:29:302
1869199107,2cyclictest13984-21dump-pmu-power20:53:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional