You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 21:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Mar 25, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35049910996,1cyclictest49-21ksoftirqd/412:06:214
245782940,2sleep3350199cyclictest10:13:533
166232800,0sleep40-21swapper/411:45:494
80612770,1sleep38003-21sshd10:07:123
80612770,1sleep38003-21sshd10:07:123
3525997471,2cyclictest12996-21cp12:06:207
3522996231,0cyclictest0-21swapper/612:06:216
46372510,2sleep3350199cyclictest11:54:293
283092510,1sleep3350199cyclictest11:21:533
333325026,9sleep60-21swapper/607:06:196
312324925,8sleep50-21swapper/507:03:295
108524828,7sleep30-21swapper/307:01:433
68382470,0sleep4471rcuc/409:27:334
244232470,1sleep71-21systemd12:12:357
145212470,0sleep70-21swapper/710:49:057
139822470,1sleep3391rcuc/311:45:403
126272470,0sleep60-21swapper/611:45:356
294352460,0sleep729436-21systemd-cgroups10:04:447
216492460,0sleep70-21swapper/710:53:147
216492460,0sleep70-21swapper/710:53:147
16012460,0sleep10-21swapper/110:48:191
138612460,0sleep70-21swapper/711:26:467
249122440,1sleep524909-21bash11:48:065
22432440,0sleep40-21swapper/409:50:004
64752430,0sleep20-21swapper/210:05:192
351399430,42cyclictest20019-21kworker/u16:312:06:215
3498994342,1cyclictest21717-21kworker/1:312:06:211
3491994342,1cyclictest28265-21kworker/0:512:06:220
333424330,9sleep70-21swapper/707:06:207
320642430,0sleep30-21swapper/310:40:443
199852430,1sleep319989-21grepconf.sh12:10:303
302624238,1sleep20-21swapper/207:02:062
29172420,1sleep42920-21kworker/u16:109:10:354
319424128,9sleep00-21swapper/007:04:280
193992410,0sleep30-21swapper/312:01:013
18932410,1sleep01890-21sshd10:55:550
18932410,1sleep01890-21sshd10:55:550
148782410,2sleep0101ktimersoftd/010:22:390
323324027,9sleep40-21swapper/407:04:564
208472400,1sleep120850-21grepconf.sh09:11:361
82132390,0sleep50-21swapper/509:18:135
3500993937,1cyclictest13550irq/24-ahci[00012:06:212
316312390,0sleep00-21swapper/011:54:100
227522390,0sleep20-21swapper/210:40:112
261182380,0sleep30-21swapper/310:04:323
302523726,8sleep10-21swapper/107:02:051
30402360,0sleep70-21swapper/710:29:357
215892360,2sleep5351399cyclictest10:28:455
306052350,0sleep00-21swapper/011:12:370
209702320,0sleep4471rcuc/411:00:484
350499234,1cyclictest49-21ksoftirqd/412:32:284
350499227,3cyclictest49-21ksoftirqd/410:03:284
350499224,3cyclictest49-21ksoftirqd/411:20:234
3504992117,1cyclictest49-21ksoftirqd/412:11:594
350499207,3cyclictest49-21ksoftirqd/409:12:534
350499205,3cyclictest49-21ksoftirqd/411:59:534
350499205,1cyclictest49-21ksoftirqd/410:15:344
241882200,1sleep61-21systemd12:12:346
350499194,3cyclictest49-21ksoftirqd/411:55:044
350499193,3cyclictest49-21ksoftirqd/411:46:484
3504991917,2cyclictest49-21ksoftirqd/410:42:244
3504991917,1cyclictest49-21ksoftirqd/411:39:074
3504991916,1cyclictest49-21ksoftirqd/410:28:024
3504991916,1cyclictest49-21ksoftirqd/409:31:434
3500991916,3cyclictest33-21ksoftirqd/211:16:492
349199191,1cyclictest131rcu_sched12:24:520
310362190,1sleep341-21ksoftirqd/312:14:553
352599183,14cyclictest396-21jbd2/sda2-810:31:367
3522991814,1cyclictest65-21ksoftirqd/611:19:386
350499188,1cyclictest49-21ksoftirqd/411:34:444
350499188,1cyclictest49-21ksoftirqd/409:45:014
350499185,1cyclictest49-21ksoftirqd/412:17:324
350499182,3cyclictest49-21ksoftirqd/412:11:234
350499182,1cyclictest49-21ksoftirqd/411:22:044
350499182,1cyclictest49-21ksoftirqd/410:48:464
3504991816,1cyclictest49-21ksoftirqd/411:15:124
3504991816,1cyclictest49-21ksoftirqd/410:21:224
3504991814,3cyclictest49-21ksoftirqd/409:59:214
3504991814,1cyclictest49-21ksoftirqd/409:26:224
3504991814,1cyclictest49-21ksoftirqd/409:26:224
350499181,3cyclictest49-21ksoftirqd/410:37:524
3500991816,1cyclictest33-21ksoftirqd/210:54:312
3500991816,1cyclictest33-21ksoftirqd/210:54:312
3500991816,1cyclictest33-21ksoftirqd/209:14:422
3500991815,2cyclictest33-21ksoftirqd/212:00:392
3491991816,1cyclictest9-21ksoftirqd/010:11:470
211842180,0sleep10-21swapper/110:26:491
352599172,14cyclictest9350-21kworker/u16:110:06:567
352599172,14cyclictest9350-21kworker/u16:110:06:567
3525991716,1cyclictest73-21ksoftirqd/709:44:457
3525991715,1cyclictest73-21ksoftirqd/711:37:117
350499174,1cyclictest49-21ksoftirqd/411:07:174
3504991715,1cyclictest492-21systemd-journal12:28:174
3504991715,1cyclictest49-21ksoftirqd/411:03:434
3504991715,1cyclictest49-21ksoftirqd/409:51:424
3504991715,1cyclictest49-21ksoftirqd/409:16:324
3504991712,3cyclictest49-21ksoftirqd/410:21:374
3504991711,4cyclictest49-21ksoftirqd/410:07:184
3504991711,4cyclictest49-21ksoftirqd/410:07:184
3500991715,1cyclictest33-21ksoftirqd/212:21:572
3500991715,1cyclictest33-21ksoftirqd/210:30:252
3500991715,1cyclictest33-21ksoftirqd/209:43:402
3500991714,3cyclictest33-21ksoftirqd/211:09:372
3500991714,2cyclictest33-21ksoftirqd/211:43:572
3500991714,2cyclictest33-21ksoftirqd/209:31:422
3500991714,2cyclictest33-21ksoftirqd/209:10:362
3500991713,1cyclictest33-21ksoftirqd/210:22:162
350099171,2cyclictest131rcu_sched10:50:312
3491991713,2cyclictest16139-21kworker/0:009:58:160
3525991614,2cyclictest73-21ksoftirqd/711:18:527
3525991614,1cyclictest73-21ksoftirqd/712:17:087
3525991614,1cyclictest73-21ksoftirqd/712:06:427
3525991614,1cyclictest73-21ksoftirqd/711:23:007
3525991614,1cyclictest73-21ksoftirqd/711:08:137
3525991614,1cyclictest73-21ksoftirqd/710:56:407
3525991614,1cyclictest73-21ksoftirqd/709:56:427
3525991612,1cyclictest73-21ksoftirqd/709:17:477
3525991611,4cyclictest73-21ksoftirqd/709:24:067
3525991611,4cyclictest73-21ksoftirqd/709:24:067
352299169,3cyclictest10359-21sshd11:52:546
3522991614,1cyclictest65-21ksoftirqd/609:34:046
3522991613,2cyclictest65-21ksoftirqd/612:09:036
350499163,1cyclictest49-21ksoftirqd/412:22:474
350499162,3cyclictest49-21ksoftirqd/411:27:484
3504991614,2cyclictest49-21ksoftirqd/410:32:084
3504991614,1cyclictest49-21ksoftirqd/409:36:474
3504991613,1cyclictest49-21ksoftirqd/410:54:264
3504991613,1cyclictest49-21ksoftirqd/410:54:264
3500991615,1cyclictest33-21ksoftirqd/212:16:522
3500991615,1cyclictest33-21ksoftirqd/209:23:082
3500991615,1cyclictest33-21ksoftirqd/209:23:082
3500991614,2cyclictest33-21ksoftirqd/212:11:272
3500991614,1cyclictest33-21ksoftirqd/212:35:432
3500991614,1cyclictest33-21ksoftirqd/212:28:502
3500991614,1cyclictest33-21ksoftirqd/211:36:432
3500991614,1cyclictest33-21ksoftirqd/211:31:512
3500991614,1cyclictest33-21ksoftirqd/211:28:222
3500991614,1cyclictest33-21ksoftirqd/211:22:372
3500991614,1cyclictest33-21ksoftirqd/211:03:572
3500991614,1cyclictest33-21ksoftirqd/210:44:452
3500991614,1cyclictest33-21ksoftirqd/210:16:522
3500991614,1cyclictest33-21ksoftirqd/210:13:592
3500991614,1cyclictest33-21ksoftirqd/210:06:562
3500991614,1cyclictest33-21ksoftirqd/210:06:562
3500991614,1cyclictest33-21ksoftirqd/209:59:092
3500991614,1cyclictest33-21ksoftirqd/209:38:002
3500991613,2cyclictest33-21ksoftirqd/211:47:042
3500991612,1cyclictest33-21ksoftirqd/212:11:512
3500991610,4cyclictest33-21ksoftirqd/209:20:082
3500991610,3cyclictest33-21ksoftirqd/211:01:302
350099161,1cyclictest131rcu_sched10:33:302
350099160,15cyclictest20196-21kworker/2:609:46:462
350099160,1cyclictest121rcu_preempt11:15:022
3491991614,2cyclictest14301-21kworker/u16:010:45:130
3491991614,1cyclictest9-21ksoftirqd/009:12:160
50602150,0sleep0101ktimersoftd/011:05:320
3525991514,1cyclictest73-21ksoftirqd/711:43:477
3525991514,1cyclictest73-21ksoftirqd/711:03:567
3525991514,1cyclictest73-21ksoftirqd/709:51:567
3525991513,1cyclictest73-21ksoftirqd/712:31:317
3525991513,1cyclictest73-21ksoftirqd/711:54:117
3525991513,1cyclictest73-21ksoftirqd/711:35:507
3525991513,1cyclictest73-21ksoftirqd/710:20:437
3525991513,1cyclictest73-21ksoftirqd/709:11:417
3525991513,1cyclictest73-21ksoftirqd/709:09:027
3525991512,1cyclictest73-21ksoftirqd/710:25:577
3525991511,1cyclictest73-21ksoftirqd/711:48:477
3522991514,1cyclictest65-21ksoftirqd/611:59:596
3522991514,1cyclictest65-21ksoftirqd/611:36:516
3522991513,1cyclictest65-21ksoftirqd/609:52:156
3522991512,2cyclictest65-21ksoftirqd/609:58:146
3501991514,1cyclictest1115-21nfsd12:06:213
3500991513,1cyclictest33-21ksoftirqd/211:51:502
3500991513,1cyclictest33-21ksoftirqd/209:29:282
3491991514,1cyclictest9-21ksoftirqd/010:28:410
3491991514,1cyclictest9-21ksoftirqd/009:26:080
3491991514,1cyclictest9-21ksoftirqd/009:26:080
3491991514,1cyclictest9-21ksoftirqd/009:09:320
3491991511,3cyclictest9-21ksoftirqd/012:16:350
3491991511,3cyclictest7721-21kworker/0:211:10:460
3491991511,1cyclictest9-21ksoftirqd/009:19:440
349199150,14cyclictest31217-21kworker/0:110:49:380
251502150,0sleep60-21swapper/612:22:036
132592150,1sleep7721ktimersoftd/709:29:527
3525991413,1cyclictest73-21ksoftirqd/710:11:437
3525991412,1cyclictest73-21ksoftirqd/711:57:187
3525991412,1cyclictest73-21ksoftirqd/710:46:197
3525991412,1cyclictest73-21ksoftirqd/709:37:527
3522991413,1cyclictest65-21ksoftirqd/610:58:536
3522991412,1cyclictest65-21ksoftirqd/611:25:276
3522991412,1cyclictest65-21ksoftirqd/610:05:166
3522991412,1cyclictest65-21ksoftirqd/609:49:506
3522991412,1cyclictest65-21ksoftirqd/609:40:456
3522991411,2cyclictest65-21ksoftirqd/610:12:116
351399148,6cyclictest57-21ksoftirqd/512:08:375
3513991412,1cyclictest57-21ksoftirqd/511:53:075
3513991412,1cyclictest57-21ksoftirqd/511:33:265
3500991412,1cyclictest33-21ksoftirqd/209:52:462
349199145,4cyclictest31015-21kworker/u16:109:32:330
3491991413,1cyclictest9-21ksoftirqd/011:32:010
3491991412,2cyclictest28532-21kworker/u16:411:22:060
3491991412,2cyclictest24298-21kworker/u16:411:57:040
3491991412,2cyclictest16175-21kworker/u16:310:06:030
3491991412,1cyclictest9-21ksoftirqd/011:49:050
3491991412,1cyclictest9-21ksoftirqd/010:37:560
3491991412,1cyclictest9-21ksoftirqd/009:51:590
3491991412,1cyclictest14933-21kworker/0:509:27:130
349199141,1cyclictest131rcu_sched10:17:410
349199140,13cyclictest16139-21kworker/0:009:41:480
27182140,0sleep62702-21sshd10:29:346
235602140,0sleep10-21swapper/109:58:461
177232140,1sleep317679-21sshd11:08:073
3525991312,1cyclictest73-21ksoftirqd/710:40:017
3525991312,1cyclictest73-21ksoftirqd/709:35:257
3525991311,1cyclictest73-21ksoftirqd/712:32:147
3525991311,1cyclictest73-21ksoftirqd/712:22:037
3525991311,1cyclictest73-21ksoftirqd/709:46:447
3522991312,1cyclictest65-21ksoftirqd/610:41:086
3522991312,1cyclictest65-21ksoftirqd/609:18:116
3522991311,2cyclictest65-21ksoftirqd/610:50:096
3522991311,1cyclictest784-21runrttasks09:25:586
3522991311,1cyclictest784-21runrttasks09:25:586
3522991311,1cyclictest65-21ksoftirqd/611:47:156
3522991311,1cyclictest65-21ksoftirqd/610:43:036
3522991311,1cyclictest65-21ksoftirqd/610:17:066
3522991310,2cyclictest16386-21bash12:29:196
3513991311,1cyclictest57-21ksoftirqd/511:06:425
3504991312,1cyclictest22493-21kworker/4:108:00:394
3501991311,1cyclictest41-21ksoftirqd/309:01:313
3498991311,1cyclictest25-21ksoftirqd/112:06:451
349899130,13cyclictest10931-21kworker/1:009:35:551
349199139,3cyclictest9-21ksoftirqd/010:33:530
3491991312,0cyclictest8911-21kworker/u16:109:39:330
3491991311,2cyclictest32199-21kworker/u16:212:32:420
3491991311,1cyclictest9-21ksoftirqd/012:11:380
3491991311,1cyclictest9-21ksoftirqd/011:39:040
3491991311,1cyclictest24912-21systemd11:27:210
3491991310,2cyclictest8796-21kworker/0:410:57:250
199042130,0sleep6686-21dbus-daemon09:45:216
177482130,0sleep10-21swapper/111:23:111
174022130,0sleep30-21swapper/310:19:063
3525991210,1cyclictest73-21ksoftirqd/711:12:447
352299129,2cyclictest65-21ksoftirqd/612:18:236
3522991211,1cyclictest65-21ksoftirqd/611:09:296
3522991210,1cyclictest65-21ksoftirqd/612:35:336
3522991210,1cyclictest65-21ksoftirqd/611:12:056
3522991210,1cyclictest65-21ksoftirqd/610:22:006
3522991210,1cyclictest65-21ksoftirqd/609:11:466
352299120,2cyclictest13038-21grep11:26:446
3513991211,1cyclictest57-21ksoftirqd/511:29:085
3513991211,1cyclictest57-21ksoftirqd/511:17:075
3513991211,1cyclictest57-21ksoftirqd/510:46:555
3513991211,1cyclictest57-21ksoftirqd/509:56:395
3513991210,1cyclictest57-21ksoftirqd/510:44:455
3513991210,1cyclictest21734-21grep09:13:275
351399120,2cyclictest686-21dbus-daemon09:47:305
351399120,11cyclictest887-21gdbus12:11:455
351399120,11cyclictest17031-21bash10:39:515
350199127,1cyclictest26020-21bash11:12:213
350199123,5cyclictest14430-21systemd11:19:153
3501991210,1cyclictest41-21ksoftirqd/309:59:363
3501991210,1cyclictest41-21ksoftirqd/309:55:433
3501991210,1cyclictest41-21ksoftirqd/309:50:213
3501991210,1cyclictest41-21ksoftirqd/309:16:303
350199120,11cyclictest1-21systemd09:30:223
3498991211,1cyclictest25-21ksoftirqd/111:34:271
3498991210,1cyclictest25-21ksoftirqd/111:52:031
3498991210,1cyclictest25-21ksoftirqd/111:38:121
3498991210,1cyclictest25-21ksoftirqd/109:26:361
349899120,2cyclictest19934-21sshd11:04:291
349899120,11cyclictest25583-21bash09:47:301
349899120,11cyclictest0-21swapper/112:34:021
349199122,7cyclictest23861-21bash12:08:480
3491991211,1cyclictest9-21ksoftirqd/011:17:130
3491991211,1cyclictest21850-21kworker/0:210:10:470
3491991211,1cyclictest21850-21kworker/0:210:10:470
3491991210,1cyclictest9-21ksoftirqd/012:29:400
3491991210,1cyclictest9-21ksoftirqd/011:42:010
3491991210,1cyclictest9-21ksoftirqd/009:47:160
230412120,0sleep10-21swapper/111:57:231
151352120,0sleep50-21swapper/512:32:595
352299119,1cyclictest65-21ksoftirqd/610:31:476
352299119,1cyclictest65-21ksoftirqd/609:30:586
352299118,2cyclictest65-21ksoftirqd/611:05:436
3522991110,1cyclictest65-21ksoftirqd/611:35:196
352299110,11cyclictest1760-21kworker/6:210:08:446
352299110,11cyclictest1760-21kworker/6:210:08:446
351399119,1cyclictest57-21ksoftirqd/509:34:315
351399119,1cyclictest57-21ksoftirqd/509:23:085
351399119,1cyclictest57-21ksoftirqd/509:23:085
351399118,1cyclictest57-21ksoftirqd/510:04:155
351399118,1cyclictest57-21ksoftirqd/509:30:135
351399115,5cyclictest885-21polkitd11:38:065
351399113,5cyclictest27728-21sshd10:25:235
351399112,6cyclictest23577-21grepconf.sh09:53:045
351399111,5cyclictest492-21systemd-journal10:52:155
351399111,5cyclictest492-21systemd-journal10:52:155
351399110,10cyclictest12588-21sshd10:09:255
351399110,10cyclictest12588-21sshd10:09:255
3504991110,1cyclictest49-21ksoftirqd/407:41:324
3504991110,1cyclictest22493-21kworker/4:109:06:214
3504991110,1cyclictest22493-21kworker/4:108:38:474
3504991110,1cyclictest22493-21kworker/4:108:14:214
3504991110,1cyclictest22493-21kworker/4:107:53:334
3504991110,1cyclictest22493-21kworker/4:107:33:054
350199119,1cyclictest41-21ksoftirqd/310:44:243
350199118,2cyclictest9114-21grepconf.sh12:24:593
350199116,4cyclictest691-21systemd-logind09:21:443
350199116,4cyclictest691-21systemd-logind09:21:443
350199113,3cyclictest691-21systemd-logind09:31:563
350199112,5cyclictest775-21gdbus11:03:383
3501991110,1cyclictest0-21swapper/311:48:193
3501991110,1cyclictest0-21swapper/309:16:393
350199110,1cyclictest20891-21sshd11:36:393
349899119,1cyclictest25-21ksoftirqd/110:55:121
349899119,1cyclictest25-21ksoftirqd/110:55:121
349899119,1cyclictest25-21ksoftirqd/109:36:501
349899119,1cyclictest1720-21idleruntime-cro10:46:311
349899118,3cyclictest25-21ksoftirqd/111:07:441
349899117,3cyclictest25-21ksoftirqd/111:47:171
349899114,4cyclictest28328-21awk11:46:311
3498991110,1cyclictest0-21swapper/109:22:481
3498991110,1cyclictest0-21swapper/109:22:481
349899110,1cyclictest1-21systemd09:20:161
349899110,1cyclictest0-21swapper/111:19:461
318152110,1sleep631813-21id09:08:056
296542110,0sleep30-21swapper/309:38:213
236282110,0sleep50-21swapper/510:36:305
352299108,1cyclictest65-21ksoftirqd/610:52:406
352299108,1cyclictest65-21ksoftirqd/610:52:406
351399109,1cyclictest57-21ksoftirqd/509:36:475
351399109,1cyclictest57-21ksoftirqd/509:07:555
351399108,1cyclictest57-21ksoftirqd/512:25:085
351399108,1cyclictest57-21ksoftirqd/510:16:595
351399107,2cyclictest57-21ksoftirqd/511:02:445
351399105,1cyclictest885-21polkitd11:16:305
351399102,5cyclictest14835-21sshd09:45:035
351399100,9cyclictest20103-21kworker/5:211:42:365
351399100,4cyclictest13893-21sshd10:56:375
351399100,10cyclictest9662-21bash11:58:315
351399100,10cyclictest0-21swapper/512:16:395
351399100,10cyclictest0-21swapper/511:21:375
350499109,1cyclictest22493-21kworker/4:108:59:254
350499109,1cyclictest22493-21kworker/4:108:44:094
350499109,1cyclictest22493-21kworker/4:107:48:314
350499100,1cyclictest121rcu_preempt08:51:434
350199109,1cyclictest41-21ksoftirqd/311:26:433
350199109,1cyclictest0-21swapper/312:18:453
350199108,1cyclictest41-21ksoftirqd/311:33:143
350199108,1cyclictest41-21ksoftirqd/310:59:363
350199107,2cyclictest24051-21id12:29:463
350199105,4cyclictest691-21systemd-logind09:09:543
350199105,3cyclictest14546-21httpd10:24:433
350199105,2cyclictest18421-21bash10:54:583
350199105,2cyclictest18421-21bash10:54:583
350199102,5cyclictest0-21swapper/310:28:533
350199100,10cyclictest0-21swapper/312:31:403
349899109,1cyclictest25-21ksoftirqd/112:27:041
349899109,1cyclictest25-21ksoftirqd/112:25:081
349899109,1cyclictest25-21ksoftirqd/112:11:451
349899109,1cyclictest25-21ksoftirqd/110:34:461
349899109,1cyclictest25-21ksoftirqd/110:12:111
349899108,1cyclictest25-21ksoftirqd/111:14:341
349899108,1cyclictest25-21ksoftirqd/110:02:371
349899107,2cyclictest4186-21rm09:10:391
349899104,2cyclictest25674-21grep09:41:511
35139998,1cyclictest0-21swapper/508:21:445
35139998,1cyclictest0-21swapper/508:21:445
35139992,4cyclictest20464-21systemd12:27:385
35139991,5cyclictest5054-21bash10:12:425
35049998,1cyclictest22493-21kworker/4:108:04:274
35049998,1cyclictest22493-21kworker/4:107:12:174
35049997,1cyclictest49-21ksoftirqd/407:26:514
35049997,1cyclictest471rcuc/407:06:524
35019999,0cyclictest0-21swapper/309:42:213
35019995,1cyclictest686-21dbus-daemon10:31:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional