You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 09:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Jul 23, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41639917464,40cyclictest5010-21bash21:08:250
189172890,0sleep3418599cyclictest00:23:543
189172890,0sleep3418599cyclictest00:23:543
4193997876,2cyclictest1842-21nfsd21:08:244
255882740,0sleep00-21swapper/022:55:090
4212996740,0cyclictest0-21swapper/621:08:256
420399650,64cyclictest8267-21kworker/u16:321:08:255
311792600,0sleep00-21swapper/023:00:540
66272580,2sleep0416399cyclictest22:10:240
129182570,1sleep612916-21sshd22:08:546
321252550,0sleep30-21swapper/323:51:513
43772530,0sleep40-21swapper/421:39:284
222622520,0sleep40-21swapper/422:49:284
72902510,1sleep17289-21systemd-cgroups22:43:091
389925140,8sleep30-21swapper/319:04:423
156822510,0sleep20-21swapper/200:07:192
56572500,0sleep60-21swapper/623:10:216
319412500,1sleep531920-21sshd21:17:275
393724926,8sleep10-21swapper/119:05:121
18452490,2sleep3391rcuc/321:57:213
18452490,2sleep3391rcuc/321:57:213
393824837,8sleep20-21swapper/219:05:132
175122480,0sleep70-21swapper/722:36:347
16972480,1sleep11696-21sshd23:31:541
158402470,0sleep10-21swapper/123:40:031
84802450,0sleep20-21swapper/221:39:422
82862450,0sleep68287-21bash00:12:206
384524533,8sleep70-21swapper/719:03:577
184652450,0sleep30-21swapper/322:20:043
183892450,0sleep518367-21sshd00:03:465
175592450,1sleep617563-21grepconf.sh23:47:216
158582450,0sleep10-21swapper/123:29:061
300172430,0sleep30-21swapper/300:08:083
280802430,1sleep41-21systemd23:17:004
16282430,1sleep01619-21systemd23:35:380
77922420,0sleep50-21swapper/522:39:365
383524231,8sleep60-21swapper/619:03:486
209682420,0sleep70-21swapper/722:14:477
183292420,0sleep00-21swapper/021:31:150
88572410,1sleep78858-21bash00:19:427
7902400,0sleep40-21swapper/422:10:044
34792400,0sleep60-21swapper/622:37:296
268822400,0sleep60-21swapper/600:29:506
243282400,0sleep60-21swapper/622:56:516
17452400,2sleep0416399cyclictest23:44:430
163452400,0sleep20-21swapper/222:09:062
114422400,0sleep20-21swapper/221:41:432
403623926,9sleep00-21swapper/019:06:310
379723927,9sleep40-21swapper/419:03:144
324312390,0sleep30-21swapper/322:26:213
154432390,0sleep70-21swapper/722:09:037
101752390,0sleep50-21swapper/523:43:205
57712380,0sleep10-21swapper/122:32:111
371323826,8sleep50-21swapper/519:02:035
302232380,0sleep30-21swapper/323:22:353
278362380,0sleep20-21swapper/200:26:172
278362380,0sleep20-21swapper/200:26:172
232402380,0sleep30-21swapper/323:11:223
20332380,0sleep1231rcuc/123:26:341
119232380,0sleep6421299cyclictest21:57:566
119232380,0sleep6421299cyclictest21:57:566
302852370,0sleep10-21swapper/121:49:591
287842370,0sleep60-21swapper/623:22:306
4178993535,0cyclictest13550irq/24-ahci[00021:08:252
267262340,1sleep426723-21sshd23:55:124
418599330,32cyclictest8788-21kworker/3:321:08:263
418599259,1cyclictest41-21ksoftirqd/300:16:053
4171992524,1cyclictest8911-21kworker/1:321:08:261
4171992511,3cyclictest25-21ksoftirqd/123:15:221
4185992312,2cyclictest41-21ksoftirqd/321:28:493
4185992310,2cyclictest41-21ksoftirqd/323:28:533
4203992212,9cyclictest57-21ksoftirqd/522:43:545
418599227,3cyclictest41-21ksoftirqd/322:55:013
418599227,1cyclictest41-21ksoftirqd/300:32:513
418599226,3cyclictest41-21ksoftirqd/322:37:323
417199229,1cyclictest25-21ksoftirqd/122:56:351
417199225,4cyclictest25-21ksoftirqd/123:54:271
421299218,1cyclictest65-21ksoftirqd/622:55:016
420399216,11cyclictest0-21swapper/521:36:385
4203992112,8cyclictest57-21ksoftirqd/523:46:525
418599219,1cyclictest41-21ksoftirqd/323:43:243
418599219,1cyclictest41-21ksoftirqd/322:03:153
418599216,3cyclictest41-21ksoftirqd/322:34:283
4185992117,1cyclictest464-21systemd-journal21:38:493
4185992117,1cyclictest41-21ksoftirqd/300:18:473
4185992111,3cyclictest41-21ksoftirqd/323:57:343
4171992113,4cyclictest25-21ksoftirqd/122:25:281
4220992019,1cyclictest8267-21kworker/u16:321:08:257
420399208,6cyclictest0-21swapper/521:23:265
4203992014,1cyclictest57-21ksoftirqd/523:14:285
418599209,3cyclictest41-21ksoftirqd/321:12:143
418599206,1cyclictest41-21ksoftirqd/321:35:283
418599205,1cyclictest41-21ksoftirqd/300:28:483
4185992016,3cyclictest41-21ksoftirqd/322:10:083
4185992015,3cyclictest41-21ksoftirqd/323:36:133
4185992011,1cyclictest41-21ksoftirqd/322:48:353
417199208,3cyclictest25-21ksoftirqd/123:41:561
417199208,3cyclictest25-21ksoftirqd/122:20:031
417199208,2cyclictest25-21ksoftirqd/122:01:211
417199208,2cyclictest25-21ksoftirqd/122:01:211
417199207,1cyclictest25-21ksoftirqd/100:13:561
417199206,2cyclictest25-21ksoftirqd/121:29:021
417199206,1cyclictest25-21ksoftirqd/122:49:581
417199205,3cyclictest25-21ksoftirqd/100:28:501
417199204,1cyclictest25-21ksoftirqd/122:53:271
417199203,1cyclictest131rcu_sched22:02:231
4171992018,1cyclictest25-21ksoftirqd/121:20:301
4171992017,3cyclictest25-21ksoftirqd/121:23:391
4171992010,3cyclictest25-21ksoftirqd/122:31:161
417199200,1cyclictest0-21swapper/123:19:501
421299196,3cyclictest65-21ksoftirqd/623:39:256
4212991913,2cyclictest65-21ksoftirqd/621:23:076
418599198,1cyclictest41-21ksoftirqd/322:31:003
418599198,1cyclictest41-21ksoftirqd/322:15:393
418599197,5cyclictest41-21ksoftirqd/323:48:493
418599196,2cyclictest41-21ksoftirqd/321:42:003
4185991917,1cyclictest41-21ksoftirqd/322:59:553
4185991916,1cyclictest41-21ksoftirqd/323:15:133
4185991914,4cyclictest41-21ksoftirqd/321:51:513
4185991914,4cyclictest41-21ksoftirqd/321:51:513
4185991910,3cyclictest41-21ksoftirqd/322:45:293
417199198,3cyclictest25-21ksoftirqd/123:05:271
417199195,2cyclictest25-21ksoftirqd/100:18:111
4171991914,1cyclictest25-21ksoftirqd/121:54:081
4171991914,1cyclictest25-21ksoftirqd/121:54:081
416399198,5cyclictest0-21swapper/021:16:440
4212991816,1cyclictest65-21ksoftirqd/623:29:136
4212991815,2cyclictest65-21ksoftirqd/623:35:176
4212991814,3cyclictest65-21ksoftirqd/623:57:216
4212991814,3cyclictest65-21ksoftirqd/600:34:026
4212991813,1cyclictest65-21ksoftirqd/622:44:226
420399187,5cyclictest0-21swapper/523:02:545
418599186,3cyclictest41-21ksoftirqd/323:41:103
418599186,3cyclictest41-21ksoftirqd/321:26:233
4185991812,4cyclictest41-21ksoftirqd/323:04:473
417199188,2cyclictest25-21ksoftirqd/100:09:001
417199186,1cyclictest25-21ksoftirqd/100:03:291
417199184,3cyclictest25-21ksoftirqd/100:26:141
417199184,3cyclictest25-21ksoftirqd/100:26:141
416399187,5cyclictest0-21swapper/023:09:240
416399187,5cyclictest0-21swapper/021:55:440
416399187,5cyclictest0-21swapper/021:55:440
416399186,5cyclictest0-21swapper/000:36:050
416399180,7cyclictest0-21swapper/021:24:160
150292180,0sleep20-21swapper/223:41:482
136422180,1sleep713627-21sshd21:41:487
11072180,1sleep71096-21sshd23:17:197
421299179,4cyclictest65-21ksoftirqd/622:48:556
421299176,2cyclictest131rcu_sched23:43:186
4212991715,1cyclictest65-21ksoftirqd/623:18:116
4212991715,1cyclictest65-21ksoftirqd/622:20:456
4212991715,1cyclictest65-21ksoftirqd/622:14:386
4212991715,1cyclictest65-21ksoftirqd/621:17:346
4212991714,1cyclictest65-21ksoftirqd/623:52:166
4212991713,3cyclictest65-21ksoftirqd/621:38:136
421299171,1cyclictest65-21ksoftirqd/623:15:496
421299171,1cyclictest65-21ksoftirqd/622:03:566
420399176,5cyclictest0-21swapper/523:51:435
418599176,4cyclictest41-21ksoftirqd/321:17:593
418599175,2cyclictest41-21ksoftirqd/323:17:223
418599175,2cyclictest41-21ksoftirqd/321:47:183
4185991715,1cyclictest41-21ksoftirqd/300:02:503
417199175,4cyclictest25-21ksoftirqd/122:06:531
417199174,3cyclictest25-21ksoftirqd/121:37:491
417199172,3cyclictest8911-21kworker/1:321:32:451
4171991716,1cyclictest25-21ksoftirqd/122:11:591
4171991715,1cyclictest25-21ksoftirqd/123:56:491
4171991715,1cyclictest25-21ksoftirqd/122:39:351
4171991715,1cyclictest25-21ksoftirqd/121:41:561
4171991715,1cyclictest25-21ksoftirqd/121:13:441
4171991714,1cyclictest25-21ksoftirqd/100:36:071
4171991712,1cyclictest25-21ksoftirqd/123:06:451
416399176,0cyclictest0-21swapper/023:20:000
8852160,0sleep51-21systemd23:39:115
421299162,3cyclictest65-21ksoftirqd/623:02:426
4212991615,1cyclictest65-21ksoftirqd/600:04:436
4212991614,1cyclictest65-21ksoftirqd/622:26:346
4212991614,1cyclictest65-21ksoftirqd/621:46:476
4212991614,1cyclictest65-21ksoftirqd/621:26:526
4212991614,1cyclictest65-21ksoftirqd/621:11:386
4212991614,1cyclictest65-21ksoftirqd/600:17:156
421299161,1cyclictest65-21ksoftirqd/621:52:086
421299161,1cyclictest65-21ksoftirqd/621:52:086
421299160,3cyclictest121rcu_preempt22:26:426
421299160,15cyclictest27150-21kworker/6:321:32:026
420399168,0cyclictest0-21swapper/522:22:465
420399167,4cyclictest0-21swapper/523:36:185
420399165,5cyclictest0-21swapper/522:48:125
420399165,5cyclictest0-21swapper/500:08:475
420399165,0cyclictest0-21swapper/500:16:595
417899169,1cyclictest0-21swapper/223:52:082
417899168,1cyclictest0-21swapper/223:12:252
4171991614,1cyclictest25-21ksoftirqd/123:46:401
416399168,5cyclictest0-21swapper/022:25:140
416399165,5cyclictest0-21swapper/023:04:240
416399165,5cyclictest0-21swapper/022:36:420
61642150,0sleep20-21swapper/221:55:522
61642150,0sleep20-21swapper/221:55:522
4212991513,1cyclictest65-21ksoftirqd/622:31:436
4212991513,1cyclictest65-21ksoftirqd/621:41:456
4212991513,1cyclictest65-21ksoftirqd/600:24:296
4212991513,1cyclictest65-21ksoftirqd/600:24:296
4212991513,1cyclictest65-21ksoftirqd/600:11:006
4203991512,2cyclictest19179-21sshd00:25:475
4203991512,2cyclictest19179-21sshd00:25:475
4203991511,0cyclictest0-21swapper/523:58:535
4203991510,4cyclictest57-21ksoftirqd/522:03:185
419399150,14cyclictest21762-21kworker/4:522:39:284
417899159,2cyclictest19173-21systemctl00:34:522
416399158,7cyclictest0-21swapper/021:57:060
416399158,7cyclictest0-21swapper/021:57:060
416399154,5cyclictest0-21swapper/023:40:040
416399154,5cyclictest0-21swapper/021:49:360
416399154,5cyclictest0-21swapper/000:22:170
416399154,5cyclictest0-21swapper/000:22:170
416399154,0cyclictest0-21swapper/000:05:030
30392150,0sleep40-21swapper/423:24:444
196132150,0sleep70-21swapper/722:23:447
52712140,1sleep449-21ksoftirqd/423:43:034
420399148,6cyclictest0-21swapper/521:35:165
420399148,5cyclictest0-21swapper/521:57:565
420399148,5cyclictest0-21swapper/521:57:565
420399147,0cyclictest0-21swapper/521:50:265
420399145,4cyclictest57-21ksoftirqd/521:55:325
420399145,4cyclictest57-21ksoftirqd/521:55:325
420399143,5cyclictest9236-21kworker/u16:222:32:305
420399142,7cyclictest0-21swapper/523:20:525
420399142,6cyclictest0-21swapper/521:27:245
420399142,1cyclictest0-21swapper/500:33:255
4203991413,1cyclictest57-21ksoftirqd/523:26:145
4203991411,0cyclictest0-21swapper/500:26:515
4185991412,1cyclictest41-21ksoftirqd/319:40:363
4178991412,1cyclictest33-21ksoftirqd/200:02:392
416399148,5cyclictest0-21swapper/022:20:000
416399146,8cyclictest0-21swapper/000:11:450
416399146,3cyclictest709-21systemd-logind22:33:060
416399143,5cyclictest0-21swapper/000:18:430
416399142,6cyclictest0-21swapper/022:12:160
416399142,6cyclictest0-21swapper/021:15:380
193472140,1sleep519308-21sshd22:07:255
422099138,4cyclictest73-21ksoftirqd/722:43:257
4220991311,1cyclictest73-21ksoftirqd/723:11:477
4220991311,1cyclictest73-21ksoftirqd/722:59:487
4220991311,1cyclictest73-21ksoftirqd/700:08:487
4220991311,1cyclictest73-21ksoftirqd/700:03:467
422099130,1cyclictest0-21swapper/723:44:117
420399138,5cyclictest57-21ksoftirqd/523:28:045
420399138,5cyclictest0-21swapper/522:56:385
420399138,5cyclictest0-21swapper/522:30:345
420399138,5cyclictest0-21swapper/522:17:305
420399138,5cyclictest0-21swapper/522:12:545
420399138,1cyclictest27946-21bash21:15:305
420399137,5cyclictest24895-21sshd00:13:175
420399132,5cyclictest0-21swapper/521:46:305
420399130,12cyclictest551rcuc/522:53:105
4193991311,1cyclictest49-21ksoftirqd/423:38:174
4185991311,1cyclictest41-21ksoftirqd/321:06:343
4185991311,1cyclictest41-21ksoftirqd/320:16:343
4178991311,1cyclictest721-21dbus-daemon00:21:272
4178991310,2cyclictest33-21ksoftirqd/200:13:522
417899130,13cyclictest4257-21kworker/2:421:57:202
417899130,13cyclictest4257-21kworker/2:421:57:202
4171991313,0cyclictest19381-21kworker/1:119:07:361
4171991311,1cyclictest25-21ksoftirqd/121:06:351
416399138,5cyclictest0-21swapper/023:11:520
416399138,5cyclictest0-21swapper/000:26:590
416399138,5cyclictest0-21swapper/000:08:090
416399138,1cyclictest16033-21sshd23:54:350
416399138,0cyclictest0-21swapper/023:25:300
416399137,3cyclictest9-21ksoftirqd/000:00:020
416399132,7cyclictest25229-21kworker/0:121:35:440
416399131,12cyclictest3238-21sshd22:28:220
416399130,8cyclictest15538-21sshd21:41:520
416399130,7cyclictest0-21swapper/023:26:380
261142130,0sleep40-21swapper/423:27:494
226872130,0sleep70-21swapper/722:27:377
224292130,0sleep70-21swapper/722:38:347
422099122,4cyclictest32340-21sshd23:31:507
4220991211,1cyclictest73-21ksoftirqd/721:52:387
4220991211,1cyclictest73-21ksoftirqd/721:52:387
4220991210,1cyclictest73-21ksoftirqd/723:05:387
4220991210,1cyclictest73-21ksoftirqd/722:48:397
4220991210,1cyclictest73-21ksoftirqd/721:21:457
4220991210,1cyclictest73-21ksoftirqd/721:18:307
4220991210,1cyclictest73-21ksoftirqd/721:12:567
4220991210,1cyclictest73-21ksoftirqd/700:31:377
4220991210,1cyclictest73-21ksoftirqd/700:24:107
4220991210,1cyclictest73-21ksoftirqd/700:24:107
422099120,12cyclictest0-21swapper/723:53:257
422099120,11cyclictest22320-21sshd22:16:427
422099120,11cyclictest18919-21kworker/7:223:46:397
420399126,6cyclictest17369-21grep23:07:185
4193991210,1cyclictest49-21ksoftirqd/400:33:234
4193991210,1cyclictest49-21ksoftirqd/400:28:144
4193991210,1cyclictest49-21ksoftirqd/400:21:504
4193991210,1cyclictest49-21ksoftirqd/400:21:504
4193991210,1cyclictest49-21ksoftirqd/400:06:484
419399121,5cyclictest5152-21sshd22:35:524
419399120,11cyclictest30432-21sshd00:20:574
419399120,11cyclictest2573-21systemd21:28:294
4185991210,1cyclictest41-21ksoftirqd/320:31:473
417899127,2cyclictest31921-21grepconf.sh22:40:592
417899122,4cyclictest5499-21sshd23:46:452
4178991210,1cyclictest0-21swapper/222:21:582
417899120,11cyclictest12256-21grepconf.sh23:39:512
417899120,11cyclictest1-21systemd22:44:492
4171991211,1cyclictest25-21ksoftirqd/120:51:501
4171991211,1cyclictest24022-21kworker/1:220:23:521
4171991210,1cyclictest25-21ksoftirqd/120:46:551
416399127,5cyclictest0-21swapper/021:37:000
416399127,0cyclictest0-21swapper/022:06:240
416399125,0cyclictest0-21swapper/022:42:040
416399120,4cyclictest20039-21kworker/0:222:50:520
113702120,0sleep40-21swapper/400:01:374
422099119,1cyclictest73-21ksoftirqd/721:56:437
422099119,1cyclictest73-21ksoftirqd/721:56:437
422099119,1cyclictest73-21ksoftirqd/721:34:577
422099118,2cyclictest73-21ksoftirqd/721:37:407
422099112,9cyclictest12340-21kworker/u16:122:52:127
4220991110,1cyclictest15-21kswork23:06:567
422099110,11cyclictest0-21swapper/723:28:027
422099110,10cyclictest0-21swapper/723:37:117
419399119,1cyclictest49-21ksoftirqd/422:43:204
419399119,1cyclictest49-21ksoftirqd/421:19:514
419399118,2cyclictest12076-21bash23:03:234
419399118,1cyclictest49-21ksoftirqd/423:07:204
419399117,2cyclictest12418-21kill23:50:474
419399117,1cyclictest24922-21kworker/4:521:36:344
419399114,4cyclictest27958-21sshd21:13:394
419399113,5cyclictest1-21systemd00:16:074
419399113,4cyclictest6797-21sshd23:15:554
419399113,4cyclictest26458-21sshd21:44:194
419399113,1cyclictest464-21systemd-journal22:13:334
419399111,4cyclictest0-21swapper/421:51:144
419399110,1cyclictest806-21grep23:57:184
418599119,1cyclictest41-21ksoftirqd/320:36:463
4185991110,1cyclictest41-21ksoftirqd/320:51:343
4185991110,1cyclictest41-21ksoftirqd/320:31:343
4185991110,1cyclictest41-21ksoftirqd/320:26:343
4185991110,1cyclictest41-21ksoftirqd/320:21:343
417899119,1cyclictest33-21ksoftirqd/223:31:542
417899119,1cyclictest33-21ksoftirqd/200:30:472
417899119,1cyclictest1-21systemd21:47:362
417899113,7cyclictest4675-21cut21:26:492
4178991110,1cyclictest0-21swapper/223:07:032
417899111,4cyclictest0-21swapper/221:16:022
417899110,11cyclictest29371-21kworker/2:123:25:232
417899110,1cyclictest131rcu_sched21:33:062
417199119,1cyclictest25-21ksoftirqd/120:56:441
417199119,1cyclictest25-21ksoftirqd/120:26:461
4171991111,0cyclictest24022-21kworker/1:220:44:101
4171991111,0cyclictest24022-21kworker/1:220:10:001
4171991111,0cyclictest24022-21kworker/1:219:50:361
4171991110,1cyclictest25-21ksoftirqd/120:36:471
4171991110,1cyclictest24022-21kworker/1:219:43:301
416399116,0cyclictest0-21swapper/023:47:300
422099109,1cyclictest73-21ksoftirqd/722:02:047
422099108,1cyclictest73-21ksoftirqd/723:57:567
422099108,1cyclictest73-21ksoftirqd/721:46:557
422099108,1cyclictest73-21ksoftirqd/721:28:027
422099108,1cyclictest73-21ksoftirqd/700:29:167
422099108,1cyclictest73-21ksoftirqd/700:11:537
422099100,4cyclictest0-21swapper/721:01:067
420399106,0cyclictest0-21swapper/519:53:285
419399109,1cyclictest0-21swapper/422:58:024
419399108,1cyclictest49-21ksoftirqd/422:24:454
419399104,4cyclictest0-21swapper/421:56:224
419399104,4cyclictest0-21swapper/421:56:224
419399103,4cyclictest23155-21bash22:55:014
419399103,4cyclictest22325-21sshd21:24:124
419399100,9cyclictest27583-21kworker/4:122:03:044
419399100,10cyclictest0-21swapper/422:19:054
419399100,1cyclictest0-21swapper/421:57:114
419399100,1cyclictest0-21swapper/421:57:114
417899108,1cyclictest11630-21sshd22:32:322
417899104,3cyclictest709-21systemd-logind21:26:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional