You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 17:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun May 10, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
86292920,1sleep18601-21sshd12:12:491
322142730,0sleep10-21swapper/112:22:111
199392680,1sleep419940-21grepconf.sh11:46:494
249932580,0sleep50-21swapper/510:08:395
188692570,0sleep70-21swapper/709:16:437
48092550,1sleep44777-21rm10:47:554
2771625226,9sleep40-21swapper/407:04:534
266592510,0sleep50-21swapper/511:02:375
126062510,0sleep50-21swapper/511:36:495
44932500,0sleep20-21swapper/210:17:092
44932500,0sleep20-21swapper/210:17:092
269352500,1sleep226923-21sshd11:58:492
58152490,0sleep00-21swapper/011:12:580
53302490,1sleep05332-21sshd10:09:220
21792490,0sleep20-21swapper/211:24:292
165602480,1sleep77565-21kworker/u16:109:27:567
165602480,1sleep77565-21kworker/u16:109:27:567
40432470,0sleep10-21swapper/111:57:281
2802224725,8sleep70-21swapper/707:09:047
287042460,0sleep50-21swapper/510:47:245
217922460,0sleep00-21swapper/012:31:070
77802440,0sleep50-21swapper/510:19:205
77802440,0sleep50-21swapper/510:19:205
325062440,1sleep232507-21kill10:24:302
255212440,0sleep6721-21dbus-daemon10:49:096
211052440,0sleep30-21swapper/311:27:343
198062440,1sleep619807-21latency_hist09:49:186
176552440,0sleep30-21swapper/312:38:393
2771424332,8sleep20-21swapper/207:04:512
2789724225,13sleep60-21swapper/607:07:276
208422420,0sleep50-21swapper/512:36:485
106122410,0sleep00-21swapper/010:02:090
325122400,0sleep50-21swapper/511:10:385
303212400,0sleep50-21swapper/509:57:345
2790024027,9sleep00-21swapper/007:07:290
25802400,0sleep25858-21kworker/2:409:15:422
177702400,0sleep5561ktimersoftd/510:50:365
42892390,0sleep10-21swapper/112:04:571
2792523927,8sleep30-21swapper/307:07:483
2788323927,9sleep10-21swapper/107:07:141
2776223927,9sleep50-21swapper/507:05:345
249572390,0sleep00-21swapper/010:04:500
127572390,0sleep60-21swapper/609:27:396
127572390,0sleep60-21swapper/609:27:396
103752390,0sleep40-21swapper/410:04:064
85162370,0sleep40-21swapper/411:20:464
218732370,2sleep02816099cyclictest09:45:270
49822290,0sleep30-21swapper/309:42:343
28160992810,1cyclictest9-21ksoftirqd/011:31:560
2817899277,3cyclictest41-21ksoftirqd/310:56:273
28192992410,3cyclictest65-21ksoftirqd/611:18:526
28192992410,3cyclictest65-21ksoftirqd/611:18:526
28192992310,4cyclictest65-21ksoftirqd/611:26:116
28178992317,3cyclictest41-21ksoftirqd/309:47:473
2819299225,4cyclictest65-21ksoftirqd/609:42:136
28178992211,1cyclictest41-21ksoftirqd/311:53:203
2816099227,2cyclictest9-21ksoftirqd/010:44:390
28160992220,1cyclictest9-21ksoftirqd/011:17:210
28160992220,1cyclictest9-21ksoftirqd/011:17:210
28160992218,2cyclictest9-21ksoftirqd/009:36:040
2819299218,3cyclictest65-21ksoftirqd/609:58:466
2819299217,3cyclictest65-21ksoftirqd/609:20:096
28192992112,1cyclictest65-21ksoftirqd/609:10:436
2817899219,3cyclictest41-21ksoftirqd/309:31:063
2817899219,1cyclictest41-21ksoftirqd/310:21:123
2817899219,1cyclictest41-21ksoftirqd/310:21:123
2817899218,1cyclictest41-21ksoftirqd/311:03:393
2817899216,3cyclictest41-21ksoftirqd/310:13:113
28178992117,3cyclictest41-21ksoftirqd/312:22:553
28178992117,3cyclictest41-21ksoftirqd/311:13:043
28178992113,1cyclictest41-21ksoftirqd/309:20:183
2816099219,2cyclictest9-21ksoftirqd/010:25:490
2816099218,1cyclictest9-21ksoftirqd/011:27:170
2816099217,2cyclictest9-21ksoftirqd/010:34:180
28160992110,2cyclictest9-21ksoftirqd/011:59:030
2819299206,3cyclictest65-21ksoftirqd/611:55:326
2819299204,3cyclictest65-21ksoftirqd/611:34:146
2817899209,3cyclictest41-21ksoftirqd/310:52:013
2817899209,1cyclictest41-21ksoftirqd/310:49:173
2817899208,2cyclictest41-21ksoftirqd/312:16:273
2817899208,2cyclictest41-21ksoftirqd/311:21:173
2817899207,3cyclictest41-21ksoftirqd/311:34:363
2817899207,3cyclictest41-21ksoftirqd/310:03:333
2817899206,3cyclictest41-21ksoftirqd/311:15:083
2817899206,3cyclictest41-21ksoftirqd/311:15:083
28178992015,3cyclictest41-21ksoftirqd/311:08:533
28178992014,3cyclictest41-21ksoftirqd/312:09:343
2816099206,1cyclictest9-21ksoftirqd/012:38:190
2816099206,1cyclictest9-21ksoftirqd/009:50:340
28160992017,3cyclictest9-21ksoftirqd/010:17:270
28160992017,3cyclictest9-21ksoftirqd/010:17:270
28160992014,1cyclictest121rcu_preempt11:23:030
28160992013,4cyclictest9-21ksoftirqd/009:09:550
226392200,0sleep30-21swapper/311:58:343
147982200,0sleep10-21swapper/110:29:091
2819299195,1cyclictest65-21ksoftirqd/609:38:016
2819299194,4cyclictest65-21ksoftirqd/610:55:036
2819299194,3cyclictest65-21ksoftirqd/610:17:056
2819299194,3cyclictest65-21ksoftirqd/610:17:056
2819299193,1cyclictest65-21ksoftirqd/612:02:556
28192991916,3cyclictest65-21ksoftirqd/610:41:316
28192991915,3cyclictest65-21ksoftirqd/611:03:566
28192991913,4cyclictest65-21ksoftirqd/612:12:016
28192991912,6cyclictest65-21ksoftirqd/610:32:106
2817899199,2cyclictest41-21ksoftirqd/310:39:353
2817899196,1cyclictest41-21ksoftirqd/311:45:173
2817899196,1cyclictest41-21ksoftirqd/309:52:343
2817899195,3cyclictest41-21ksoftirqd/310:14:503
2817899195,3cyclictest41-21ksoftirqd/310:14:503
2817899195,3cyclictest41-21ksoftirqd/310:05:053
2817899195,2cyclictest41-21ksoftirqd/310:32:343
28178991913,4cyclictest41-21ksoftirqd/309:36:263
28178991912,3cyclictest41-21ksoftirqd/311:59:553
28160991916,1cyclictest9-21ksoftirqd/011:48:470
28160991915,3cyclictest9-21ksoftirqd/010:49:400
28160991915,3cyclictest111rcuc/011:40:270
28160991911,5cyclictest9-21ksoftirqd/009:29:320
2819299189,1cyclictest65-21ksoftirqd/609:19:006
2819299187,2cyclictest65-21ksoftirqd/612:37:416
2819299187,1cyclictest65-21ksoftirqd/610:35:356
2819299186,1cyclictest65-21ksoftirqd/611:22:366
2819299185,3cyclictest65-21ksoftirqd/611:53:316
2819299185,2cyclictest65-21ksoftirqd/609:32:446
2819299184,3cyclictest65-21ksoftirqd/609:59:306
28192991812,4cyclictest65-21ksoftirqd/612:05:486
28187991815,1cyclictest57-21ksoftirqd/509:25:175
28187991815,1cyclictest57-21ksoftirqd/509:25:175
2818799180,17cyclictest11792-21kworker/5:012:33:005
2817899188,3cyclictest41-21ksoftirqd/311:34:123
2817899186,1cyclictest41-21ksoftirqd/311:40:273
2817899186,1cyclictest41-21ksoftirqd/309:14:143
2817899185,1cyclictest41-21ksoftirqd/309:28:263
2817899185,1cyclictest41-21ksoftirqd/309:28:263
2817899183,3cyclictest41-21ksoftirqd/312:24:223
28178991816,1cyclictest41-21ksoftirqd/309:55:343
2817899180,1cyclictest121rcu_preempt10:38:433
2816099188,3cyclictest9-21ksoftirqd/010:39:420
2816099188,2cyclictest9-21ksoftirqd/009:56:450
2816099186,3cyclictest9-21ksoftirqd/010:35:090
28160991814,1cyclictest9-21ksoftirqd/010:20:500
28160991814,1cyclictest9-21ksoftirqd/010:20:500
28160991813,4cyclictest9-21ksoftirqd/011:05:580
2816099180,2cyclictest9-21ksoftirqd/011:03:010
2819299176,2cyclictest65-21ksoftirqd/611:37:046
2819299175,3cyclictest65-21ksoftirqd/610:21:366
2819299175,3cyclictest65-21ksoftirqd/610:21:366
2819299174,3cyclictest65-21ksoftirqd/610:53:506
28192991715,1cyclictest65-21ksoftirqd/612:29:396
28192991714,3cyclictest65-21ksoftirqd/611:12:236
28192991713,1cyclictest65-21ksoftirqd/610:24:446
28192991713,1cyclictest65-21ksoftirqd/610:11:106
28192991713,1cyclictest65-21ksoftirqd/609:52:036
28192991712,3cyclictest65-21ksoftirqd/610:04:396
2817899176,2cyclictest41-21ksoftirqd/312:05:003
28178991713,3cyclictest41-21ksoftirqd/310:24:273
2817899171,2cyclictest41-21ksoftirqd/312:29:223
2817899170,1cyclictest131rcu_sched09:19:043
2816099175,2cyclictest9-21ksoftirqd/012:25:110
2816099175,1cyclictest9-21ksoftirqd/012:02:250
28160991715,1cyclictest9-21ksoftirqd/012:08:080
28160991715,1cyclictest9-21ksoftirqd/011:49:360
28160991714,2cyclictest9-21ksoftirqd/010:58:210
28160991714,2cyclictest9-21ksoftirqd/009:15:010
28160991714,1cyclictest9-21ksoftirqd/009:25:400
28160991714,1cyclictest9-21ksoftirqd/009:25:400
28160991714,1cyclictest9-21ksoftirqd/009:21:520
28160991711,2cyclictest9-21ksoftirqd/011:34:290
152422170,1sleep415246-21bash10:17:514
152422170,1sleep415246-21bash10:17:514
120982170,0sleep10-21swapper/111:21:001
2819299169,4cyclictest65-21ksoftirqd/612:14:346
2819299164,3cyclictest65-21ksoftirqd/611:05:146
2819299163,3cyclictest65-21ksoftirqd/611:40:146
28192991614,1cyclictest65-21ksoftirqd/612:26:086
28192991611,3cyclictest65-21ksoftirqd/611:46:466
28187991615,1cyclictest57-21ksoftirqd/510:26:115
28187991614,2cyclictest57-21ksoftirqd/511:47:265
28187991614,1cyclictest57-21ksoftirqd/510:13:435
28187991613,2cyclictest57-21ksoftirqd/511:54:025
28187991613,1cyclictest57-21ksoftirqd/511:21:065
28187991612,3cyclictest57-21ksoftirqd/512:28:135
28187991612,3cyclictest57-21ksoftirqd/511:32:125
28175991611,3cyclictest33-21ksoftirqd/209:22:462
2816099164,4cyclictest9-21ksoftirqd/012:20:300
28160991614,1cyclictest9-21ksoftirqd/012:14:510
28160991614,1cyclictest9-21ksoftirqd/012:10:130
28160991614,1cyclictest9-21ksoftirqd/009:39:420
175422160,1sleep417538-21sshd09:14:404
28196991510,4cyclictest73-21ksoftirqd/709:54:387
2819299155,3cyclictest65-21ksoftirqd/612:22:286
28187991513,2cyclictest57-21ksoftirqd/509:54:175
28187991513,1cyclictest57-21ksoftirqd/512:23:035
28187991513,1cyclictest57-21ksoftirqd/511:54:335
28187991513,1cyclictest57-21ksoftirqd/510:00:035
28187991513,1cyclictest57-21ksoftirqd/509:47:415
28175991513,1cyclictest709-21systemd-logind12:00:172
28175991513,0cyclictest13550irq/24-ahci[00011:12:462
2816899159,2cyclictest9193-21sshd10:07:441
28160991514,0cyclictest9-21ksoftirqd/008:15:010
15542150,0sleep20-21swapper/210:07:162
297052140,0sleep40-21swapper/412:06:284
28196991410,1cyclictest73-21ksoftirqd/711:27:467
2818799148,3cyclictest22340-21kworker/5:211:42:175
28187991413,1cyclictest57-21ksoftirqd/512:11:005
28187991413,1cyclictest57-21ksoftirqd/512:02:025
28187991413,1cyclictest57-21ksoftirqd/509:38:185
28187991412,1cyclictest57-21ksoftirqd/509:21:185
28187991410,3cyclictest57-21ksoftirqd/511:08:335
28187991410,3cyclictest30730-21sshd12:18:155
2818599147,6cyclictest31026-21kworker/4:409:32:154
28175991411,2cyclictest33-21ksoftirqd/210:03:552
2816099140,14cyclictest0-21swapper/007:37:030
31682130,1sleep449-21ksoftirqd/412:31:594
28196991311,1cyclictest73-21ksoftirqd/712:13:427
2818799139,1cyclictest57-21ksoftirqd/509:10:225
2818799138,4cyclictest57-21ksoftirqd/510:29:535
28187991312,1cyclictest57-21ksoftirqd/511:16:115
28187991312,1cyclictest57-21ksoftirqd/511:16:115
28187991312,1cyclictest57-21ksoftirqd/509:41:175
28187991311,1cyclictest57-21ksoftirqd/512:05:145
28187991311,1cyclictest57-21ksoftirqd/510:54:375
28187991311,1cyclictest57-21ksoftirqd/510:40:175
28187991311,1cyclictest57-21ksoftirqd/510:14:415
28187991311,1cyclictest57-21ksoftirqd/510:14:415
28187991311,1cyclictest57-21ksoftirqd/509:30:225
28187991311,1cyclictest57-21ksoftirqd/509:16:585
2818599136,3cyclictest307-21kworker/4:309:23:354
2818599132,5cyclictest20347-21id10:25:364
28185991312,1cyclictest49-21ksoftirqd/412:20:514
28185991311,1cyclictest49-21ksoftirqd/410:56:234
28185991310,2cyclictest1934-21bash09:42:224
28178991310,3cyclictest41-21ksoftirqd/307:59:173
2817899130,1cyclictest121rcu_preempt08:24:353
28175991312,1cyclictest33-21ksoftirqd/212:19:022
28175991312,1cyclictest33-21ksoftirqd/211:36:092
28175991311,1cyclictest709-21systemd-logind12:08:422
28175991311,1cyclictest33-21ksoftirqd/210:21:362
28175991311,1cyclictest33-21ksoftirqd/210:21:362
2816899132,5cyclictest12059-21sshd11:31:021
28168991311,1cyclictest25-21ksoftirqd/112:33:291
28168991311,1cyclictest25-21ksoftirqd/110:30:191
28160991313,0cyclictest0-21swapper/007:22:510
28160991311,2cyclictest0-21swapper/007:59:250
28160991311,2cyclictest0-21swapper/007:45:230
2816099130,13cyclictest0-21swapper/008:49:310
245012130,0sleep7721ktimersoftd/709:22:447
236602130,1sleep723636-21sshd09:37:507
298522120,0sleep2321ktimersoftd/211:04:432
2819699129,1cyclictest73-21ksoftirqd/710:46:167
2819699127,1cyclictest73-21ksoftirqd/711:36:417
2819699125,4cyclictest721-21dbus-daemon10:26:187
2819699122,4cyclictest0-21swapper/709:45:037
28196991211,1cyclictest73-21ksoftirqd/711:44:337
28196991210,1cyclictest73-21ksoftirqd/712:16:447
28196991210,1cyclictest73-21ksoftirqd/711:32:417
28196991210,1cyclictest73-21ksoftirqd/710:50:077
28196991210,1cyclictest73-21ksoftirqd/710:20:037
28196991210,1cyclictest73-21ksoftirqd/710:20:037
2819699120,12cyclictest0-21swapper/711:07:417
2818799127,3cyclictest57-21ksoftirqd/510:34:475
28187991211,1cyclictest57-21ksoftirqd/511:28:185
2818599125,1cyclictest709-21systemd-logind12:09:274
2818599122,4cyclictest857-21polkitd12:18:444
2818599122,4cyclictest6252-21sshd10:49:484
2818599122,4cyclictest0-21swapper/411:34:444
28185991211,1cyclictest49-21ksoftirqd/411:34:124
28185991211,1cyclictest49-21ksoftirqd/409:37:414
28185991210,1cyclictest49-21ksoftirqd/411:53:434
28185991210,1cyclictest49-21ksoftirqd/410:31:254
2818599120,12cyclictest19478-21kworker/4:010:07:384
2818599120,11cyclictest4029-21sshd11:42:014
28178991210,1cyclictest41-21ksoftirqd/307:39:173
2817599127,4cyclictest33-21ksoftirqd/212:29:422
2817599124,4cyclictest721-21dbus-daemon10:30:162
2817599124,4cyclictest24326-21sshd11:23:552
2817599123,5cyclictest721-21dbus-daemon12:11:272
2817599122,2cyclictest0-21swapper/212:25:132
28175991210,2cyclictest33-21ksoftirqd/209:58:102
28175991210,1cyclictest33-21ksoftirqd/212:22:112
28175991210,1cyclictest33-21ksoftirqd/211:40:192
2817599120,11cyclictest13333-21bash09:25:472
2817599120,11cyclictest13333-21bash09:25:472
2816899123,4cyclictest1080-21grep11:12:411
2816899122,4cyclictest721-21dbus-daemon09:49:301
2816899122,4cyclictest663-21in:imjournal10:36:241
2816899122,4cyclictest27469-21sshd11:45:191
2816899122,4cyclictest14360-21systemd-cgroups11:17:111
2816899122,4cyclictest14360-21systemd-cgroups11:17:111
2816899122,4cyclictest0-21swapper/112:18:511
2816899122,4cyclictest0-21swapper/109:35:031
2816899122,4cyclictest0-21swapper/109:23:561
28168991210,1cyclictest25-21ksoftirqd/110:39:391
2816899121,5cyclictest7949-21sshd11:09:121
2816899121,5cyclictest27950-21systemd11:43:331
2816899120,11cyclictest17903-21systemd11:37:081
2816099128,1cyclictest9-21ksoftirqd/007:09:190
2816099128,1cyclictest9-21ksoftirqd/007:09:190
28160991211,1cyclictest24285-21kworker/0:107:19:180
28160991211,0cyclictest0-21swapper/008:30:470
21632120,0sleep20-21swapper/210:47:452
286772110,0sleep20-21swapper/208:59:402
2819699119,1cyclictest73-21ksoftirqd/712:00:297
2819699119,1cyclictest73-21ksoftirqd/711:15:327
2819699119,1cyclictest73-21ksoftirqd/711:15:327
2819699119,1cyclictest73-21ksoftirqd/709:40:147
2819699119,1cyclictest15-21kswork10:11:347
2819699119,1cyclictest1-21systemd11:54:497
2819699115,5cyclictest23323-21sshd10:14:287
2819699115,5cyclictest23323-21sshd10:14:287
2819699114,4cyclictest4104-21sshd10:44:017
2819699114,4cyclictest0-21swapper/710:07:187
2819699113,5cyclictest4918-21systemd12:37:497
2819699112,5cyclictest24800-21bash12:19:447
28196991110,1cyclictest73-21ksoftirqd/709:30:077
28196991110,1cyclictest0-21swapper/710:58:587
2819699110,10cyclictest12980-21sshd09:52:387
2819299119,1cyclictest17981-21latency_hist08:44:176
2818599113,7cyclictest709-21systemd-logind09:26:544
2818599113,7cyclictest709-21systemd-logind09:26:544
2818599113,1cyclictest8069-21sshd10:09:314
2818599112,4cyclictest1-21systemd09:55:084
2818599112,4cyclictest0-21swapper/412:02:324
2818599111,4cyclictest721-21dbus-daemon12:25:104
2818599111,4cyclictest31306-21sshd11:16:174
2818599111,4cyclictest31306-21sshd11:16:174
2818599111,4cyclictest31211-21sshd11:02:564
2818599111,4cyclictest21211-21sshd09:10:384
2818599111,4cyclictest14836-21sshd09:45:024
2818599111,4cyclictest1-21systemd10:40:414
2818599111,4cyclictest0-21swapper/410:35:114
2817899119,1cyclictest41-21ksoftirqd/307:24:183
2817899110,1cyclictest121rcu_preempt07:24:383
2817599119,1cyclictest33-21ksoftirqd/209:30:402
2817599119,1cyclictest0-21swapper/211:00:412
2817599118,1cyclictest33-21ksoftirqd/210:37:382
2817599114,4cyclictest32550-21bash11:49:332
2817599113,3cyclictest721-21dbus-daemon09:09:452
2817599112,7cyclictest3750-21kill09:50:112
2817599112,3cyclictest18235-21bash11:44:462
2817599111,3cyclictest1-21systemd10:10:352
2817599110,1cyclictest466-21sshd12:35:362
2816899113,7cyclictest8086-21sshd11:28:471
28168991110,1cyclictest25-21ksoftirqd/111:49:521
2816899111,4cyclictest9441-21systemd-cgroups09:09:481
2816899111,4cyclictest721-21dbus-daemon09:48:341
2816899111,4cyclictest26532-21sshd10:56:551
2816899111,4cyclictest16111-21systemd09:27:551
2816899111,4cyclictest16111-21systemd09:27:551
2816899111,4cyclictest12622-21grepconf.sh10:50:101
2816899111,4cyclictest0-21swapper/110:59:191
2816899110,5cyclictest9599-21bash09:58:151
2816899110,5cyclictest21821-21systemd10:23:551
2816899110,5cyclictest21821-21systemd10:23:551
2816899110,11cyclictest30272-21kworker/1:210:03:211
2816899110,1cyclictest0-21swapper/110:45:351
2816099119,2cyclictest0-21swapper/007:44:090
2816099119,2cyclictest0-21swapper/007:31:310
2816099119,1cyclictest9-21ksoftirqd/008:47:000
2816099119,0cyclictest0-21swapper/008:29:130
2816099110,11cyclictest0-21swapper/008:13:370
125232110,0sleep70-21swapper/710:59:517
98252100,0sleep10-21swapper/108:29:291
2819699109,1cyclictest15-21kswork11:40:557
2819699108,1cyclictest73-21ksoftirqd/712:04:437
2819699108,1cyclictest73-21ksoftirqd/710:01:307
2819699103,4cyclictest670-21rs:main7
2819699103,4cyclictest0-21swapper/712:30:487
2819699103,3cyclictest25441-21bash12:27:307
2819699101,5cyclictest8089-21systemd09:12:037
2819699100,4cyclictest709-21systemd-logind10:30:227
2819699100,10cyclictest0-21swapper/711:52:567
2819699100,1cyclictest17856-21systemd11:11:457
2818599107,2cyclictest721-21dbus-daemon10:21:224
2818599107,2cyclictest721-21dbus-daemon10:21:224
2818599103,6cyclictest49-21ksoftirqd/411:26:084
2818599103,1cyclictest721-21dbus-daemon11:07:214
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional