You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 10:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Apr 03, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31601302990,1sleep73160131-21irqcore20:47:487
33201802650,1sleep73320181-21grep21:57:447
33201802650,1sleep73320181-21grep21:57:447
34894052620,1sleep73489404-21iostat_ios23:07:497
35960382610,0sleep73596039-21sh23:52:137
295394725948,8sleep50-21swapper/519:01:065
295383425948,7sleep40-21swapper/418:59:294
295377825039,7sleep60-21swapper/618:58:426
2954326994846,2cyclictest3063597-21kworker/u16:2+flush-8:021:18:024
2954326994443,1cyclictest3572595-21kworker/u16:2+flush-8:000:22:334
2954332994138,2cyclictest3404313-21kworker/u16:2+flush-8:022:32:506
29455002414,31sleep70-21swapper/718:57:477
2954332993936,2cyclictest3158859-21kworker/u16:1+flush-8:021:07:336
2954326993937,2cyclictest3522904-21kworker/u16:3+events_unbound23:23:004
2954328993837,1cyclictest3282460-21kworker/u16:1+flush-8:021:47:335
2954326993735,2cyclictest2871489-21kworker/u16:1+events_unbound19:18:004
2954328993634,2cyclictest3391965-21kworker/u16:5+events_unbound22:37:545
2954326993634,2cyclictest3368252-21kworker/u16:0+flush-8:022:42:324
2954326993634,2cyclictest2871489-21kworker/u16:1+flush-8:019:52:554
2954326993532,2cyclictest3572595-21kworker/u16:2+events_unbound23:42:434
30573752340,0chrt0-21swapper/619:52:506
2954332993431,2cyclictest3630656-21kworker/u16:1+flush-8:000:07:386
2954338993328,4cyclictest3644260-21latency_hist00:12:337
2954328993331,2cyclictest3282460-21kworker/u16:1+flush-8:021:53:115
2954328993331,2cyclictest2952967-21kworker/u16:0+events_unbound19:12:595
2954326993331,2cyclictest3404313-21kworker/u16:2+flush-8:023:13:054
2954328993230,2cyclictest3282460-21kworker/u16:1+events_unbound21:40:265
2954328993230,2cyclictest3063597-21kworker/u16:2+flush-8:021:33:025
2954326993230,2cyclictest3368252-21kworker/u16:0+events_unbound22:18:024
2954332993128,2cyclictest3618048-21kworker/u16:4+flush-8:000:13:146
2954328993129,2cyclictest3391965-21kworker/u16:5+flush-8:022:58:125
2954328993129,2cyclictest3208626-21kworker/u16:4+events_unbound21:08:085
2954328993129,2cyclictest3063597-21kworker/u16:2+events_unbound20:57:275
2954328993129,2cyclictest3063597-21kworker/u16:2+events_unbound20:49:265
2954326993129,2cyclictest2996684-21kworker/u16:0+events_unbound20:45:104
2954328993028,2cyclictest3618048-21kworker/u16:4+events_unbound00:27:405
2954328993028,2cyclictest3391965-21kworker/u16:5+flush-8:022:33:135
2954328993028,2cyclictest3282460-21kworker/u16:1+events_unbound21:58:135
2954328993028,2cyclictest3282460-21kworker/u16:1+events_unbound21:58:135
2954328993028,2cyclictest3199144-21kworker/u16:3+events_unbound21:23:245
2954328993028,2cyclictest2871489-21kworker/u16:1+events_unbound19:20:405
2954326993028,2cyclictest3199144-21kworker/u16:3+events_unbound21:36:534
2954326993028,2cyclictest2996684-21kworker/u16:0+events_unbound20:59:594
2954326993027,2cyclictest2996684-21kworker/u16:0+flush-8:020:02:484
2954338992925,3cyclictest124-21kswapd000:17:337
2954328992927,2cyclictest3618048-21kworker/u16:4+flush-8:000:03:135
2954328992927,2cyclictest3063597-21kworker/u16:2+events_unbound20:22:435
2954328992927,2cyclictest2871489-21kworker/u16:1+events_unbound19:58:455
2954328992927,2cyclictest2871489-21kworker/u16:1+events_unbound19:58:455
2954326992927,2cyclictest3630656-21kworker/u16:1+flush-8:000:08:044
2954326992927,2cyclictest3282460-21kworker/u16:1+events_unbound22:07:284
2954326992926,2cyclictest3618048-21kworker/u16:4+flush-8:000:27:494
2954328992826,2cyclictest3436577-21kworker/u16:3+events_unbound22:43:435
2954328992826,2cyclictest3063597-21kworker/u16:2+events_unbound21:18:275
2954328992826,2cyclictest2996684-21kworker/u16:0+flush-8:020:41:555
2954328992826,2cyclictest2996684-21kworker/u16:0+events_unbound20:58:145
2954328992826,2cyclictest2987047-21kworker/u16:2+events_unbound19:29:465
2954326992826,2cyclictest3572595-21kworker/u16:2+events_unbound00:03:284
2954326992826,2cyclictest3063597-21kworker/u16:2+events_unbound20:20:464
2954326992826,2cyclictest2996684-21kworker/u16:0+events_unbound19:38:024
2954332992725,2cyclictest3208626-21kworker/u16:4+flush-8:021:13:146
2954328992725,2cyclictest3015565-21kworker/u16:4+events_unbound19:45:005
2954326992725,2cyclictest3404313-21kworker/u16:2+events_unbound23:17:484
2954326992725,2cyclictest3404313-21kworker/u16:2+events_unbound23:17:484
2954326992725,2cyclictest3283750-21kworker/u16:5+events_unbound21:47:564
2954326992725,2cyclictest2952967-21kworker/u16:0+events_unbound19:05:184
30346672260,1chrt3034668-21cut19:42:347
2954328992624,2cyclictest3618048-21kworker/u16:4+events_unbound00:07:595
2954328992624,2cyclictest3063597-21kworker/u16:2+events_unbound20:31:065
2954328992624,2cyclictest2996684-21kworker/u16:0+events_unbound19:56:135
2954326992624,2cyclictest3557280-21kworker/u16:6+flush-8:023:33:084
2954326992624,2cyclictest3063597-21kworker/u16:2+events_unbound20:38:004
2954326992624,2cyclictest3015565-21kworker/u16:4+events_unbound20:17:274
2954326992624,2cyclictest2996684-21kworker/u16:0+flush-8:020:33:074
2954338992519,5cyclictest650-21systemd-journal19:57:337
2954332992523,2cyclictest3391965-21kworker/u16:5+flush-8:022:58:036
2954328992523,2cyclictest3391965-21kworker/u16:5+events_unbound23:23:205
2954328992523,2cyclictest3063597-21kworker/u16:2+events_unbound20:21:585
2954328992523,2cyclictest2871489-21kworker/u16:1+events_unbound19:50:525
2954328992523,2cyclictest2871489-21kworker/u16:1+events_unbound19:37:525
2954326992523,2cyclictest3208626-21kworker/u16:4+events_unbound21:28:214
2954332992422,2cyclictest3656323-21kworker/u16:0+flush-8:000:18:026
2954332992422,2cyclictest3208626-21kworker/u16:4+flush-8:021:23:156
2954328992422,2cyclictest3572213-21kworker/u16:1+flush-8:023:57:535
2954328992422,2cyclictest3572213-21kworker/u16:1+flush-8:023:57:535
2954328992422,2cyclictest3522904-21kworker/u16:3+flush-8:023:37:005
2954328992422,2cyclictest3283749-21kworker/u16:2+events_unbound22:23:045
2954328992422,2cyclictest2996684-21kworker/u16:0+events_unbound19:36:345
2954328992422,2cyclictest2925599-21kworker/u16:4+events_unbound19:05:515
2954328992422,2cyclictest2871489-21kworker/u16:1+events_unbound19:25:125
2954326992422,2cyclictest2871489-21kworker/u16:1+events_unbound19:46:094
2954332992321,2cyclictest3282460-21kworker/u16:1+flush-8:022:53:426
2954328992321,2cyclictest3450940-21kworker/u16:0+flush-8:022:50:425
2954328992321,2cyclictest3063597-21kworker/u16:2+events_unbound20:12:555
2954328992321,2cyclictest2996684-21kworker/u16:0+events_unbound20:05:435
2954328992321,2cyclictest2952967-21kworker/u16:0+events_unbound19:11:065
2954326992321,2cyclictest3282460-21kworker/u16:1+flush-8:021:58:214
2954326992321,2cyclictest3282460-21kworker/u16:1+flush-8:021:58:214
2954326992321,2cyclictest3063597-21kworker/u16:2+events_unbound20:31:314
2954326992321,2cyclictest3063597-21kworker/u16:2+events_unbound20:22:594
2954326992321,2cyclictest2996684-21kworker/u16:0+events_unbound19:28:184
2954326992321,2cyclictest2871489-21kworker/u16:1+events_unbound19:11:164
2954338992221,1cyclictest3187509-21diskmemload23:33:477
2954332992220,2cyclictest3572595-21kworker/u16:2+flush-8:023:58:496
2954332992220,2cyclictest3572595-21kworker/u16:2+flush-8:023:58:496
2954328992220,2cyclictest3368252-21kworker/u16:0+events_unbound22:17:585
2954326992220,2cyclictest3015565-21kworker/u16:4+events_unbound19:51:254
2954326992220,2cyclictest2996684-21kworker/u16:0+flush-8:021:03:134
2954326992220,2cyclictest2996684-21kworker/u16:0+events_unbound19:37:294
2954326992220,2cyclictest2987047-21kworker/u16:2+events_unbound19:23:384
2954326992219,2cyclictest3436577-21kworker/u16:3+events_unbound22:47:504
2954338992119,1cyclictest3378603-21ssh22:20:227
2954328992119,2cyclictest3282460-21kworker/u16:1+flush-8:023:10:265
2954328992119,2cyclictest3139339-21kworker/u16:3+events_unbound20:42:515
2954328992119,2cyclictest3139339-21kworker/u16:3+events_unbound20:35:085
2954326992119,2cyclictest3404313-21kworker/u16:2+flush-8:022:53:184
2954332992019,1cyclictest3283750-21kworker/u16:5+events_unbound21:49:326
2954328992018,2cyclictest3572213-21kworker/u16:1+events_unbound23:48:235
2954328992017,2cyclictest2996684-21kworker/u16:0+events_unbound20:07:425
2954326992018,2cyclictest3572595-21kworker/u16:2+flush-8:023:53:254
2954326992018,2cyclictest3282460-21kworker/u16:1+flush-8:022:28:324
2954326992018,2cyclictest3282460-21kworker/u16:1+events_unbound22:13:164
2954326992018,2cyclictest3063597-21kworker/u16:2+events_unbound20:11:124
35759872190,0sleep73575989-21cut23:42:517
2954338991914,4cyclictest3259585-21latency_hist21:32:337
2954328991916,2cyclictest3283749-21kworker/u16:2+flush-8:022:02:445
2954326991917,2cyclictest3404313-21kworker/u16:2+flush-8:022:58:074
2954326991917,2cyclictest3391965-21kworker/u16:5+flush-8:023:03:244
2954326991917,2cyclictest2996684-21kworker/u16:0+events_unbound20:53:524
2954338991818,0cyclictest0-21swapper/723:01:507
2954338991818,0cyclictest0-21swapper/722:15:587
2954338991818,0cyclictest0-21swapper/721:14:357
2954338991818,0cyclictest0-21swapper/700:31:347
2954338991817,0cyclictest0-21swapper/721:53:347
2954338991814,3cyclictest1267-21snmpd21:35:037
2954328991816,2cyclictest3572595-21kworker/u16:2+events_unbound23:57:325
2954328991816,2cyclictest3557280-21kworker/u16:6+events_unbound23:38:315
2954328991816,2cyclictest3391965-21kworker/u16:5+flush-8:023:18:115
2954328991816,2cyclictest3391965-21kworker/u16:5+flush-8:023:18:115
2954328991816,2cyclictest3282460-21kworker/u16:1+events_unbound22:32:335
2954328991816,2cyclictest2996684-21kworker/u16:0+events_unbound21:12:495
295432899180,17cyclictest0-21swapper/522:52:355
2954326991816,2cyclictest3656323-21kworker/u16:0+events_unbound00:22:394
2954326991816,2cyclictest3537435-21kworker/u16:0+flush-8:023:38:154
2954326991816,2cyclictest3391965-21kworker/u16:5+flush-8:022:33:184
2954326991816,2cyclictest3063597-21kworker/u16:2+events_unbound20:01:004
2954326991816,2cyclictest3063597-21kworker/u16:2+events_unbound20:01:004
2954338991716,1cyclictest3187509-21diskmemload23:20:347
2954338991716,1cyclictest3187509-21diskmemload23:20:347
2954338991715,1cyclictest3547388-21sh23:31:077
2954338991715,1cyclictest3293947-21sh21:44:077
2954338991715,1cyclictest3187509-21diskmemload23:07:077
2954338991714,2cyclictest924-21NetworkManager22:52:437
2954338991712,4cyclictest650-21systemd-journal22:52:277
2954328991715,2cyclictest3572595-21kworker/u16:2+flush-8:000:23:105
2954328991715,2cyclictest3522904-21kworker/u16:3+events_unbound23:27:505
2954328991715,2cyclictest3282460-21kworker/u16:1+flush-8:021:48:215
2954326991714,2cyclictest3208626-21kworker/u16:4+events_unbound21:12:454
295433899169,6cyclictest0-21swapper/700:22:487
2954338991616,0cyclictest0-21swapper/700:06:577
2954338991613,2cyclictest3533910-21ssh23:23:147
2954326991614,2cyclictest3283749-21kworker/u16:2+events_unbound22:12:144
2954326991614,2cyclictest3199144-21kworker/u16:3+events_unbound21:22:434
295433899156,8cyclictest5750-21gmain22:23:267
2954338991515,0cyclictest0-21swapper/722:11:317
2954338991514,1cyclictest3619342-21ssh00:00:497
2954338991514,1cyclictest3619342-21ssh00:00:497
2954338991514,0cyclictest0-21swapper/720:42:147
2954338991513,1cyclictest3224694-21fschecks_time21:17:487
2954338991512,2cyclictest0-21swapper/700:17:577
2954338991511,3cyclictest3412887-21ntpq22:33:017
2954332991514,1cyclictest3391965-21kworker/u16:5+events_unbound22:37:566
2954328991513,2cyclictest3618048-21kworker/u16:4+flush-8:000:17:435
2954328991513,2cyclictest3282460-21kworker/u16:1+events_unbound22:15:355
2954326991513,2cyclictest3618048-21kworker/u16:4+flush-8:000:13:124
2954326991513,2cyclictest3283750-21kworker/u16:5+flush-8:021:43:124
2954326991513,2cyclictest3283750-21kworker/u16:5+events_unbound21:52:514
34269002140,0sleep73426901-21rm22:40:407
295433899149,4cyclictest3247572-21latency_hist21:27:337
295433899147,6cyclictest0-21swapper/723:38:027
295433899146,7cyclictest0-21swapper/721:07:507
2954338991413,0cyclictest0-21swapper/720:27:437
2954338991412,1cyclictest3510671-21sh23:14:487
2954338991411,2cyclictest3606779-21ssh23:54:487
2954338991411,2cyclictest0-21swapper/721:48:007
295433899141,11cyclictest3130994-21df20:32:457
295433899140,12cyclictest3096304-21cut20:12:517
2954332991413,1cyclictest0-21swapper/622:04:396
295433299140,1cyclictest0-21swapper/623:10:526
295433299140,1cyclictest0-21swapper/621:54:536
295433299140,14cyclictest0-21swapper/600:03:036
2954328991412,2cyclictest3572213-21kworker/u16:1+flush-8:023:47:285
2954328991412,2cyclictest3391965-21kworker/u16:5+events_unbound23:13:105
2954326991413,1cyclictest0-21swapper/423:10:024
2954326991412,2cyclictest2996684-21kworker/u16:0+events_unbound21:09:204
2954326991412,2cyclictest2976767-21kworker/u16:3+events_unbound19:13:504
295432699140,14cyclictest0-21swapper/421:41:074
295433899139,3cyclictest3183810-21kthreadcore20:57:557
295433899139,3cyclictest3176998-21ntpq20:52:567
295433899139,3cyclictest3150336-21perl20:42:467
295433899139,3cyclictest1267-21snmpd20:02:017
295433899139,3cyclictest1267-21snmpd20:02:017
295433899138,4cyclictest3007408-21kthreadcore19:27:517
295433899136,6cyclictest0-21swapper/722:02:447
295433899136,6cyclictest0-21swapper/721:03:327
295433899135,7cyclictest0-21swapper/722:44:537
295433899135,7cyclictest0-21swapper/722:28:547
295433899133,9cyclictest3274651-21kthreadcore21:37:517
295433899133,4cyclictest2977880-21expr19:12:447
2954338991310,2cyclictest3110056-21ntpq20:17:587
2954332991312,1cyclictest0-21swapper/623:25:416
2954332991312,1cyclictest0-21swapper/623:06:376
2954332991312,1cyclictest0-21swapper/621:31:336
2954332991311,2cyclictest3063597-21kworker/u16:2+flush-8:020:32:596
295433299130,13cyclictest0-21swapper/622:28:086
295433299130,13cyclictest0-21swapper/621:43:136
295433299130,13cyclictest0-21swapper/600:24:016
295433299130,0cyclictest0-21swapper/623:46:306
295433299130,0cyclictest0-21swapper/623:15:076
2954328991311,2cyclictest3391965-21kworker/u16:5+events_unbound23:03:475
2954326991312,1cyclictest0-21swapper/423:57:484
2954326991312,1cyclictest0-21swapper/423:57:484
2954326991311,2cyclictest3283749-21kworker/u16:2+events_unbound22:22:434
2954326991311,2cyclictest3282460-21kworker/u16:1+events_unbound22:46:144
295433899129,2cyclictest1267-21snmpd20:10:137
295433899129,2cyclictest1267-21snmpd19:24:577
295433899129,2cyclictest0-21swapper/720:22:477
295433899128,3cyclictest2967919-21/usr/sbin/munin19:07:477
295433899127,4cyclictest3073919-21cat20:02:487
295433899127,4cyclictest3035716-21cat19:42:497
295433899127,4cyclictest2955331-21cat19:02:487
295433899120,2cyclictest3044742-21cpuspeed_turbos19:47:457
295433899120,11cyclictest3021543-21kthreadcore19:32:547
295433899120,11cyclictest2992007-21kthreadcore19:17:537
2954332991211,1cyclictest0-21swapper/623:54:426
2954332991211,1cyclictest0-21swapper/623:36:056
2954332991211,1cyclictest0-21swapper/622:00:436
2954332991211,1cyclictest0-21swapper/622:00:436
2954332991211,1cyclictest0-21swapper/621:41:196
2954332991211,1cyclictest0-21swapper/621:19:536
2954332991210,2cyclictest3537435-21kworker/u16:0+events_unbound23:52:336
2954332991210,2cyclictest3404313-21kworker/u16:2+flush-8:023:32:286
295433299120,1cyclictest0-21swapper/619:44:496
295433299120,12cyclictest0-21swapper/620:46:376
295433299120,12cyclictest0-21swapper/620:38:446
295433299120,0cyclictest0-21swapper/619:14:426
2954328991210,2cyclictest3282460-21kworker/u16:1+events_unbound22:08:155
2954328991210,2cyclictest3199144-21kworker/u16:3+flush-8:021:28:065
2954328991210,2cyclictest2996684-21kworker/u16:0+events_unbound21:04:355
2954326991210,2cyclictest3537435-21kworker/u16:0+events_unbound23:50:244
295432699120,12cyclictest0-21swapper/420:48:374
295433299117,3cyclictest3537435-21kworker/u16:0+flush-8:023:37:566
2954332991110,1cyclictest0-21swapper/622:18:226
2954332991110,1cyclictest0-21swapper/622:16:296
2954332991110,1cyclictest0-21swapper/622:12:326
2954332991110,1cyclictest0-21swapper/621:33:266
2954332991110,1cyclictest0-21swapper/621:10:166
2954332991110,1cyclictest0-21swapper/620:48:306
2954332991110,1cyclictest0-21swapper/620:12:056
2954332991110,1cyclictest0-21swapper/619:03:216
295433299110,11cyclictest0-21swapper/620:58:366
2954328991110,1cyclictest0-21swapper/500:13:465
295432699119,2cyclictest3537435-21kworker/u16:0+events_unbound23:31:344
295433299109,1cyclictest0-21swapper/623:21:266
295433299109,1cyclictest0-21swapper/623:21:266
295433299109,1cyclictest0-21swapper/622:24:126
295433299109,1cyclictest0-21swapper/620:03:446
295433299109,1cyclictest0-21swapper/619:26:226
295433299109,1cyclictest0-21swapper/600:28:076
29543329998,1cyclictest0-21swapper/622:49:446
29543329998,1cyclictest0-21swapper/620:24:426
29543329998,1cyclictest0-21swapper/620:20:276
29543329998,1cyclictest0-21swapper/619:33:286
29543329987,1cyclictest0-21swapper/619:19:166
29543329976,1cyclictest0-21swapper/622:45:486
29543329976,1cyclictest0-21swapper/619:31:066
29543329973,3cyclictest2964755-21cut19:07:356
29543329970,1cyclictest0-21swapper/620:16:186
29543329965,1cyclictest0-21swapper/620:54:306
29543329963,2cyclictest31292992sleep620:28:016
29543329963,2cyclictest30450282chrt19:47:456
29543329960,5cyclictest5873-21gsd-housekeepin19:41:226
29543329950,5cyclictest0-21swapper/619:57:456
29543329950,5cyclictest0-21swapper/619:57:456
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional