You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 01:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sun May 31, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310984825848,7sleep40-21swapper/419:05:424
310984825848,7sleep40-21swapper/419:05:424
3110234994440,4cyclictest3257480-21kworker/u16:2+flush-8:022:26:565
31026392434,33sleep70-21swapper/719:02:167
31026392434,33sleep70-21swapper/719:02:167
3110242993633,2cyclictest3429982-21ssh21:42:117
3110234993634,2cyclictest3597579-21kworker/u16:4+flush-8:000:01:515
3110242993429,4cyclictest3597387-21latency_hist22:51:567
3110234993432,2cyclictest3718146-21kworker/u16:0+events_unbound00:26:505
3110234993432,2cyclictest3718146-21kworker/u16:0+events_unbound00:26:505
3110234993432,2cyclictest3654854-21kworker/u16:2+events_unbound23:36:425
33905142330,0chrt3390512-21ssh21:23:097
311024299330,32cyclictest124-21kswapd000:27:097
311024299330,32cyclictest124-21kswapd000:27:097
3110234993331,2cyclictest3802331-21kworker/u16:4+events_unbound00:16:425
3110234993331,2cyclictest3257480-21kworker/u16:2+events_unbound21:41:515
3110234993331,2cyclictest3257480-21kworker/u16:2+events_unbound21:41:515
3110234993331,2cyclictest3047314-21kworker/u16:1+events_unbound19:22:195
310979023322,8sleep50-21swapper/519:04:555
310979023322,8sleep50-21swapper/519:04:555
36333922320,1chrt3633394-21ssh23:06:167
36333922320,1chrt3633394-21ssh23:06:167
3110234993230,2cyclictest3325173-21kworker/u16:0+events_unbound21:17:185
3110234993227,4cyclictest3047314-21kworker/u16:1+flush-8:019:41:565
3110242993025,4cyclictest635-21systemd-journal22:56:517
3110234993026,3cyclictest3152628-21kworker/u16:3+flush-8:020:12:165
3110234993026,3cyclictest3152628-21kworker/u16:3+flush-8:020:12:165
310990622818,7sleep60-21swapper/619:06:326
310990622818,7sleep60-21swapper/619:06:326
3110242992724,2cyclictest3763304-21sh23:57:197
3110242992722,4cyclictest3428741-21latency_hist21:41:567
3110242992722,4cyclictest3428741-21latency_hist21:41:567
3110238992725,2cyclictest3257480-21kworker/u16:2+events_unbound20:27:106
3110234992724,2cyclictest3152628-21kworker/u16:3+flush-8:020:22:145
3110234992722,5cyclictest3440788-21kworker/u16:0+flush-8:022:36:565
3110242992625,0cyclictest0-21swapper/719:22:117
3110242992620,5cyclictest635-21systemd-journal23:21:567
311024299260,1cyclictest0-21swapper/720:07:207
3110234992523,2cyclictest3740532-21kworker/u16:1+events_unbound00:05:105
3110234992523,2cyclictest3654854-21kworker/u16:2+flush-8:023:27:025
3110234992523,2cyclictest3277165-21kworker/u16:1+events_unbound21:42:155
3110234992523,2cyclictest3257480-21kworker/u16:2+events_unbound21:07:275
3110242992419,4cyclictest635-21systemd-journal22:26:567
3110234992422,2cyclictest3740532-21kworker/u16:1+events_unbound00:36:505
3110234992422,2cyclictest3654854-21kworker/u16:2+events_unbound23:46:425
3110234992422,2cyclictest3654854-21kworker/u16:2+events_unbound23:46:425
3110234992422,2cyclictest3257480-21kworker/u16:2+events_unbound22:12:285
3110234992422,2cyclictest3257480-21kworker/u16:2+events_unbound22:04:065
3110234992321,2cyclictest3777047-21kworker/u16:2+events_unbound00:09:345
3110234992321,2cyclictest3257480-21kworker/u16:2+flush-8:022:47:245
3110234992321,2cyclictest3257480-21kworker/u16:2+events_unbound22:07:065
3110234992220,2cyclictest3152628-21kworker/u16:3+events_unbound20:32:135
3110234992118,2cyclictest3718146-21kworker/u16:0+flush-8:000:17:065
3110234992117,3cyclictest3257480-21kworker/u16:2+flush-8:021:22:165
3110242992017,2cyclictest124-21kswapd000:32:097
3110234992018,2cyclictest3597579-21kworker/u16:4+flush-8:023:17:225
3110234992018,2cyclictest3597579-21kworker/u16:4+events_unbound22:54:065
3110234992018,2cyclictest3277165-21kworker/u16:1+events_unbound21:32:285
3110234992018,2cyclictest3047314-21kworker/u16:1+events_unbound19:27:165
3110234992018,2cyclictest3047314-21kworker/u16:1+events_unbound19:27:165
3110231992016,3cyclictest3718146-21kworker/u16:0+flush-8:000:07:234
311024299192,15cyclictest1234-21snmpd21:50:467
3110242991916,1cyclictest3502765-21ssh22:12:137
311024299190,17cyclictest3706044-21latency_hist23:36:557
3110234991917,2cyclictest3440788-21kworker/u16:0+flush-8:022:37:165
3110234991917,2cyclictest3257480-21kworker/u16:2+events_unbound21:56:405
311024299189,8cyclictest6101-21gmain23:12:147
3110242991817,0cyclictest0-21swapper/719:42:277
3110242991814,3cyclictest124-21kswapd000:06:567
311024299180,16cyclictest0-21swapper/720:27:187
3110234991816,2cyclictest3718146-21kworker/u16:0+events_unbound23:55:355
3110234991816,2cyclictest3654854-21kworker/u16:2+events_unbound23:37:215
3110234991816,2cyclictest3546837-21kworker/u16:1+events_unbound22:43:545
3110234991815,2cyclictest3597579-21kworker/u16:4+flush-8:022:57:145
3110242991712,4cyclictest3501047-21latency_hist22:11:567
3110242991711,5cyclictest3228965-21latency_hist20:06:567
3110242991711,5cyclictest3200213-21latency_hist19:51:577
3110234991715,2cyclictest3718146-21kworker/u16:0+events_unbound23:47:545
3110234991715,2cyclictest3718146-21kworker/u16:0+events_unbound00:30:345
3110234991715,2cyclictest3718146-21kworker/u16:0+events_unbound00:30:345
3110234991715,2cyclictest3597427-21kworker/u16:1+events_unbound23:04:275
3110234991715,2cyclictest3597427-21kworker/u16:1+events_unbound23:04:275
3110234991715,2cyclictest3380494-21kworker/u16:3+events_unbound22:20:315
3110234991715,2cyclictest3380494-21kworker/u16:3+events_unbound22:20:315
3110234991715,2cyclictest3152628-21kworker/u16:3+flush-8:020:07:145
3110234991715,2cyclictest3152628-21kworker/u16:3+flush-8:019:32:205
3110231991713,3cyclictest3802269-40logrotate00:16:284
3110231991713,3cyclictest3243125-21kthreadcore20:12:164
3110231991713,3cyclictest3243125-21kthreadcore20:12:164
311023199170,3cyclictest3570236-21ntpq22:37:194
311023199170,1cyclictest0-21swapper/422:50:434
311023199170,1cyclictest0-21swapper/421:18:484
311023199170,14cyclictest0-21swapper/421:47:394
37286592160,1chrt3728658-21ssh23:44:067
37286592160,1chrt3728658-21ssh23:44:067
3110242991611,4cyclictest3694036-21latency_hist23:31:567
3110238991613,2cyclictest3152628-21kworker/u16:3+flush-8:019:37:126
3110234991614,2cyclictest3125340-21kworker/u16:2+flush-8:019:17:245
311023199160,15cyclictest3352939-21latency21:07:184
3110242991512,2cyclictest0-21swapper/700:11:567
311024299150,2cyclictest3570302-21ssh22:37:217
3110234991513,2cyclictest3277165-21kworker/u16:1+events_unbound20:37:205
3110234991513,2cyclictest3257480-21kworker/u16:2+flush-8:021:47:375
3110234991513,2cyclictest3047314-21kworker/u16:1+events_unbound19:42:215
311024299140,1cyclictest0-21swapper/722:17:217
311024299140,1cyclictest0-21swapper/722:17:217
311024299140,12cyclictest3645881-21latency_hist23:11:567
3110238991413,1cyclictest0-21swapper/622:38:396
3110238991413,1cyclictest0-21swapper/621:36:326
3110238991413,1cyclictest0-21swapper/621:30:426
311023899140,1cyclictest0-21swapper/623:28:386
311023899140,14cyclictest0-21swapper/622:00:406
311023899140,14cyclictest0-21swapper/621:25:116
311023899140,14cyclictest0-21swapper/621:19:216
3110234991412,2cyclictest3380494-21kworker/u16:3+flush-8:021:57:265
3110234991412,2cyclictest3257480-21kworker/u16:2+flush-8:020:42:235
3110234991411,2cyclictest3257480-21kworker/u16:2+flush-8:022:27:065
311023499140,1cyclictest0-21swapper/520:47:185
3110231991413,1cyclictest0-21swapper/423:43:044
3110231991413,1cyclictest0-21swapper/423:43:044
3110231991413,1cyclictest0-21swapper/423:35:014
3110231991413,1cyclictest0-21swapper/422:31:014
3110231991413,1cyclictest0-21swapper/422:05:474
3110231991413,1cyclictest0-21swapper/400:26:444
3110231991413,1cyclictest0-21swapper/400:26:444
311023199140,1cyclictest0-21swapper/422:57:204
311023199140,14cyclictest0-21swapper/423:51:444
311023199140,13cyclictest0-21swapper/422:11:564
33466662130,1sleep60-21swapper/621:07:146
311024299139,3cyclictest1234-21snmpd23:01:147
311024299139,3cyclictest1234-21snmpd22:45:537
311024299139,3cyclictest1234-21snmpd20:37:447
3110242991312,0cyclictest0-21swapper/722:32:257
3110242991311,1cyclictest3404626-21munin-run21:31:557
3110242991310,2cyclictest0-21swapper/721:57:257
311023899139,4cyclictest0-21swapper/600:18:376
311023899132,10cyclictest3759281-21cut23:57:146
3110238991312,1cyclictest0-21swapper/623:21:046
3110238991312,1cyclictest0-21swapper/622:25:536
3110238991312,1cyclictest0-21swapper/622:13:076
3110238991312,1cyclictest0-21swapper/600:29:486
3110238991312,1cyclictest0-21swapper/600:29:486
3110238991311,1cyclictest3430095-21ps21:42:136
3110238991310,2cyclictest3170470-21ntpq19:32:186
311023899130,1cyclictest0-21swapper/623:13:026
311023899130,13cyclictest0-21swapper/623:53:526
311023899130,13cyclictest0-21swapper/623:45:116
311023899130,13cyclictest0-21swapper/623:45:116
311023899130,0cyclictest0-21swapper/623:05:566
311023899130,0cyclictest0-21swapper/623:05:566
311023899130,0cyclictest0-21swapper/622:58:506
311023499139,3cyclictest3257480-21kworker/u16:2+events_unbound21:27:145
3110234991312,1cyclictest0-21swapper/521:15:315
3110234991311,2cyclictest3597579-21kworker/u16:4+events_unbound23:25:105
3110234991311,2cyclictest3047314-21kworker/u16:1+events_unbound19:12:155
3110231991312,1cyclictest0-21swapper/423:18:564
3110231991312,1cyclictest0-21swapper/423:04:074
3110231991312,1cyclictest0-21swapper/423:04:074
3110231991312,1cyclictest0-21swapper/421:53:294
3110231991312,1cyclictest0-21swapper/421:41:304
3110231991312,1cyclictest0-21swapper/421:41:304
3110231991312,1cyclictest0-21swapper/421:30:004
3110231991311,2cyclictest3440788-21kworker/u16:0+flush-8:022:22:284
3110231991311,2cyclictest2951920-21kworker/u16:3+events_unbound19:07:224
3110231991311,2cyclictest0-21swapper/422:18:244
3110231991311,2cyclictest0-21swapper/422:18:244
311023199130,1cyclictest0-21swapper/421:24:384
311023199130,13cyclictest0-21swapper/423:11:224
311023199130,13cyclictest0-21swapper/419:47:504
311023199130,13cyclictest0-21swapper/400:00:154
311023199130,11cyclictest0-21swapper/420:43:014
311023199130,0cyclictest0-21swapper/421:59:384
311024299129,2cyclictest1234-21snmpd23:22:457
311024299129,2cyclictest1234-21snmpd19:56:167
311024299129,2cyclictest1234-21snmpd19:29:527
311024299129,2cyclictest1234-21snmpd19:29:527
311024299128,3cyclictest1234-21snmpd21:09:097
311024299128,3cyclictest1234-21snmpd21:02:547
311024299128,3cyclictest1234-21snmpd20:52:067
311024299128,3cyclictest1234-21snmpd20:32:177
311024299128,3cyclictest1234-21snmpd20:01:107
311024299128,3cyclictest1234-21snmpd19:11:517
311024299128,3cyclictest1234-21snmpd00:17:287
311024299126,5cyclictest6382-21gvfs-afc-volume20:57:237
3110242991211,0cyclictest0-21swapper/721:12:157
3110238991211,1cyclictest0-21swapper/622:19:356
3110238991211,1cyclictest0-21swapper/622:19:356
3110238991211,1cyclictest0-21swapper/621:54:216
3110238991211,1cyclictest0-21swapper/621:48:126
3110238991211,1cyclictest0-21swapper/620:54:176
3110238991211,1cyclictest0-21swapper/600:10:446
3110238991210,2cyclictest86-21ksoftirqd/620:22:196
3110238991210,2cyclictest86-21ksoftirqd/600:22:186
3110238991210,2cyclictest86-21ksoftirqd/600:22:186
3110238991210,2cyclictest3277165-21kworker/u16:1+flush-8:020:58:276
311023899120,1cyclictest0-21swapper/619:59:256
311023899120,12cyclictest0-21swapper/620:18:116
3110234991210,2cyclictest3609879-21kworker/u16:0+events_unbound23:09:345
3110234991210,2cyclictest3152628-21kworker/u16:3+events_unbound20:17:205
3110234991210,2cyclictest3047314-21kworker/u16:1+events_unbound19:57:205
311023199125,2cyclictest0-21swapper/422:07:114
311023199124,4cyclictest3653716-21cut23:12:174
311023199124,3cyclictest3675180-21kthreadcore23:22:164
311023199123,4cyclictest3749421-21grep23:52:184
311023199123,4cyclictest3358861-21grep21:12:164
311023199123,4cyclictest3128911-21tr19:12:144
311023199120,1cyclictest0-21swapper/420:22:034
311024299118,2cyclictest0-21swapper/722:02:167
311024299118,2cyclictest0-21swapper/720:22:187
311024299117,3cyclictest6382-21gvfs-afc-volume20:42:207
311024299117,3cyclictest1234-21snmpd19:36:527
311024299116,5cyclictest6382-21gvfs-afc-volume22:24:597
311024299116,5cyclictest6382-21gvfs-afc-volume00:08:137
311024299116,4cyclictest6382-21gvfs-afc-volume19:37:117
311024299116,4cyclictest6101-21gmain19:12:107
311024299115,5cyclictest6382-21gvfs-afc-volume21:21:457
3110242991110,0cyclictest0-21swapper/720:17:187
311024299110,10cyclictest3137785-21kthreadcore19:17:147
311023899119,2cyclictest86-21ksoftirqd/622:02:106
311023899118,2cyclictest3707392-21irqcore23:37:116
311023899117,3cyclictest3143795-21cat19:22:116
3110238991110,1cyclictest0-21swapper/621:13:316
3110238991110,1cyclictest0-21swapper/620:08:536
3110238991110,1cyclictest0-21swapper/600:02:136
311023899110,3cyclictest3123467-21kthreadcore19:12:016
311023899110,11cyclictest0-21swapper/619:18:546
311023499119,2cyclictest3152628-21kworker/u16:3+flush-8:020:52:215
311023499119,2cyclictest2951920-21kworker/u16:3+flush-8:019:07:385
311023499117,3cyclictest3335768-21cat21:02:115
311023199117,3cyclictest3550450-21cat22:32:114
311023199114,3cyclictest3684382-21kthreadcore23:27:124
3110231991110,1cyclictest0-21swapper/420:31:594
3110231991110,1cyclictest0-21swapper/420:01:424
311023199110,11cyclictest0-21swapper/421:00:034
311024299106,3cyclictest1234-21snmpd23:52:587
311024299106,3cyclictest1234-21snmpd23:50:107
311024299106,3cyclictest1234-21snmpd21:52:227
311024299104,5cyclictest3718103-21latency_hist23:41:557
311024299104,4cyclictest3821274-21cut00:22:167
311024299104,4cyclictest3821274-21cut00:22:167
311024299102,7cyclictest1234-21snmpd20:47:157
311024299100,9cyclictest1234-21snmpd21:32:527
311023899109,1cyclictest0-21swapper/620:36:476
311023899108,2cyclictest86-21ksoftirqd/622:42:126
311023899108,2cyclictest86-21ksoftirqd/622:31:546
311023899107,2cyclictest3731750-21sed23:47:146
311023899101,8cyclictest3494949-21kthreadcore22:07:166
311023899100,4cyclictest3604409-21grep22:52:166
311023899100,4cyclictest3588216-21kthreadcore22:47:126
311023899100,2cyclictest3702962-21awk23:32:206
311023499109,1cyclictest0-21swapper/519:53:325
311023499108,2cyclictest3609879-21kworker/u16:0+flush-8:023:12:165
311023199109,1cyclictest0-21swapper/422:43:374
311023199109,1cyclictest0-21swapper/421:35:314
311023199109,1cyclictest0-21swapper/420:52:384
311023199109,1cyclictest0-21swapper/419:31:554
311023199109,1cyclictest0-21swapper/419:31:554
311023199106,1cyclictest0-21swapper/419:37:144
311023199103,6cyclictest0-21swapper/420:27:094
311023199100,7cyclictest3201108-21sh19:52:094
311023199100,6cyclictest0-21swapper/420:02:154
31102389997,2cyclictest86-21ksoftirqd/620:37:116
31102389997,1cyclictest3192944-21kthreadcore19:47:146
31102389996,2cyclictest3305008-21smart_sda20:42:246
31102389996,2cyclictest3113040-21cut19:07:136
31102389994,4cyclictest3635782-21kthreadcore23:07:126
31102389991,7cyclictest3671115-21fschecks_time23:22:116
31102389990,8cyclictest3791476-21cstates00:12:086
31102389990,8cyclictest3555790-21cut22:32:166
31102389990,8cyclictest3424401-21cut21:37:176
31102389990,8cyclictest3424401-21cut21:37:176
31102389990,8cyclictest3309457-21kthreadcore20:47:146
31102389990,8cyclictest0-21swapper/620:02:156
31102389990,3cyclictest3841213-21cat00:32:136
31102389990,2cyclictest3334993-21/usr/sbin/munin21:02:096
31102389990,2cyclictest3189495-21memory19:42:186
31102349998,1cyclictest0-21swapper/520:05:315
31102319995,1cyclictest0-21swapper/420:37:134
31102319994,4cyclictest3840186-21sed00:32:124
31102319994,4cyclictest3768568-21cut00:02:134
31102319994,4cyclictest3162920-21tune2fs19:32:104
31102319993,3cyclictest3181926-21dnf19:42:104
31102319990,4cyclictest36044472kthreadcore22:52:164
31102429984,3cyclictest1234-21snmpd20:12:027
31102429984,3cyclictest1234-21snmpd20:12:027
31102389985,2cyclictest0-21swapper/619:27:106
31102389985,2cyclictest0-21swapper/619:27:106
31102389980,7cyclictest0-21swapper/619:52:126
31102349983,4cyclictest3192395-21cut19:47:135
31102319986,1cyclictest0-21swapper/421:02:154
31102319985,2cyclictest0-21swapper/420:17:124
31102319980,1cyclictest0-21swapper/400:27:104
31102319980,1cyclictest0-21swapper/400:27:104
31102389972,4cyclictest3239366-21expr20:12:096
31102389972,4cyclictest3239366-21expr20:12:096
31102349972,4cyclictest3330459-21cut20:57:165
31102349972,4cyclictest3268314-21expr20:27:075
31102319975,1cyclictest0-21swapper/423:37:074
31102319975,1cyclictest0-21swapper/419:22:094
31102319975,1cyclictest0-21swapper/419:17:074
31102319974,2cyclictest3803004-21cpu00:17:064
31102319974,2cyclictest3306171-21cpu20:47:074
31102319973,3cyclictest3429919-21tune2fs21:42:114
31102319973,3cyclictest3229779-21expr20:07:084
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional