You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 22:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Mon Nov 17, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
311476325948,7sleep40-21swapper/415:18:584
3124741995853,4cyclictest3158906-21latency_hist15:38:517
312441725646,7sleep50-21swapper/515:23:495
3124741995347,4cyclictest3280134-21latency_hist16:38:517
3124741994843,4cyclictest3340846-21latency_hist17:08:507
3124719994846,2cyclictest3755517-21kworker/u16:2+flush-8:020:34:214
3124720994542,3cyclictest3675001-21kworker/u16:5+events_unbound20:03:515
3124720994341,2cyclictest3179025-21kworker/u16:4+flush-8:016:18:525
312474199420,40cyclictest589235-21systemd-journal16:48:147
3124720994240,2cyclictest3093996-21kworker/u16:2+events_unbound15:34:065
312474199410,39cyclictest589235-21systemd-journal20:44:257
3124729994037,2cyclictest3675001-21kworker/u16:5+flush-8:020:43:506
3124720994037,2cyclictest3473018-21kworker/u16:0+flush-8:019:41:255
3124719994038,2cyclictest3300460-21kworker/u16:3+events_unbound18:04:154
31155882403,31sleep70-21swapper/715:19:097
3124741993934,4cyclictest3229576-21latency_hist16:13:517
3124720993836,2cyclictest3473018-21kworker/u16:0+flush-8:018:33:515
3124719993835,2cyclictest3093996-21kworker/u16:2+events_unbound15:54:064
3124729993634,2cyclictest3114132-21kworker/u16:1+events_unbound15:29:056
312435923626,7sleep60-21swapper/615:23:016
3124741993534,0cyclictest0-21swapper/720:04:057
3124741993529,5cyclictest3654594-21latency_hist19:43:517
3124719993533,2cyclictest3614517-21kworker/u16:1+events_unbound19:34:054
3124741993433,0cyclictest0-21swapper/717:30:337
3124719993432,2cyclictest3442059-21kworker/u16:2+flush-8:018:39:214
3124719993431,2cyclictest3442059-21kworker/u16:2+flush-8:018:19:134
3124719993431,2cyclictest3351358-21kworker/u16:4+events_unbound17:19:054
3124729993331,2cyclictest3093996-21kworker/u16:2+events_unbound15:59:246
3124720993331,2cyclictest3421872-21kworker/u16:1+events_unbound17:54:215
3124719993331,2cyclictest3229784-21kworker/u16:3+events_unbound16:29:264
3124729993129,2cyclictest3219213-21kworker/u16:1+flush-8:016:09:226
3124720993128,2cyclictest3675001-21kworker/u16:5+flush-8:020:29:055
3124741993025,4cyclictest3462511-21basename18:08:507
3124729993026,3cyclictest3492998-21kworker/u16:3+flush-8:018:54:066
3124720993028,2cyclictest3093996-21kworker/u16:2+events_unbound16:24:145
312474199290,27cyclictest3745731-21sed20:28:507
3124729992927,2cyclictest3310143-21kworker/u16:5+events_unbound16:59:226
3124729992926,2cyclictest3179025-21kworker/u16:4+events_unbound15:49:056
3124729992926,2cyclictest3179025-21kworker/u16:4+events_unbound15:49:056
3124720992927,2cyclictest3492998-21kworker/u16:3+flush-8:019:28:505
3124720992927,2cyclictest3219213-21kworker/u16:1+flush-8:016:33:515
3124720992926,2cyclictest3755517-21kworker/u16:2+events_unbound20:39:085
3124720992926,2cyclictest3724591-21kworker/u16:1+flush-8:020:28:505
3124720992926,2cyclictest3492998-21kworker/u16:3+events_unbound18:44:055
3124719992926,2cyclictest3492998-21kworker/u16:3+flush-8:019:24:044
3124741992827,0cyclictest0-21swapper/717:49:067
3124741992822,5cyclictest589235-21systemd-journal18:38:507
3124741992822,5cyclictest3715304-21latency_hist20:13:507
312474199280,26cyclictest3270033-21latency_hist16:33:517
3124729992826,2cyclictest3442059-21kworker/u16:2+flush-8:017:59:116
3124729992826,2cyclictest3219213-21kworker/u16:1+events_unbound16:19:116
3124719992826,2cyclictest3614517-21kworker/u16:1+flush-8:019:44:154
3124741992722,4cyclictest589235-21systemd-journal18:30:517
3124741992721,5cyclictest3765769-21latency_hist20:38:517
3124729992725,2cyclictest3473018-21kworker/u16:0+flush-8:020:09:226
3124720992725,2cyclictest3093996-21kworker/u16:2+flush-8:015:55:265
3124719992725,2cyclictest3673996-21kworker/u16:4+flush-8:019:54:184
3124719992724,2cyclictest3473018-21kworker/u16:0+flush-8:019:49:094
3124719992724,2cyclictest3442059-21kworker/u16:2+flush-8:018:55:134
3124719992724,2cyclictest3148790-21kworker/u16:3+flush-8:015:37:094
3124741992625,0cyclictest0-21swapper/716:49:147
3124741992625,0cyclictest0-21swapper/715:24:107
3124741992624,1cyclictest0-21swapper/719:54:097
3124741992621,4cyclictest3593931-21latency_hist19:13:517
3124729992624,2cyclictest3473018-21kworker/u16:0+flush-8:019:24:106
3124720992624,2cyclictest3492998-21kworker/u16:3+events_unbound18:39:205
3124719992624,2cyclictest3421872-21kworker/u16:1+flush-8:018:34:144
3124719992623,2cyclictest3351358-21kworker/u16:4+events_unbound17:24:074
3124741992518,5cyclictest589235-21systemd-journal19:45:257
3124729992523,2cyclictest3219213-21kworker/u16:1+events_unbound16:43:466
3124729992522,2cyclictest3269725-21kworker/u16:0+events_unbound16:34:086
3124729992521,3cyclictest3473018-21kworker/u16:0+events_unbound19:09:106
3124729992520,4cyclictest3391260-21packagekitd17:30:136
3124720992523,2cyclictest3351358-21kworker/u16:4+flush-8:017:30:165
3124720992523,2cyclictest3179025-21kworker/u16:4+flush-8:016:53:515
3124719992523,2cyclictest3179025-21kworker/u16:4+events_unbound16:54:294
3124729992422,2cyclictest3442059-21kworker/u16:2+events_unbound18:29:166
3124720992421,2cyclictest3492998-21kworker/u16:3+events_unbound18:49:065
3124719992422,2cyclictest3219213-21kworker/u16:1+flush-8:016:37:024
3124719992421,2cyclictest3442059-21kworker/u16:2+flush-8:017:59:054
3124719992421,2cyclictest3114132-21kworker/u16:1+flush-8:015:29:104
3124729992321,2cyclictest3795857-21kworker/u16:0+flush-8:020:53:326
3124729992321,2cyclictest3179024-21kworker/u16:0+events_unbound16:04:276
3124729992320,2cyclictest3391335-21kworker/u16:5+events_unbound17:44:076
3124729992319,3cyclictest3093996-21kworker/u16:2+flush-8:016:15:216
3124720992320,2cyclictest3351358-21kworker/u16:4+flush-8:017:21:345
3124741992221,0cyclictest0-21swapper/719:04:067
3124741992221,0cyclictest0-21swapper/717:34:117
3124741992221,0cyclictest0-21swapper/717:14:127
3124729992219,2cyclictest3442059-21kworker/u16:2+events_unbound19:14:136
3124720992220,2cyclictest3725057-21kworker/u16:2+flush-8:020:19:245
3124719992219,2cyclictest3442059-21kworker/u16:2+flush-8:018:14:204
312474199210,19cyclictest589235-21systemd-journal15:48:267
312474199210,19cyclictest589235-21systemd-journal15:39:167
3124729992117,3cyclictest3148790-21kworker/u16:3+flush-8:015:53:586
3124720992118,3cyclictest3279884-21kworker/u16:2+flush-8:017:39:175
3124720992117,3cyclictest3279884-21kworker/u16:2+flush-8:017:06:565
3124719992119,2cyclictest3675001-21kworker/u16:5+events_unbound20:44:074
3124719992118,2cyclictest3351358-21kworker/u16:4+flush-8:017:34:184
3124741992019,0cyclictest0-21swapper/718:19:107
3124741992014,5cyclictest3290231-21latency_hist16:43:517
3124729992018,2cyclictest3492998-21kworker/u16:3+flush-8:018:49:156
3124729992018,2cyclictest3492998-21kworker/u16:3+events_unbound19:23:066
3124729992018,2cyclictest3350680-21kworker/u16:1+events_unbound17:15:266
3124719992016,3cyclictest3724591-21kworker/u16:1+flush-8:020:24:114
3124741991915,3cyclictest4175659-21snmpd18:53:537
3124741991914,4cyclictest589235-21systemd-journal18:00:257
3124729991917,2cyclictest3421872-21kworker/u16:1+flush-8:017:50:006
3124729991917,2cyclictest3279884-21kworker/u16:2+events_unbound16:47:276
3124720991917,2cyclictest3179025-21kworker/u16:4+events_unbound15:49:195
3124720991917,2cyclictest3179025-21kworker/u16:4+events_unbound15:49:195
3124720991916,2cyclictest3473018-21kworker/u16:0+flush-8:019:09:215
3124719991917,2cyclictest3553238-21kworker/u16:1+flush-8:019:05:304
3124719991917,2cyclictest3219213-21kworker/u16:1+flush-8:016:19:174
3124719991916,2cyclictest3473018-21kworker/u16:0+flush-8:019:39:174
3124719991916,2cyclictest3473018-21kworker/u16:0+flush-8:018:52:334
3124719991916,2cyclictest3350680-21kworker/u16:1+flush-8:017:14:174
3124719991915,3cyclictest3675001-21kworker/u16:5+events_unbound20:49:124
3124741991817,0cyclictest0-21swapper/718:24:127
3124741991817,0cyclictest0-21swapper/717:09:177
3124741991817,0cyclictest0-21swapper/716:54:107
3124741991813,4cyclictest3199255-21latency_hist15:58:517
3124729991816,2cyclictest3673996-21kworker/u16:4+flush-8:020:14:066
3124729991816,2cyclictest3340502-21kworker/u16:0+events_unbound17:12:266
3124729991816,2cyclictest3179025-21kworker/u16:4+flush-8:016:58:516
3124729991814,3cyclictest3473018-21kworker/u16:0+events_unbound18:39:166
3124720991816,2cyclictest3300460-21kworker/u16:3+events_unbound18:04:055
3124720991816,2cyclictest3279884-21kworker/u16:2+events_unbound16:44:175
3124720991816,2cyclictest3124330-21kworker/u16:3+events_unbound15:24:085
3124719991816,2cyclictest3473018-21kworker/u16:0+flush-8:018:24:204
3124719991816,2cyclictest3179024-21kworker/u16:0+flush-8:016:04:224
3124719991816,2cyclictest3179024-21kworker/u16:0+events_unbound15:59:224
3124719991815,2cyclictest3114132-21kworker/u16:1+flush-8:015:27:574
3124741991716,0cyclictest0-21swapper/716:19:077
3124741991715,1cyclictest0-21swapper/719:34:097
312474199170,16cyclictest0-21swapper/720:19:197
3124729991715,2cyclictest3675001-21kworker/u16:5+events_unbound20:30:016
3124729991715,2cyclictest3421872-21kworker/u16:1+flush-8:017:54:176
3124729991715,2cyclictest3300460-21kworker/u16:3+flush-8:017:39:166
3124729991715,2cyclictest3148790-21kworker/u16:3+events_unbound15:38:266
3124719991715,2cyclictest3675001-21kworker/u16:5+events_unbound20:29:104
3124719991715,2cyclictest3673996-21kworker/u16:4+events_unbound19:59:064
3124719991715,2cyclictest3148790-21kworker/u16:3+events_unbound15:44:204
3124719991713,3cyclictest3473018-21kworker/u16:0+flush-8:019:33:504
312471999170,1cyclictest0-21swapper/420:41:274
3124741991613,2cyclictest4175659-21snmpd16:18:497
3124729991614,2cyclictest3442059-21kworker/u16:2+events_unbound19:29:086
3124729991614,2cyclictest3442059-21kworker/u16:2+events_unbound18:34:216
3124729991613,3cyclictest3219213-21kworker/u16:1+flush-8:016:27:026
312472999160,15cyclictest3479652-21kthreadcore18:14:156
3124720991614,2cyclictest3492998-21kworker/u16:3+flush-8:019:44:095
3124720991614,2cyclictest3492998-21kworker/u16:3+events_unbound18:59:085
3124720991614,2cyclictest3351358-21kworker/u16:4+events_unbound17:24:215
3124741991515,0cyclictest0-21swapper/720:39:217
3124741991514,0cyclictest0-21swapper/717:39:147
3124741991512,2cyclictest4175659-21snmpd17:25:427
3124729991513,2cyclictest3673996-21kworker/u16:4+events_unbound20:19:206
3124729991513,2cyclictest3614517-21kworker/u16:1+events_unbound19:34:156
3124729991513,2cyclictest3553238-21kworker/u16:1+flush-8:018:59:096
3124729991513,2cyclictest3492998-21kworker/u16:3+events_unbound19:53:516
3124729991513,2cyclictest3473018-21kworker/u16:0+flush-8:018:24:186
3124729991513,2cyclictest3114132-21kworker/u16:1+events_unbound15:44:126
3124729991513,2cyclictest3114132-21kworker/u16:1+events_unbound15:43:276
3124729991511,3cyclictest3114132-21kworker/u16:1+flush-8:015:25:566
3124720991513,2cyclictest3492998-21kworker/u16:3+flush-8:018:54:075
3124720991513,2cyclictest3442059-21kworker/u16:2+events_unbound18:03:505
3124720991513,2cyclictest3421872-21kworker/u16:1+flush-8:018:34:065
3124720991513,2cyclictest3114132-21kworker/u16:1+flush-8:015:29:085
3124720991512,2cyclictest3351358-21kworker/u16:4+flush-8:017:34:085
312472099150,15cyclictest0-21swapper/515:44:215
312472099150,14cyclictest0-21swapper/517:08:515
312471999156,8cyclictest0-21swapper/416:59:084
3124719991513,2cyclictest3553238-21kworker/u16:1+flush-8:018:59:574
312471999150,15cyclictest0-21swapper/418:09:244
3124741991411,2cyclictest4175659-21snmpd17:55:347
312474199140,1cyclictest0-21swapper/716:59:187
3124729991412,2cyclictest3351358-21kworker/u16:4+flush-8:017:19:176
3124729991411,2cyclictest3724591-21kworker/u16:1+flush-8:020:27:566
3124720991412,2cyclictest3093996-21kworker/u16:2+events_unbound15:59:265
3124720991411,2cyclictest3310143-21kworker/u16:5+flush-8:016:59:125
312472099140,14cyclictest0-21swapper/518:14:165
3124719991412,2cyclictest3442059-21kworker/u16:2+flush-8:018:44:164
3124719991411,2cyclictest3421872-21kworker/u16:1+flush-8:018:29:114
312471999140,14cyclictest0-21swapper/420:14:064
312471999140,14cyclictest0-21swapper/417:49:134
312471999140,14cyclictest0-21swapper/417:07:344
312474199139,3cyclictest4175659-21snmpd16:27:417
312474199139,3cyclictest3603139-21ntpq19:14:197
312474199139,3cyclictest3533709-21/usr/sbin/munin18:44:187
312474199138,4cyclictest589235-21systemd-journal16:02:267
312474199138,4cyclictest3748865-21cut20:29:117
312474199136,6cyclictest0-21swapper/720:00:037
3124741991313,0cyclictest0-21swapper/715:49:097
3124741991313,0cyclictest0-21swapper/715:49:097
3124729991311,2cyclictest3675001-21kworker/u16:5+flush-8:020:07:256
3124729991311,2cyclictest3391335-21kworker/u16:5+events_unbound18:04:076
3124729991311,2cyclictest3351358-21kworker/u16:4+events_unbound17:28:276
3124729991311,2cyclictest3179025-21kworker/u16:4+events_unbound16:29:426
3124720991311,2cyclictest3673996-21kworker/u16:4+flush-8:020:14:115
3124720991311,2cyclictest3473018-21kworker/u16:0+events_unbound19:04:135
3124719991312,1cyclictest0-21swapper/420:12:224
312471999130,13cyclictest0-21swapper/417:48:264
312471999130,12cyclictest0-21swapper/417:29:054
312474199129,2cyclictest4175659-21snmpd17:44:557
312474199128,3cyclictest4175659-21snmpd18:11:497
3124729991210,2cyclictest3755517-21kworker/u16:2+flush-8:020:34:176
312472999120,1cyclictest0-21swapper/618:12:406
312472099129,2cyclictest3675001-21kworker/u16:5+flush-8:020:47:565
3124720991211,1cyclictest0-21swapper/519:55:005
3124720991210,2cyclictest3421872-21kworker/u16:1+flush-8:018:26:525
312472099120,1cyclictest0-21swapper/519:19:235
312471999128,3cyclictest3473018-21kworker/u16:0+flush-8:019:09:564
3124719991211,1cyclictest0-21swapper/415:41:134
3124719991210,2cyclictest3725057-21kworker/u16:2+flush-8:020:19:264
3124719991210,2cyclictest3179025-21kworker/u16:4+events_unbound16:11:274
312474199118,2cyclictest4175659-21snmpd18:59:357
312474199118,2cyclictest4175659-21snmpd18:17:017
312474199117,3cyclictest948-21NetworkManager16:07:177
312474199117,3cyclictest4175659-21snmpd20:49:107
312474199117,3cyclictest4175659-21snmpd15:28:577
312474199114,6cyclictest27904-21gmain18:49:057
312474199114,6cyclictest27204-21gmain17:19:097
312474199110,10cyclictest4175659-21snmpd18:39:087
312474199110,10cyclictest3613210-21ntp_states19:19:187
312472999119,2cyclictest3755517-21kworker/u16:2+events_unbound20:44:176
312472999119,2cyclictest3179025-21kworker/u16:4+events_unbound16:49:076
312472999118,2cyclictest3655119-21cpuspeed_turbos19:44:056
312472999118,2cyclictest3300460-21kworker/u16:3+flush-8:017:05:576
3124729991110,1cyclictest0-21swapper/619:58:186
312472099119,2cyclictest3391335-21kworker/u16:5+flush-8:017:44:065
312472099119,2cyclictest3179025-21kworker/u16:4+events_unbound16:54:065
3124720991110,1cyclictest0-21swapper/519:53:165
3124720991110,1cyclictest0-21swapper/517:17:125
312472099110,11cyclictest0-21swapper/519:37:025
312472099110,11cyclictest0-21swapper/515:40:065
312471999118,2cyclictest3300460-21kworker/u16:3+events_unbound17:39:104
3124719991110,1cyclictest0-21swapper/416:28:404
312471999110,11cyclictest0-21swapper/417:10:394
312474199108,1cyclictest0-21swapper/719:33:007
312474199106,3cyclictest4175659-21snmpd19:24:117
312472999109,1cyclictest0-21swapper/620:00:026
312472099109,1cyclictest0-21swapper/520:12:115
312472099109,1cyclictest0-21swapper/519:14:305
312472099109,1cyclictest0-21swapper/516:34:295
312472099109,1cyclictest0-21swapper/516:08:575
312472099108,2cyclictest3391335-21kworker/u16:5+flush-8:018:11:315
312472099107,2cyclictest3755517-21kworker/u16:2+flush-8:020:34:225
312471999109,1cyclictest0-21swapper/419:14:314
312471999109,1cyclictest0-21swapper/417:55:224
312471999109,1cyclictest0-21swapper/416:51:134
312471999108,2cyclictest3179025-21kworker/u16:4+flush-8:016:39:174
31247419996,2cyclictest0-21swapper/719:49:097
31247419995,3cyclictest27763-21gvfs-afc-volume20:14:067
31247299998,1cyclictest0-21swapper/619:08:386
31247299996,2cyclictest3490847-21kthreadcore18:19:156
31247209998,1cyclictest0-21swapper/520:51:365
31247209998,1cyclictest0-21swapper/517:52:315
31247209995,3cyclictest3625452-21cat19:29:095
31247209990,2cyclictest0-21swapper/516:19:055
31247199990,8cyclictest3230735-21cat16:14:074
31247299986,1cyclictest0-21swapper/617:34:096
31247209984,3cyclictest3704222-21sed20:04:165
31247209984,3cyclictest3179025-21kworker/u16:4+flush-8:016:39:135
31247209983,4cyclictest3209933-21cat16:04:055
31247199984,3cyclictest3695432-21/usr/sbin/munin20:04:144
31247299973,3cyclictest3644927-21grep19:39:046
31247299973,3cyclictest3538559-21cut18:44:116
31247209972,4cyclictest3483550-21expr18:19:075
31247199975,1cyclictest0-21swapper/415:49:104
31247199975,1cyclictest0-21swapper/415:49:104
31247199973,3cyclictest3604463-21grep19:19:044
31247199972,4cyclictest3290726-21wc16:44:054
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional