You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 19:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Nov 06, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
274964425646,7sleep40-21swapper/415:23:324
2750023995249,2cyclictest2865122-21latency_hist16:19:357
274964625242,7sleep60-21swapper/615:23:346
2750023994640,5cyclictest589235-21systemd-journal17:19:017
2750014994543,2cyclictest2956616-21kworker/u16:1+flush-8:017:12:025
2750014994543,2cyclictest2814663-21kworker/u16:3+events_unbound16:28:025
2750014994542,2cyclictest2815784-21kworker/u16:4+events_unbound16:14:375
2750014994240,2cyclictest2916853-21kworker/u16:5+events_unbound16:49:345
274957824232,7sleep50-21swapper/515:22:365
2750023994136,4cyclictest3118131-21latency_hist18:24:347
2750019994139,2cyclictest3016141-21kworker/u16:1+events_unbound18:00:016
2750014994139,2cyclictest3158362-21kworker/u16:4+events_unbound18:54:015
2750014994139,2cyclictest2814663-21kworker/u16:3+flush-8:016:52:015
2750023993934,4cyclictest3350792-21latency_hist20:19:357
2750019993937,2cyclictest2916853-21kworker/u16:5+flush-8:016:50:046
2750014993937,2cyclictest3209083-21kworker/u16:2+flush-8:019:47:015
27487412393,31sleep70-21swapper/715:20:067
2750014993836,2cyclictest2058533-21kworker/u16:2+events_unbound15:27:375
2750007993836,2cyclictest2749782-21kworker/u16:0+events_unbound15:29:364
2750014993735,2cyclictest2916853-21kworker/u16:5+events_unbound16:56:015
2750014993735,2cyclictest2749782-21kworker/u16:0+events_unbound15:31:535
2750014993734,2cyclictest3087808-21kworker/u16:0+events_unbound18:19:375
2750007993735,2cyclictest2986298-21kworker/u16:0+flush-8:017:29:514
2750007993735,2cyclictest2986298-21kworker/u16:0+flush-8:017:24:354
2750023993631,4cyclictest589235-21systemd-journal20:54:007
2750019993632,3cyclictest3798288-21fwupd19:31:056
2750014993634,2cyclictest3361278-21kworker/u16:1+events_unbound20:28:015
2750014993634,2cyclictest3238479-21kworker/u16:0+events_unbound19:41:325
2750014993634,2cyclictest3158362-21kworker/u16:4+events_unbound19:11:015
2750007993634,2cyclictest2815784-21kworker/u16:4+flush-8:016:05:014
2750023993534,0cyclictest0-21swapper/718:35:057
2750014993533,2cyclictest3410615-21kworker/u16:5+flush-8:020:47:015
2750014993533,2cyclictest2814663-21kworker/u16:3+flush-8:016:09:565
2750023993433,0cyclictest0-21swapper/719:20:447
2750023993433,0cyclictest0-21swapper/718:08:087
2750014993432,2cyclictest3158362-21kworker/u16:4+events_unbound19:33:025
2750014993432,2cyclictest2936106-21kworker/u16:2+events_unbound17:03:015
2750023993327,5cyclictest3280096-21latency_hist19:44:357
2750014993331,2cyclictest3087808-21kworker/u16:0+events_unbound18:47:015
2750014993331,2cyclictest2936106-21kworker/u16:2+events_unbound17:21:005
2750007993331,2cyclictest3310359-21kworker/u16:1+events_unbound20:05:014
2750023993227,4cyclictest589235-21systemd-journal16:38:017
2750019993230,2cyclictest2986298-21kworker/u16:0+flush-8:017:48:406
2750014993230,2cyclictest3238479-21kworker/u16:0+events_unbound19:26:025
2750014993230,2cyclictest3198145-21kworker/u16:1+flush-8:019:14:565
2750014993230,2cyclictest2759644-21kworker/u16:1+flush-8:015:50:085
2750023993126,4cyclictest3209120-21latency_hist19:09:347
2750019993129,2cyclictest2956616-21kworker/u16:1+flush-8:017:20:176
2750014993129,2cyclictest3016141-21kworker/u16:1+flush-8:017:59:595
2750023993029,0cyclictest0-21swapper/716:52:577
2750019993028,2cyclictest3158362-21kworker/u16:4+events_unbound19:55:376
2750019993028,2cyclictest3158362-21kworker/u16:4+events_unbound19:19:126
2750019993028,2cyclictest3087808-21kworker/u16:0+events_unbound18:48:136
2750019993028,2cyclictest3067280-21kworker/u16:4+events_unbound18:13:016
2750014993028,2cyclictest3320123-21kworker/u16:2+flush-8:020:21:045
2750007993028,2cyclictest3158362-21kworker/u16:4+flush-8:019:05:014
2750007993028,2cyclictest2895425-21kworker/u16:0+events_unbound16:59:594
2750023992928,0cyclictest0-21swapper/720:30:067
2750023992926,2cyclictest3228411-21ntpq19:14:577
2750023992923,5cyclictest3219197-21latency_hist19:14:347
2750019992927,2cyclictest3310359-21kworker/u16:1+events_unbound20:00:286
2750019992927,2cyclictest2814663-21kworker/u16:3+flush-8:015:56:016
2750019992927,2cyclictest2759644-21kworker/u16:1+flush-8:016:06:376
2750014992927,2cyclictest2864116-21kworker/u16:0+flush-8:016:21:515
2750007992927,2cyclictest3158362-21kworker/u16:4+flush-8:019:09:504
2750007992927,2cyclictest3158362-21kworker/u16:4+flush-8:018:59:594
2750023992827,0cyclictest0-21swapper/716:58:377
2750023992823,4cyclictest3097878-21latency_hist18:14:357
2750019992826,2cyclictest3238479-21kworker/u16:0+events_unbound20:31:526
2750019992826,2cyclictest3198145-21kworker/u16:1+events_unbound19:23:126
2750019992826,2cyclictest2936106-21kworker/u16:2+flush-8:017:29:136
2750019992826,2cyclictest2815784-21kworker/u16:4+events_unbound16:32:536
2750019992826,2cyclictest2814663-21kworker/u16:3+flush-8:016:19:336
2750019992826,2cyclictest2814663-21kworker/u16:3+events_unbound15:59:366
2750019992826,2cyclictest2804126-21kworker/u16:2+events_unbound15:45:476
2750014992826,2cyclictest3391200-21kworker/u16:4+flush-8:020:50:085
2750014992826,2cyclictest3087808-21kworker/u16:0+flush-8:018:10:415
2750014992826,2cyclictest2986298-21kworker/u16:0+flush-8:017:55:405
2750014992826,2cyclictest2986298-21kworker/u16:0+flush-8:017:46:445
2750014992826,2cyclictest2986298-21kworker/u16:0+events_unbound17:15:355
2750007992826,2cyclictest3238479-21kworker/u16:0+flush-8:020:19:494
2750023992726,0cyclictest0-21swapper/717:41:297
2750019992725,2cyclictest3320123-21kworker/u16:2+events_unbound20:20:416
2750019992725,2cyclictest3310359-21kworker/u16:1+events_unbound20:09:006
2750019992725,2cyclictest3238479-21kworker/u16:0+events_unbound20:18:136
2750019992725,2cyclictest3238479-21kworker/u16:0+events_unbound19:26:376
2750019992725,2cyclictest3158362-21kworker/u16:4+events_unbound19:11:506
2750019992725,2cyclictest3067280-21kworker/u16:4+flush-8:018:15:206
2750019992725,2cyclictest2916853-21kworker/u16:5+events_unbound17:05:496
2750014992725,2cyclictest3391200-21kworker/u16:4+events_unbound20:40:045
2750014992725,2cyclictest3310359-21kworker/u16:1+flush-8:020:09:375
2750014992725,2cyclictest2759644-21kworker/u16:1+events_unbound16:05:455
2750014992724,2cyclictest2815784-21kworker/u16:4+events_unbound15:59:505
2750007992725,2cyclictest2936106-21kworker/u16:2+flush-8:017:04:574
2750007992725,2cyclictest2815784-21kworker/u16:4+events_unbound16:19:534
2750007992725,2cyclictest2759644-21kworker/u16:1+flush-8:015:39:484
2750007992724,2cyclictest3016141-21kworker/u16:1+flush-8:017:39:564
2750019992624,2cyclictest3401795-21kworker/u16:1+events_unbound20:49:356
2750019992624,2cyclictest3209083-21kworker/u16:2+flush-8:019:45:206
2750019992624,2cyclictest3158362-21kworker/u16:4+events_unbound18:50:486
2750019992624,2cyclictest3158230-21kworker/u16:1+events_unbound18:40:576
2750019992624,2cyclictest3117944-21kworker/u16:1+events_unbound18:27:366
2750019992624,2cyclictest3016141-21kworker/u16:1+flush-8:018:08:286
2750019992624,2cyclictest2986298-21kworker/u16:0+flush-8:017:53:216
2750019992624,2cyclictest2956616-21kworker/u16:1+events_unbound17:17:136
2750019992624,2cyclictest2936106-21kworker/u16:2+events_unbound18:34:586
2750019992624,2cyclictest2916853-21kworker/u16:5+flush-8:017:13:486
2750019992624,2cyclictest2815784-21kworker/u16:4+events_unbound16:23:056
2750014992624,2cyclictest3238479-21kworker/u16:0+flush-8:020:36:455
2750014992624,2cyclictest3158362-21kworker/u16:4+events_unbound19:59:295
2750014992624,2cyclictest3067280-21kworker/u16:4+flush-8:018:15:375
2750014992624,2cyclictest2997100-21kworker/u16:3+flush-8:017:52:565
2750023992524,0cyclictest0-21swapper/720:27:577
2750023992524,0cyclictest0-21swapper/719:48:137
2750023992524,0cyclictest0-21swapper/717:24:297
2750019992523,2cyclictest3238479-21kworker/u16:0+flush-8:020:10:366
2750019992523,2cyclictest2936106-21kworker/u16:2+events_unbound18:33:186
2750019992523,2cyclictest2936106-21kworker/u16:2+events_unbound17:34:056
2750019992523,2cyclictest2916853-21kworker/u16:5+flush-8:016:47:536
2750019992523,2cyclictest2036474-21kworker/u16:5+events_unbound15:41:206
2750019992522,2cyclictest2058533-21kworker/u16:2+flush-8:015:34:386
2750014992523,2cyclictest2058533-21kworker/u16:2+flush-8:015:36:455
2750007992523,2cyclictest3401795-21kworker/u16:1+events_unbound20:50:004
2750007992523,2cyclictest3238479-21kworker/u16:0+flush-8:019:54:594
2750007992523,2cyclictest2916853-21kworker/u16:5+flush-8:016:49:524
2750023992423,0cyclictest0-21swapper/717:05:367
2750023992423,0cyclictest0-21swapper/717:02:567
2750023992419,4cyclictest2784210-21latency_hist15:39:357
2750023992418,5cyclictest3198993-21latency_hist19:04:347
2750019992422,2cyclictest3391200-21kworker/u16:4+events_unbound20:46:126
2750019992422,2cyclictest3238479-21kworker/u16:0+flush-8:019:51:566
2750019992422,2cyclictest3087808-21kworker/u16:0+events_unbound19:02:126
2750019992422,2cyclictest3016141-21kworker/u16:1+flush-8:017:43:406
2750019992422,2cyclictest2815784-21kworker/u16:4+flush-8:016:27:376
2750019992422,2cyclictest2058533-21kworker/u16:2+events_unbound15:27:066
2750014992422,2cyclictest2936106-21kworker/u16:2+events_unbound18:59:025
2750014992422,2cyclictest2036474-21kworker/u16:5+flush-8:015:40:515
2750014992421,3cyclictest3158362-21kworker/u16:4+flush-8:019:05:035
2750007992422,2cyclictest3209083-21kworker/u16:2+flush-8:019:45:014
2750007992422,2cyclictest3087808-21kworker/u16:0+flush-8:018:59:304
2750007992422,2cyclictest3087808-21kworker/u16:0+flush-8:018:20:054
2750007992422,2cyclictest3087808-21kworker/u16:0+events_unbound18:10:094
2750007992422,2cyclictest2936106-21kworker/u16:2+flush-8:018:39:504
2750007992421,2cyclictest3158362-21kworker/u16:4+flush-8:019:19:344
2750019992321,2cyclictest3158362-21kworker/u16:4+flush-8:019:42:206
2750019992321,2cyclictest3087808-21kworker/u16:0+flush-8:019:05:366
2750019992321,2cyclictest2895425-21kworker/u16:0+events_unbound17:01:216
2750019992321,2cyclictest2814663-21kworker/u16:3+events_unbound16:12:146
2750014992321,2cyclictest2759644-21kworker/u16:1+events_unbound15:56:465
2750014992321,2cyclictest2036474-21kworker/u16:5+events_unbound15:44:455
2750014992320,2cyclictest2815784-21kworker/u16:4+flush-8:016:34:375
2750007992320,2cyclictest3087808-21kworker/u16:0+flush-8:018:44:364
2750007992320,2cyclictest2936106-21kworker/u16:2+events_unbound18:04:524
2750023992222,0cyclictest0-21swapper/719:25:107
2750023992222,0cyclictest0-21swapper/718:53:407
2750023992222,0cyclictest0-21swapper/716:29:327
2750023992221,0cyclictest0-21swapper/717:24:587
2750023992221,0cyclictest0-21swapper/716:05:177
2750023992217,4cyclictest589235-21systemd-journal20:03:007
2750019992220,2cyclictest3370135-21kworker/u16:4+events_unbound20:26:596
2750019992220,2cyclictest3350678-21kworker/u16:3+flush-8:020:43:146
2750019992220,2cyclictest3350678-21kworker/u16:3+flush-8:020:39:036
2750019992220,2cyclictest3067280-21kworker/u16:4+events_unbound17:59:326
2750019992220,2cyclictest2814663-21kworker/u16:3+events_unbound16:38:336
2750019992220,2cyclictest2759644-21kworker/u16:1+events_unbound15:50:586
2750014992220,2cyclictest3158362-21kworker/u16:4+events_unbound20:07:445
2750014992219,2cyclictest3238479-21kworker/u16:0+flush-8:019:51:005
2750014992219,2cyclictest3158362-21kworker/u16:4+flush-8:019:35:025
2750007992220,2cyclictest3209083-21kworker/u16:2+flush-8:019:25:154
2750007992220,2cyclictest3117944-21kworker/u16:1+flush-8:018:30:154
2750007992220,2cyclictest2997100-21kworker/u16:3+flush-8:017:25:044
2750023992120,0cyclictest0-21swapper/720:38:367
2750023992120,0cyclictest0-21swapper/716:32:017
2750023992120,0cyclictest0-21swapper/715:30:427
2750019992119,2cyclictest3117944-21kworker/u16:1+flush-8:018:24:316
2750019992119,2cyclictest2936106-21kworker/u16:2+flush-8:018:58:396
2750019992119,2cyclictest2895425-21kworker/u16:0+flush-8:016:56:356
2750014992119,2cyclictest3087808-21kworker/u16:0+flush-8:018:28:575
2750007992119,2cyclictest3350678-21kworker/u16:3+flush-8:020:34:524
2750007992119,2cyclictest2815784-21kworker/u16:4+flush-8:016:35:034
2750007992118,2cyclictest2986298-21kworker/u16:0+events_unbound17:44:564
2750023992020,0cyclictest0-21swapper/719:50:577
2750023992019,0cyclictest0-21swapper/717:34:507
2750023992019,0cyclictest0-21swapper/717:33:137
2750023992018,1cyclictest0-21swapper/719:55:087
2750023992014,5cyclictest589235-21systemd-journal17:10:017
2750023992014,5cyclictest589235-21systemd-journal16:04:347
2750019992018,2cyclictest3238479-21kworker/u16:0+events_unbound19:35:056
2750019992018,2cyclictest3016141-21kworker/u16:1+flush-8:017:37:256
2750019992018,2cyclictest2815784-21kworker/u16:4+flush-8:016:40:246
2750019992018,2cyclictest2036474-21kworker/u16:5+events_unbound15:31:206
2750014992017,3cyclictest3198145-21kworker/u16:1+flush-8:019:00:545
2750007992018,2cyclictest2814663-21kworker/u16:3+flush-8:016:29:564
2750007992018,2cyclictest2814663-21kworker/u16:3+events_unbound16:14:524
2750023991919,0cyclictest0-21swapper/716:11:497
2750023991918,0cyclictest0-21swapper/720:20:347
2750023991917,1cyclictest0-21swapper/720:44:577
2750023991914,4cyclictest589235-21systemd-journal15:47:517
2750014991917,2cyclictest3310359-21kworker/u16:1+events_unbound20:15:015
2750014991917,2cyclictest3016141-21kworker/u16:1+flush-8:018:06:015
2750014991917,2cyclictest2875366-21kworker/u16:2+flush-8:016:44:025
2750007991917,2cyclictest2956616-21kworker/u16:1+events_unbound17:14:524
2750007991917,2cyclictest2936106-21kworker/u16:2+flush-8:018:15:004
2750007991917,2cyclictest2814663-21kworker/u16:3+events_unbound15:59:594
2750007991917,2cyclictest2749782-21kworker/u16:0+flush-8:015:25:004
2750023991818,0cyclictest0-21swapper/719:32:417
2750023991817,0cyclictest0-21swapper/720:08:057
2750023991817,0cyclictest0-21swapper/715:56:097
2750023991816,1cyclictest0-21swapper/715:40:017
2750014991816,2cyclictest3087808-21kworker/u16:0+flush-8:018:31:015
2750014991816,2cyclictest2986298-21kworker/u16:0+flush-8:017:40:005
2750014991816,2cyclictest2936106-21kworker/u16:2+flush-8:017:04:575
2750007991816,2cyclictest3158362-21kworker/u16:4+flush-8:020:09:504
2750007991816,2cyclictest2936106-21kworker/u16:2+events_unbound16:54:484
2750007991816,2cyclictest2759644-21kworker/u16:1+flush-8:016:09:484
2750023991716,0cyclictest0-21swapper/718:46:417
2750023991716,0cyclictest0-21swapper/715:53:297
2750023991711,4cyclictest589235-21systemd-journal16:44:497
2750014991715,2cyclictest2986298-21kworker/u16:0+events_unbound17:25:005
2750007991715,2cyclictest3350678-21kworker/u16:3+events_unbound20:44:484
2750007991715,2cyclictest3117944-21kworker/u16:1+flush-8:018:24:564
2750007991715,2cyclictest3016141-21kworker/u16:1+events_unbound17:49:534
2750007991715,2cyclictest2986298-21kworker/u16:0+flush-8:017:55:054
2750007991715,2cyclictest2916853-21kworker/u16:5+flush-8:017:14:354
2750007991715,2cyclictest2916853-21kworker/u16:5+events_unbound16:48:024
2750007991715,2cyclictest2036474-21kworker/u16:5+flush-8:015:49:304
275000799170,1cyclictest0-21swapper/420:04:144
275000799170,1cyclictest0-21swapper/419:52:584
275000799170,1cyclictest0-21swapper/419:41:434
275000799170,1cyclictest0-21swapper/419:37:374
275000799170,1cyclictest0-21swapper/419:30:274
275000799170,1cyclictest0-21swapper/419:20:124
2750023991615,0cyclictest0-21swapper/718:40:187
2750023991613,2cyclictest0-21swapper/720:39:347
2750014991614,2cyclictest2814663-21kworker/u16:3+flush-8:016:30:215
2750007991614,2cyclictest3016141-21kworker/u16:1+flush-8:017:59:504
2750007991614,2cyclictest2759644-21kworker/u16:1+flush-8:015:49:514
2750023991514,0cyclictest0-21swapper/718:55:347
2750023991514,0cyclictest0-21swapper/717:45:147
2750014991513,2cyclictest3310359-21kworker/u16:1+flush-8:020:04:345
2750014991513,2cyclictest3238479-21kworker/u16:0+flush-8:020:32:295
2750014991513,2cyclictest2936106-21kworker/u16:2+events_unbound18:34:505
2750014991512,3cyclictest3123589-21kworker/u16:3+flush-8:018:39:565
2750007991513,2cyclictest3238479-21kworker/u16:0+flush-8:020:29:514
2750007991513,2cyclictest2936106-21kworker/u16:2+flush-8:018:34:574
2750007991512,2cyclictest3391200-21kworker/u16:4+flush-8:020:39:354
2750023991414,0cyclictest0-21swapper/716:23:267
2750023991412,1cyclictest0-21swapper/715:25:067
2750023991410,2cyclictest3119759-21kthreadcore18:24:547
2750014991412,2cyclictest2936106-21kworker/u16:2+flush-8:017:34:375
2750007991412,2cyclictest2936106-21kworker/u16:2+events_unbound18:52:044
2750007991412,2cyclictest2814663-21kworker/u16:3+events_unbound15:58:244
2750007991412,2cyclictest2058533-21kworker/u16:2+events_unbound15:34:494
275002399138,4cyclictest589235-21systemd-journal19:36:017
2750023991313,0cyclictest0-21swapper/718:02:397
2750023991310,2cyclictest4175659-21snmpd18:29:517
2750014991311,2cyclictest3158362-21kworker/u16:4+flush-8:019:19:485
2750007991311,2cyclictest2815784-21kworker/u16:4+flush-8:016:44:064
2750007991311,2cyclictest2814663-21kworker/u16:3+flush-8:016:25:104
275002399129,2cyclictest4175659-21snmpd17:50:387
2750023991212,0cyclictest0-21swapper/717:56:177
275002399120,11cyclictest2915663-21idleruntime-cro16:44:357
2750007991210,2cyclictest3370135-21kworker/u16:4+flush-8:020:29:204
2750007991210,2cyclictest2936106-21kworker/u16:2+events_unbound17:37:074
275000799120,12cyclictest0-21swapper/420:15:394
275002399111,10cyclictest948-21NetworkManager18:19:077
2750014991110,1cyclictest0-21swapper/517:30:555
275002399104,5cyclictest27763-21gvfs-afc-volume20:09:357
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional