You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 18:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue Aug 26, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
256285625621,31sleep70-21swapper/715:26:477
2563328995348,4cyclictest3146888-21latency_hist20:24:247
256302025242,7sleep60-21swapper/615:29:036
256302824636,7sleep50-21swapper/515:29:105
2563322994139,2cyclictest2553653-21kworker/u16:1+flush-8:015:34:425
2563327994038,2cyclictest3054175-21kworker/u16:0+flush-8:020:09:236
256303623827,8sleep40-21swapper/415:29:174
2563328993631,4cyclictest589235-21systemd-journal20:26:547
2563321993432,2cyclictest3166217-21kworker/u16:2+events_unbound20:31:554
2563321993432,2cyclictest3028943-21kworker/u16:3+flush-8:020:46:344
2563321993432,2cyclictest3028943-21kworker/u16:3+flush-8:020:46:344
2563327993330,2cyclictest3166217-21kworker/u16:2+events_unbound20:34:396
2563321993331,2cyclictest2714255-21kworker/u16:1+events_unbound17:08:564
2563321993230,2cyclictest3054175-21kworker/u16:0+events_unbound19:56:384
2563328993125,5cyclictest589235-21systemd-journal19:14:237
2563322993129,2cyclictest3107300-21kworker/u16:1+flush-8:020:54:185
2563322993129,2cyclictest3107300-21kworker/u16:1+events_unbound20:29:545
2563322993129,2cyclictest2665087-21kworker/u16:2+events_unbound16:34:425
2563322993129,2cyclictest2553653-21kworker/u16:1+flush-8:015:29:385
2563321993129,2cyclictest2940157-21kworker/u16:4+flush-8:019:41:574
2563321993129,2cyclictest2861577-21kworker/u16:0+flush-8:017:55:344
2563321993129,2cyclictest2714255-21kworker/u16:1+events_unbound16:57:554
2563321993129,2cyclictest2655221-21kworker/u16:0+events_unbound16:20:494
2563321993128,2cyclictest2564182-21kworker/u16:0+events_unbound15:49:254
2563328993028,1cyclictest0-21swapper/715:44:507
2563327993028,2cyclictest2792971-21kworker/u16:3+events_unbound17:44:536
2563327993028,2cyclictest2714255-21kworker/u16:1+flush-8:018:19:556
2563327993028,2cyclictest2714255-21kworker/u16:1+events_unbound19:29:246
2563321993028,2cyclictest3107300-21kworker/u16:1+events_unbound20:51:254
2563321993028,2cyclictest2940157-21kworker/u16:4+events_unbound19:06:384
2563321993028,2cyclictest2940157-21kworker/u16:4+events_unbound19:04:224
2563321993028,2cyclictest2792971-21kworker/u16:3+events_unbound17:41:574
2563321993028,2cyclictest2714255-21kworker/u16:1+flush-8:018:24:554
2563321993028,2cyclictest2564182-21kworker/u16:0+events_unbound15:34:484
2563321993028,2cyclictest1861687-21kworker/u16:8+events_unbound16:28:174
2563327992927,2cyclictest2714255-21kworker/u16:1+events_unbound19:44:536
2563327992926,2cyclictest2782854-21kworker/u16:5+flush-8:017:25:256
2563322992927,2cyclictest3107300-21kworker/u16:1+flush-8:020:14:535
2563322992927,2cyclictest2861577-21kworker/u16:0+flush-8:018:09:545
2563321992927,2cyclictest3117093-21kworker/u16:2+events_unbound20:18:224
2563321992927,2cyclictest3054175-21kworker/u16:0+flush-8:020:22:254
2563321992927,2cyclictest3054175-21kworker/u16:0+flush-8:020:09:484
2563321992927,2cyclictest2940157-21kworker/u16:4+events_unbound18:43:334
2563321992927,2cyclictest2871387-21kworker/u16:5+flush-8:018:11:344
2563321992927,2cyclictest2714255-21kworker/u16:1+flush-8:019:22:254
2563321992927,2cyclictest2714255-21kworker/u16:1+events_unbound16:43:574
2563328992827,0cyclictest0-21swapper/716:14:447
2563322992826,2cyclictest3146734-21kworker/u16:4+events_unbound20:54:545
2563321992826,2cyclictest2940157-21kworker/u16:4+flush-8:019:12:254
2563321992826,2cyclictest2841974-21kworker/u16:2+events_unbound18:22:134
2563321992826,2cyclictest2714255-21kworker/u16:1+flush-8:016:45:564
2563321992826,2cyclictest2553653-21kworker/u16:1+events_unbound16:03:594
2563328992725,1cyclictest0-21swapper/720:39:527
2563322992725,2cyclictest2920418-21kworker/u16:0+events_unbound19:08:185
2563321992725,2cyclictest2950162-21kworker/u16:2+events_unbound18:48:574
2563321992725,2cyclictest2714255-21kworker/u16:1+events_unbound19:16:014
2563321992725,2cyclictest2714255-21kworker/u16:1+events_unbound18:05:344
2563321992725,2cyclictest1861687-21kworker/u16:8+events_unbound16:37:594
29063932260,1chrt2906394-21kthreadcore18:19:457
2563328992623,2cyclictest96-21ksoftirqd/719:04:537
2563327992624,2cyclictest2714079-21kworker/u16:0+flush-8:016:44:406
2563327992622,3cyclictest2714255-21kworker/u16:1+flush-8:016:54:446
2563322992624,2cyclictest2841974-21kworker/u16:2+events_unbound18:20:335
2563321992624,2cyclictest3107300-21kworker/u16:1+flush-8:020:38:224
2563321992624,2cyclictest3077810-21kworker/u16:2+flush-8:020:00:374
2563321992624,2cyclictest3077810-21kworker/u16:2+flush-8:020:00:374
2563321992624,2cyclictest3077810-21kworker/u16:2+events_unbound19:46:584
2563321992624,2cyclictest3028943-21kworker/u16:3+flush-8:020:41:574
2563321992624,2cyclictest2782854-21kworker/u16:5+flush-8:017:24:094
2563321992624,2cyclictest2714255-21kworker/u16:1+flush-8:017:51:384
2563321992624,2cyclictest2616117-21kworker/u16:3+flush-8:016:07:424
2563321992624,2cyclictest1861687-21kworker/u16:8+flush-8:016:14:464
2563327992523,2cyclictest2841974-21kworker/u16:2+flush-8:018:00:356
2563327992523,2cyclictest2714255-21kworker/u16:1+flush-8:018:39:506
2563327992522,2cyclictest2920418-21kworker/u16:0+flush-8:018:54:446
2563322992523,2cyclictest2714255-21kworker/u16:1+events_unbound18:34:415
2563322992523,2cyclictest2714255-21kworker/u16:1+events_unbound16:59:485
2563322992523,2cyclictest1861687-21kworker/u16:8+flush-8:016:04:195
2563322992522,2cyclictest2714255-21kworker/u16:1+events_unbound19:09:365
2563328992423,0cyclictest0-21swapper/717:54:467
2563327992422,2cyclictest2842199-21kworker/u16:4+flush-8:017:51:256
2563322992422,2cyclictest2940157-21kworker/u16:4+flush-8:019:19:555
2563322992422,2cyclictest2940157-21kworker/u16:4+events_unbound18:44:395
2563322992422,2cyclictest2802843-21kworker/u16:0+events_unbound17:39:405
2563322992422,2cyclictest2665087-21kworker/u16:2+events_unbound16:49:455
2563322992421,2cyclictest2940157-21kworker/u16:4+flush-8:019:29:255
2563321992422,2cyclictest3054175-21kworker/u16:0+events_unbound19:38:534
2563321992422,2cyclictest3028943-21kworker/u16:3+events_unbound19:33:234
2563321992422,2cyclictest2871387-21kworker/u16:5+events_unbound18:02:564
2563321992422,2cyclictest2763313-21kworker/u16:2+events_unbound17:12:254
2563321992422,2cyclictest2714255-21kworker/u16:1+flush-8:018:33:334
2563321992422,2cyclictest2714255-21kworker/u16:1+flush-8:017:01:584
2563321992422,2cyclictest2714255-21kworker/u16:1+events_unbound18:53:414
2563328992321,1cyclictest0-21swapper/717:44:487
2563327992321,2cyclictest3054175-21kworker/u16:0+flush-8:020:14:346
2563327992321,2cyclictest2940157-21kworker/u16:4+flush-8:019:44:246
2563327992321,2cyclictest2940157-21kworker/u16:4+flush-8:019:19:566
2563322992321,2cyclictest3107300-21kworker/u16:1+flush-8:020:24:535
2563322992321,2cyclictest3028943-21kworker/u16:3+events_unbound20:04:515
2563322992321,2cyclictest2714079-21kworker/u16:0+flush-8:017:14:395
2563322992321,2cyclictest2553653-21kworker/u16:1+events_unbound16:26:025
2563321992321,2cyclictest3107300-21kworker/u16:1+flush-8:020:56:334
2563321992321,2cyclictest3107300-21kworker/u16:1+events_unbound20:05:284
2563321992321,2cyclictest2714255-21kworker/u16:1+events_unbound18:37:554
2563321992321,2cyclictest2714255-21kworker/u16:1+events_unbound17:32:254
2563321992321,2cyclictest2564182-21kworker/u16:0+flush-8:015:43:184
2563328992217,4cyclictest2970082-21latency_hist18:54:247
2563327992220,2cyclictest2940157-21kworker/u16:4+events_unbound18:36:236
2563327992220,2cyclictest2861577-21kworker/u16:0+events_unbound18:09:486
2563327992220,2cyclictest1861687-21kworker/u16:8+flush-8:016:09:396
2563327992220,2cyclictest1861687-21kworker/u16:8+flush-8:016:09:396
2563322992220,2cyclictest3054175-21kworker/u16:0+flush-8:019:50:335
2563322992220,2cyclictest2861577-21kworker/u16:0+flush-8:018:04:465
2563322992220,2cyclictest2792971-21kworker/u16:3+flush-8:017:34:555
2563321992220,2cyclictest2714255-21kworker/u16:1+flush-8:018:58:114
2563321992220,2cyclictest2714255-21kworker/u16:1+events_unbound19:25:144
2563321992220,2cyclictest2553653-21kworker/u16:1+events_unbound15:59:194
2563328992120,0cyclictest0-21swapper/717:14:417
2563328992119,1cyclictest0-21swapper/718:09:367
256332899211,18cyclictest27763-21gvfs-afc-volume17:05:017
2563327992119,2cyclictest2714255-21kworker/u16:1+flush-8:019:36:256
2563327992119,2cyclictest2714255-21kworker/u16:1+flush-8:017:29:526
2563322992119,2cyclictest2940157-21kworker/u16:4+events_unbound19:39:385
2563322992119,2cyclictest2714255-21kworker/u16:1+flush-8:017:04:465
2563322992119,2cyclictest2714255-21kworker/u16:1+events_unbound17:44:435
2563322992119,2cyclictest2714079-21kworker/u16:0+events_unbound16:44:365
2563322992119,2cyclictest2675152-21kworker/u16:3+flush-8:016:30:345
2563321992119,2cyclictest2792971-21kworker/u16:3+events_unbound17:35:584
2563321992119,2cyclictest2714079-21kworker/u16:0+flush-8:017:15:584
2563328992014,5cyclictest2616286-21latency_hist15:54:257
2563327992018,2cyclictest2986427-21kworker/u16:2+flush-8:018:59:526
2563327992018,2cyclictest2920418-21kworker/u16:0+flush-8:019:05:176
2563327992018,2cyclictest2920418-21kworker/u16:0+events_unbound18:49:526
2563327992018,2cyclictest2841974-21kworker/u16:2+events_unbound18:24:496
2563327992016,3cyclictest2714255-21kworker/u16:1+flush-8:019:29:516
2563322992018,2cyclictest2792971-21kworker/u16:3+events_unbound17:59:425
2563322992018,2cyclictest2553653-21kworker/u16:1+events_unbound16:09:435
2563322992018,2cyclictest2553653-21kworker/u16:1+events_unbound16:09:435
2563321992018,2cyclictest2714255-21kworker/u16:1+flush-8:017:45:554
2563321992018,2cyclictest2714079-21kworker/u16:0+flush-8:016:51:564
2563321992018,2cyclictest1861687-21kworker/u16:8+flush-8:016:32:584
2563328991918,0cyclictest0-21swapper/720:04:437
2563328991918,0cyclictest0-21swapper/719:54:507
2563328991918,0cyclictest0-21swapper/719:32:207
2563327991917,2cyclictest2665087-21kworker/u16:2+flush-8:016:34:466
2563327991917,2cyclictest1861687-21kworker/u16:8+flush-8:016:04:476
2563327991916,2cyclictest2714255-21kworker/u16:1+flush-8:016:59:406
2563322991917,2cyclictest2940157-21kworker/u16:4+events_unbound19:47:235
2563322991917,2cyclictest2920418-21kworker/u16:0+events_unbound18:59:385
2563322991917,2cyclictest2743344-21kworker/u16:3+events_unbound16:58:385
2563322991917,2cyclictest2714255-21kworker/u16:1+events_unbound18:15:545
2563322991917,2cyclictest2606429-21kworker/u16:2+events_unbound15:49:455
2563322991917,2cyclictest2553653-21kworker/u16:1+flush-8:016:04:535
2563321991917,2cyclictest3054175-21kworker/u16:0+flush-8:020:28:574
2563321991917,2cyclictest2553653-21kworker/u16:1+flush-8:016:09:444
2563321991917,2cyclictest2553653-21kworker/u16:1+flush-8:016:09:444
2563328991817,0cyclictest0-21swapper/719:59:467
2563328991817,0cyclictest0-21swapper/719:59:467
256332899180,1cyclictest0-21swapper/718:39:477
256332899180,17cyclictest1313-21snmpd16:44:027
2563327991816,2cyclictest3107300-21kworker/u16:1+flush-8:020:29:526
2563327991816,2cyclictest2871387-21kworker/u16:5+flush-8:018:15:096
2563327991816,2cyclictest2861577-21kworker/u16:0+events_unbound18:04:516
2563327991814,3cyclictest3207009-21cat20:54:396
2563327991814,3cyclictest3054175-21kworker/u16:0+flush-8:020:12:256
2563322991816,2cyclictest3117093-21kworker/u16:2+events_unbound20:21:335
2563322991816,2cyclictest3107300-21kworker/u16:1+flush-8:020:38:575
2563322991816,2cyclictest3028943-21kworker/u16:3+flush-8:019:39:195
2563322991816,2cyclictest2714255-21kworker/u16:1+flush-8:017:49:305
2563322991816,2cyclictest2714255-21kworker/u16:1+flush-8:017:19:475
2563322991816,2cyclictest2564182-21kworker/u16:0+flush-8:015:49:195
2563322991816,2cyclictest2553653-21kworker/u16:1+events_unbound16:19:435
2563322991815,2cyclictest3077810-21kworker/u16:2+events_unbound19:54:435
2563321991816,2cyclictest2714255-21kworker/u16:1+flush-8:018:14:344
2563321991816,2cyclictest2553653-21kworker/u16:1+events_unbound15:30:024
27100192170,0sleep50-21swapper/516:39:445
2563328991716,0cyclictest0-21swapper/719:41:437
2563328991716,0cyclictest0-21swapper/715:59:427
2563328991715,1cyclictest0-21swapper/717:24:497
2563328991715,1cyclictest0-21swapper/715:54:497
2563327991715,2cyclictest2782854-21kworker/u16:5+flush-8:017:15:246
2563327991715,2cyclictest2665087-21kworker/u16:2+events_unbound16:19:476
2563327991714,2cyclictest2940157-21kworker/u16:4+flush-8:019:49:516
2563322991715,2cyclictest3028943-21kworker/u16:3+events_unbound19:29:095
2563322991715,2cyclictest2792971-21kworker/u16:3+events_unbound17:29:235
2563322991715,2cyclictest2714255-21kworker/u16:1+flush-8:018:54:575
2563322991715,2cyclictest2655221-21kworker/u16:0+flush-8:016:18:375
2563321991715,2cyclictest3028943-21kworker/u16:3+events_unbound19:53:544
2563321991713,3cyclictest2597072-21munin-node15:44:374
256332899165,10cyclictest921-21dbus-daemon18:35:467
2563328991615,0cyclictest0-21swapper/719:49:527
2563328991615,0cyclictest0-21swapper/717:34:497
2563328991614,1cyclictest0-21swapper/719:19:477
2563328991610,5cyclictest2989706-21latency_hist19:04:237
256332899160,15cyclictest1313-21snmpd20:37:357
256332899160,14cyclictest2881526-21latency_hist18:09:247
2563327991614,2cyclictest3146734-21kworker/u16:4+events_unbound20:49:506
2563327991614,2cyclictest3077810-21kworker/u16:2+flush-8:019:54:546
2563327991614,2cyclictest3028943-21kworker/u16:3+flush-8:020:39:436
2563327991614,2cyclictest2714255-21kworker/u16:1+flush-8:017:34:446
2563327991614,2cyclictest2714079-21kworker/u16:0+flush-8:016:49:516
2563327991614,2cyclictest2655221-21kworker/u16:0+flush-8:016:14:516
2563327991613,2cyclictest1830418-21kworker/u16:3+flush-8:015:29:376
2563327991612,3cyclictest2553653-21kworker/u16:1+flush-8:015:44:516
2563322991614,2cyclictest2920418-21kworker/u16:0+flush-8:018:29:185
2563322991614,2cyclictest2714079-21kworker/u16:0+events_unbound17:12:485
2563322991613,2cyclictest2920418-21kworker/u16:0+flush-8:018:39:255
2563321991614,2cyclictest2782854-21kworker/u16:5+events_unbound17:25:504
2563328991514,0cyclictest0-21swapper/720:57:337
256332899150,14cyclictest3166412-21taskset20:32:557
2563327991513,2cyclictest3028943-21kworker/u16:3+flush-8:020:44:386
2563327991513,2cyclictest3028943-21kworker/u16:3+flush-8:020:44:386
2563327991513,2cyclictest2940157-21kworker/u16:4+events_unbound19:14:396
2563327991513,2cyclictest2792971-21kworker/u16:3+flush-8:017:23:256
2563327991513,2cyclictest2714255-21kworker/u16:1+events_unbound17:04:496
2563327991513,2cyclictest2564182-21kworker/u16:0+flush-8:015:54:526
2563322991513,2cyclictest3054175-21kworker/u16:0+flush-8:020:09:335
2563322991513,2cyclictest3028943-21kworker/u16:3+events_unbound20:44:335
2563322991513,2cyclictest3028943-21kworker/u16:3+events_unbound20:44:335
2563322991513,2cyclictest2802843-21kworker/u16:0+events_unbound17:29:445
2563322991513,2cyclictest1861687-21kworker/u16:8+flush-8:015:39:385
2563322991512,2cyclictest2940157-21kworker/u16:4+events_unbound19:14:315
256332899149,4cyclictest3078035-21latency_hist19:49:237
2563328991414,0cyclictest0-21swapper/720:48:377
2563328991414,0cyclictest0-21swapper/720:48:377
2563328991413,0cyclictest0-21swapper/718:44:437
2563328991413,0cyclictest0-21swapper/716:19:457
2563328991413,0cyclictest0-21swapper/715:40:087
2563328991412,1cyclictest0-21swapper/717:09:467
2563328991412,1cyclictest0-21swapper/716:54:477
256332899140,12cyclictest3126266-21ntpq20:09:497
256332899140,12cyclictest2827568-21grep17:39:457
2563327991412,2cyclictest3028943-21kworker/u16:3+flush-8:020:23:316
2563327991412,2cyclictest2940157-21kworker/u16:4+flush-8:018:44:456
2563327991412,2cyclictest2714079-21kworker/u16:0+flush-8:017:09:416
2563327991412,2cyclictest2606429-21kworker/u16:2+flush-8:015:49:376
2563327991412,2cyclictest2553653-21kworker/u16:1+flush-8:016:24:556
2563327991411,2cyclictest2675152-21kworker/u16:3+flush-8:016:29:266
2563327991411,2cyclictest2553653-21kworker/u16:1+flush-8:015:39:396
2563322991412,2cyclictest3028943-21kworker/u16:3+events_unbound20:02:345
2563322991412,2cyclictest3028943-21kworker/u16:3+events_unbound20:02:345
2563322991412,2cyclictest2920418-21kworker/u16:0+events_unbound18:29:485
2563322991412,2cyclictest2841974-21kworker/u16:2+flush-8:017:56:555
256332899135,6cyclictest27763-21gvfs-afc-volume17:29:477
2563328991311,1cyclictest2684355-21find16:24:567
256332799139,3cyclictest3054175-21kworker/u16:0+flush-8:020:24:406
2563327991311,2cyclictest3054175-21kworker/u16:0+flush-8:019:59:386
2563327991311,2cyclictest3054175-21kworker/u16:0+flush-8:019:59:386
2563322991311,2cyclictest2940157-21kworker/u16:4+events_unbound18:53:375
2563322991311,2cyclictest1861687-21kworker/u16:8+events_unbound15:57:575
256332899129,2cyclictest1313-21snmpd16:37:587
256332899128,3cyclictest2921163-21/usr/sbin/munin18:29:557
256332899128,3cyclictest2646100-21/usr/sbin/munin16:09:527
256332899128,3cyclictest2646100-21/usr/sbin/munin16:09:527
256332899128,3cyclictest1313-21snmpd15:35:427
256332899127,4cyclictest27763-21gvfs-afc-volume19:14:407
256332899127,4cyclictest27763-21gvfs-afc-volume16:44:457
256332899121,9cyclictest589235-21systemd-journal16:04:427
2563328991212,0cyclictest0-21swapper/718:57:377
2563328991211,1cyclictest0-21swapper/719:34:457
2563328991211,0cyclictest0-21swapper/718:14:347
256332899120,11cyclictest948-21NetworkManager18:24:417
256332899120,10cyclictest0-21swapper/716:29:507
256332799129,2cyclictest2802843-21kworker/u16:0+flush-8:017:39:566
256332799120,12cyclictest0-21swapper/615:38:586
2563322991210,2cyclictest3146734-21kworker/u16:4+events_unbound20:40:155
256332899118,2cyclictest1313-21snmpd20:51:177
256332899118,2cyclictest1313-21snmpd19:26:217
256332899118,2cyclictest0-21swapper/715:29:487
256332899116,4cyclictest589235-21systemd-journal16:49:247
256332899110,9cyclictest0-21swapper/717:19:397
256332899110,2cyclictest0-21swapper/716:59:487
256332899110,10cyclictest96-21ksoftirqd/718:00:077
256332799119,2cyclictest2920418-21kworker/u16:0+flush-8:018:29:416
256332799119,2cyclictest2714255-21kworker/u16:1+flush-8:019:10:266
2563327991110,1cyclictest0-21swapper/617:58:196
256332899108,1cyclictest0-21swapper/717:49:547
256332899101,1cyclictest0-21swapper/720:14:387
256332799107,2cyclictest2714079-21kworker/u16:0+flush-8:016:43:256
25633279998,1cyclictest0-21swapper/616:03:436
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional