You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 23:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Dec 04, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1938810996663,2cyclictest2235413-21kworker/u16:1+flush-8:018:02:436
193842125747,7sleep50-21swapper/515:21:505
193843425320,29sleep70-21swapper/715:22:007
193841125343,7sleep40-21swapper/415:21:414
1938802994744,2cyclictest2499758-21kworker/u16:2+events_unbound20:46:104
1938802994644,2cyclictest2195203-21kworker/u16:4+events_unbound17:55:104
1938813994540,4cyclictest2296240-21latency_hist18:17:437
1938810994542,2cyclictest2548506-21kworker/u16:5+flush-8:020:42:436
192889324434,7sleep60-21swapper/615:17:506
193881399430,41cyclictest589235-21systemd-journal16:57:437
1938802994341,2cyclictest2386977-21kworker/u16:4+flush-8:019:13:584
1938804994240,2cyclictest2386977-21kworker/u16:4+events_unbound19:49:105
1938804994240,2cyclictest2083836-21kworker/u16:2+events_unbound17:04:315
1938804994139,2cyclictest2386977-21kworker/u16:4+flush-8:019:54:055
1938804994139,2cyclictest2124648-21kworker/u16:0+flush-8:017:18:475
1938804994139,2cyclictest2124648-21kworker/u16:0+flush-8:017:18:475
1938804994139,2cyclictest1982716-21kworker/u16:3+events_unbound16:26:075
1938802994038,2cyclictest2386977-21kworker/u16:4+events_unbound20:04:054
1938802993836,2cyclictest1948489-21kworker/u16:1+events_unbound15:44:064
1938802993735,2cyclictest2346742-21kworker/u16:2+flush-8:019:23:074
1938802993735,2cyclictest2083836-21kworker/u16:2+events_unbound17:09:104
1938802993735,2cyclictest2083836-21kworker/u16:2+events_unbound16:48:534
1938802993735,2cyclictest1982716-21kworker/u16:3+flush-8:016:39:064
1938802993735,2cyclictest1982716-21kworker/u16:3+flush-8:016:39:064
1938813993632,3cyclictest2023500-21sh16:02:437
1938813993631,4cyclictest2477987-21latency_hist19:47:437
193881399360,34cyclictest589235-21systemd-journal19:41:087
1938804993634,2cyclictest2365983-21kworker/u16:0+events_unbound19:22:105
1938810993532,2cyclictest2286134-21kworker/u16:4+events_unbound18:17:586
1938804993533,2cyclictest2346742-21kworker/u16:2+events_unbound19:29:025
1938804993533,2cyclictest2124648-21kworker/u16:0+events_unbound17:01:105
1938804993533,2cyclictest2083836-21kworker/u16:2+events_unbound17:27:115
1938804993533,2cyclictest2083836-21kworker/u16:2+events_unbound17:27:115
1938802993533,2cyclictest2271160-21kworker/u16:3+events_unbound18:36:344
1938802993533,2cyclictest2093236-21kworker/u16:5+events_unbound16:58:144
1938813993429,4cyclictest2094175-21latency_hist16:37:437
1938813993416,17cyclictest0-21swapper/720:23:077
1938810993431,2cyclictest2499758-21kworker/u16:2+flush-8:020:02:436
1938804993432,2cyclictest1948489-21kworker/u16:1+flush-8:016:07:075
1938813993328,4cyclictest2407333-21latency_hist19:12:437
1938802993331,2cyclictest2386977-21kworker/u16:4+events_unbound20:14:054
1938802993331,2cyclictest2286134-21kworker/u16:4+events_unbound18:19:434
1938802993331,2cyclictest2093236-21kworker/u16:5+events_unbound16:56:094
1938804993229,2cyclictest2346742-21kworker/u16:2+flush-8:019:22:455
1938802993230,2cyclictest2447668-21kworker/u16:3+events_unbound19:43:184
1938802993230,2cyclictest2365983-21kworker/u16:0+events_unbound19:10:094
1938802993230,2cyclictest2271160-21kworker/u16:3+flush-8:018:11:364
1938802993230,2cyclictest2271160-21kworker/u16:3+flush-8:018:11:364
1938802993230,2cyclictest2255085-21kworker/u16:2+events_unbound18:06:284
1938802993229,3cyclictest2271160-21kworker/u16:3+events_unbound18:56:474
1938802993229,2cyclictest2083836-21kworker/u16:2+events_unbound17:02:474
193881399310,29cyclictest2417423-21latency_hist19:17:437
1938802993129,2cyclictest2326393-21kworker/u16:1+events_unbound18:46:104
1938802993128,2cyclictest1239819-21kworker/u16:8+flush-8:015:32:504
1938804993028,2cyclictest2558643-21kworker/u16:3+flush-8:020:40:105
1938804993028,2cyclictest2548415-21kworker/u16:1+events_unbound20:24:095
1938804993028,2cyclictest2386977-21kworker/u16:4+events_unbound19:15:105
1938804993028,2cyclictest2346742-21kworker/u16:2+events_unbound19:02:105
1938804993028,2cyclictest1962542-21kworker/u16:0+events_unbound16:12:425
1938804993028,2cyclictest1239819-21kworker/u16:8+events_unbound15:41:085
1938802993028,2cyclictest2558643-21kworker/u16:3+flush-8:020:38:274
1938802993028,2cyclictest2406708-21kworker/u16:3+flush-8:019:19:014
1938802993028,2cyclictest1239819-21kworker/u16:8+events_unbound16:10:074
193881399290,27cyclictest589235-21systemd-journal18:28:527
1938810992925,3cyclictest2447668-21kworker/u16:3+flush-8:019:39:386
1938804992926,2cyclictest2215312-21kworker/u16:0+events_unbound18:27:465
1938802992927,2cyclictest2558643-21kworker/u16:3+events_unbound20:32:024
1938802992927,2cyclictest2286134-21kworker/u16:4+events_unbound18:26:014
1938802992927,2cyclictest1982716-21kworker/u16:3+flush-8:015:57:074
1938802992927,2cyclictest1982716-21kworker/u16:3+flush-8:015:57:074
1938802992927,2cyclictest1948489-21kworker/u16:1+events_unbound16:20:544
1938802992927,2cyclictest1871629-21kworker/u16:2+flush-8:015:27:494
1938802992926,2cyclictest2195203-21kworker/u16:4+events_unbound17:57:444
1938813992827,0cyclictest0-21swapper/715:23:147
1938810992826,2cyclictest2386977-21kworker/u16:4+events_unbound19:18:026
1938804992826,2cyclictest1982716-21kworker/u16:3+events_unbound16:31:435
1938804992826,2cyclictest1871629-21kworker/u16:2+events_unbound15:30:485
1938802992826,2cyclictest2427484-21kworker/u16:1+flush-8:019:36:514
1938802992826,2cyclictest2083836-21kworker/u16:2+events_unbound16:36:464
1938802992826,2cyclictest1239819-21kworker/u16:8+events_unbound16:00:194
193881399270,25cyclictest2589164-21sh20:42:437
1938802992725,2cyclictest2558643-21kworker/u16:3+events_unbound20:26:454
1938802992725,2cyclictest2518262-21kworker/u16:0+events_unbound20:19:534
1938802992725,2cyclictest2488001-21kworker/u16:1+events_unbound19:58:544
1938802992725,2cyclictest2447668-21kworker/u16:3+events_unbound19:53:124
1938802992725,2cyclictest2447668-21kworker/u16:3+events_unbound19:52:064
1938802992725,2cyclictest2365983-21kworker/u16:0+events_unbound18:59:024
1938802992725,2cyclictest2346742-21kworker/u16:2+flush-8:019:30:424
1938802992725,2cyclictest2346742-21kworker/u16:2+events_unbound19:05:454
1938802992725,2cyclictest2271160-21kworker/u16:3+flush-8:018:48:304
1938802992725,2cyclictest2114233-21kworker/u16:1+events_unbound16:47:154
1938802992724,2cyclictest2195203-21kworker/u16:4+flush-8:017:28:094
1938802992724,2cyclictest1948489-21kworker/u16:1+flush-8:015:47:544
1938813992621,4cyclictest2366961-21latency_hist18:52:437
1938813992620,5cyclictest4184977-17auditd19:34:027
1938810992624,2cyclictest2124648-21kworker/u16:0+events_unbound17:07:446
1938804992624,2cyclictest2215312-21kworker/u16:0+flush-8:018:23:075
1938804992623,2cyclictest2386977-21kworker/u16:4+events_unbound20:17:525
1938804992623,2cyclictest2215312-21kworker/u16:0+events_unbound17:42:575
1938804992623,2cyclictest2114233-21kworker/u16:1+flush-8:017:12:585
1938802992624,2cyclictest1982716-21kworker/u16:3+events_unbound16:29:464
1938813992523,1cyclictest0-21swapper/718:58:117
1938804992523,2cyclictest2558643-21kworker/u16:3+flush-8:020:29:095
1938804992523,2cyclictest2548415-21kworker/u16:1+flush-8:020:33:115
1938804992523,2cyclictest2386977-21kworker/u16:4+events_unbound19:03:365
1938804992523,2cyclictest2235413-21kworker/u16:1+flush-8:017:58:535
1938804992523,2cyclictest1982716-21kworker/u16:3+events_unbound16:44:065
1938804992523,2cyclictest1871629-21kworker/u16:2+flush-8:015:37:355
1938802992523,2cyclictest2447668-21kworker/u16:3+events_unbound19:41:584
1938802992523,2cyclictest2114233-21kworker/u16:1+events_unbound17:25:354
1938802992523,2cyclictest2114233-21kworker/u16:1+events_unbound17:25:354
1938802992522,2cyclictest2286134-21kworker/u16:4+events_unbound18:42:434
1938813992419,4cyclictest589235-21systemd-journal17:12:437
193881399240,22cyclictest2164895-21latency_hist17:12:437
1938810992421,2cyclictest2386977-21kworker/u16:4+events_unbound19:12:596
1938804992422,2cyclictest2083836-21kworker/u16:2+flush-8:017:38:095
1938802992422,2cyclictest1982716-21kworker/u16:3+events_unbound16:27:024
193881399230,21cyclictest2154841-21latency_hist17:07:447
1938810992321,2cyclictest2499758-21kworker/u16:2+flush-8:020:18:106
1938810992320,2cyclictest2235413-21kworker/u16:1+events_unbound18:02:576
1938810992319,3cyclictest2326393-21kworker/u16:1+events_unbound19:03:106
1938804992321,2cyclictest2518262-21kworker/u16:0+flush-8:020:06:025
1938804992321,2cyclictest2365983-21kworker/u16:0+events_unbound19:08:585
1938804992321,2cyclictest2195203-21kworker/u16:4+flush-8:017:57:115
1938804992321,2cyclictest2083836-21kworker/u16:2+events_unbound17:37:115
1938802992321,2cyclictest2083836-21kworker/u16:2+flush-8:017:38:104
1938802992321,2cyclictest1948489-21kworker/u16:1+events_unbound15:40:394
1938802992321,2cyclictest1239819-21kworker/u16:8+events_unbound16:06:034
1938813992220,1cyclictest0-21swapper/716:23:097
1938810992220,2cyclictest1948489-21kworker/u16:1+events_unbound15:42:576
1938804992220,2cyclictest2447668-21kworker/u16:3+flush-8:019:43:155
1938804992220,2cyclictest2013174-21kworker/u16:2+flush-8:015:57:385
1938804992220,2cyclictest2013174-21kworker/u16:2+flush-8:015:57:385
1938804992220,2cyclictest1982716-21kworker/u16:3+flush-8:016:00:075
1938804992219,2cyclictest2499758-21kworker/u16:2+events_unbound20:12:435
1938804992218,3cyclictest2195203-21kworker/u16:4+events_unbound17:48:025
1938802992220,2cyclictest2093236-21kworker/u16:5+events_unbound17:48:334
1938802992219,2cyclictest2558643-21kworker/u16:3+events_unbound20:47:444
1938810992119,2cyclictest2427484-21kworker/u16:1+flush-8:019:43:006
1938810992119,2cyclictest2286134-21kworker/u16:4+flush-8:018:32:436
1938804992119,2cyclictest2326393-21kworker/u16:1+events_unbound18:40:525
1938804992119,2cyclictest2083836-21kworker/u16:2+flush-8:017:08:105
1938804992117,3cyclictest2286134-21kworker/u16:4+flush-8:018:43:085
1938802992119,2cyclictest2286134-21kworker/u16:4+events_unbound18:16:164
1938802992119,2cyclictest2271160-21kworker/u16:3+events_unbound18:30:424
1938802992119,2cyclictest2093236-21kworker/u16:5+events_unbound17:20:234
1938802992119,2cyclictest2093236-21kworker/u16:5+events_unbound17:20:234
1938802992119,2cyclictest1962542-21kworker/u16:0+events_unbound16:12:444
1938813992015,4cyclictest2235630-21latency_hist17:47:447
1938810992018,2cyclictest2271160-21kworker/u16:3+flush-8:018:08:146
1938810992018,2cyclictest2271160-21kworker/u16:3+flush-8:018:08:146
1938804992018,2cyclictest2558643-21kworker/u16:3+flush-8:020:52:385
1938804992018,2cyclictest2499758-21kworker/u16:2+flush-8:019:58:065
1938804992018,2cyclictest1982716-21kworker/u16:3+events_unbound16:38:105
1938804992018,2cyclictest1982716-21kworker/u16:3+events_unbound16:38:105
1938804992018,2cyclictest1982716-21kworker/u16:3+events_unbound15:43:055
1938804992018,2cyclictest1948489-21kworker/u16:1+flush-8:015:24:475
1938802992018,2cyclictest2518262-21kworker/u16:0+flush-8:020:10:544
1938802992018,2cyclictest2093236-21kworker/u16:5+flush-8:017:45:454
1938802992018,2cyclictest2093236-21kworker/u16:5+events_unbound17:35:124
1938813991918,0cyclictest0-21swapper/719:48:007
1938810991917,2cyclictest2326393-21kworker/u16:1+events_unbound18:58:096
1938804991918,1cyclictest0-21swapper/518:47:445
1938804991917,2cyclictest2499758-21kworker/u16:2+flush-8:020:08:045
1938804991917,2cyclictest2447668-21kworker/u16:3+flush-8:019:34:145
1938804991917,2cyclictest2215312-21kworker/u16:0+flush-8:018:20:545
1938804991917,2cyclictest2114233-21kworker/u16:1+events_unbound16:52:385
1938804991917,2cyclictest2083836-21kworker/u16:2+events_unbound16:55:085
1938802991917,2cyclictest2114233-21kworker/u16:1+flush-8:017:13:094
1938813991817,0cyclictest0-21swapper/718:07:587
1938813991817,0cyclictest0-21swapper/718:07:587
1938813991815,2cyclictest4175659-21snmpd20:50:157
1938813991812,5cyclictest589235-21systemd-journal15:29:067
1938810991816,2cyclictest2083836-21kworker/u16:2+events_unbound16:37:566
1938810991816,2cyclictest2083836-21kworker/u16:2+events_unbound16:37:566
1938810991816,2cyclictest1239819-21kworker/u16:8+events_unbound15:23:096
1938810991815,2cyclictest2286134-21kworker/u16:4+flush-8:018:16:176
1938810991815,2cyclictest1239819-21kworker/u16:8+flush-8:015:33:086
1938804991816,2cyclictest2548506-21kworker/u16:5+flush-8:020:46:335
1938802991816,2cyclictest2558643-21kworker/u16:3+events_unbound20:36:064
1938813991717,0cyclictest0-21swapper/718:53:057
1938813991715,1cyclictest0-21swapper/716:18:097
1938813991711,5cyclictest589235-21systemd-journal15:52:077
1938810991715,2cyclictest2235413-21kworker/u16:1+events_unbound17:53:096
1938810991715,2cyclictest2185478-21kworker/u16:3+flush-8:017:28:006
1938810991713,3cyclictest1871629-21kworker/u16:2+flush-8:015:28:136
1938804991715,2cyclictest2083836-21kworker/u16:2+events_unbound16:33:015
1938802991715,2cyclictest1239819-21kworker/u16:8+events_unbound15:23:484
1938813991615,0cyclictest0-21swapper/718:02:597
1938813991615,0cyclictest0-21swapper/715:33:017
1938813991610,5cyclictest2245777-21latency_hist17:52:447
1938810991614,2cyclictest2548506-21kworker/u16:5+flush-8:020:43:076
1938810991614,2cyclictest2053432-21kworker/u16:2+flush-8:016:17:596
1938810991613,3cyclictest2578934-21kworker/u16:0+flush-8:020:48:086
1938810991612,3cyclictest2427484-21kworker/u16:1+flush-8:019:27:406
1938804991614,2cyclictest2427484-21kworker/u16:1+flush-8:019:42:375
1938804991614,2cyclictest2286134-21kworker/u16:4+flush-8:018:35:095
1938804991612,3cyclictest2195203-21kworker/u16:4+flush-8:017:32:435
193881399159,5cyclictest1983044-21latency_hist15:42:437
1938813991510,4cyclictest2084050-21latency_hist16:32:437
1938810991513,2cyclictest2255085-21kworker/u16:2+flush-8:018:24:146
1938810991513,2cyclictest1871629-21kworker/u16:2+flush-8:015:38:066
1938810991512,2cyclictest2114233-21kworker/u16:1+flush-8:017:14:146
1938810991511,3cyclictest2346742-21kworker/u16:2+events_unbound19:08:116
1938810991511,3cyclictest2083836-21kworker/u16:2+flush-8:016:33:096
1938804991513,2cyclictest2255085-21kworker/u16:2+events_unbound18:05:435
193881399149,4cyclictest2436738-21ntpq19:23:097
1938813991411,2cyclictest4175659-21snmpd18:38:157
1938813991411,2cyclictest0-21swapper/715:42:437
193881399140,12cyclictest0-21swapper/719:18:087
1938810991411,3cyclictest2124648-21kworker/u16:0+flush-8:016:57:566
1938804991411,2cyclictest2271160-21kworker/u16:3+flush-8:018:07:565
1938804991411,2cyclictest2271160-21kworker/u16:3+flush-8:018:07:565
193881399139,3cyclictest96-21ksoftirqd/717:57:577
193881399134,8cyclictest0-21swapper/716:43:067
1938813991312,0cyclictest0-21swapper/716:08:107
1938813991310,2cyclictest0-21swapper/718:47:437
193881399130,12cyclictest2306364-21latency_hist18:22:437
193881099139,3cyclictest2083836-21kworker/u16:2+events_unbound17:37:586
1938810991310,2cyclictest2093236-21kworker/u16:5+flush-8:016:53:146
1938810991310,2cyclictest1948489-21kworker/u16:1+events_unbound15:47:566
1938804991310,2cyclictest2271160-21kworker/u16:3+flush-8:018:52:535
1938804991310,2cyclictest1948489-21kworker/u16:1+events_unbound15:47:515
193881399129,2cyclictest4175659-21snmpd20:36:237
193881399129,2cyclictest4175659-21snmpd20:17:507
193881399129,2cyclictest4175659-21snmpd19:04:337
193881399129,2cyclictest4175659-21snmpd16:51:387
193881399129,2cyclictest0-21swapper/717:52:447
193881399128,3cyclictest2195610-21/usr/sbin/munin17:28:117
193881399127,4cyclictest984960-21gvfsd-wsdd20:12:597
193881399127,4cyclictest589235-21systemd-journal20:03:097
193881399127,4cyclictest2496148-21cut19:53:067
1938813991211,0cyclictest0-21swapper/718:33:017
193881399120,4cyclictest2526363-21kthreadcore20:08:047
193881399120,4cyclictest2503003-21cut19:58:037
193881399120,10cyclictest2448112-21cut19:32:437
193881099129,3cyclictest2499758-21kworker/u16:2+events_unbound20:02:556
193881099129,2cyclictest2548415-21kworker/u16:1+flush-8:020:33:086
193881099129,2cyclictest2447668-21kworker/u16:3+flush-8:019:48:106
193881099129,2cyclictest2083836-21kworker/u16:2+flush-8:017:08:046
1938810991211,1cyclictest0-21swapper/616:09:536
1938810991210,2cyclictest2326393-21kworker/u16:1+flush-8:018:52:596
193880499120,1cyclictest0-21swapper/516:14:025
193881399118,2cyclictest4175659-21snmpd20:30:477
193881399118,2cyclictest4175659-21snmpd17:22:487
193881399118,2cyclictest4175659-21snmpd17:22:487
193881399118,2cyclictest0-21swapper/716:02:447
193881399116,4cyclictest921-21dbus-daemon15:57:437
193881399116,4cyclictest921-21dbus-daemon15:57:437
193881399110,10cyclictest2315500-21ntpq18:23:097
193881399110,10cyclictest0-21swapper/717:18:107
193881399110,10cyclictest0-21swapper/717:18:107
193881099119,2cyclictest2499758-21kworker/u16:2+flush-8:020:23:036
193881099119,2cyclictest2215312-21kworker/u16:0+flush-8:018:33:096
193881099119,2cyclictest2185478-21kworker/u16:3+flush-8:017:23:016
193881099119,2cyclictest2185478-21kworker/u16:3+flush-8:017:23:016
193881099118,2cyclictest2326393-21kworker/u16:1+flush-8:018:47:576
1938810991110,1cyclictest0-21swapper/620:17:236
1938810991110,1cyclictest0-21swapper/615:56:576
1938810991110,1cyclictest0-21swapper/615:56:576
193881099110,11cyclictest0-21swapper/619:33:336
193881099110,11cyclictest0-21swapper/617:34:326
193881099110,0cyclictest0-21swapper/616:30:046
1938804991110,1cyclictest0-21swapper/516:18:555
193881399107,2cyclictest4175659-21snmpd20:43:067
193881399107,2cyclictest0-21swapper/716:37:447
193881399107,2cyclictest0-21swapper/716:37:447
193881399106,3cyclictest27924-21gmain16:58:057
193881399103,6cyclictest0-21swapper/716:15:397
193881399100,9cyclictest4175659-21snmpd17:40:407
193881399100,9cyclictest0-21swapper/717:33:007
193881099109,1cyclictest0-21swapper/618:38:136
193881099109,1cyclictest0-21swapper/617:18:276
193881099109,1cyclictest0-21swapper/617:18:276
193881099109,1cyclictest0-21swapper/616:23:366
193881099100,10cyclictest0-21swapper/619:28:406
193880499108,2cyclictest2255085-21kworker/u16:2+flush-8:018:13:045
19388109997,2cyclictest2499758-21kworker/u16:2+events_unbound20:28:096
19388109987,1cyclictest0-21swapper/617:52:216
19388109987,1cyclictest0-21swapper/617:45:536
19388109986,1cyclictest0-21swapper/618:42:556
19388109984,3cyclictest2115524-21cat16:47:586
19388109983,4cyclictest2105896-21irqstats16:43:006
19388109983,4cyclictest2045422-21cut16:13:006
19388109975,2cyclictest2499758-21kworker/u16:2+flush-8:020:07:596
19388109975,1cyclictest0-21swapper/619:52:566
19388109975,1cyclictest0-21swapper/616:02:586
19388109973,3cyclictest2016422-21cut15:58:006
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional