You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 00:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Tue Jul 15, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9437321390,1sleep794372-21ntpq20:42:387
363726299400,38cyclictest4144731-21latency_hist19:37:127
3637261994038,2cyclictest3580020-21kworker/u16:1+flush-8:015:41:216
3637258993735,2cyclictest3580020-21kworker/u16:1+flush-8:015:39:495
363726299350,33cyclictest3877468-21latency_hist17:27:137
363726299340,33cyclictest27326-21gnome-software15:38:367
3637256993330,2cyclictest3847014-21kworker/u16:2+events_unbound17:32:154
3637258993230,2cyclictest3928630-21kworker/u16:2+flush-8:018:42:435
363726299310,25cyclictest3939220-21latency_hist17:57:127
3637258993129,2cyclictest4083167-21kworker/u16:4+events_unbound20:14:235
3637256993028,2cyclictest53923-21kworker/u16:2+events_unbound20:40:234
3637256993028,2cyclictest4083167-21kworker/u16:4+events_unbound20:15:514
3637256993028,2cyclictest3626536-21kworker/u16:0+events_unbound16:20:494
3637258992927,2cyclictest3846674-21kworker/u16:1+flush-8:017:23:145
3637258992927,2cyclictest3626536-21kworker/u16:0+events_unbound15:44:245
3637256992927,2cyclictest4083167-21kworker/u16:4+events_unbound19:28:494
3637256992927,2cyclictest3928630-21kworker/u16:2+events_unbound18:55:484
3637256992927,2cyclictest3836346-21kworker/u16:0+events_unbound17:09:434
3637256992927,2cyclictest3743934-21kworker/u16:3+events_unbound16:34:324
3637256992926,2cyclictest3846674-21kworker/u16:1+events_unbound17:12:234
37885472280,1chrt0-21swapper/716:42:337
363726299280,26cyclictest0-21swapper/717:02:387
3637258992826,2cyclictest3928630-21kworker/u16:2+events_unbound19:27:125
3637256992826,2cyclictest4103237-21kworker/u16:3+events_unbound19:20:134
3637256992826,2cyclictest3928630-21kworker/u16:2+events_unbound18:05:154
3637256992826,2cyclictest3910340-21kworker/u16:0+events_unbound18:15:244
3637256992826,2cyclictest3910340-21kworker/u16:0+events_unbound18:15:244
3637256992826,2cyclictest3743934-21kworker/u16:3+events_unbound16:41:244
3637256992826,2cyclictest3743934-21kworker/u16:3+events_unbound16:41:244
41235542270,0chrt4123542-21timerwakeupswit19:22:417
3637261992725,2cyclictest4124149-21kworker/u16:1+events_unbound20:30:566
3637261992725,2cyclictest3910340-21kworker/u16:0+events_unbound17:44:006
3637261992725,2cyclictest3703331-21kworker/u16:1+events_unbound16:08:276
3637256992725,2cyclictest53923-21kworker/u16:2+events_unbound20:27:414
3637256992725,2cyclictest4124149-21kworker/u16:1+flush-8:021:00:394
3637256992725,2cyclictest4124149-21kworker/u16:1+events_unbound19:43:234
3637256992725,2cyclictest3959818-21kworker/u16:4+events_unbound18:21:444
3637256992725,2cyclictest3928630-21kworker/u16:2+events_unbound18:30:164
3637256992725,2cyclictest3846674-21kworker/u16:1+flush-8:017:52:234
3637256992725,2cyclictest3804406-21kworker/u16:4+events_unbound16:55:234
3637256992725,2cyclictest3703331-21kworker/u16:1+flush-8:016:07:424
3637256992725,2cyclictest3626536-21kworker/u16:0+events_unbound16:14:524
3637262992624,1cyclictest3815776-21munin-run16:57:137
3637262992623,2cyclictest3743770-21awk16:22:137
3637261992624,2cyclictest53923-21kworker/u16:2+events_unbound20:49:226
3637261992624,2cyclictest2905539-21kworker/u16:6+events_unbound15:44:526
3637258992624,2cyclictest3939005-21kworker/u16:3+events_unbound18:22:365
3637258992623,2cyclictest3910340-21kworker/u16:0+events_unbound18:20:125
3637256992624,2cyclictest4011327-21kworker/u16:3+events_unbound19:03:134
3637256992624,2cyclictest3928630-21kworker/u16:2+flush-8:018:00:164
3637256992624,2cyclictest3626536-21kworker/u16:0+events_unbound16:28:234
3637256992624,2cyclictest2918937-21kworker/u16:2+flush-8:015:39:144
3637261992523,2cyclictest42999-21kworker/u16:5+events_unbound20:32:226
3637261992523,2cyclictest42999-21kworker/u16:5+events_unbound20:32:226
3637261992523,2cyclictest4123804-21kworker/u16:0+events_unbound19:25:076
3637261992523,2cyclictest4083167-21kworker/u16:4+events_unbound19:28:596
3637261992523,2cyclictest4052207-21kworker/u16:0+events_unbound19:08:286
3637261992523,2cyclictest4011327-21kworker/u16:3+events_unbound19:03:276
3637261992523,2cyclictest3910340-21kworker/u16:0+events_unbound17:56:356
3637261992523,2cyclictest3846674-21kworker/u16:1+flush-8:017:17:246
3637261992523,2cyclictest3804406-21kworker/u16:4+events_unbound17:24:046
3637258992523,2cyclictest4124149-21kworker/u16:1+events_unbound21:00:235
3637258992523,2cyclictest3743934-21kworker/u16:3+events_unbound16:42:135
3637258992523,2cyclictest3743934-21kworker/u16:3+events_unbound16:42:135
3637258992522,2cyclictest3626536-21kworker/u16:0+events_unbound16:22:275
3637256992522,2cyclictest4124149-21kworker/u16:1+events_unbound20:07:134
371263922422,1sleep70-21swapper/716:04:207
363726299240,22cyclictest643-21systemd-journal15:46:567
3637261992422,2cyclictest53923-21kworker/u16:2+events_unbound20:40:036
3637261992422,2cyclictest42999-21kworker/u16:5+events_unbound20:18:556
3637261992422,2cyclictest4083167-21kworker/u16:4+flush-8:020:13:156
3637261992422,2cyclictest3999848-21kworker/u16:1+events_unbound18:28:286
3637261992422,2cyclictest3928630-21kworker/u16:2+events_unbound19:51:046
3637261992422,2cyclictest3928630-21kworker/u16:2+events_unbound19:14:436
3637261992422,2cyclictest3928630-21kworker/u16:2+events_unbound18:53:436
3637261992422,2cyclictest3928630-21kworker/u16:2+events_unbound17:58:286
3637261992422,2cyclictest3910340-21kworker/u16:0+events_unbound17:51:406
3637261992422,2cyclictest3846674-21kworker/u16:1+flush-8:017:30:036
3637261992422,2cyclictest3836346-21kworker/u16:0+events_unbound17:16:336
3637261992422,2cyclictest3762476-21kworker/u16:5+events_unbound16:44:126
3637261992422,2cyclictest3703331-21kworker/u16:1+events_unbound16:03:376
3637258992422,2cyclictest2905539-21kworker/u16:6+events_unbound15:48:565
3637258992421,2cyclictest3703331-21kworker/u16:1+flush-8:016:12:305
3637258992421,2cyclictest2918937-21kworker/u16:2+events_unbound15:52:155
3637258992421,2cyclictest2918937-21kworker/u16:2+events_unbound15:52:155
3637256992422,2cyclictest53923-21kworker/u16:2+events_unbound20:43:234
3637256992422,2cyclictest42999-21kworker/u16:5+flush-8:020:35:234
3637256992422,2cyclictest42999-21kworker/u16:5+flush-8:020:35:234
3637256992422,2cyclictest4123804-21kworker/u16:0+events_unbound19:24:514
3637256992422,2cyclictest3804406-21kworker/u16:4+events_unbound16:49:434
3637256992422,2cyclictest3692102-21kworker/u16:3+flush-8:015:54:504
3637256992422,2cyclictest3692102-21kworker/u16:3+flush-8:015:54:504
3637256992422,2cyclictest3626536-21kworker/u16:0+events_unbound16:05:484
3637256992422,2cyclictest22306-21kworker/u16:3+events_unbound20:08:204
3637256992421,2cyclictest4063175-21kworker/u16:1+events_unbound19:12:034
3637261992321,2cyclictest4124149-21kworker/u16:1+events_unbound20:04:396
3637261992321,2cyclictest4124149-21kworker/u16:1+events_unbound19:35:076
3637261992321,2cyclictest4010936-21kworker/u16:0+events_unbound18:33:176
3637261992321,2cyclictest3928630-21kworker/u16:2+events_unbound18:02:276
3637261992321,2cyclictest3867161-21kworker/u16:3+events_unbound17:41:286
3637261992321,2cyclictest3804406-21kworker/u16:4+events_unbound17:10:006
3637261992321,2cyclictest3804406-21kworker/u16:4+events_unbound16:54:206
3637261992321,2cyclictest3681750-21kworker/u16:1+events_unbound15:50:006
3637261992321,2cyclictest3626536-21kworker/u16:0+events_unbound16:29:256
3637261992321,2cyclictest3626536-21kworker/u16:0+events_unbound16:16:166
3637261992321,2cyclictest2918937-21kworker/u16:2+events_unbound16:22:006
3637261992320,2cyclictest3743934-21kworker/u16:3+events_unbound16:57:206
3637258992320,2cyclictest73104-21kworker/u16:0+events_unbound20:42:265
3637256992321,2cyclictest3928630-21kworker/u16:2+events_unbound18:51:124
3637256992321,2cyclictest3692102-21kworker/u16:3+events_unbound15:58:234
3637256992321,2cyclictest33783-21kworker/u16:0+events_unbound20:19:484
3637256992320,2cyclictest3999848-21kworker/u16:1+events_unbound18:32:284
3637256992320,2cyclictest3847014-21kworker/u16:2+flush-8:017:42:004
363726299220,20cyclictest4032372-21exim418:42:147
363726299220,20cyclictest3764336-21latency_hist16:32:137
3637261992220,2cyclictest42999-21kworker/u16:5+events_unbound20:26:366
3637261992220,2cyclictest4139471-21kworker/u16:3+events_unbound19:39:076
3637261992220,2cyclictest4124149-21kworker/u16:1+flush-8:020:44:476
3637261992220,2cyclictest3928630-21kworker/u16:2+events_unbound19:02:096
3637261992220,2cyclictest3928630-21kworker/u16:2+events_unbound19:02:096
3637261992220,2cyclictest3910340-21kworker/u16:0+flush-8:018:14:366
3637261992220,2cyclictest3910340-21kworker/u16:0+flush-8:018:14:366
3637261992220,2cyclictest3910340-21kworker/u16:0+flush-8:018:07:156
3637261992220,2cyclictest3910340-21kworker/u16:0+events_unbound18:21:596
3637261992220,2cyclictest3836346-21kworker/u16:0+flush-8:017:07:136
3637261992220,2cyclictest3762476-21kworker/u16:5+events_unbound16:39:086
3637261992220,2cyclictest3762476-21kworker/u16:5+events_unbound16:39:086
3637261992220,2cyclictest3762476-21kworker/u16:5+events_unbound16:35:196
3637261992220,2cyclictest3743934-21kworker/u16:3+events_unbound16:25:356
3637261992220,2cyclictest2918937-21kworker/u16:2+events_unbound15:53:326
3637261992220,2cyclictest2918937-21kworker/u16:2+events_unbound15:53:326
3637258992220,2cyclictest4124149-21kworker/u16:1+events_unbound20:38:515
3637258992220,2cyclictest3928630-21kworker/u16:2+flush-8:019:32:335
3637258992220,2cyclictest3910340-21kworker/u16:0+events_unbound18:14:125
3637258992220,2cyclictest3910340-21kworker/u16:0+events_unbound18:14:125
3637258992220,2cyclictest3836346-21kworker/u16:0+events_unbound17:12:445
3637258992219,2cyclictest42999-21kworker/u16:5+flush-8:020:32:275
3637258992219,2cyclictest42999-21kworker/u16:5+flush-8:020:32:275
3637256992220,2cyclictest4174660-21kworker/u16:0+events_unbound19:55:124
3637256992220,2cyclictest3928630-21kworker/u16:2+flush-8:019:15:524
3637256992219,2cyclictest3847014-21kworker/u16:2+flush-8:017:28:074
3637261992119,2cyclictest4124149-21kworker/u16:1+flush-8:019:46:356
3637261992119,2cyclictest4083167-21kworker/u16:4+flush-8:019:57:126
3637261992119,2cyclictest4083167-21kworker/u16:4+events_unbound19:18:516
3637261992119,2cyclictest4030639-21kworker/u16:4+events_unbound18:40:276
3637261992119,2cyclictest3959818-21kworker/u16:4+events_unbound18:23:176
3637261992119,2cyclictest2905539-21kworker/u16:6+events_unbound15:33:556
3637261992119,2cyclictest2181-21kworker/u16:2+events_unbound20:11:516
3637258992119,2cyclictest42999-21kworker/u16:5+flush-8:020:27:075
3637258992119,2cyclictest4052207-21kworker/u16:0+flush-8:018:52:395
3637258992119,2cyclictest3626536-21kworker/u16:0+flush-8:016:32:075
3637256992119,2cyclictest4139471-21kworker/u16:3+flush-8:019:38:234
3637256992119,2cyclictest4030639-21kworker/u16:4+events_unbound18:40:174
3637256992119,2cyclictest3846674-21kworker/u16:1+events_unbound17:50:084
3637256992119,2cyclictest3743934-21kworker/u16:3+events_unbound17:06:124
3637256992118,2cyclictest33783-21kworker/u16:0+flush-8:020:22:374
363726299200,18cyclictest2399-21latency_hist20:02:137
3637261992018,2cyclictest4124149-21kworker/u16:1+flush-8:020:53:396
3637261992018,2cyclictest4124149-21kworker/u16:1+events_unbound19:58:366
3637261992018,2cyclictest3928630-21kworker/u16:2+flush-8:018:49:356
3637261992018,2cyclictest3692102-21kworker/u16:3+events_unbound16:00:516
3637258992018,2cyclictest4011327-21kworker/u16:3+events_unbound19:04:225
3637258992018,2cyclictest3867161-21kworker/u16:3+events_unbound17:47:435
3637258992017,2cyclictest4083167-21kworker/u16:4+flush-8:019:37:345
3637256992018,2cyclictest4124149-21kworker/u16:1+events_unbound19:59:484
3637256992018,2cyclictest3928630-21kworker/u16:2+flush-8:019:50:004
3637256992018,2cyclictest3928630-21kworker/u16:2+events_unbound19:00:254
3637256992018,2cyclictest3928630-21kworker/u16:2+events_unbound19:00:254
3637256992018,2cyclictest3910340-21kworker/u16:0+events_unbound18:09:484
3637256992017,2cyclictest3867161-21kworker/u16:3+flush-8:017:22:224
3637256992017,2cyclictest3743934-21kworker/u16:3+events_unbound16:26:214
3637261991917,2cyclictest3743934-21kworker/u16:3+flush-8:016:52:106
3637258991917,2cyclictest4052207-21kworker/u16:0+events_unbound19:07:375
3637258991917,2cyclictest3959818-21kworker/u16:4+flush-8:018:29:475
3637258991917,2cyclictest3928630-21kworker/u16:2+flush-8:017:52:335
3637258991917,2cyclictest3703331-21kworker/u16:1+events_unbound16:10:495
3637256991917,2cyclictest73104-21kworker/u16:0+events_unbound20:49:284
3637256991917,2cyclictest3626536-21kworker/u16:0+flush-8:015:46:484
3637261991816,2cyclictest4124149-21kworker/u16:1+events_unbound21:00:196
3637261991816,2cyclictest3999848-21kworker/u16:1+events_unbound18:46:176
3637258991816,2cyclictest4124149-21kworker/u16:1+flush-8:019:45:135
3637258991816,2cyclictest3847014-21kworker/u16:2+flush-8:017:17:345
3637258991816,2cyclictest3836346-21kworker/u16:0+flush-8:017:07:445
3637258991815,2cyclictest42999-21kworker/u16:5+events_unbound20:52:265
3637256991816,2cyclictest3959818-21kworker/u16:4+flush-8:018:23:234
3637256991816,2cyclictest3867161-21kworker/u16:3+events_unbound17:46:004
3637256991816,2cyclictest3743934-21kworker/u16:3+flush-8:017:01:444
3637256991816,2cyclictest3626536-21kworker/u16:0+events_unbound16:46:084
3637256991816,2cyclictest2905539-21kworker/u16:6+events_unbound15:36:294
363726299170,16cyclictest3723144-21latency_hist16:12:137
363726299170,15cyclictest4011839-21exim418:32:147
3637261991715,2cyclictest3847014-21kworker/u16:2+flush-8:017:34:556
3637258991715,2cyclictest73104-21kworker/u16:0+flush-8:020:47:335
3637258991715,2cyclictest3928630-21kworker/u16:2+events_unbound19:27:335
3637258991715,2cyclictest3910340-21kworker/u16:0+events_unbound17:57:415
3637256991715,2cyclictest3999848-21kworker/u16:1+flush-8:018:44:204
3637258991614,2cyclictest4174660-21kworker/u16:0+events_unbound19:56:235
3637258991614,2cyclictest4174660-21kworker/u16:0+events_unbound19:49:525
3637258991614,2cyclictest4030639-21kworker/u16:4+events_unbound18:37:455
3637256991614,2cyclictest3681750-21kworker/u16:1+flush-8:015:50:444
3637262991512,2cyclictest3733444-21munin-run16:17:137
3637262991512,2cyclictest12707-21munin-run20:07:127
363726299150,14cyclictest3856927-21latency_hist17:17:137
3637258991513,2cyclictest4011327-21kworker/u16:3+events_unbound18:50:235
3637258991513,2cyclictest3928630-21kworker/u16:2+flush-8:018:05:235
3637258991513,2cyclictest3846674-21kworker/u16:1+flush-8:017:27:435
3637256991513,2cyclictest4124149-21kworker/u16:1+events_unbound19:35:284
3637256991513,2cyclictest3836346-21kworker/u16:0+flush-8:017:18:134
363726299149,4cyclictest4082998-21basename19:07:127
3637262991411,2cyclictest4134435-21munin-run19:32:127
3637262991410,3cyclictest3647054-21idleruntime-cro15:37:127
363726299140,13cyclictest4011115-21turbostat18:32:137
363726299140,13cyclictest1313-21snmpd20:36:087
363726299140,13cyclictest1313-21snmpd20:36:087
3637258991412,2cyclictest4174660-21kworker/u16:0+flush-8:020:06:235
3637258991412,2cyclictest4124149-21kworker/u16:1+events_unbound20:29:485
3637258991412,2cyclictest4063175-21kworker/u16:1+flush-8:018:57:435
3637258991412,2cyclictest4063175-21kworker/u16:1+flush-8:018:57:435
3637258991412,2cyclictest3910340-21kworker/u16:0+events_unbound18:07:375
3637258991412,2cyclictest3846674-21kworker/u16:1+events_unbound17:34:245
3637258991411,2cyclictest3928630-21kworker/u16:2+events_unbound19:13:235
363725899140,1cyclictest0-21swapper/520:17:425
3637262991312,0cyclictest0-21swapper/717:00:247
3637262991310,2cyclictest105591-21munin-run20:52:127
363726299130,13cyclictest0-21swapper/721:00:107
363726299130,11cyclictest1313-21snmpd16:32:507
3637258991312,1cyclictest0-21swapper/516:02:285
3637258991311,2cyclictest3846674-21kworker/u16:1+events_unbound17:38:245
3637258991311,2cyclictest3743934-21kworker/u16:3+events_unbound16:42:375
3637258991311,2cyclictest3692102-21kworker/u16:3+events_unbound15:59:515
363725899130,1cyclictest0-21swapper/516:48:495
363726299129,2cyclictest4155093-21basename19:42:127
363726299128,3cyclictest27394-21gmain19:47:317
3637262991210,1cyclictest3846658-21awk17:12:127
363726299120,3cyclictest78557-21kthreadcore20:37:327
363726299120,2cyclictest3971108-21cat18:12:257
363726299120,2cyclictest3971108-21cat18:12:257
363726299120,11cyclictest1313-21snmpd18:56:177
363726299120,11cyclictest1313-21snmpd18:20:347
363726299120,10cyclictest3929448-21sed17:52:147
363726299120,10cyclictest1313-21snmpd20:30:117
363726299120,10cyclictest1313-21snmpd20:08:197
363726299120,10cyclictest0-21swapper/717:37:387
363725899129,2cyclictest3743934-21kworker/u16:3+events_unbound16:52:315
3637258991210,2cyclictest3626536-21kworker/u16:0+events_unbound15:32:295
3637258991210,2cyclictest2181-21kworker/u16:2+events_unbound20:08:515
363725899120,1cyclictest0-21swapper/517:45:435
363725699120,12cyclictest0-21swapper/420:53:244
363726299118,2cyclictest4103559-21munin-run19:17:127
363726299118,2cyclictest3682039-21awk15:52:137
363726299117,3cyclictest27763-21gvfs-afc-volume20:22:257
363726299115,5cyclictest27763-21gvfs-afc-volume19:17:437
363726299115,5cyclictest27763-21gvfs-afc-volume17:57:337
3637262991111,0cyclictest0-21swapper/720:56:047
3637262991110,0cyclictest0-21swapper/717:36:307
363726299110,9cyclictest0-21swapper/718:07:317
363726299110,1cyclictest0-21swapper/716:47:437
363726299110,1cyclictest0-21swapper/715:57:407
363726299110,10cyclictest1313-21snmpd20:13:437
363726299110,10cyclictest1313-21snmpd18:39:597
363726299110,10cyclictest1313-21snmpd17:18:337
363726299110,10cyclictest1313-21snmpd16:39:307
363726299110,10cyclictest1313-21snmpd16:39:307
363726299110,10cyclictest0-21swapper/717:27:347
363725899119,2cyclictest4124149-21kworker/u16:1+events_unbound19:59:525
363725899119,2cyclictest3816510-21kworker/u16:1+flush-8:016:57:445
363725899119,2cyclictest3743934-21kworker/u16:3+events_unbound17:02:375
363726299106,3cyclictest27642-21gmain17:42:277
363726299105,4cyclictest27763-21gvfs-afc-volume20:17:267
363726299100,9cyclictest1313-21snmpd18:49:267
363726299100,9cyclictest1313-21snmpd18:22:287
363726299100,9cyclictest1313-21snmpd18:03:197
363726299100,9cyclictest1313-21snmpd15:55:267
363726299100,9cyclictest1313-21snmpd15:55:267
363726299100,1cyclictest0-21swapper/718:57:347
363726299100,1cyclictest0-21swapper/718:57:347
363725899108,2cyclictest4083167-21kworker/u16:4+events_unbound19:19:525
36372629998,0cyclictest0-21swapper/716:22:247
36372629990,8cyclictest1313-21snmpd19:56:437
36372629990,8cyclictest1313-21snmpd19:42:427
36372629990,8cyclictest1313-21snmpd19:07:147
36372629990,7cyclictest3636562-21latency_hist15:32:147
36372589998,1cyclictest0-21swapper/516:17:365
36372589997,2cyclictest3743934-21kworker/u16:3+flush-8:016:32:435
36372589980,7cyclictest0-21swapper/518:32:285
36372619930,1cyclictest991rcuop/715:32:146
36372569930,2cyclictest21490-21in:imuxsock15:32:144
36372589920,1cyclictest0-21swapper/515:32:145
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional