You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 18:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Nov 21, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
359980825848,7sleep50-21swapper/515:20:595
37039912560,1sleep40-21swapper/416:08:574
359984925319,30sleep70-21swapper/715:21:337
359972025342,8sleep40-21swapper/415:19:464
3600349995149,2cyclictest3816753-21kworker/u16:3+events_unbound17:38:356
3600349994341,2cyclictest4038485-21kworker/u16:1+flush-8:019:13:306
3600349994340,2cyclictest4058958-21kworker/u16:2+events_unbound19:19:086
3600349994139,2cyclictest3956731-21kworker/u16:2+flush-8:018:23:356
3600349994037,3cyclictest4078191-21kworker/u16:0+events_unbound19:30:126
3600349994037,3cyclictest4078191-21kworker/u16:0+events_unbound19:30:126
3600340994038,2cyclictest3897058-21kworker/u16:0+events_unbound18:52:064
359979124030,7sleep60-21swapper/615:20:446
3600340993937,2cyclictest4009248-21kworker/u16:4+events_unbound19:07:074
360035399380,36cyclictest589235-21systemd-journal18:03:357
360035399380,36cyclictest589235-21systemd-journal18:03:357
3600340993836,2cyclictest4165774-21kworker/u16:3+events_unbound20:28:074
3600340993836,2cyclictest4009248-21kworker/u16:4+events_unbound19:02:064
3600340993836,2cyclictest3785012-21kworker/u16:5+flush-8:016:52:504
3600340993735,2cyclictest4078191-21kworker/u16:0+events_unbound19:47:084
3600340993734,2cyclictest3755338-21kworker/u16:2+flush-8:017:13:594
3600340993734,2cyclictest3755338-21kworker/u16:2+flush-8:017:13:594
3600353993631,4cyclictest589235-21systemd-journal16:17:077
3600353993631,4cyclictest3745506-21latency_hist16:33:357
3600353993631,4cyclictest3745506-21latency_hist16:33:357
3600349993634,2cyclictest4078191-21kworker/u16:0+flush-8:019:44:036
3600353993533,1cyclictest0-21swapper/718:53:507
3600340993533,2cyclictest4165774-21kworker/u16:3+events_unbound20:48:074
3600340993533,2cyclictest4038485-21kworker/u16:1+events_unbound19:28:344
3600340993533,2cyclictest3847098-21kworker/u16:5+events_unbound18:30:364
3600344993432,2cyclictest3847098-21kworker/u16:5+events_unbound18:38:585
3600340993432,2cyclictest4165774-21kworker/u16:3+flush-8:020:10:074
3600340993432,2cyclictest3634314-21kworker/u16:2+events_unbound16:20:074
3600340993432,2cyclictest3543788-21kworker/u16:0+events_unbound15:54:114
3600340993431,2cyclictest4078191-21kworker/u16:0+flush-8:020:38:374
3600353993328,4cyclictest4069087-21latency_hist19:13:357
360035399330,31cyclictest4160236-21latency_hist19:58:357
3600349993331,2cyclictest3847098-21kworker/u16:5+flush-8:017:28:306
3600349993331,2cyclictest3755338-21kworker/u16:2+flush-8:017:13:586
3600349993331,2cyclictest3755338-21kworker/u16:2+flush-8:017:13:586
3600349993230,2cyclictest3634314-21kworker/u16:2+flush-8:015:57:456
3600344993230,2cyclictest47532-21kworker/u16:4+flush-8:020:43:535
3600340993230,2cyclictest3543788-21kworker/u16:0+flush-8:015:34:104
3600353993130,0cyclictest0-21swapper/718:34:017
3600349993129,2cyclictest4038485-21kworker/u16:1+flush-8:019:07:376
3600340993129,2cyclictest4078191-21kworker/u16:0+flush-8:020:31:074
3600340993129,2cyclictest4038485-21kworker/u16:1+events_unbound19:43:084
3600340993129,2cyclictest3878768-21kworker/u16:2+events_unbound17:44:464
3600340993129,2cyclictest3876869-21kworker/u16:0+events_unbound17:35:084
3600340993129,2cyclictest3785899-21kworker/u16:6+flush-8:016:55:434
3600340993129,2cyclictest3609312-21kworker/u16:2+events_unbound15:24:114
3600340993129,2cyclictest3543788-21kworker/u16:0+flush-8:015:52:464
3600340993129,2cyclictest3543788-21kworker/u16:0+events_unbound17:11:414
3600340993128,2cyclictest3684856-21kworker/u16:3+events_unbound16:13:504
3600349993028,2cyclictest3816753-21kworker/u16:3+events_unbound17:23:306
3600349993027,2cyclictest3609312-21kworker/u16:2+flush-8:015:28:516
3600344993028,2cyclictest3956731-21kworker/u16:2+flush-8:018:19:065
3600344993027,2cyclictest3634314-21kworker/u16:2+flush-8:016:22:465
3600340993028,2cyclictest3847098-21kworker/u16:5+events_unbound18:40:264
3600340993028,2cyclictest3735791-21kworker/u16:1+flush-8:016:34:104
360035399290,27cyclictest3806242-21latency_hist17:03:357
3600349992927,2cyclictest3847098-21kworker/u16:5+flush-8:018:43:296
3600344992927,2cyclictest4099268-21kworker/u16:4+events_unbound19:38:585
3600340992927,2cyclictest4190501-21kworker/u16:1+events_unbound20:14:034
3600340992927,2cyclictest4190501-21kworker/u16:1+events_unbound20:14:034
3600340992927,2cyclictest4165774-21kworker/u16:3+events_unbound19:59:494
3600340992927,2cyclictest4038485-21kworker/u16:1+flush-8:019:58:254
3600340992927,2cyclictest4038485-21kworker/u16:1+events_unbound18:58:094
3600340992927,2cyclictest3917470-21kworker/u16:1+events_unbound18:10:464
3600340992927,2cyclictest3897058-21kworker/u16:0+events_unbound18:26:064
3600340992927,2cyclictest3816753-21kworker/u16:3+events_unbound17:29:104
3600340992927,2cyclictest3816753-21kworker/u16:3+events_unbound17:26:474
3600340992927,2cyclictest3796526-21kworker/u16:1+events_unbound17:07:094
3600340992927,2cyclictest3763086-21kworker/u16:4+events_unbound16:45:184
3600340992926,2cyclictest4165774-21kworker/u16:3+flush-8:020:20:094
3600340992926,2cyclictest4058958-21kworker/u16:2+events_unbound19:18:384
3600353992827,0cyclictest0-21swapper/717:13:507
3600353992827,0cyclictest0-21swapper/717:13:507
3600349992826,2cyclictest4190501-21kworker/u16:1+events_unbound20:38:306
3600344992825,2cyclictest3897058-21kworker/u16:0+events_unbound18:23:495
3600344992825,2cyclictest3634314-21kworker/u16:2+events_unbound16:03:505
3600340992826,2cyclictest4099268-21kworker/u16:4+events_unbound19:51:584
3600340992826,2cyclictest4038485-21kworker/u16:1+events_unbound20:05:254
3600340992826,2cyclictest3816753-21kworker/u16:3+flush-8:017:23:334
3600340992826,2cyclictest3763086-21kworker/u16:4+flush-8:016:41:234
3600340992826,2cyclictest3568923-21kworker/u16:3+events_unbound15:41:024
3600340992826,2cyclictest3543788-21kworker/u16:0+flush-8:015:44:104
3600340992826,2cyclictest3543788-21kworker/u16:0+flush-8:015:44:104
3600340992825,3cyclictest4099268-21kworker/u16:4+events_unbound19:30:004
3600340992825,3cyclictest4099268-21kworker/u16:4+events_unbound19:30:004
3600353992726,0cyclictest0-21swapper/717:53:537
3600353992725,1cyclictest0-21swapper/718:28:537
3600349992725,2cyclictest3543788-21kworker/u16:0+flush-8:016:07:456
3600349992725,2cyclictest3543788-21kworker/u16:0+events_unbound16:13:076
3600344992724,2cyclictest3816753-21kworker/u16:3+flush-8:017:30:385
3600344992724,2cyclictest3755338-21kworker/u16:2+events_unbound17:13:485
3600344992724,2cyclictest3755338-21kworker/u16:2+events_unbound17:13:485
3600340992725,2cyclictest4165774-21kworker/u16:3+events_unbound20:49:074
3600340992725,2cyclictest4058958-21kworker/u16:2+flush-8:019:09:184
3600340992725,2cyclictest37826-21kworker/u16:2+events_unbound20:34:574
3600353992625,0cyclictest0-21swapper/719:48:597
3600353992625,0cyclictest0-21swapper/719:23:507
3600353992620,5cyclictest3664699-21latency_hist15:53:357
3600349992623,2cyclictest3956731-21kworker/u16:2+events_unbound18:28:376
3600349992623,2cyclictest3897058-21kworker/u16:0+flush-8:018:25:376
3600340992624,2cyclictest4099268-21kworker/u16:4+events_unbound19:36:494
3600340992624,2cyclictest3684856-21kworker/u16:3+flush-8:016:28:074
3600340992624,2cyclictest3624041-21kworker/u16:1+flush-8:015:59:384
3600353992520,4cyclictest67736-21latency_hist20:48:347
3600349992522,2cyclictest3568923-21kworker/u16:3+events_unbound15:38:496
3600340992523,2cyclictest3987906-21kworker/u16:1+flush-8:018:37:504
3600340992523,2cyclictest3897058-21kworker/u16:0+events_unbound18:07:094
360035399240,22cyclictest3937740-21latency_hist18:08:357
3600349992422,2cyclictest4129808-21kworker/u16:2+flush-8:020:08:496
3600344992422,2cyclictest3624041-21kworker/u16:1+flush-8:015:49:015
3600344992422,2cyclictest3543788-21kworker/u16:0+flush-8:016:11:355
3600344992420,3cyclictest4190501-21kworker/u16:1+flush-8:020:14:045
3600344992420,3cyclictest4190501-21kworker/u16:1+flush-8:020:14:045
3600340992422,2cyclictest3897058-21kworker/u16:0+flush-8:018:23:254
3600340992422,2cyclictest3878768-21kworker/u16:2+events_unbound17:52:104
3600340992422,2cyclictest3785899-21kworker/u16:6+events_unbound17:01:094
3600340992421,2cyclictest3897058-21kworker/u16:0+events_unbound18:43:454
3600340992421,2cyclictest3897058-21kworker/u16:0+events_unbound18:43:454
3600353992318,4cyclictest4028615-21latency_hist18:53:357
3600353992317,5cyclictest3775803-21latency_hist16:48:357
3600353992317,4cyclictest589235-21systemd-journal19:17:077
3600349992321,2cyclictest4165774-21kworker/u16:3+events_unbound20:06:066
3600349992320,2cyclictest3543788-21kworker/u16:0+flush-8:015:44:026
3600349992320,2cyclictest3543788-21kworker/u16:0+flush-8:015:44:026
3600344992321,2cyclictest37826-21kworker/u16:2+flush-8:020:33:505
3600344992320,2cyclictest3897058-21kworker/u16:0+events_unbound18:43:535
3600344992320,2cyclictest3897058-21kworker/u16:0+events_unbound18:43:535
3600353992221,0cyclictest0-21swapper/719:28:487
3600353992221,0cyclictest0-21swapper/719:28:487
3600353992217,3cyclictest589235-21systemd-journal17:37:587
3600349992220,2cyclictest3847098-21kworker/u16:5+events_unbound17:48:376
3600349992219,2cyclictest3987906-21kworker/u16:1+flush-8:018:34:376
3600349992219,2cyclictest3796526-21kworker/u16:1+flush-8:017:43:476
3600340992220,2cyclictest3847098-21kworker/u16:5+events_unbound17:38:564
3600340992220,2cyclictest3624041-21kworker/u16:1+events_unbound15:32:224
3600340992220,2cyclictest3543788-21kworker/u16:0+flush-8:016:06:544
3600349992119,2cyclictest4165774-21kworker/u16:3+events_unbound20:48:526
3600349992119,2cyclictest3785899-21kworker/u16:6+flush-8:017:05:386
3600344992119,2cyclictest3735791-21kworker/u16:1+events_unbound16:34:035
3600344992117,3cyclictest3897058-21kworker/u16:0+flush-8:017:54:055
3600340992119,2cyclictest3897058-21kworker/u16:0+events_unbound17:57:054
3600340992119,2cyclictest3847098-21kworker/u16:5+events_unbound18:16:264
3600353992019,0cyclictest0-21swapper/715:58:477
3600353992014,5cyclictest589235-21systemd-journal16:58:357
3600349992018,2cyclictest4165774-21kworker/u16:3+events_unbound20:03:026
3600349992018,2cyclictest4099268-21kworker/u16:4+events_unbound19:33:596
3600349992018,2cyclictest3917470-21kworker/u16:1+events_unbound18:01:466
3600349992018,2cyclictest3917470-21kworker/u16:1+events_unbound18:01:466
3600353991918,0cyclictest0-21swapper/720:23:507
3600349991917,2cyclictest47532-21kworker/u16:4+events_unbound20:43:276
3600349991917,2cyclictest3897058-21kworker/u16:0+flush-8:018:54:006
3600349991917,2cyclictest3634314-21kworker/u16:2+flush-8:016:03:136
3600349991917,2cyclictest2920663-21kworker/u16:1+events_unbound15:23:506
3600349991916,2cyclictest3763086-21kworker/u16:4+flush-8:016:38:596
3600349991916,2cyclictest3624041-21kworker/u16:1+flush-8:015:48:506
3600344991917,2cyclictest3917470-21kworker/u16:1+events_unbound18:08:505
3600344991917,2cyclictest3684856-21kworker/u16:3+events_unbound16:14:055
3600344991916,2cyclictest4058958-21kworker/u16:2+events_unbound19:08:505
3600353991817,0cyclictest0-21swapper/718:08:557
3600349991816,2cyclictest4190501-21kworker/u16:1+events_unbound20:14:016
3600349991816,2cyclictest4190501-21kworker/u16:1+events_unbound20:14:016
3600349991816,2cyclictest3816753-21kworker/u16:3+events_unbound17:33:306
3600349991816,2cyclictest3684856-21kworker/u16:3+flush-8:016:28:576
3600349991816,2cyclictest3684856-21kworker/u16:3+flush-8:016:28:576
3600349991815,2cyclictest3897058-21kworker/u16:0+flush-8:018:48:516
3600349991815,2cyclictest3634314-21kworker/u16:2+flush-8:016:23:516
3600344991816,2cyclictest4099268-21kworker/u16:4+events_unbound19:54:035
3600344991816,2cyclictest4038485-21kworker/u16:1+flush-8:019:23:595
3600344991816,2cyclictest3755338-21kworker/u16:2+flush-8:017:09:035
3600344991815,3cyclictest4078191-21kworker/u16:0+flush-8:019:14:065
3600344991815,2cyclictest3897058-21kworker/u16:0+flush-8:018:48:595
3600340991816,2cyclictest4078191-21kworker/u16:0+flush-8:019:15:104
3600340991816,2cyclictest3735791-21kworker/u16:1+events_unbound16:30:174
3600340991816,2cyclictest3735791-21kworker/u16:1+events_unbound16:30:174
579272170,0sleep757925-21cat20:43:357
3600353991716,0cyclictest0-21swapper/720:03:597
3600353991716,0cyclictest0-21swapper/718:58:537
3600353991716,0cyclictest0-21swapper/717:39:027
3600353991716,0cyclictest0-21swapper/716:04:077
3600353991715,1cyclictest0-21swapper/719:03:577
3600353991714,2cyclictest3644569-21cat15:43:357
3600353991712,4cyclictest3978081-21latency_hist18:28:357
360035399170,1cyclictest0-21swapper/717:28:577
3600349991715,2cyclictest4009248-21kworker/u16:4+events_unbound18:58:526
3600344991715,2cyclictest4165774-21kworker/u16:3+flush-8:020:48:585
3600344991715,2cyclictest3543788-21kworker/u16:0+flush-8:016:48:595
3600344991714,2cyclictest4129808-21kworker/u16:2+flush-8:020:08:505
3600353991613,2cyclictest4175659-21snmpd18:38:387
3600349991614,2cyclictest6166-21kworker/u16:4+flush-8:020:25:366
3600349991614,2cyclictest3816753-21kworker/u16:3+flush-8:017:08:536
3600349991614,2cyclictest3684856-21kworker/u16:3+events_unbound16:18:576
3600349991613,2cyclictest3878768-21kworker/u16:2+events_unbound17:53:556
3600344991614,2cyclictest3897058-21kworker/u16:0+events_unbound18:28:505
3600340991614,2cyclictest3897058-21kworker/u16:0+events_unbound17:59:434
3600340991614,2cyclictest3897058-21kworker/u16:0+events_unbound17:59:434
3600353991514,0cyclictest0-21swapper/716:18:457
3600353991512,2cyclictest0-21swapper/719:18:587
3600353991510,4cyclictest3610276-21latency_hist15:28:367
360035399150,14cyclictest0-21swapper/716:48:597
360035399150,14cyclictest0-21swapper/716:39:047
360035399150,14cyclictest0-21swapper/716:23:587
360035399149,4cyclictest27763-21gvfs-afc-volume17:24:007
360035399148,5cyclictest4190540-21latency_hist20:13:347
360035399147,6cyclictest27924-21gmain18:19:017
3600353991410,3cyclictest96-21ksoftirqd/719:34:047
3600349991411,3cyclictest3897058-21kworker/u16:0+flush-8:018:44:006
3600349991411,3cyclictest3897058-21kworker/u16:0+flush-8:018:44:006
3600344991413,1cyclictest0-21swapper/520:26:465
3600344991413,1cyclictest0-21swapper/516:01:365
3600344991412,2cyclictest3796526-21kworker/u16:1+flush-8:017:33:585
360034499140,14cyclictest0-21swapper/519:44:025
360034499140,14cyclictest0-21swapper/516:44:385
360035399139,3cyclictest4175659-21snmpd20:19:587
360035399138,4cyclictest948-21NetworkManager15:34:037
360035399130,4cyclictest4168295-21kthreadcore19:58:577
360035399130,1cyclictest0-21swapper/720:34:007
360035399130,11cyclictest4138066-21tr19:43:557
360035399130,11cyclictest3700138-21cut16:08:537
3600349991312,1cyclictest0-21swapper/620:23:216
3600349991311,2cyclictest3956731-21kworker/u16:2+flush-8:018:15:426
3600349991311,2cyclictest3735791-21kworker/u16:1+flush-8:016:34:056
3600349991311,2cyclictest3543788-21kworker/u16:0+events_unbound15:33:566
3600344991312,1cyclictest0-21swapper/519:34:355
3600344991312,1cyclictest0-21swapper/519:03:505
3600344991312,1cyclictest0-21swapper/518:17:105
3600344991312,1cyclictest0-21swapper/516:30:275
3600344991312,1cyclictest0-21swapper/516:30:275
3600344991312,1cyclictest0-21swapper/515:40:385
3600344991311,2cyclictest3987906-21kworker/u16:1+flush-8:018:34:025
3600344991311,1cyclictest0-21swapper/517:38:525
360034499130,1cyclictest0-21swapper/517:28:285
360034499130,13cyclictest0-21swapper/519:53:205
360035399128,3cyclictest984960-21gvfsd-wsdd19:38:487
360035399127,4cyclictest984960-21gvfsd-wsdd20:49:037
360035399127,4cyclictest589235-21systemd-journal20:14:067
360035399127,4cyclictest589235-21systemd-journal20:14:067
360035399126,5cyclictest27174-21gnome-shell17:52:347
360035399125,6cyclictest0-21swapper/720:31:067
3600353991211,0cyclictest0-21swapper/716:34:467
360034999129,3cyclictest4038485-21kworker/u16:1+flush-8:019:14:016
360034999129,2cyclictest3755338-21kworker/u16:2+flush-8:016:46:136
3600349991210,2cyclictest4099268-21kworker/u16:4+events_unbound19:28:296
360034499129,2cyclictest4165774-21kworker/u16:3+flush-8:020:18:545
3600344991211,1cyclictest0-21swapper/518:58:195
3600344991211,1cyclictest0-21swapper/517:52:255
3600344991211,1cyclictest0-21swapper/517:04:305
3600344991211,1cyclictest0-21swapper/515:34:205
360034499120,12cyclictest0-21swapper/520:41:355
360035399118,2cyclictest4175659-21snmpd18:17:287
360035399118,2cyclictest4175659-21snmpd17:12:367
360035399118,2cyclictest4175659-21snmpd15:29:047
360035399117,3cyclictest948-21NetworkManager17:22:457
360035399114,6cyclictest27763-21gvfs-afc-volume17:43:587
360035399110,9cyclictest3665097-21/usr/sbin/munin15:53:577
360034999119,2cyclictest3763086-21kworker/u16:4+flush-8:016:49:046
360034999118,2cyclictest3917470-21kworker/u16:1+events_unbound18:08:486
3600349991110,1cyclictest0-21swapper/619:52:466
3600349991110,1cyclictest0-21swapper/616:15:416
360034999110,11cyclictest0-21swapper/620:44:566
360034999110,11cyclictest0-21swapper/616:54:286
360034499116,4cyclictest3928813-21cat18:03:505
3600344991110,1cyclictest0-21swapper/520:29:075
360034499110,0cyclictest0-21swapper/520:01:045
360035399107,2cyclictest4175659-21snmpd15:48:357
360035399107,2cyclictest4175659-21snmpd15:48:357
360035399106,4cyclictest27763-21gvfs-afc-volume18:43:517
360035399106,4cyclictest27763-21gvfs-afc-volume18:43:517
360035399104,4cyclictest3813410-21cut17:03:567
360034499108,2cyclictest4009248-21kworker/u16:4+events_unbound18:58:505
360034499106,3cyclictest3798288-21fwupd19:30:005
360034499106,3cyclictest3798288-21fwupd19:30:005
360034499106,3cyclictest3797312-21cat16:58:515
36003499998,1cyclictest0-21swapper/619:38:536
36003499997,2cyclictest4078191-21kworker/u16:0+events_unbound19:58:076
36003499996,2cyclictest0-21swapper/620:28:476
36003449998,1cyclictest0-21swapper/515:43:475
36003449998,1cyclictest0-21swapper/515:43:475
36003449996,2cyclictest0-21swapper/515:53:565
36003449994,4cyclictest589260-21gdbus16:28:355
36003499986,2cyclictest3785899-21kworker/u16:6+events_unbound16:58:586
36003499985,2cyclictest3847098-21kworker/u16:5+flush-8:018:04:036
36003449983,4cyclictest3922403-21grep17:58:535
36003449983,4cyclictest3922403-21grep17:58:535
36003449983,4cyclictest3893575-21tr17:43:545
36003449983,4cyclictest3842884-21grep17:18:595
36003449983,4cyclictest3610772-21nfs4_client15:28:375
36003499975,1cyclictest0-21swapper/617:38:496
36003449973,3cyclictest4171014-21cat20:03:475
36003449972,4cyclictest4080527-21sed19:18:525
36003449972,4cyclictest3786999-21grep16:53:505
36003449972,4cyclictest3756136-21expr16:38:475
36003449972,4cyclictest3601398-21tr15:23:535
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional