You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 17:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Tue Nov 25, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4155303996155,5cyclictest4189370-21latency_hist15:38:197
415489125949,7sleep50-21swapper/515:22:275
415481725420,29sleep70-21swapper/715:21:257
415466225343,7sleep40-21swapper/415:19:134
4155293995047,2cyclictest4190511-21kworker/u16:3+flush-8:015:53:204
4155298994644,2cyclictest25909-21kworker/u16:4+events_unbound16:18:475
4155298994644,2cyclictest25909-21kworker/u16:4+events_unbound16:18:475
4155298994644,2cyclictest174511-21kworker/u16:4+flush-8:018:08:485
4155293994542,2cyclictest460522-21kworker/u16:2+flush-8:019:43:194
4155302994240,2cyclictest460522-21kworker/u16:2+events_unbound20:48:446
4155302994240,2cyclictest460522-21kworker/u16:2+events_unbound20:48:446
4155298994240,2cyclictest208033-21kworker/u16:1+events_unbound17:53:445
4155303994136,4cyclictest450710-21latency_hist19:23:197
4155302994139,2cyclictest439657-21kworker/u16:4+events_unbound20:37:486
4155302994139,2cyclictest208033-21kworker/u16:1+flush-8:017:48:456
4155293994139,2cyclictest4127290-21kworker/u16:3+flush-8:015:28:384
4155298994038,2cyclictest36315-21kworker/u16:5+events_unbound15:58:475
4155303993934,4cyclictest602358-21latency_hist20:38:187
415530399390,37cyclictest5610-21latency_hist15:43:207
4155298993937,2cyclictest4190511-21kworker/u16:3+events_unbound16:09:485
4155298993937,2cyclictest4164137-21kworker/u16:1+events_unbound15:36:485
4155293993937,2cyclictest460522-21kworker/u16:2+flush-8:020:08:494
415467323929,7sleep60-21swapper/615:19:236
4155302993836,2cyclictest439657-21kworker/u16:4+flush-8:019:33:526
4155302993836,2cyclictest257826-21kworker/u16:2+events_unbound17:53:486
4155302993835,2cyclictest460522-21kworker/u16:2+flush-8:020:08:426
4155298993836,2cyclictest460522-21kworker/u16:2+events_unbound20:29:495
4155298993836,2cyclictest430373-21kworker/u16:2+events_unbound19:11:295
4155298993735,2cyclictest521556-21kworker/u16:0+flush-8:020:08:215
4155298993735,2cyclictest439657-21kworker/u16:4+events_unbound19:35:415
4155293993734,2cyclictest279058-21kworker/u16:0+events_unbound18:18:334
4155302993634,2cyclictest25909-21kworker/u16:4+events_unbound15:55:306
4155298993634,2cyclictest208033-21kworker/u16:1+flush-8:017:48:475
4155302993532,2cyclictest76387-21kworker/u16:0+events_unbound16:58:206
4155298993533,2cyclictest76387-21kworker/u16:0+flush-8:016:39:485
4155293993533,2cyclictest401413-21kworker/u16:0+events_unbound19:18:474
4155302993432,2cyclictest490921-21kworker/u16:1+events_unbound20:02:376
4155302993432,2cyclictest4164137-21kworker/u16:1+flush-8:015:42:486
4155298993432,2cyclictest460522-21kworker/u16:2+events_unbound20:05:295
4155298993432,2cyclictest460522-21kworker/u16:2+events_unbound20:05:295
4155298993432,2cyclictest4143967-21kworker/u16:0+events_unbound15:24:315
4155298993432,2cyclictest279058-21kworker/u16:0+events_unbound18:40:365
4155298993432,2cyclictest137208-21kworker/u16:2+events_unbound16:59:485
4155303993326,6cyclictest589235-21systemd-journal18:31:467
4155302993331,2cyclictest470663-21kworker/u16:3+events_unbound19:42:296
4155302993330,2cyclictest257826-21kworker/u16:2+events_unbound17:58:226
4155298993331,2cyclictest359727-21kworker/u16:3+events_unbound18:54:295
4155298993331,2cyclictest298191-21kworker/u16:1+events_unbound18:14:335
4155298993331,2cyclictest279058-21kworker/u16:0+flush-8:018:34:295
4155298993331,2cyclictest217952-21kworker/u16:5+events_unbound18:52:475
4155303993227,4cyclictest238553-21latency_hist17:38:197
4155302993230,2cyclictest174511-21kworker/u16:4+events_unbound18:05:476
4155298993230,2cyclictest460522-21kworker/u16:2+events_unbound19:30:225
4155298993230,2cyclictest439657-21kworker/u16:4+events_unbound19:56:365
4155298993230,2cyclictest238949-21kworker/u16:0+events_unbound17:39:305
4155298993230,2cyclictest208033-21kworker/u16:1+events_unbound17:33:305
4155298993230,2cyclictest174511-21kworker/u16:4+events_unbound18:05:375
4155298993230,2cyclictest157223-21kworker/u16:3+events_unbound17:14:295
4155298993230,2cyclictest137208-21kworker/u16:2+events_unbound16:54:375
4155293993230,2cyclictest174511-21kworker/u16:4+flush-8:017:18:494
4155293993228,3cyclictest76387-21kworker/u16:0+flush-8:016:35:294
4155302993129,2cyclictest470663-21kworker/u16:3+events_unbound19:45:456
4155302993129,2cyclictest460522-21kworker/u16:2+events_unbound19:32:296
4155302993129,2cyclictest4190511-21kworker/u16:3+events_unbound15:47:296
4155302993129,2cyclictest174511-21kworker/u16:4+flush-8:017:26:346
4155302993129,2cyclictest157223-21kworker/u16:3+flush-8:017:17:216
4155302993128,2cyclictest439657-21kworker/u16:4+events_unbound19:23:206
4155298993129,2cyclictest76387-21kworker/u16:0+flush-8:016:28:345
4155298993129,2cyclictest521556-21kworker/u16:0+events_unbound20:24:385
4155298993129,2cyclictest490921-21kworker/u16:1+events_unbound19:53:185
4155298993129,2cyclictest460522-21kworker/u16:2+events_unbound19:27:055
4155298993129,2cyclictest439657-21kworker/u16:4+events_unbound20:37:565
4155298993129,2cyclictest439657-21kworker/u16:4+events_unbound19:20:055
4155298993129,2cyclictest4190511-21kworker/u16:3+events_unbound15:46:215
4155298993129,2cyclictest25909-21kworker/u16:4+flush-8:016:43:495
4155298993129,2cyclictest257826-21kworker/u16:2+events_unbound17:45:225
4155298993129,2cyclictest217952-21kworker/u16:5+events_unbound18:02:475
4155298993129,2cyclictest174511-21kworker/u16:4+flush-8:017:08:135
4155298993129,2cyclictest174511-21kworker/u16:4+flush-8:017:08:135
4155298993128,2cyclictest470663-21kworker/u16:3+flush-8:019:38:285
4155303993025,4cyclictest46357-21latency_hist16:03:207
4155303993025,4cyclictest4179315-21latency_hist15:33:197
4155302993028,2cyclictest76387-21kworker/u16:0+flush-8:017:11:326
4155302993028,2cyclictest521556-21kworker/u16:0+events_unbound20:41:216
4155302993028,2cyclictest439657-21kworker/u16:4+flush-8:020:47:056
4155302993028,2cyclictest4143967-21kworker/u16:0+flush-8:015:36:586
4155302993028,2cyclictest257826-21kworker/u16:2+events_unbound17:47:256
4155302993028,2cyclictest174511-21kworker/u16:4+events_unbound17:41:026
4155302993028,2cyclictest174511-21kworker/u16:4+events_unbound17:36:506
4155298993028,2cyclictest4190511-21kworker/u16:3+events_unbound16:17:215
4155298993028,2cyclictest4178295-21kworker/u16:2+events_unbound15:49:425
4155298993028,2cyclictest279058-21kworker/u16:0+events_unbound18:31:215
4155298993028,2cyclictest25909-21kworker/u16:4+events_unbound16:07:275
4155298993028,2cyclictest137208-21kworker/u16:2+flush-8:016:50:535
4155302992927,2cyclictest561635-21kworker/u16:1+events_unbound20:22:476
4155302992927,2cyclictest4178295-21kworker/u16:2+events_unbound16:07:296
4155302992927,2cyclictest411479-21kworker/u16:1+flush-8:019:09:056
4155302992927,2cyclictest279058-21kworker/u16:0+events_unbound18:35:336
4155302992927,2cyclictest25909-21kworker/u16:4+flush-8:016:25:386
4155302992927,2cyclictest25909-21kworker/u16:4+events_unbound16:02:506
4155302992927,2cyclictest217952-21kworker/u16:5+events_unbound18:48:176
4155302992927,2cyclictest137208-21kworker/u16:2+flush-8:017:04:206
4155302992927,2cyclictest137208-21kworker/u16:2+flush-8:017:04:206
4155302992926,2cyclictest174511-21kworker/u16:4+events_unbound17:18:286
4155298992927,2cyclictest439657-21kworker/u16:4+events_unbound20:42:575
4155298992927,2cyclictest411479-21kworker/u16:1+events_unbound19:04:335
4155298992927,2cyclictest217952-21kworker/u16:5+events_unbound18:20:215
4155302992826,2cyclictest439657-21kworker/u16:4+events_unbound20:13:576
4155302992826,2cyclictest4190511-21kworker/u16:3+flush-8:016:17:066
4155302992826,2cyclictest4178295-21kworker/u16:2+flush-8:015:32:296
4155302992826,2cyclictest411479-21kworker/u16:1+events_unbound19:19:456
4155302992826,2cyclictest157223-21kworker/u16:3+events_unbound16:57:376
4155298992826,2cyclictest521556-21kworker/u16:0+events_unbound20:51:295
4155298992826,2cyclictest521556-21kworker/u16:0+events_unbound20:51:295
4155298992826,2cyclictest521556-21kworker/u16:0+events_unbound20:21:335
4155298992826,2cyclictest490921-21kworker/u16:1+events_unbound19:47:345
4155298992826,2cyclictest374445-21kworker/u16:2+flush-8:019:00:255
4155298992826,2cyclictest279058-21kworker/u16:0+flush-8:018:25:365
4155298992825,2cyclictest4190511-21kworker/u16:3+flush-8:016:33:295
4155293992826,2cyclictest76387-21kworker/u16:0+flush-8:016:43:414
4155293992826,2cyclictest4190511-21kworker/u16:3+flush-8:016:28:484
4155303992721,5cyclictest589235-21systemd-journal16:34:477
4155303992721,4cyclictest589235-21systemd-journal19:23:427
4155302992725,2cyclictest76387-21kworker/u16:0+events_unbound16:29:176
4155302992725,2cyclictest76387-21kworker/u16:0+events_unbound16:20:486
4155302992725,2cyclictest76387-21kworker/u16:0+events_unbound16:20:486
4155302992725,2cyclictest4127290-21kworker/u16:3+events_unbound15:24:416
4155302992725,2cyclictest359727-21kworker/u16:3+events_unbound18:57:346
4155302992725,2cyclictest329394-21kworker/u16:2+events_unbound18:26:526
4155302992725,2cyclictest217952-21kworker/u16:5+events_unbound17:31:336
4155298992725,2cyclictest4164137-21kworker/u16:1+flush-8:015:32:585
4155298992725,2cyclictest217952-21kworker/u16:5+events_unbound17:31:025
4155298992724,2cyclictest298191-21kworker/u16:1+flush-8:018:43:295
4155293992724,2cyclictest76387-21kworker/u16:0+flush-8:016:18:334
4155293992724,2cyclictest76387-21kworker/u16:0+flush-8:016:18:334
4155303992625,0cyclictest0-21swapper/720:43:367
4155302992624,2cyclictest561635-21kworker/u16:1+flush-8:020:29:026
4155302992624,2cyclictest411479-21kworker/u16:1+events_unbound19:06:366
4155302992624,2cyclictest298191-21kworker/u16:1+flush-8:018:08:406
4155298992624,2cyclictest439657-21kworker/u16:4+events_unbound20:45:375
4155298992624,2cyclictest411479-21kworker/u16:1+events_unbound19:16:305
4155293992624,2cyclictest4190511-21kworker/u16:3+events_unbound16:13:194
4155293992624,2cyclictest401413-21kworker/u16:0+events_unbound19:28:434
4155293992623,2cyclictest490921-21kworker/u16:1+flush-8:019:58:574
4155303992520,4cyclictest589235-21systemd-journal18:08:247
4155302992523,2cyclictest460522-21kworker/u16:2+events_unbound19:55:256
4155302992523,2cyclictest4190511-21kworker/u16:3+flush-8:016:11:186
4155302992522,2cyclictest521556-21kworker/u16:0+flush-8:020:23:226
4155298992523,2cyclictest490921-21kworker/u16:1+flush-8:019:58:365
4155298992523,2cyclictest460522-21kworker/u16:2+events_unbound20:18:175
4155298992523,2cyclictest4164137-21kworker/u16:1+events_unbound15:39:385
4155298992523,2cyclictest208033-21kworker/u16:1+flush-8:017:25:575
4155293992523,2cyclictest279058-21kworker/u16:0+flush-8:018:33:384
4155293992523,2cyclictest25908-21kworker/u16:0+flush-8:015:53:494
4155293992523,2cyclictest217952-21kworker/u16:5+flush-8:018:03:434
4155293992522,2cyclictest76387-21kworker/u16:0+events_unbound16:38:324
4155293992522,2cyclictest622588-21kworker/u16:3+events_unbound20:48:334
4155293992522,2cyclictest622588-21kworker/u16:3+events_unbound20:48:334
4155302992422,2cyclictest4190511-21kworker/u16:3+events_unbound16:41:026
4155302992422,2cyclictest411479-21kworker/u16:1+flush-8:019:15:376
4155302992422,2cyclictest374445-21kworker/u16:2+flush-8:018:59:016
4155302992422,2cyclictest279058-21kworker/u16:0+events_unbound18:40:266
4155302992422,2cyclictest25909-21kworker/u16:4+flush-8:016:35:016
4155302992422,2cyclictest217952-21kworker/u16:5+flush-8:018:50:016
4155302992421,2cyclictest4164137-21kworker/u16:1+events_unbound15:48:226
4155298992422,2cyclictest25909-21kworker/u16:4+events_unbound15:55:285
4155298992421,2cyclictest4190511-21kworker/u16:3+flush-8:016:23:235
4155293992421,2cyclictest25909-21kworker/u16:4+flush-8:016:00:294
4155293992420,3cyclictest439657-21kworker/u16:4+flush-8:020:13:384
4155302992321,2cyclictest460522-21kworker/u16:2+flush-8:020:05:376
4155302992321,2cyclictest460522-21kworker/u16:2+flush-8:020:05:376
4155302992321,2cyclictest460522-21kworker/u16:2+flush-8:019:48:536
4155302992321,2cyclictest4190511-21kworker/u16:3+flush-8:016:45:576
4155302992321,2cyclictest298191-21kworker/u16:1+events_unbound18:15:206
4155302992321,2cyclictest217952-21kworker/u16:5+events_unbound18:19:226
4155298992321,2cyclictest76387-21kworker/u16:0+flush-8:017:10:415
4155303992217,4cyclictest137324-21latency_hist16:48:207
4155302992221,1cyclictest76387-21kworker/u16:0+events_unbound16:51:206
4155298992220,2cyclictest174511-21kworker/u16:4+events_unbound17:20:175
4155293992219,3cyclictest4143967-21kworker/u16:0+flush-8:015:23:464
4155293992219,3cyclictest279058-21kworker/u16:0+flush-8:018:13:464
4155303992115,5cyclictest470881-21latency_hist19:33:197
4155302992119,2cyclictest279058-21kworker/u16:0+events_unbound18:30:196
4155293992119,2cyclictest401413-21kworker/u16:0+events_unbound19:03:484
4155293992119,2cyclictest329394-21kworker/u16:2+events_unbound18:28:474
4155293992117,3cyclictest439657-21kworker/u16:4+flush-8:020:38:534
4155293992018,2cyclictest561635-21kworker/u16:1+flush-8:020:23:344
4155293992018,2cyclictest157223-21kworker/u16:3+flush-8:017:13:444
4155293992017,2cyclictest76387-21kworker/u16:0+flush-8:016:53:404
4155293992017,2cyclictest401413-21kworker/u16:0+events_unbound19:13:484
4155293992016,3cyclictest439657-21kworker/u16:4+flush-8:019:54:224
4155303991914,4cyclictest4165258-21latency_hist15:28:197
4155303991914,4cyclictest400197-21latency_hist18:58:197
415530399190,17cyclictest167717-21latency_hist17:03:197
4155293991917,2cyclictest4178295-21kworker/u16:2+events_unbound15:33:434
4155293991917,2cyclictest174511-21kworker/u16:4+flush-8:017:33:454
4155293991916,2cyclictest76387-21kworker/u16:0+flush-8:016:58:324
4155293991915,3cyclictest208033-21kworker/u16:1+flush-8:017:50:294
4155303991817,0cyclictest0-21swapper/717:53:347
4155303991813,4cyclictest589235-21systemd-journal20:03:197
4155303991813,4cyclictest589235-21systemd-journal20:03:197
415530399180,16cyclictest0-21swapper/716:08:457
4155293991816,2cyclictest460522-21kworker/u16:2+flush-8:020:28:414
4155293991816,2cyclictest25909-21kworker/u16:4+events_unbound16:03:444
4155293991816,2cyclictest217952-21kworker/u16:5+events_unbound18:48:434
4155293991815,2cyclictest238949-21kworker/u16:0+flush-8:017:43:374
4155293991815,2cyclictest217952-21kworker/u16:5+flush-8:018:11:314
4155293991811,6cyclictest0-21swapper/420:33:374
4155303991714,2cyclictest0-21swapper/718:58:207
415530399170,1cyclictest0-21swapper/720:13:477
415530399170,11cyclictest77111-21/usr/sbin/munin16:18:467
415530399170,11cyclictest77111-21/usr/sbin/munin16:18:467
415530399170,11cyclictest0-21swapper/719:03:447
4155293991715,2cyclictest439657-21kworker/u16:4+flush-8:019:48:454
4155293991715,2cyclictest298191-21kworker/u16:1+flush-8:018:38:454
4155293991714,2cyclictest208033-21kworker/u16:1+flush-8:017:38:414
415529399170,16cyclictest471842-21fschecks_count19:33:344
415530399165,5cyclictest27763-21gvfs-afc-volume19:48:387
415530399160,14cyclictest589235-21systemd-journal16:43:197
4155293991614,2cyclictest411479-21kworker/u16:1+flush-8:019:08:354
4155293991614,2cyclictest174511-21kworker/u16:4+flush-8:017:08:194
4155293991614,2cyclictest174511-21kworker/u16:4+flush-8:017:08:194
4155293991612,3cyclictest25909-21kworker/u16:4+flush-8:016:23:544
415529399160,16cyclictest0-21swapper/418:26:514
415530399159,4cyclictest0-21swapper/719:58:187
4155293991513,2cyclictest460522-21kworker/u16:2+flush-8:020:05:184
4155293991513,2cyclictest460522-21kworker/u16:2+flush-8:020:05:184
415530399149,4cyclictest329433-21latency_hist18:23:197
4155303991411,2cyclictest4175659-21snmpd16:04:307
4155293991412,2cyclictest4190511-21kworker/u16:3+flush-8:015:43:474
4155293991411,2cyclictest460522-21kworker/u16:2+flush-8:019:43:364
415530399139,3cyclictest589235-21systemd-journal16:25:477
415530399139,3cyclictest227505-21ntpq17:28:447
415530399138,4cyclictest628579-21kthreadcore20:48:407
415530399138,4cyclictest628579-21kthreadcore20:48:407
415530399136,6cyclictest27642-21gmain20:23:407
415530399136,6cyclictest0-21swapper/717:46:477
415530399136,6cyclictest0-21swapper/715:53:477
415530399135,7cyclictest27204-21gmain17:18:327
415530399132,4cyclictest175683-21grep17:03:407
415530399132,4cyclictest175683-21grep17:03:407
4155303991311,1cyclictest0-21swapper/716:51:347
415529399138,4cyclictest613608-21cat20:43:344
4155293991312,1cyclictest0-21swapper/418:53:314
4155293991312,1cyclictest0-21swapper/415:40:344
4155293991310,2cyclictest174511-21kworker/u16:4+flush-8:017:58:454
4155293991310,2cyclictest174511-21kworker/u16:4+flush-8:017:53:204
415529399130,13cyclictest0-21swapper/418:44:154
415530399129,2cyclictest4175659-21snmpd19:59:157
415530399129,2cyclictest4175659-21snmpd19:45:267
415530399129,2cyclictest4175659-21snmpd19:17:057
415530399129,2cyclictest4175659-21snmpd19:08:257
415530399129,2cyclictest4175659-21snmpd18:03:427
415530399129,2cyclictest4175659-21snmpd18:01:187
415530399128,3cyclictest4175659-21snmpd20:39:077
415530399128,3cyclictest4175659-21snmpd15:49:597
415530399127,4cyclictest27763-21gvfs-afc-volume16:28:437
415530399126,5cyclictest248615-21latency_hist17:43:197
415530399125,6cyclictest0-21swapper/717:52:477
4155293991211,1cyclictest0-21swapper/419:24:354
4155293991210,2cyclictest521556-21kworker/u16:0+flush-8:020:18:344
415529399120,12cyclictest0-21swapper/419:00:464
415530399118,2cyclictest4175659-21snmpd20:28:337
415530399118,2cyclictest4175659-21snmpd20:22:337
415530399118,2cyclictest4175659-21snmpd19:33:297
415530399118,2cyclictest4175659-21snmpd18:53:047
415530399118,2cyclictest4175659-21snmpd18:14:457
415530399118,2cyclictest4175659-21snmpd17:24:507
415530399118,2cyclictest4175659-21snmpd17:11:167
415530399118,2cyclictest4175659-21snmpd16:15:097
415530399118,2cyclictest4175659-21snmpd15:45:297
415530399117,3cyclictest1127-21ntpd18:33:477
415530399115,5cyclictest27763-21gvfs-afc-volume18:39:287
415530399110,9cyclictest948-21NetworkManager18:23:457
415530399110,9cyclictest0-21swapper/716:53:387
415530399110,4cyclictest375105-21grep18:43:407
415530399110,1cyclictest0-21swapper/717:13:457
415530399110,10cyclictest96-21ksoftirqd/720:08:367
415529399117,3cyclictest208033-21kworker/u16:1+flush-8:017:33:174
415529399110,10cyclictest0-21swapper/416:13:524
415529399110,0cyclictest0-21swapper/417:11:414
415530399100,9cyclictest1072-21runrttasks19:39:367
415529399109,1cyclictest0-21swapper/417:28:054
41552939984,3cyclictest25909-21kworker/u16:4+events_unbound16:48:394
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional