You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 20:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Nov 13, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2572965997973,5cyclictest589235-21systemd-journal19:19:057
257259326050,7sleep60-21swapper/615:23:546
2572947995653,2cyclictest2788231-21kworker/u16:4+flush-8:019:24:374
2572947995653,2cyclictest2788231-21kworker/u16:4+flush-8:019:24:374
2572965995247,4cyclictest3132120-21latency_hist19:59:067
2572947995250,2cyclictest3091700-21kworker/u16:2+events_unbound20:09:064
257252524720,7sleep40-21swapper/415:22:564
257237824737,7sleep50-21swapper/515:20:565
2572947994643,2cyclictest3081385-21kworker/u16:6+events_unbound19:31:094
2572962994341,2cyclictest3000026-21kworker/u16:0+flush-8:019:24:336
2572962994341,2cyclictest3000026-21kworker/u16:0+flush-8:019:24:336
2572962994240,2cyclictest2788231-21kworker/u16:4+flush-8:017:44:336
25724082427,31sleep70-21swapper/715:21:227
2572965994039,0cyclictest0-21swapper/720:19:377
257296599400,38cyclictest2687696-21latency_hist16:19:077
2572962993937,2cyclictest2919778-21kworker/u16:5+flush-8:018:49:326
2572965993833,4cyclictest2960124-21latency_hist18:34:067
2572965993832,5cyclictest2617174-21latency_hist15:44:077
2572965993832,5cyclictest2617174-21latency_hist15:44:077
257296599370,35cyclictest4184977-17auditd15:29:217
2572962993735,2cyclictest3223236-21kworker/u16:2+flush-8:020:44:376
2572962993735,2cyclictest3081348-21kworker/u16:3+flush-8:020:38:546
2572965993630,5cyclictest2637303-21latency_hist15:54:077
2572962993634,2cyclictest2582885-21kworker/u16:1+events_unbound15:45:186
2572962993633,2cyclictest3000026-21kworker/u16:0+flush-8:019:19:236
2572954993634,2cyclictest1882683-21kworker/u16:4+flush-8:015:49:075
2572947993634,2cyclictest3020365-21kworker/u16:2+events_unbound19:14:304
2572962993533,2cyclictest3081348-21kworker/u16:3+flush-8:020:12:486
2572962993533,2cyclictest3081348-21kworker/u16:3+flush-8:020:12:486
2572962993533,2cyclictest3081348-21kworker/u16:3+events_unbound20:29:316
2572962993533,2cyclictest2788231-21kworker/u16:4+events_unbound18:08:066
2572947993533,2cyclictest2647576-21kworker/u16:5+events_unbound16:09:504
2572962993432,2cyclictest3020365-21kworker/u16:2+flush-8:019:16:176
2572962993432,2cyclictest2889380-21kworker/u16:1+events_unbound17:59:496
2572962993432,2cyclictest2737690-21kworker/u16:3+events_unbound17:08:186
2572962993432,2cyclictest2647576-21kworker/u16:5+events_unbound16:10:506
2572962993432,2cyclictest2647071-21kworker/u16:0+events_unbound16:17:506
2572962993331,2cyclictest3081348-21kworker/u16:3+events_unbound19:56:026
2572962993331,2cyclictest2677306-21kworker/u16:2+events_unbound16:57:076
2572947993331,2cyclictest1882683-21kworker/u16:4+events_unbound15:50:504
2572962993230,2cyclictest2919778-21kworker/u16:5+events_unbound19:07:486
2572962993230,2cyclictest2919778-21kworker/u16:5+events_unbound18:36:306
2572962993230,2cyclictest2737690-21kworker/u16:3+events_unbound18:32:536
2572962993230,2cyclictest2647071-21kworker/u16:0+events_unbound17:49:086
2572962993230,2cyclictest2572406-21kworker/u16:0+events_unbound15:30:586
2572965993126,4cyclictest3202672-21latency_hist20:34:077
2572965993126,4cyclictest2950057-21latency_hist18:29:067
2572962993129,2cyclictest3091700-21kworker/u16:2+events_unbound19:40:556
2572962993129,2cyclictest2889380-21kworker/u16:1+events_unbound18:18:066
2572962993129,2cyclictest2788231-21kworker/u16:4+events_unbound18:45:536
2572962993129,2cyclictest2687628-21kworker/u16:3+events_unbound16:25:346
2572962993129,2cyclictest2687628-21kworker/u16:3+events_unbound16:25:346
2572962993129,2cyclictest2677306-21kworker/u16:2+flush-8:016:34:106
2572962993129,2cyclictest2647071-21kworker/u16:0+flush-8:016:22:546
2572962993129,2cyclictest2582885-21kworker/u16:1+flush-8:015:39:386
2572962993129,2cyclictest2582885-21kworker/u16:1+flush-8:015:39:386
2572962993128,2cyclictest3121985-21kworker/u16:0+flush-8:019:59:076
2572947993129,2cyclictest2677306-21kworker/u16:2+events_unbound17:03:504
2572965993024,5cyclictest3000356-21latency_hist18:54:077
2572962993028,2cyclictest3152055-21kworker/u16:4+events_unbound20:07:146
2572962993028,2cyclictest2737690-21kworker/u16:3+events_unbound16:48:066
2572962993028,2cyclictest2677306-21kworker/u16:2+events_unbound16:30:296
2572962993028,2cyclictest2647071-21kworker/u16:0+events_unbound15:57:546
2572962993028,2cyclictest1859017-21kworker/u16:3+events_unbound15:28:346
2572962993027,2cyclictest2788231-21kworker/u16:4+flush-8:018:39:096
2572962993027,2cyclictest2788231-21kworker/u16:4+flush-8:018:39:096
257296599290,27cyclictest589235-21systemd-journal17:25:487
2572962992927,2cyclictest3081347-21kworker/u16:1+events_unbound19:32:456
2572962992927,2cyclictest3000026-21kworker/u16:0+flush-8:019:38:536
2572962992927,2cyclictest3000026-21kworker/u16:0+events_unbound19:12:536
2572962992927,2cyclictest2788231-21kworker/u16:4+events_unbound17:16:306
2572962992927,2cyclictest2717536-21kworker/u16:4+events_unbound16:43:136
2572962992927,2cyclictest2647071-21kworker/u16:0+events_unbound17:57:466
2572962992927,2cyclictest2647071-21kworker/u16:0+events_unbound17:57:466
2572962992927,2cyclictest2647071-21kworker/u16:0+events_unbound17:41:026
2572962992927,2cyclictest2647071-21kworker/u16:0+events_unbound17:13:346
2572962992927,2cyclictest2647071-21kworker/u16:0+events_unbound17:13:346
2572962992926,2cyclictest2737690-21kworker/u16:3+events_unbound18:19:166
2572947992927,2cyclictest2788231-21kworker/u16:4+flush-8:018:39:014
2572947992927,2cyclictest2788231-21kworker/u16:4+events_unbound18:45:494
2572947992927,2cyclictest2647576-21kworker/u16:5+flush-8:016:09:074
2572947992927,2cyclictest1859017-21kworker/u16:3+events_unbound15:26:504
2572962992826,2cyclictest3181530-21kworker/u16:1+events_unbound20:22:586
2572962992826,2cyclictest3081347-21kworker/u16:1+events_unbound19:46:576
2572962992826,2cyclictest2757899-21kworker/u16:5+flush-8:016:50:546
2572962992826,2cyclictest2737690-21kworker/u16:3+events_unbound17:24:506
2572962992826,2cyclictest2677306-21kworker/u16:2+events_unbound17:21:456
2572962992826,2cyclictest2647576-21kworker/u16:5+events_unbound16:08:226
2572962992825,2cyclictest2788231-21kworker/u16:4+events_unbound18:09:146
2572962992825,2cyclictest2582885-21kworker/u16:1+flush-8:015:49:176
2572947992826,2cyclictest2788231-21kworker/u16:4+events_unbound18:08:494
2572962992725,2cyclictest3212656-21kworker/u16:4+events_unbound20:42:336
2572962992725,2cyclictest3152055-21kworker/u16:4+events_unbound20:14:466
2572962992725,2cyclictest2919778-21kworker/u16:5+flush-8:018:55:186
2572962992725,2cyclictest2737690-21kworker/u16:3+events_unbound18:26:346
2572962992725,2cyclictest2647071-21kworker/u16:0+events_unbound17:38:576
2572962992725,2cyclictest2626987-21kworker/u16:2+events_unbound16:02:426
2572962992725,2cyclictest1882683-21kworker/u16:4+events_unbound15:37:176
2572947992725,2cyclictest3212656-21kworker/u16:4+events_unbound20:52:504
2572947992725,2cyclictest2647071-21kworker/u16:0+flush-8:017:39:234
2572965992625,0cyclictest0-21swapper/717:14:357
257296599260,25cyclictest3081282-21packagekitd19:31:207
2572962992624,2cyclictest3223236-21kworker/u16:2+events_unbound20:54:036
2572962992624,2cyclictest3091700-21kworker/u16:2+events_unbound20:28:256
2572962992624,2cyclictest3091700-21kworker/u16:2+events_unbound19:52:296
2572962992624,2cyclictest2919778-21kworker/u16:5+events_unbound19:03:166
2572962992624,2cyclictest2647071-21kworker/u16:0+flush-8:017:33:096
2572947992624,2cyclictest3000026-21kworker/u16:0+events_unbound19:06:494
2572947992624,2cyclictest2919778-21kworker/u16:5+events_unbound18:42:494
2572947992624,2cyclictest2919778-21kworker/u16:5+events_unbound18:42:494
2572947992624,2cyclictest2919778-21kworker/u16:5+events_unbound18:27:504
2572947992523,2cyclictest3081348-21kworker/u16:3+events_unbound20:38:504
2572947992523,2cyclictest3081348-21kworker/u16:3+events_unbound20:32:504
2572947992523,2cyclictest2919778-21kworker/u16:5+flush-8:018:24:024
2572947992523,2cyclictest2788231-21kworker/u16:4+events_unbound18:52:494
2572947992523,2cyclictest2698158-21kworker/u16:1+events_unbound16:44:504
2572947992523,2cyclictest2677306-21kworker/u16:2+events_unbound16:30:504
2572947992523,2cyclictest1882683-21kworker/u16:4+events_unbound15:29:504
2572947992523,2cyclictest1859017-21kworker/u16:3+flush-8:015:47:314
2572965992419,4cyclictest589235-21systemd-journal15:34:227
257296599240,22cyclictest2939958-21latency_hist18:24:077
2572962992422,2cyclictest2647071-21kworker/u16:0+events_unbound17:00:306
2572947992422,2cyclictest2788231-21kworker/u16:4+events_unbound17:35:064
2572947992422,2cyclictest2677306-21kworker/u16:2+events_unbound16:20:504
2572965992317,5cyclictest2859184-21latency_hist17:44:067
2572947992321,2cyclictest3162514-21kworker/u16:0+events_unbound20:23:494
2572947992321,2cyclictest3091700-21kworker/u16:2+events_unbound19:56:494
2572947992321,2cyclictest2919778-21kworker/u16:5+events_unbound18:58:504
2572947992321,2cyclictest2582885-21kworker/u16:1+events_unbound16:00:504
2572947992320,2cyclictest3091700-21kworker/u16:2+events_unbound19:59:234
2572965992217,4cyclictest589235-21systemd-journal19:07:227
257296599220,20cyclictest2798583-21latency_hist17:14:077
257296599220,20cyclictest2798583-21latency_hist17:14:077
2572947992220,2cyclictest2737690-21kworker/u16:3+events_unbound17:09:324
2572947992220,2cyclictest2737690-21kworker/u16:3+events_unbound17:09:324
2572965992115,5cyclictest3071445-21latency_hist19:29:077
2572965992115,5cyclictest3071445-21latency_hist19:29:077
2572965992114,6cyclictest589235-21systemd-journal15:29:077
2572947992119,2cyclictest2737690-21kworker/u16:3+events_unbound18:31:504
2572947992119,2cyclictest2677306-21kworker/u16:2+flush-8:016:39:464
2572965992015,4cyclictest589235-21systemd-journal16:04:087
2572947992018,2cyclictest3121985-21kworker/u16:0+events_unbound19:53:494
2572947992018,2cyclictest3000026-21kworker/u16:0+events_unbound19:11:504
2572947992018,2cyclictest2647071-21kworker/u16:0+events_unbound17:51:504
2572947992018,2cyclictest2647071-21kworker/u16:0+events_unbound16:16:504
2572947992017,3cyclictest2647071-21kworker/u16:0+events_unbound17:29:324
2572947992017,2cyclictest2717536-21kworker/u16:4+flush-8:016:38:204
2572965991917,1cyclictest0-21swapper/717:49:357
2572965991913,5cyclictest3010454-21latency_hist18:59:077
2572947991917,2cyclictest3081347-21kworker/u16:1+events_unbound19:34:284
2572947991917,2cyclictest2788231-21kworker/u16:4+events_unbound18:17:504
2572947991917,2cyclictest2788231-21kworker/u16:4+events_unbound17:24:354
257296599181,15cyclictest4175659-21snmpd18:14:337
257295499189,8cyclictest2870460-21cat17:49:245
2572947991816,2cyclictest2919778-21kworker/u16:5+flush-8:019:20:424
2572947991816,2cyclictest2737690-21kworker/u16:3+events_unbound18:12:394
2572965991712,4cyclictest3212750-21latency_hist20:39:077
2572965991711,5cyclictest2758209-21latency_hist16:54:077
257296599170,1cyclictest0-21swapper/720:24:327
2572954991710,6cyclictest2893059-21kthreadcore17:59:265
2572947991715,2cyclictest3091700-21kworker/u16:2+events_unbound19:41:504
2572947991715,2cyclictest2737690-21kworker/u16:3+events_unbound18:01:504
2572947991714,2cyclictest2698158-21kworker/u16:1+flush-8:016:49:234
2572965991612,3cyclictest4175659-21snmpd18:47:377
2572947991614,2cyclictest3181530-21kworker/u16:1+events_unbound20:39:234
2572947991614,2cyclictest2647071-21kworker/u16:0+events_unbound17:46:534
2572947991614,2cyclictest2647071-21kworker/u16:0+events_unbound16:26:504
2572947991614,2cyclictest2647071-21kworker/u16:0+events_unbound16:26:504
2572947991614,2cyclictest2582885-21kworker/u16:1+flush-8:015:54:304
2572947991613,3cyclictest3212582-21kworker/u16:0+events_unbound20:44:324
257296599157,7cyclictest27394-21gmain18:39:257
257296599157,7cyclictest27394-21gmain18:39:257
2572965991513,1cyclictest2778436-21munin-run17:04:067
257295499150,1cyclictest0-21swapper/517:34:295
2572947991513,2cyclictest3152055-21kworker/u16:4+flush-8:020:09:344
2572947991513,2cyclictest3152055-21kworker/u16:4+flush-8:020:09:344
257296599140,3cyclictest2649841-21taskset15:59:257
257296599140,2cyclictest0-21swapper/719:34:367
257296599140,1cyclictest0-21swapper/717:04:317
257296599140,12cyclictest80692-21crond16:44:087
257296599140,12cyclictest2721365-21kthreadcore16:34:257
257295499140,6cyclictest2772737-21grep16:59:285
257295499140,6cyclictest2711782-21grep16:29:265
257295499140,5cyclictest2659657-21grep16:04:255
257295499140,2cyclictest0-21swapper/516:21:495
257295499140,14cyclictest0-21swapper/519:19:385
257295499140,14cyclictest0-21swapper/519:04:595
2572947991412,2cyclictest2677306-21kworker/u16:2+flush-8:017:19:374
2572947991412,2cyclictest2582885-21kworker/u16:1+events_unbound15:39:344
2572947991412,2cyclictest2582885-21kworker/u16:1+events_unbound15:39:344
2572947991411,3cyclictest3091700-21kworker/u16:2+events_unbound20:14:324
2572947991411,2cyclictest2677306-21kworker/u16:2+flush-8:017:04:284
257296599137,5cyclictest27174-21gnome-shell19:13:067
257296599136,6cyclictest0-21swapper/719:21:487
2572965991312,0cyclictest0-21swapper/717:34:177
2572965991311,1cyclictest2869309-21awk17:49:067
2572965991310,2cyclictest0-21swapper/719:44:077
257296599130,4cyclictest3140426-21kthreadcore19:59:297
257296599130,1cyclictest0-21swapper/717:19:337
257296599130,1cyclictest0-21swapper/716:09:317
257296599130,11cyclictest3109463-21tr19:44:287
257296599130,11cyclictest0-21swapper/719:49:327
257295499136,6cyclictest3011644-21cat18:59:235
257295499133,9cyclictest2903251-21grep18:04:245
2572954991311,2cyclictest2889380-21kworker/u16:1+events_unbound18:29:245
257295499130,8cyclictest30032731kthreadcore18:54:245
257295499130,6cyclictest2858266-21ntpq17:39:345
257295499130,1cyclictest0-21swapper/520:04:425
257295499130,13cyclictest0-21swapper/519:30:215
257295499130,13cyclictest0-21swapper/516:57:365
2572947991311,2cyclictest2647071-21kworker/u16:0+events_unbound17:57:174
2572947991311,2cyclictest2647071-21kworker/u16:0+events_unbound17:57:174
2572947991311,2cyclictest2582885-21kworker/u16:1+events_unbound15:36:504
257296599129,2cyclictest4175659-21snmpd18:12:397
257296599129,2cyclictest4175659-21snmpd16:22:537
257296599127,4cyclictest878-21systemd-oomd18:34:327
257296599126,5cyclictest878-21systemd-oomd17:29:247
257296599120,2cyclictest0-21swapper/718:59:317
257296599120,11cyclictest2718016-21cat16:34:077
257295499127,4cyclictest0-21swapper/519:34:265
257295499123,8cyclictest3185678-21cut20:24:255
257295499123,8cyclictest3165027-21kthreadcore20:14:245
257295499123,8cyclictest2779492-21tune2fs17:04:215
257295499123,8cyclictest2655048-21cut15:59:285
257295499123,8cyclictest2581600-21cut15:24:315
257295499122,9cyclictest2598120-21cat15:34:235
2572954991211,1cyclictest0-21swapper/518:38:485
2572954991211,1cyclictest0-21swapper/517:57:595
2572954991211,1cyclictest0-21swapper/517:57:595
2572954991211,1cyclictest0-21swapper/516:48:085
2572954991211,1cyclictest0-21swapper/515:30:545
257295499121,10cyclictest2735611-21tr16:39:305
2572954991210,2cyclictest0-21swapper/519:57:385
257295499120,7cyclictest3226173-21grep20:44:255
257295499120,7cyclictest2640358-21kthreadcore15:54:265
257295499120,12cyclictest0-21swapper/518:45:265
257295499120,12cyclictest0-21swapper/517:48:505
257295499120,11cyclictest2798182-21unixbench_singl17:09:355
257295499120,11cyclictest2798182-21unixbench_singl17:09:355
257294799129,2cyclictest2737690-21kworker/u16:3+flush-8:016:58:304
257296599118,2cyclictest4175659-21snmpd15:56:057
257296599117,3cyclictest878-21systemd-oomd16:54:337
2572965991111,0cyclictest0-21swapper/717:54:337
2572965991111,0cyclictest0-21swapper/717:54:337
257296599110,9cyclictest0-21swapper/718:04:307
257296599110,2cyclictest0-21swapper/720:44:207
257296599110,2cyclictest0-21swapper/720:39:327
257296599110,10cyclictest589235-21systemd-journal16:28:497
257296599110,10cyclictest589235-21systemd-journal16:28:497
257296599110,10cyclictest4175659-21snmpd18:01:537
257296599110,10cyclictest4175659-21snmpd16:39:277
257296599110,10cyclictest0-21swapper/720:04:317
257295499119,2cyclictest0-21swapper/518:10:165
257295499119,1cyclictest0-21swapper/518:39:255
257295499119,1cyclictest0-21swapper/518:39:255
257295499117,3cyclictest3133293-21cat19:59:235
257295499116,4cyclictest0-21swapper/519:14:265
257295499116,4cyclictest0-21swapper/517:29:255
257295499116,4cyclictest0-21swapper/517:14:255
257295499114,6cyclictest3116944-21kthreadcore19:49:265
257295499113,7cyclictest3097432-21cut19:39:295
257295499113,7cyclictest3031966-21smartctl19:09:235
257295499113,7cyclictest2920246-21cat18:14:195
257295499112,8cyclictest3234683-21cut20:49:255
257295499112,8cyclictest3197602-21cut20:29:265
257295499112,8cyclictest2940441-21cat18:24:195
257295499112,8cyclictest2810344-21cat17:19:265
2572954991110,1cyclictest0-21swapper/519:47:425
257295499110,1cyclictest0-21swapper/515:52:115
257295499110,11cyclictest0-21swapper/519:27:035
257295499110,11cyclictest0-21swapper/519:27:035
257295499110,10cyclictest3222760-21chrt20:42:585
257295499110,10cyclictest3182419-21chrt20:23:275
257295499110,10cyclictest2677293-21taskset16:09:515
2572947991110,1cyclictest0-21swapper/420:25:254
257294799110,11cyclictest0-21swapper/417:16:334
257296599105,4cyclictest96-21ksoftirqd/715:44:307
257296599104,5cyclictest27174-21gnome-shell20:50:057
257296599100,9cyclictest4175659-21snmpd20:10:457
257296599100,9cyclictest4175659-21snmpd20:10:457
257296599100,9cyclictest0-21swapper/720:14:317
257295499102,7cyclictest3205039-21kthreadcore20:34:215
257295499102,7cyclictest2682138-21cat16:14:265
257295499102,7cyclictest2609755-21cut15:39:225
257295499102,7cyclictest2609755-21cut15:39:225
257295499100,9cyclictest2991201-21/usr/sbin/munin18:49:205
257295499100,9cyclictest2930348-21cpuspeed18:19:215
257295499100,9cyclictest2819606-21expr17:24:195
257295499100,9cyclictest2751253-21cut16:49:275
257295499100,9cyclictest2727631-21chrt16:34:515
257295499100,9cyclictest2698251-21cpuspeed16:24:195
257295499100,9cyclictest2698251-21cpuspeed16:24:195
25729549990,8cyclictest3152795-21cpuspeed_turbos20:09:205
25729549990,8cyclictest3152795-21cpuspeed_turbos20:09:205
25729479997,2cyclictest3081347-21kworker/u16:1+flush-8:019:44:254
25729479997,2cyclictest2788231-21kworker/u16:4+flush-8:019:01:494
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional