You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 21:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 03, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
756347995349,3cyclictest1297922-21fwupd17:29:137
75590525340,10sleep40-21swapper/415:21:154
756339995148,2cyclictest961034-21kworker/u16:4+flush-8:017:22:475
756347995044,5cyclictest589235-21systemd-journal20:07:467
756347994944,4cyclictest951863-21latency_hist16:57:487
756347994744,2cyclictest982293-21cat17:12:477
756335994745,2cyclictest840706-21kworker/u16:2+events_unbound16:11:584
74719124712,30sleep70-21swapper/715:18:057
756347994640,5cyclictest1053104-21latency_hist17:47:477
756339994644,2cyclictest911666-21kworker/u16:3+flush-8:016:38:145
756335994542,2cyclictest1120108-21kworker/u16:0+events_unbound18:19:194
756339994341,2cyclictest1264638-21kworker/u16:3+flush-8:020:28:155
756335994239,2cyclictest1120108-21kworker/u16:0+flush-8:018:38:134
756335994139,2cyclictest1124892-21kworker/u16:2+events_unbound18:37:144
756347994035,4cyclictest851008-21latency_hist16:07:487
756335994038,2cyclictest1406305-21kworker/u16:4+events_unbound20:52:224
756345993937,2cyclictest1264638-21kworker/u16:3+flush-8:020:28:116
756345993836,2cyclictest1012188-21kworker/u16:3+events_unbound17:46:136
756339993836,2cyclictest811089-21kworker/u16:1+events_unbound16:01:585
75592523828,7sleep60-21swapper/615:21:336
756347993735,1cyclictest1325405-21latency_hist20:02:467
756345993735,2cyclictest799675-21kworker/u16:4+events_unbound15:44:096
756345993735,2cyclictest799675-21kworker/u16:4+events_unbound15:44:096
756335993735,2cyclictest961034-21kworker/u16:4+events_unbound17:09:154
756335993735,2cyclictest891138-21kworker/u16:1+events_unbound16:45:114
75593323727,7sleep50-21swapper/515:21:405
756347993635,0cyclictest0-21swapper/718:43:077
756347993632,3cyclictest4184977-17auditd17:57:067
756345993634,2cyclictest953043-21kworker/u16:0+events_unbound16:59:506
756345993634,2cyclictest911666-21kworker/u16:3+events_unbound16:40:126
756339993634,2cyclictest1345777-21kworker/u16:0+events_unbound20:20:215
756339993634,2cyclictest1022411-21kworker/u16:6+events_unbound17:53:585
756335993634,2cyclictest1022411-21kworker/u16:6+events_unbound17:45:114
756339993533,2cyclictest1143667-21kworker/u16:3+events_unbound18:30:125
756335993533,2cyclictest941813-21kworker/u16:5+events_unbound17:19:154
756335993533,2cyclictest1345777-21kworker/u16:0+flush-8:020:41:574
756335993533,2cyclictest1012188-21kworker/u16:3+events_unbound17:57:494
756345993432,2cyclictest860169-21kworker/u16:0+events_unbound16:15:586
756339993432,2cyclictest1355865-21kworker/u16:1+flush-8:020:38:165
756335993432,2cyclictest1002773-21kworker/u16:0+events_unbound17:29:424
756345993331,2cyclictest1244455-21kworker/u16:1+events_unbound19:20:586
756345993331,2cyclictest1164161-21kworker/u16:2+events_unbound19:14:276
756345993331,2cyclictest1083798-21kworker/u16:0+flush-8:018:04:146
756339993331,2cyclictest840706-21kworker/u16:2+events_unbound17:29:295
756339993331,2cyclictest790405-21kworker/u16:3+events_unbound16:06:475
756339993331,2cyclictest1244455-21kworker/u16:1+events_unbound19:34:145
756339993331,2cyclictest1164161-21kworker/u16:2+events_unbound18:59:135
756335993330,2cyclictest953043-21kworker/u16:0+events_unbound17:12:504
756347993230,1cyclictest0-21swapper/715:27:497
756345993230,2cyclictest961034-21kworker/u16:4+flush-8:017:12:036
756345993230,2cyclictest861187-21kworker/u16:4+events_unbound16:21:596
756345993230,2cyclictest790405-21kworker/u16:3+flush-8:015:38:506
756345993230,2cyclictest1264638-21kworker/u16:3+flush-8:019:59:466
756345993230,2cyclictest1002773-21kworker/u16:0+events_unbound17:25:136
756339993230,2cyclictest790405-21kworker/u16:3+flush-8:015:39:125
756339993230,2cyclictest746076-21kworker/u16:2+flush-8:015:29:145
756339993230,2cyclictest1406305-21kworker/u16:4+flush-8:020:52:305
756339993230,2cyclictest1264638-21kworker/u16:3+events_unbound20:24:585
756339993230,2cyclictest1164161-21kworker/u16:2+events_unbound19:30:115
756339993229,2cyclictest911666-21kworker/u16:3+flush-8:016:57:585
756335993230,2cyclictest1012188-21kworker/u16:3+flush-8:018:09:114
756347993130,0cyclictest0-21swapper/715:58:077
756347993126,4cyclictest992298-21latency_hist17:17:477
756345993129,2cyclictest1406305-21kworker/u16:4+events_unbound20:52:186
756345993129,2cyclictest1355865-21kworker/u16:1+events_unbound20:19:266
756345993129,2cyclictest1264638-21kworker/u16:3+events_unbound20:09:016
756345993129,2cyclictest1244455-21kworker/u16:1+events_unbound19:32:306
756345993128,2cyclictest1143667-21kworker/u16:3+events_unbound18:52:546
756339993129,2cyclictest941813-21kworker/u16:5+events_unbound16:55:465
756339993129,2cyclictest1264638-21kworker/u16:3+flush-8:019:38:385
756339993129,2cyclictest1120108-21kworker/u16:0+flush-8:019:03:015
756339993129,2cyclictest1012188-21kworker/u16:3+events_unbound17:39:035
756345993028,2cyclictest961034-21kworker/u16:4+events_unbound17:19:546
756345993028,2cyclictest911666-21kworker/u16:3+events_unbound16:57:126
756345993028,2cyclictest891138-21kworker/u16:1+events_unbound16:50:576
756345993028,2cyclictest1395658-21kworker/u16:2+events_unbound20:44:116
756345993028,2cyclictest1164161-21kworker/u16:2+flush-8:019:02:256
756345993028,2cyclictest1153877-21kworker/u16:1+events_unbound18:39:116
756345993028,2cyclictest1022411-21kworker/u16:6+events_unbound18:19:116
756339993028,2cyclictest860169-21kworker/u16:0+flush-8:016:16:585
756339993028,2cyclictest811089-21kworker/u16:1+events_unbound16:11:545
756339993028,2cyclictest1395658-21kworker/u16:2+events_unbound20:36:095
756339993028,2cyclictest1264638-21kworker/u16:3+events_unbound20:05:385
756339993028,2cyclictest1264638-21kworker/u16:3+events_unbound20:00:415
756339993028,2cyclictest1164161-21kworker/u16:2+flush-8:019:45:145
756339993028,2cyclictest1153877-21kworker/u16:1+events_unbound18:38:205
756335993028,2cyclictest1244455-21kworker/u16:1+events_unbound19:22:464
756347992924,4cyclictest830893-21awk15:57:477
756345992927,2cyclictest840706-21kworker/u16:2+events_unbound16:29:196
756345992927,2cyclictest735816-21kworker/u16:0+events_unbound15:50:516
756345992927,2cyclictest1164161-21kworker/u16:2+events_unbound20:06:096
756345992927,2cyclictest1120108-21kworker/u16:0+flush-8:019:07:476
756345992927,2cyclictest1012188-21kworker/u16:3+events_unbound18:02:036
756345992927,2cyclictest1012188-21kworker/u16:3+events_unbound17:56:156
756339992927,2cyclictest941813-21kworker/u16:5+events_unbound17:14:025
756339992927,2cyclictest840706-21kworker/u16:2+flush-8:016:19:065
756339992927,2cyclictest840706-21kworker/u16:2+events_unbound16:44:265
756339992927,2cyclictest735816-21kworker/u16:0+events_unbound15:24:035
756339992927,2cyclictest1264638-21kworker/u16:3+flush-8:020:09:095
756339992927,2cyclictest1164161-21kworker/u16:2+events_unbound19:49:135
756339992927,2cyclictest1120108-21kworker/u16:0+events_unbound19:10:195
756339992927,2cyclictest1120108-21kworker/u16:0+events_unbound18:26:295
756339992927,2cyclictest1002773-21kworker/u16:0+flush-8:017:37:145
756335992927,2cyclictest811089-21kworker/u16:1+events_unbound15:57:424
756335992927,2cyclictest699811-21kworker/u16:1+events_unbound15:25:134
756347992827,0cyclictest0-21swapper/719:13:137
756347992826,1cyclictest0-21swapper/716:13:067
75634799280,26cyclictest1063204-21latency_hist17:52:477
756345992826,2cyclictest891138-21kworker/u16:1+events_unbound16:44:066
756345992826,2cyclictest860169-21kworker/u16:0+events_unbound16:25:196
756345992826,2cyclictest790405-21kworker/u16:3+events_unbound16:05:506
756345992826,2cyclictest746076-21kworker/u16:2+events_unbound15:24:546
756345992826,2cyclictest1264638-21kworker/u16:3+flush-8:019:40:146
756345992826,2cyclictest1264638-21kworker/u16:3+events_unbound20:27:296
756345992826,2cyclictest1264638-21kworker/u16:3+events_unbound19:48:576
756345992826,2cyclictest1264638-21kworker/u16:3+events_unbound19:35:516
756345992826,2cyclictest1143667-21kworker/u16:3+flush-8:018:44:306
756345992826,2cyclictest1120108-21kworker/u16:0+events_unbound18:37:026
756345992825,2cyclictest1355865-21kworker/u16:1+events_unbound20:32:556
756339992826,2cyclictest961034-21kworker/u16:4+events_unbound17:06:065
756339992826,2cyclictest840706-21kworker/u16:2+events_unbound17:25:035
756339992826,2cyclictest790405-21kworker/u16:3+events_unbound15:56:105
756339992826,2cyclictest790405-21kworker/u16:3+events_unbound15:48:275
756339992826,2cyclictest1153877-21kworker/u16:1+events_unbound18:37:455
756339992826,2cyclictest1143667-21kworker/u16:3+flush-8:018:55:495
756339992826,2cyclictest1083798-21kworker/u16:0+events_unbound18:06:135
756339992826,2cyclictest1050114-21kworker/u16:2+events_unbound18:00:025
756335992826,2cyclictest840706-21kworker/u16:2+flush-8:017:27:304
756335992826,2cyclictest1264638-21kworker/u16:3+events_unbound19:54:104
756335992826,2cyclictest1120108-21kworker/u16:0+flush-8:018:52:114
756335992824,3cyclictest1164161-21kworker/u16:2+events_unbound19:23:014
75634799270,25cyclictest4175659-21snmpd19:22:477
756345992725,2cyclictest961034-21kworker/u16:4+events_unbound17:05:036
756345992725,2cyclictest1264638-21kworker/u16:3+events_unbound20:16:466
756345992725,2cyclictest1223640-21kworker/u16:1+events_unbound19:11:476
756345992725,2cyclictest1153877-21kworker/u16:1+flush-8:018:50:026
756345992725,2cyclictest1050114-21kworker/u16:2+events_unbound17:49:076
756345992724,2cyclictest811089-21kworker/u16:1+events_unbound15:52:526
756339992725,2cyclictest1164161-21kworker/u16:2+events_unbound19:56:265
756339992725,2cyclictest1012188-21kworker/u16:3+events_unbound18:10:065
756335992725,2cyclictest1345777-21kworker/u16:0+events_unbound20:45:224
756335992725,2cyclictest1164161-21kworker/u16:2+flush-8:018:59:114
756335992725,2cyclictest1012188-21kworker/u16:3+flush-8:017:52:154
75634799260,24cyclictest810702-21latency_hist15:47:477
75634799260,24cyclictest810702-21latency_hist15:47:477
756345992624,2cyclictest790405-21kworker/u16:3+events_unbound15:59:026
756345992624,2cyclictest1042735-21kworker/u16:1+events_unbound18:30:026
756345992624,2cyclictest1042735-21kworker/u16:1+events_unbound18:10:316
756345992624,2cyclictest1012188-21kworker/u16:3+events_unbound18:17:276
756345992624,2cyclictest1002773-21kworker/u16:0+events_unbound17:41:266
756339992624,2cyclictest961034-21kworker/u16:4+events_unbound17:09:195
756339992624,2cyclictest861187-21kworker/u16:4+flush-8:016:34:385
756339992624,2cyclictest790405-21kworker/u16:3+flush-8:015:46:595
756339992624,2cyclictest790405-21kworker/u16:3+flush-8:015:46:595
756339992624,2cyclictest735816-21kworker/u16:0+events_unbound15:37:015
756339992624,2cyclictest1264638-21kworker/u16:3+events_unbound20:17:395
756339992624,2cyclictest1164161-21kworker/u16:2+flush-8:019:16:255
756339992624,2cyclictest1153877-21kworker/u16:1+flush-8:018:51:305
756339992624,2cyclictest1042735-21kworker/u16:1+events_unbound18:14:575
756339992624,2cyclictest1022411-21kworker/u16:6+flush-8:017:48:345
756335992624,2cyclictest911666-21kworker/u16:3+flush-8:016:38:134
756335992624,2cyclictest1124892-21kworker/u16:2+flush-8:018:31:124
756335992623,2cyclictest1164161-21kworker/u16:2+events_unbound19:13:034
756347992521,2cyclictest961956-21munin-run17:02:477
756347992520,4cyclictest1405918-21latency_hist20:42:477
756345992523,2cyclictest1355865-21kworker/u16:1+events_unbound20:39:306
756345992523,2cyclictest1264638-21kworker/u16:3+flush-8:019:57:126
756345992523,2cyclictest1244455-21kworker/u16:1+events_unbound19:26:176
756339992523,2cyclictest1345777-21kworker/u16:0+events_unbound20:44:335
756339992523,2cyclictest1244455-21kworker/u16:1+events_unbound19:25:345
756339992523,2cyclictest1234187-21kworker/u16:4+events_unbound19:19:385
756339992523,2cyclictest1120108-21kworker/u16:0+flush-8:018:19:155
756335992523,2cyclictest1264638-21kworker/u16:3+flush-8:020:00:374
756335992523,2cyclictest1120108-21kworker/u16:0+events_unbound19:30:504
756335992523,2cyclictest1022411-21kworker/u16:6+flush-8:017:53:124
756347992423,0cyclictest0-21swapper/719:38:067
756345992422,2cyclictest891138-21kworker/u16:1+flush-8:016:37:266
756345992422,2cyclictest840706-21kworker/u16:2+flush-8:016:09:236
756345992422,2cyclictest1164161-21kworker/u16:2+events_unbound19:45:106
756345992422,2cyclictest1012188-21kworker/u16:3+flush-8:017:31:226
756339992422,2cyclictest861187-21kworker/u16:4+events_unbound16:30:065
756339992422,2cyclictest1143667-21kworker/u16:3+events_unbound18:44:025
756335992422,2cyclictest840706-21kworker/u16:2+flush-8:016:04:104
756335992422,2cyclictest811089-21kworker/u16:1+events_unbound15:51:504
756335992422,2cyclictest1324253-21kworker/u16:4+events_unbound20:25:574
756335992422,2cyclictest1264638-21kworker/u16:3+events_unbound20:11:574
756335992421,2cyclictest891138-21kworker/u16:1+events_unbound16:47:494
756347992317,5cyclictest1274834-21latency_hist19:37:477
756345992321,2cyclictest1022411-21kworker/u16:6+events_unbound17:34:496
756339992321,2cyclictest840706-21kworker/u16:2+flush-8:016:49:495
756339992319,3cyclictest840706-21kworker/u16:2+flush-8:016:22:475
756335992321,2cyclictest840706-21kworker/u16:2+events_unbound16:21:114
756335992321,2cyclictest1264638-21kworker/u16:3+events_unbound19:48:374
756335992321,2cyclictest1120108-21kworker/u16:0+flush-8:018:23:114
756335992321,2cyclictest1002773-21kworker/u16:0+events_unbound17:40:574
756345992220,2cyclictest941813-21kworker/u16:5+events_unbound17:14:086
756345992220,2cyclictest735816-21kworker/u16:0+flush-8:015:29:116
756345992220,2cyclictest1042735-21kworker/u16:1+events_unbound18:24:456
756339992220,2cyclictest1002773-21kworker/u16:0+flush-8:017:43:025
756335992220,2cyclictest840706-21kworker/u16:2+flush-8:017:03:224
756335992220,2cyclictest840706-21kworker/u16:2+flush-8:016:58:144
756335992220,2cyclictest790405-21kworker/u16:3+events_unbound15:43:044
756335992220,2cyclictest790405-21kworker/u16:3+events_unbound15:43:044
756347992120,0cyclictest0-21swapper/718:36:477
756347992117,3cyclictest589235-21systemd-journal20:22:487
756335992119,2cyclictest1355865-21kworker/u16:1+events_unbound20:18:204
756335992119,2cyclictest1264638-21kworker/u16:3+flush-8:020:07:304
756335992119,2cyclictest1244455-21kworker/u16:1+events_unbound19:37:134
756335992119,2cyclictest1164161-21kworker/u16:2+events_unbound19:44:494
756335992119,2cyclictest1164161-21kworker/u16:2+events_unbound19:04:224
756335992119,2cyclictest1143667-21kworker/u16:3+flush-8:018:54:144
756335992119,2cyclictest1083798-21kworker/u16:0+flush-8:018:03:434
756345992018,2cyclictest699811-21kworker/u16:1+events_unbound15:34:486
756335992018,2cyclictest811089-21kworker/u16:1+flush-8:015:58:124
756335992018,2cyclictest1244455-21kworker/u16:1+events_unbound19:41:124
756347991918,0cyclictest0-21swapper/719:23:037
756347991918,0cyclictest0-21swapper/718:00:537
756335991917,2cyclictest840706-21kworker/u16:2+flush-8:016:33:574
756347991817,0cyclictest0-21swapper/718:03:037
756347991815,2cyclictest4175659-21snmpd16:37:137
75634799180,16cyclictest1395508-21sshd-session20:33:217
756335991816,2cyclictest861187-21kworker/u16:4+flush-8:016:30:124
756335991815,2cyclictest941813-21kworker/u16:5+flush-8:016:54:534
756347991716,0cyclictest0-21swapper/715:33:127
756335991715,2cyclictest861187-21kworker/u16:4+flush-8:016:23:134
756335991714,2cyclictest735816-21kworker/u16:0+flush-8:015:33:054
756347991615,0cyclictest0-21swapper/716:23:057
756347991611,4cyclictest1103534-21latency_hist18:12:477
756335991614,2cyclictest1002773-21kworker/u16:0+flush-8:017:34:124
756347991514,0cyclictest0-21swapper/715:38:587
756347991513,1cyclictest0-21swapper/715:48:037
75634799150,14cyclictest589235-21systemd-journal17:36:117
756335991513,2cyclictest1355865-21kworker/u16:1+flush-8:020:33:134
756335991513,2cyclictest1120108-21kworker/u16:0+flush-8:018:43:184
756335991513,2cyclictest1120108-21kworker/u16:0+events_unbound19:09:504
75634799149,4cyclictest1222430-21tr19:08:077
75634799148,5cyclictest1365577-21latency_hist20:22:477
75634799144,8cyclictest0-21swapper/719:43:117
756347991413,0cyclictest0-21swapper/718:48:057
756347991412,1cyclictest0-21swapper/720:43:137
75634799140,1cyclictest0-21swapper/716:43:127
75634799140,13cyclictest1133769-21turbostat18:27:477
756335991412,2cyclictest860169-21kworker/u16:0+flush-8:016:13:034
756335991412,2cyclictest735816-21kworker/u16:0+flush-8:015:38:394
75634799136,6cyclictest0-21swapper/717:21:117
756347991312,0cyclictest0-21swapper/716:18:157
75634799130,7cyclictest1214347-21latency_hist19:07:487
756335991312,1cyclictest0-21swapper/420:16:584
756335991311,2cyclictest1264638-21kworker/u16:3+events_unbound20:28:494
756335991310,3cyclictest1042735-21kworker/u16:1+flush-8:018:13:014
75634799129,2cyclictest4175659-21snmpd20:15:037
75634799129,2cyclictest4175659-21snmpd19:53:477
75634799129,2cyclictest4175659-21snmpd19:31:207
75634799129,2cyclictest4175659-21snmpd18:16:577
75634799129,2cyclictest1376092-21/usr/sbin/munin20:28:137
75634799128,3cyclictest4175659-21snmpd16:29:017
75634799128,3cyclictest27763-21gvfs-afc-volume17:23:107
75634799127,4cyclictest1123693-21latency_hist18:22:477
75634799126,5cyclictest1143870-21latency_hist18:32:477
75634799125,6cyclictest0-21swapper/715:25:127
756347991210,1cyclictest0-21swapper/718:38:077
75634799120,2cyclictest917927-21cut16:38:087
75634799120,11cyclictest0-21swapper/717:03:167
75634799120,10cyclictest4175659-21snmpd18:54:017
75634799118,2cyclictest4175659-21snmpd19:50:267
75634799114,6cyclictest0-21swapper/720:50:467
75634799111,8cyclictest0-21swapper/716:08:107
75634799110,3cyclictest1043013-21munin-run17:42:477
75633599119,2cyclictest746076-21kworker/u16:2+flush-8:015:28:164
75634799107,2cyclictest4175659-21snmpd20:08:147
756347991010,0cyclictest0-21swapper/716:48:087
75634799100,2cyclictest589235-21systemd-journal18:57:477
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional