You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 03:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Fri Nov 07, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409657099119104,9cyclictest4190498-40mandb00:00:011
4096570998781,4cyclictest4094837-21kworker/u8:3+events_unbound19:10:251
4096569998782,4cyclictest4120483-21kworker/u8:3+events_unbound20:35:270
4096570998574,4cyclictest4162623-21kworker/u8:3+flush-179:000:35:261
4096570998478,4cyclictest4185989-21kworker/u8:0+events_unbound23:55:011
4096569998277,4cyclictest4115648-21kworker/u8:0+flush-179:020:15:280
4096569998277,4cyclictest4115648-21kworker/u8:0+flush-179:020:15:270
409656999820,80cyclictest1-21systemd22:05:000
4096570998175,4cyclictest4118828-21kworker/u8:1+events_unbound20:25:001
4096569998173,3cyclictest4150978-21kworker/u8:3+events_unbound22:20:250
4096569997772,4cyclictest4146148-21kworker/u8:0+flush-179:021:50:240
4096570997667,7cyclictest4172695-21/usr/sbin/munin23:05:241
4096569997670,5cyclictest4120483-21kworker/u8:3+events_unbound21:15:020
4096570997564,8cyclictest4133178-21latency_hist21:05:011
4096569997571,3cyclictest4125262-21kworker/u8:0+events_unbound20:50:290
4096569997571,3cyclictest4115648-21kworker/u8:0+events_unbound20:10:250
4096569997566,7cyclictest4115667-21latency_hist20:10:010
4096569997470,3cyclictest4162623-21kworker/u8:3+events_unbound23:30:250
4096570997367,4cyclictest4141425-21kworker/u8:3+events_unbound21:35:221
4096569997267,4cyclictest4091827-21kworker/u8:0+events_unbound19:15:240
4096570997164,5cyclictest4141365-21kworker/u8:2+flush-179:021:45:001
4096570997161,7cyclictest4096300-21latency_hist19:10:031
4096570996964,3cyclictest4091827-21kworker/u8:0+flush-179:019:30:011
4096570996960,6cyclictest4193717-21latency_hist00:10:011
4096570996863,4cyclictest4133156-21kworker/u8:0+flush-179:021:20:001
4096570996863,3cyclictest4109285-21kworker/u8:2+flush-179:020:15:011
4096570996861,5cyclictest4109339-21kworker/u8:3+flush-179:019:50:261
4096570996857,6cyclictest4162623-21kworker/u8:3+events_unbound23:00:001
4096569996863,4cyclictest4109339-21kworker/u8:3+events_unbound20:00:240
4096569996863,4cyclictest4094837-21kworker/u8:3+events_unbound19:10:030
4096570996761,4cyclictest4162622-21kworker/u8:0+flush-179:022:35:001
4096569996758,7cyclictest271-21systemd-journal00:04:010
4096570996655,8cyclictest4185449-21latency_hist23:45:011
4096569996661,4cyclictest4146148-21kworker/u8:0+events_unbound22:10:250
4096570996459,4cyclictest4157726-21kworker/u8:2+events_unbound22:25:161
4096570996255,5cyclictest4141365-21kworker/u8:2+flush-179:021:45:241
4096569996257,4cyclictest4182031-21kworker/u8:2+events_unbound23:40:260
4096570996156,3cyclictest4133156-21kworker/u8:0+events_unbound21:20:141
4096570996154,5cyclictest4162623-21kworker/u8:3+events_unbound23:30:011
4096570996054,5cyclictest4146148-21kworker/u8:0+flush-179:022:10:011
4096570996054,4cyclictest4118828-21kworker/u8:1+flush-179:020:25:201
4096570996052,6cyclictest4185989-21kworker/u8:0+flush-179:023:45:261
4096570996052,6cyclictest4185989-21kworker/u8:0+flush-179:023:45:251
4096570995955,3cyclictest4150978-21kworker/u8:3+flush-179:022:15:001
4096570995953,4cyclictest4091827-21kworker/u8:0+flush-179:019:45:211
4096569995955,3cyclictest4162623-21kworker/u8:3+events_unbound23:15:190
4096569995955,3cyclictest4162622-21kworker/u8:0+flush-179:022:45:230
4096569995949,7cyclictest4107720-21latency_hist19:45:010
4096570995853,4cyclictest4091827-21kworker/u8:0+flush-179:019:34:551
4096570995853,3cyclictest4162622-21kworker/u8:0+flush-179:022:45:001
4096570995850,6cyclictest271-21systemd-journal20:00:001
4096569995853,4cyclictest4185989-21kworker/u8:0+flush-179:023:45:270
4096569995853,4cyclictest4185989-21kworker/u8:0+flush-179:023:45:270
4096569995853,4cyclictest4118828-21kworker/u8:1+flush-179:020:20:210
4096570995752,4cyclictest4123606-21kworker/u8:2+flush-179:020:40:001
4096569995752,4cyclictest4141425-21kworker/u8:3+events_unbound21:35:240
4096569995751,4cyclictest4141365-21kworker/u8:2+flush-179:021:40:200
4096569995747,8cyclictest4111127-21/usr/sbin/munin19:55:260
4096570995651,3cyclictest4190765-21kworker/u8:4+flush-179:000:00:181
4096570995550,4cyclictest4120483-21kworker/u8:3+events_unbound21:10:241
4096569995551,3cyclictest4187026-21kworker/u8:1+flush-179:023:54:550
4096569995551,3cyclictest4162623-21kworker/u8:3+flush-179:000:20:240
4096569995551,3cyclictest4162623-21kworker/u8:3+flush-179:000:05:210
4096570995449,4cyclictest4120483-21kworker/u8:3+flush-179:020:34:551
4096570995446,6cyclictest271-21systemd-journal19:20:001
4096570995442,11cyclictest4109285-21kworker/u8:2+events_unbound20:05:201
4096569995446,6cyclictest271-21systemd-journal21:30:000
4096569995440,10cyclictest4141425-21kworker/u8:3+flush-179:021:35:000
4096570995347,4cyclictest4115648-21kworker/u8:0+flush-179:020:15:191
4096570995347,4cyclictest4115648-21kworker/u8:0+flush-179:020:15:191
4096570995343,8cyclictest4158087-21apt-get22:20:121
4096569995349,3cyclictest4178857-21kworker/u8:0+flush-179:023:25:210
4096570995246,4cyclictest4185989-21kworker/u8:0+flush-179:000:10:281
4096570995246,4cyclictest4162622-21kworker/u8:0+events_unbound23:00:201
4096570995245,5cyclictest4146148-21kworker/u8:0+flush-179:021:50:231
4096569995248,3cyclictest6676-21kworker/u8:2+flush-179:000:29:560
4096569995247,4cyclictest4162623-21kworker/u8:3+flush-179:023:35:200
4096569995247,4cyclictest4162623-21kworker/u8:3+flush-179:022:50:170
4096569995247,4cyclictest4081683-21kworker/u8:1+events_unbound19:35:150
4096575995046,2cyclictest0-21swapper/222:38:592
4096570995045,4cyclictest4162623-21kworker/u8:3+flush-179:023:20:221
4096569995046,3cyclictest4120483-21kworker/u8:3+flush-179:021:10:260
4096570994944,4cyclictest4185989-21kworker/u8:0+flush-179:000:20:001
4096570994940,7cyclictest4162876-21/usr/sbin/munin22:35:261
4096569994945,3cyclictest4081683-21kworker/u8:1+flush-179:019:30:250
4096569994942,5cyclictest4165833-21latency_hist22:45:010
4096580994845,2cyclictest0-21swapper/322:38:593
4096570994842,4cyclictest4162623-21kworker/u8:3+flush-179:000:25:031
4096570994842,3cyclictest4178857-21kworker/u8:0+flush-179:023:30:151
4096570994839,7cyclictest4167673-21apt-get22:50:121
4096570994839,7cyclictest4125485-21apt-get20:40:151
4096569994844,3cyclictest6676-21kworker/u8:2+events_unbound00:30:230
4670791460,13ptp4l441ktimers/319:10:003
409658099460,44cyclictest4102953-21turbostat19:29:593
4096570994638,6cyclictest4183591-21apt-get23:40:001
4096570994636,4cyclictest4091827-21kworker/u8:0+events_unbound19:35:241
4096569994642,3cyclictest4162623-21kworker/u8:3+flush-179:022:55:260
4096569994642,3cyclictest4091827-21kworker/u8:0+events_unbound19:25:230
4096569994641,4cyclictest4157631-21kworker/u8:1+events_unbound22:27:270
4096570994540,4cyclictest4120483-21kworker/u8:3+flush-179:020:50:291
4096570994540,4cyclictest4081683-21kworker/u8:1+flush-179:019:41:261
4096569994541,3cyclictest4141365-21kworker/u8:2+flush-179:022:05:250
4096569994541,3cyclictest4120483-21kworker/u8:3+flush-179:021:05:250
4096569994540,4cyclictest4120483-21kworker/u8:3+events_unbound20:40:270
4096569994540,3cyclictest4162622-21kworker/u8:0+events_unbound22:40:010
4096569994537,3cyclictest4120483-21kworker/u8:3+events_unbound20:45:220
4096570994438,5cyclictest4120483-21kworker/u8:3+flush-179:020:55:211
4096569994440,3cyclictest4162623-21kworker/u8:3+flush-179:000:10:220
4096570994338,4cyclictest4146148-21kworker/u8:0+flush-179:022:15:221
4096570994337,5cyclictest4141365-21kworker/u8:2+flush-179:021:31:271
4096569994338,4cyclictest4146148-21kworker/u8:0+flush-179:022:19:550
4096569994338,4cyclictest4141365-21kworker/u8:2+events_unbound21:45:290
409657599420,39cyclictest0-21swapper/222:18:592
4096570994236,5cyclictest4146148-21kworker/u8:0+events_unbound22:00:261
4096569994238,3cyclictest4118828-21kworker/u8:1+flush-179:020:25:260
409658099410,39cyclictest4112477-21turbostat20:00:003
4096570994137,3cyclictest4162623-21kworker/u8:3+events_unbound00:30:291
4096570994136,4cyclictest4162623-21kworker/u8:3+flush-179:023:16:281
4096570994136,4cyclictest4109339-21kworker/u8:3+flush-179:020:00:171
4096569994137,3cyclictest4162623-21kworker/u8:3+events_unbound23:20:200
4096569994137,3cyclictest4162623-21kworker/u8:3+events_unbound23:14:270
4096569994137,3cyclictest4120483-21kworker/u8:3+flush-179:020:55:250
4096580994035,4cyclictest4141403-21turbostat21:30:003
4096580994035,4cyclictest4117266-21turbostat20:15:003
4096580994024,5cyclictest4188882-21turbostat23:55:003
409658099400,39cyclictest4147768-21turbostat21:50:003
409658099400,39cyclictest0-21swapper/322:18:593
409658099400,38cyclictest4107732-21turbostat19:45:003
409658099400,38cyclictest3252-21turbostat00:19:593
409657599400,37cyclictest0-21swapper/200:23:582
4096570994034,4cyclictest4162623-21kworker/u8:3+events_unbound00:20:171
4096570994033,5cyclictest4162622-21kworker/u8:0+flush-179:022:45:261
4096569994035,4cyclictest4185989-21kworker/u8:0+events_unbound00:15:150
4096569994035,4cyclictest4091827-21kworker/u8:0+flush-179:019:20:060
409656999400,38cyclictest723-21Xorg19:49:590
4096580993934,4cyclictest4098183-21turbostat19:15:013
409658099390,37cyclictest0-21swapper/320:24:553
4096570993934,4cyclictest4162622-21kworker/u8:0+flush-179:023:10:251
4096570993932,3cyclictest4123606-21kworker/u8:2+events_unbound20:45:211
409656999391,36cyclictest8547-21apt-get00:35:140
4096580993833,4cyclictest4149350-21turbostat21:59:553
4096580993832,5cyclictest4190469-21turbostat23:59:593
409658099380,37cyclictest0-21swapper/323:26:593
4096575993835,2cyclictest0-21swapper/221:30:002
409657599380,36cyclictest0-21swapper/219:50:012
409657599380,35cyclictest0-21swapper/220:24:562
4096570993833,4cyclictest4141365-21kworker/u8:2+events_unbound21:55:211
4096580993733,2cyclictest0-21swapper/300:12:593
4096580993732,4cyclictest4169012-21turbostat22:55:013
4096580993732,4cyclictest4126839-21turbostat20:45:003
409658099370,36cyclictest0-21swapper/300:23:593
4096575993734,2cyclictest0-21swapper/222:34:552
4096575993733,2cyclictest0-21swapper/221:59:552
4096575993733,2cyclictest0-21swapper/200:12:592
4096575993724,2cyclictest0-21swapper/223:55:002
409657599370,35cyclictest0-21swapper/223:26:582
409657599370,2cyclictest0-21swapper/223:19:002
409657599370,2cyclictest0-21swapper/219:11:582
4096570993734,2cyclictest723-21Xorg19:21:591
4096570993725,5cyclictest4120483-21kworker/u8:3+events_unbound21:05:141
4096569993733,3cyclictest4185989-21kworker/u8:0+events_unbound23:59:020
4096569993733,3cyclictest4109339-21kworker/u8:3+events_unbound19:50:240
4096580993634,1cyclictest0-21swapper/322:34:553
4096580993630,4cyclictest4167431-21turbostat22:50:003
4096575993634,1cyclictest0-21swapper/220:15:002
4096575993633,2cyclictest0-21swapper/220:49:592
4096575993632,2cyclictest0-21swapper/222:11:592
409657599360,1cyclictest0-21swapper/221:50:002
4096569993632,3cyclictest4162622-21kworker/u8:0+events_unbound23:02:270
4096569993631,4cyclictest4118828-21kworker/u8:1+events_unbound20:30:280
4096580993532,2cyclictest0-21swapper/322:11:593
4096580993531,2cyclictest0-21swapper/323:33:003
4096575993532,2cyclictest0-21swapper/222:55:012
4096575993531,2cyclictest0-21swapper/223:33:002
4096575993531,2cyclictest0-21swapper/222:07:592
409657599350,27cyclictest0-21swapper/223:35:152
4096569993530,4cyclictest4162622-21kworker/u8:0+events_unbound22:33:280
4096580993432,1cyclictest0-21swapper/320:49:593
409658099340,28cyclictest0-21swapper/323:35:153
4096575993432,1cyclictest0-21swapper/220:45:012
4096575993432,1cyclictest0-21swapper/200:00:002
4096569993430,3cyclictest4141365-21kworker/u8:2+events_unbound21:58:270
4096569993427,5cyclictest723-21Xorg21:01:590
4096569993330,2cyclictest4096631-21apt-config19:10:010
4096580993230,1cyclictest0-21swapper/322:07:593
4096580993229,2cyclictest4125222-21turbostat20:40:003
4096575993229,2cyclictest0-21swapper/222:03:592
4096575993227,2cyclictest0-21swapper/222:45:592
409657599320,2cyclictest0-21swapper/219:52:592
409657599320,28cyclictest0-21swapper/219:35:142
4096570993226,4cyclictest4140057-21apt-get21:25:151
4096569993228,3cyclictest4138185-21kworker/u8:1+events_unbound21:20:230
4096580993127,2cyclictest0-21swapper/322:56:593
4096580993127,2cyclictest0-21swapper/320:01:593
409658099310,2cyclictest0-21swapper/319:30:173
409658099310,29cyclictest0-21swapper/300:00:183
4096575993128,2cyclictest0-21swapper/220:37:592
4096575993127,2cyclictest0-21swapper/222:56:592
409657599310,30cyclictest0-21swapper/200:00:172
409657599310,2cyclictest0-21swapper/223:10:142
4096569993126,4cyclictest0-21swapper/023:05:140
4096580993027,2cyclictest0-21swapper/321:40:143
4096580993023,5cyclictest4149350-21turbostat21:55:003
409658099300,29cyclictest0-21swapper/322:20:033
4096575993027,2cyclictest0-21swapper/222:20:032
4096575993027,2cyclictest0-21swapper/221:40:152
4096575993027,2cyclictest0-21swapper/220:02:002
409657599300,2cyclictest0-21swapper/221:35:112
409657599300,28cyclictest0-21swapper/223:49:002
409657599300,28cyclictest0-21swapper/223:48:592
409657599300,28cyclictest0-21swapper/221:50:132
409657599300,28cyclictest0-21swapper/220:50:162
409657599300,28cyclictest0-21swapper/219:30:162
409657599300,28cyclictest0-21swapper/200:30:182
409657599300,27cyclictest0-21swapper/219:27:592
4096580992926,2cyclictest0-21swapper/322:25:133
4096580992923,5cyclictest4152542-21turbostat22:05:003
4096580992923,4cyclictest4144580-21turbostat21:40:003
409658099290,28cyclictest0-21swapper/321:03:593
409658099290,27cyclictest0-21swapper/320:50:163
409658099290,27cyclictest0-21swapper/300:30:183
409658099290,1cyclictest0-21swapper/320:05:173
409658099290,1cyclictest0-21swapper/319:52:593
4096575992925,2cyclictest0-21swapper/200:08:592
409657599290,27cyclictest0-21swapper/221:04:002
409657599290,27cyclictest0-21swapper/220:05:182
409657599290,27cyclictest0-21swapper/200:15:032
409657599290,26cyclictest0-21swapper/221:15:152
4670791280,8ptp4l441ktimers/321:10:013
4096580992825,2cyclictest0-21swapper/323:05:003
409658099280,27cyclictest0-21swapper/323:49:003
409658099280,27cyclictest0-21swapper/323:49:003
409658099280,26cyclictest0-21swapper/323:40:013
409658099280,26cyclictest0-21swapper/320:25:583
409658099280,1cyclictest0-21swapper/321:15:163
4096575992825,2cyclictest0-21swapper/219:55:152
409657599280,2cyclictest0-21swapper/223:09:552
409657599280,27cyclictest0-21swapper/223:40:022
409657599280,26cyclictest0-21swapper/219:15:582
409657599280,25cyclictest0-21swapper/223:04:552
409657599280,25cyclictest0-21swapper/221:05:592
4096580992724,2cyclictest0-21swapper/300:08:593
4096580992723,2cyclictest0-21swapper/323:05:143
4096580992723,2cyclictest0-21swapper/321:31:593
4096580992721,5cyclictest8304-21turbostat00:39:543
409658099270,26cyclictest0-21swapper/319:15:593
409658099270,1cyclictest0-21swapper/319:35:153
4096575992724,2cyclictest0-21swapper/200:26:592
4096575992723,2cyclictest0-21swapper/221:31:592
4670791260,6ptp4l441ktimers/319:50:003
4670791260,6ptp4l441ktimers/319:25:003
4670791260,5ptp4l441ktimers/320:30:023
4670791260,0ptp4l71-21kworker/3:1+events22:40:123
4096580992624,1cyclictest0-21swapper/300:26:593
4096575992622,2cyclictest0-21swapper/221:12:592
409657599260,24cyclictest0-21swapper/220:25:582
409657599260,24cyclictest0-21swapper/219:23:082
4670791250,6ptp4l441ktimers/321:00:003
4670791250,6ptp4l441ktimers/320:20:013
4670791250,6ptp4l441ktimers/320:20:003
409658099250,24cyclictest0-21swapper/323:14:593
4096575992521,2cyclictest0-21swapper/200:39:552
4670791240,5ptp4l441ktimers/323:24:563
4096580992421,2cyclictest0-21swapper/321:12:593
4670791220,4ptp4l441ktimers/323:19:553
4096575992219,2cyclictest0-21swapper/220:32:592
4096575992119,1cyclictest0-21swapper/220:20:002
4096575992119,1cyclictest0-21swapper/220:19:592
4096575992118,2cyclictest0-21swapper/223:25:002
4096575992118,2cyclictest0-21swapper/219:40:142
4096575992017,2cyclictest0-21swapper/220:58:592
4096575991814,2cyclictest0-21swapper/222:41:592
4670791150,3ptp4l441ktimers/321:20:013
4096575991512,2cyclictest0-21swapper/221:24:562
4096575991411,2cyclictest0-21swapper/222:26:592
40965759940,3cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional