You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 04:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Mon Mar 16, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21382019910291,8cyclictest2209298-21latency_hist22:50:010
2138201999889,7cyclictest266-21systemd-journal21:15:000
2138202999783,10cyclictest266-21systemd-journal00:04:001
2138202997869,6cyclictest2241716-21latency_hist00:30:011
2138201997868,7cyclictest2172157-21latency_hist20:55:000
2138201997562,11cyclictest2231582-21latency_hist00:00:020
2138201997362,8cyclictest2159182-21apt-get20:15:000
2138202997266,5cyclictest2191397-21kworker/u8:1+flush-179:022:04:551
2138201997264,6cyclictest2223624-21latency_hist23:35:010
2138201997259,8cyclictest2230040-21kworker/u8:2+flush-179:000:00:230
2138201997162,6cyclictest2238282-21latency_hist00:20:010
2138201997057,10cyclictest2176924-21kworker/u8:1+flush-179:021:25:130
2138202996856,10cyclictest2169243-21apt-get20:45:121
2138202996758,6cyclictest2157576-21latency_hist20:10:001
2138202996754,11cyclictest2204249-21kworker/u8:1+flush-179:023:25:001
2138202996657,6cyclictest2173775-21latency_hist21:00:021
2138201996660,4cyclictest2164250-21kworker/u8:1+flush-179:020:45:260
2138201996558,5cyclictest2197313-21kworker/u8:3+flush-179:022:55:240
2138201996556,6cyclictest2204249-21kworker/u8:1+flush-179:023:20:200
2138201996554,9cyclictest2193385-21apt-get22:00:120
2138201996551,9cyclictest266-21systemd-journal20:20:000
2138201996454,7cyclictest2154310-21kworker/u8:3+flush-179:020:00:010
2138201996454,7cyclictest2154310-21kworker/u8:3+flush-179:020:00:000
2138201996448,11cyclictest510-21rs:main0
2138201996250,8cyclictest2153409-21kworker/u8:2+flush-179:020:00:230
2138201996156,4cyclictest714-21Xorg21:39:000
2138201995948,7cyclictest2164250-21kworker/u8:1+flush-179:020:40:200
2138201995943,12cyclictest2239880-21apt-get00:25:010
2138201995943,12cyclictest2239880-21apt-get00:25:000
2138201995850,6cyclictest266-21systemd-journal23:08:200
2138201995848,7cyclictest2184894-21latency_hist21:35:010
2138201995847,8cyclictest2181703-21kworker/u8:0+flush-179:021:50:210
2138202995648,6cyclictest2207453-21latency_hist22:45:011
2138202995646,8cyclictest2233740-21/usr/sbin/munin00:05:231
2138201995647,6cyclictest2136816-21kworker/u8:1+flush-179:019:25:200
2138201995547,5cyclictest2228403-21latency_hist23:50:010
2138202995451,2cyclictest0-21swapper/119:42:001
2138202995445,7cyclictest2161271-21/usr/sbin/munin20:20:241
2138202995444,8cyclictest2231656-21cupsd00:00:001
2138201995448,4cyclictest2179633-21kworker/u8:2+events_unbound21:20:230
2138201995444,8cyclictest2214115-21kworker/u8:3+flush-179:023:15:210
2138201995443,7cyclictest2197313-21kworker/u8:3+flush-179:022:35:190
2138202995341,9cyclictest2223862-21/usr/sbin/munin23:35:251
2138201995349,3cyclictest2170616-21kworker/u8:0+flush-179:020:55:570
2138201995344,6cyclictest2181703-21kworker/u8:0+events_unbound22:05:230
2138201995246,4cyclictest2160987-21kworker/u8:0+flush-179:020:25:020
2138202995144,5cyclictest2213035-21diskstats23:00:151
2138202995142,7cyclictest2154310-21kworker/u8:3+flush-179:020:30:221
2138201995144,5cyclictest2181703-21kworker/u8:0+events_unbound22:15:240
2138201995142,6cyclictest2160987-21kworker/u8:0+flush-179:020:30:010
4577091500,13ptp4l441ktimers/319:10:003
2138201995041,7cyclictest2139748-21latency_hist19:15:010
2138202994942,5cyclictest2138200-21cyclictest22:15:591
2138202994939,8cyclictest2186758-21apt-get21:40:111
2138201994846,1cyclictest2170616-21kworker/u8:0+events_unbound21:05:240
2138202994743,3cyclictest2223639-21awk23:35:001
2138201994742,4cyclictest2176924-21kworker/u8:1+flush-179:021:15:210
2138201994742,3cyclictest2221498-21kworker/u8:3+events_unbound23:25:220
2138201994740,5cyclictest2204249-21kworker/u8:1+flush-179:000:05:160
2138201994739,6cyclictest2215922-21apt-get23:10:110
2138201994738,6cyclictest2147733-21latency_hist19:40:010
2138201994737,7cyclictest2121779-21kworker/u8:0+flush-179:019:20:150
2138201994736,8cyclictest2225487-21apt-get23:40:110
2138201994735,9cyclictest2149291-21kworker/u8:1+flush-179:019:50:210
213820999460,45cyclictest2223636-21turbostat23:35:003
2138201994641,4cyclictest2160987-21kworker/u8:0+flush-179:020:30:240
2138201994640,4cyclictest2181703-21kworker/u8:0+events_unbound22:30:220
2138201994639,6cyclictest2204249-21kworker/u8:1+flush-179:000:30:160
2138201994639,5cyclictest2204249-21kworker/u8:1+flush-179:000:35:130
2138201994637,7cyclictest2141394-21kworker/u8:2+flush-179:019:30:250
213820199461,43cyclictest2197900-21awk22:15:010
2138202994541,3cyclictest2230040-21kworker/u8:2+events_unbound00:31:201
2138201994538,5cyclictest2173811-21kworker/u8:2+events_unbound21:00:130
2138201994538,5cyclictest2153409-21kworker/u8:2+events_unbound20:05:140
2138201994536,6cyclictest2149291-21kworker/u8:1+flush-179:019:45:000
2138201994535,8cyclictest2166030-21/usr/sbin/munin20:35:220
2138202994433,9cyclictest2197313-21kworker/u8:3+flush-179:022:10:211
2138201994439,4cyclictest2230040-21kworker/u8:2+flush-179:000:25:210
2138201994433,9cyclictest2235344-21apt-get00:10:100
2138201994433,8cyclictest2181703-21kworker/u8:0+flush-179:021:50:000
2138202994335,5cyclictest2193128-21latency_hist22:00:011
2138202994236,4cyclictest2215666-21latency_hist23:10:011
2138202994135,4cyclictest2214115-21kworker/u8:3+flush-179:023:15:201
2138202994133,6cyclictest2235326-21/usr/sbin/munin00:10:161
2138201994136,4cyclictest1-21systemd19:50:010
2138201994136,3cyclictest2202678-21munin-run22:30:000
2138201994133,6cyclictest2210894-21awk22:55:000
2138201994131,8cyclictest2206120-21apt-get22:40:110
2138202994034,5cyclictest2149322-21turbostat19:49:551
2138202994029,9cyclictest2185150-21apt-get21:35:111
213820299400,4cyclictest2139751-21turbostat19:19:541
2138201994031,6cyclictest2223590-21kworker/u8:0+flush-179:023:40:010
2138202993931,6cyclictest2244921-21latency_hist00:40:011
213820299391,37cyclictest714-21Xorg20:40:001
213820299391,2cyclictest714-21Xorg20:03:591
213820299390,37cyclictest714-21Xorg22:25:591
2138201993929,5cyclictest2207432-21kworker/u8:2+events_unbound23:00:130
4577091380,2ptp4l441ktimers/300:00:023
2138209993836,1cyclictest0-21swapper/321:10:583
2138206993836,1cyclictest0-21swapper/219:35:592
2138206993835,2cyclictest0-21swapper/219:42:592
213820699380,36cyclictest0-21swapper/223:38:592
213820699380,36cyclictest0-21swapper/221:25:592
213820699380,35cyclictest0-21swapper/220:19:562
213820699380,35cyclictest0-21swapper/200:03:002
2138202993835,2cyclictest714-21Xorg21:24:581
2138202993835,2cyclictest0-21swapper/122:55:591
2138202993834,3cyclictest2154310-21kworker/u8:3+events_unbound19:57:001
2138202993834,3cyclictest2154310-21kworker/u8:3+events_unbound19:56:591
2138202993833,4cyclictest2202691-21turbostat22:34:551
2138202993830,6cyclictest2227055-21/usr/sbin/munin23:45:171
2138202993828,8cyclictest2236932-21apt-get00:15:111
213820299380,37cyclictest0-21swapper/121:15:001
213820999370,36cyclictest0-21swapper/320:10:593
213820699370,34cyclictest0-21swapper/220:14:592
2138202993734,2cyclictest714-21Xorg19:37:591
2138202993733,2cyclictest714-21Xorg20:42:581
2138202993732,3cyclictest714-21Xorg00:24:591
2138202993732,3cyclictest714-21Xorg00:24:591
2138202993730,5cyclictest266-21systemd-journal23:43:211
2138201993728,6cyclictest0-21swapper/021:42:590
2138209993634,1cyclictest0-21swapper/320:48:003
2138209993633,2cyclictest431rcuc/322:35:003
2138209993633,2cyclictest0-21swapper/323:39:593
2138209993633,2cyclictest0-21swapper/300:29:563
213820999360,35cyclictest0-21swapper/320:42:593
213820999360,35cyclictest0-21swapper/300:24:593
213820999360,35cyclictest0-21swapper/300:24:583
213820999360,1cyclictest0-21swapper/322:55:593
213820999360,1cyclictest0-21swapper/320:59:543
2138206993633,2cyclictest0-21swapper/223:30:592
2138206993633,2cyclictest0-21swapper/221:58:592
213820699360,1cyclictest0-21swapper/222:27:592
213820699360,1cyclictest0-21swapper/222:24:552
2138202993633,2cyclictest0-21swapper/120:10:591
2138202993632,3cyclictest2154310-21kworker/u8:3+events_unbound20:54:021
2138202993629,5cyclictest2218908-21kworker/u8:2+flush-179:023:30:001
213820299360,34cyclictest2209552-21apt-get22:50:131
4577091350,3ptp4l441ktimers/321:15:123
2138209993533,1cyclictest0-21swapper/323:00:593
213820999350,34cyclictest0-21swapper/319:49:543
213820999350,1cyclictest0-21swapper/300:00:593
2138206993532,2cyclictest0-21swapper/222:42:592
2138206993532,2cyclictest0-21swapper/221:02:592
2138206993532,2cyclictest0-21swapper/220:38:592
2138206993532,2cyclictest0-21swapper/219:30:582
2138202993532,2cyclictest0-21swapper/119:24:001
2138202993531,3cyclictest2176924-21kworker/u8:1+events_unbound21:09:001
2138202993531,3cyclictest2154310-21kworker/u8:3+events_unbound21:02:591
2138202993529,4cyclictest2138400-21/usr/sbin/munin19:10:171
2138202993524,9cyclictest0-21swapper/123:10:131
2138209993432,1cyclictest0-21swapper/322:45:593
2138209993432,1cyclictest0-21swapper/322:35:593
2138209993432,1cyclictest0-21swapper/321:44:593
2138209993432,1cyclictest0-21swapper/300:19:553
2138209993431,2cyclictest0-21swapper/322:53:593
2138209993429,4cyclictest2181732-21turbostat21:25:013
2138206993432,1cyclictest0-21swapper/223:20:002
2138206993431,2cyclictest0-21swapper/223:01:592
2138206993431,2cyclictest0-21swapper/222:17:592
2138206993431,2cyclictest0-21swapper/220:59:582
2138206993431,2cyclictest0-21swapper/220:08:002
2138206993431,2cyclictest0-21swapper/200:11:582
2138202993431,2cyclictest714-21Xorg21:17:591
2138202993430,3cyclictest2221498-21kworker/u8:3+events_unbound23:50:591
2138202993430,3cyclictest2189659-21kworker/u8:2+events_unbound21:50:001
2138202993430,3cyclictest2181703-21kworker/u8:0+events_unbound21:51:001
2138201993429,4cyclictest2121779-21kworker/u8:0+flush-179:019:15:270
2138209993331,1cyclictest0-21swapper/323:49:583
2138209993331,1cyclictest0-21swapper/322:29:593
2138209993329,2cyclictest0-21swapper/323:14:593
2138206993330,2cyclictest0-21swapper/219:21:592
2138202993329,3cyclictest2182845-21proc_pri21:25:221
2138202993323,9cyclictest0-21swapper/120:15:141
213820299330,31cyclictest714-21Xorg22:45:591
2138209993229,2cyclictest0-21swapper/319:28:583
2138206993229,2cyclictest0-21swapper/223:58:592
2138206993229,2cyclictest0-21swapper/220:31:592
2138206993229,2cyclictest0-21swapper/220:26:002
2138206993229,2cyclictest0-21swapper/200:28:592
2138202993227,3cyclictest0-21swapper/122:25:001
2138201993226,4cyclictest2229490-21phc2sys23:50:210
2138201993221,8cyclictest2197313-21kworker/u8:3+flush-179:022:20:150
2138209993129,1cyclictest0-21swapper/320:29:593
2138209993128,2cyclictest0-21swapper/323:50:593
2138206993128,2cyclictest0-21swapper/220:00:582
2138206993128,2cyclictest0-21swapper/219:14:552
2138202993126,3cyclictest0-21swapper/119:50:131
2138202993117,6cyclictest0-21swapper/122:40:011
2138209993028,1cyclictest0-21swapper/323:26:583
2138209993028,1cyclictest0-21swapper/322:19:593
2138209993028,1cyclictest0-21swapper/321:06:593
213820999300,29cyclictest0-21swapper/320:00:593
213820999300,28cyclictest0-21swapper/321:55:023
2138206993028,1cyclictest0-21swapper/222:09:582
2138206993027,2cyclictest0-21swapper/223:29:552
2138206993027,2cyclictest0-21swapper/222:58:592
2138206993027,2cyclictest0-21swapper/221:05:132
2138206993027,2cyclictest0-21swapper/200:08:592
213820699300,2cyclictest0-21swapper/220:40:112
2138202993026,3cyclictest2181703-21kworker/u8:0+events_unbound21:33:001
2138209992926,2cyclictest0-21swapper/322:08:583
213820999291,26cyclictest0-21swapper/320:15:013
213820999290,27cyclictest0-21swapper/322:20:593
213820999290,1cyclictest0-21swapper/320:35:123
2138206992926,2cyclictest0-21swapper/220:20:132
2138206992926,2cyclictest0-21swapper/219:55:032
2138206992926,2cyclictest0-21swapper/219:55:032
2138206992926,2cyclictest0-21swapper/219:15:132
2138206992926,2cyclictest0-21swapper/200:35:142
213820699290,28cyclictest0-21swapper/223:50:112
213820699290,27cyclictest0-21swapper/223:05:142
213820699290,27cyclictest0-21swapper/221:40:132
213820699290,27cyclictest0-21swapper/221:10:122
213820699290,27cyclictest0-21swapper/200:30:132
213820299290,28cyclictest714-21Xorg20:29:581
2138209992826,1cyclictest0-21swapper/323:40:133
2138209992826,1cyclictest0-21swapper/320:30:133
2138209992822,5cyclictest2244926-21turbostat00:39:593
213820999280,27cyclictest0-21swapper/321:00:113
213820999280,26cyclictest0-21swapper/322:10:123
213820999280,26cyclictest0-21swapper/321:45:123
213820999280,26cyclictest0-21swapper/320:05:133
213820999280,26cyclictest0-21swapper/319:50:143
213820999280,26cyclictest0-21swapper/300:10:123
2138206992825,2cyclictest0-21swapper/222:53:592
2138206992825,2cyclictest0-21swapper/221:45:592
2138206992825,2cyclictest0-21swapper/221:35:122
2138206992825,2cyclictest0-21swapper/200:21:592
2138206992825,2cyclictest0-21swapper/200:21:592
213820699280,2cyclictest0-21swapper/222:45:032
213820699280,26cyclictest0-21swapper/223:20:132
213820699280,26cyclictest0-21swapper/221:50:132
213820699280,26cyclictest0-21swapper/221:30:122
2138202992823,4cyclictest2195811-21phc2sys22:05:221
213820299280,3cyclictest2146133-21awk19:35:001
4577091270,6ptp4l441ktimers/319:35:003
4577091270,6ptp4l441ktimers/300:35:003
2138209992725,1cyclictest431rcuc/321:33:593
213820999270,26cyclictest0-21swapper/320:51:593
2138206992724,2cyclictest0-21swapper/223:13:592
2138206992724,2cyclictest0-21swapper/220:55:002
2138206992724,2cyclictest0-21swapper/219:53:592
213820699270,1cyclictest0-21swapper/219:45:122
2138202992721,4cyclictest2143182-21/usr/sbin/munin19:25:171
4577091260,3ptp4l441ktimers/319:39:553
2138209992624,1cyclictest0-21swapper/321:37:003
2138209992620,5cyclictest2215672-21turbostat23:10:003
213820999260,2cyclictest0-21swapper/319:21:593
2138206992623,2cyclictest0-21swapper/223:49:002
2138206992623,2cyclictest0-21swapper/223:40:132
2138206992623,2cyclictest0-21swapper/222:11:592
4577091250,3ptp4l61490irq/134-eno1-TxRx-023:19:563
4577091250,3ptp4l61490irq/134-eno1-TxRx-021:54:553
4577091250,3ptp4l441ktimers/323:25:013
4577091250,3ptp4l441ktimers/321:30:013
4577091250,3ptp4l441ktimers/320:25:013
4577091250,3ptp4l441ktimers/319:20:013
2138209992523,1cyclictest0-21swapper/319:58:593
2138209992523,1cyclictest0-21swapper/319:58:583
2138209992523,1cyclictest0-21swapper/319:12:583
213820999250,24cyclictest0-21swapper/300:08:593
4577091240,3ptp4l61490irq/134-eno1-TxRx-019:45:003
4577091240,3ptp4l441ktimers/322:44:553
4577091240,3ptp4l441ktimers/322:05:003
2138206992219,2cyclictest0-21swapper/222:30:592
2138206992219,2cyclictest0-21swapper/220:47:002
2138206992119,1cyclictest0-21swapper/222:05:002
213820299201,17cyclictest2138117-21latency_hist19:10:021
2138201991914,4cyclictest0-21swapper/019:10:010
2138206991815,2cyclictest0-21swapper/221:21:592
213820699119,1cyclictest0-21swapper/219:25:132
21382069986,1cyclictest0-21swapper/221:17:272
21382069985,2cyclictest0-21swapper/200:18:002
21382069960,5cyclictest0-21swapper/222:36:482
21382069930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional