You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 18:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Fri Apr 24, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
228327599113100,10cyclictest2370778-21latency_hist11:40:011
22832719910893,11cyclictest1213033-21systemd-journal09:20:000
22832759910293,6cyclictest2329954-21latency_hist09:35:021
2283271999688,5cyclictest2284776-21latency_hist07:15:000
2283271999583,9cyclictest2389059-21apt-get12:33:000
2283271999280,9cyclictest2340006-21/usr/sbin/munin10:05:220
2283271999265,13cyclictest2346395-21latency_hist10:25:010
2283275998976,10cyclictest2341895-21diskstats10:10:141
2283275998879,7cyclictest2325177-21latency_hist09:20:011
2283275998877,8cyclictest2347980-21latency_hist10:30:021
2283275998877,8cyclictest2347980-21latency_hist10:30:011
2283271998569,14cyclictest2334735-21latency_hist09:50:000
2283271998374,6cyclictest2307723-21kworker/u8:2+flush-179:008:50:020
228327199831,65cyclictest1-21systemd11:50:160
2283275998057,20cyclictest1213033-21systemd-journal09:50:241
2283275997869,7cyclictest2362810-21latency_hist11:15:011
2283271997669,5cyclictest2329934-21kworker/u8:3+flush-179:009:40:230
2283271997668,6cyclictest2294940-21/usr/sbin/munin07:45:220
2283275997566,7cyclictest2289556-21latency_hist07:30:011
2283275997449,22cyclictest2380838-21latency_hist12:10:011
2283275997151,18cyclictest1213033-21systemd-journal11:50:161
2283275996962,5cyclictest2294701-21latency_hist07:45:001
2283271996965,3cyclictest2283203-21kworker/u8:0+flush-179:007:55:010
2283271996962,5cyclictest2382423-21latency_hist12:15:010
2283275996860,5cyclictest1213033-21systemd-journal12:25:231
2283271996860,6cyclictest2307723-21kworker/u8:2+flush-179:008:40:000
2283275996760,5cyclictest2370749-21kworker/u8:2+flush-179:012:15:011
2283271996760,5cyclictest2370767-21apt-get11:40:030
2283275996644,19cyclictest1213033-21systemd-journal08:56:241
2283275996559,4cyclictest2333181-21kworker/u8:2+flush-179:010:35:261
2283271996558,5cyclictest2310859-21latency_hist08:35:010
2283271996555,8cyclictest2336574-21latency_hist09:55:010
2283275996456,6cyclictest2344789-21latency_hist10:20:011
2283275996355,5cyclictest2353019-21latency_hist10:45:021
2283275996354,7cyclictest2385878-21latency_hist12:25:011
2283271996357,4cyclictest2307723-21kworker/u8:2+events_unbound08:55:220
2283271996355,6cyclictest2369177-21latency_hist11:35:010
2283271996355,5cyclictest1-21systemd11:28:230
2283271996353,8cyclictest2285317-21diskstats07:15:160
2283275996254,6cyclictest2359414-21kworker/u8:1+events_unbound11:10:011
2283271996254,6cyclictest2384048-21latency_hist12:20:010
2283275996151,8cyclictest2303163-21apt-get08:10:111
2283275996049,9cyclictest2319084-21apt-get09:00:101
2283271996054,4cyclictest2323822-21kworker/u8:0+events_unbound09:25:230
2283275995925,25cyclictest2367629-21systemd-run11:30:001
2283271995851,5cyclictest2369159-21kworker/u8:0+events_unbound11:45:240
2283271995750,5cyclictest2363477-21kworker/u8:3+events_unbound11:20:240
2283271995748,7cyclictest2323586-21latency_hist09:15:010
2283271995746,9cyclictest2350081-21apt-get10:35:120
2283275995651,4cyclictest2289533-21kworker/u8:1+flush-179:007:55:211
228327599560,53cyclictest2307692-21turbostat08:29:541
2283275995548,5cyclictest2370749-21kworker/u8:2+events_unbound12:00:231
2283271995550,4cyclictest2283203-21kworker/u8:0+flush-179:008:00:230
2283271995548,5cyclictest2326815-21kworker/u8:2+flush-179:009:25:010
2283275995426,17cyclictest2283266-21cyclictest08:05:001
2283271995446,6cyclictest2377412-21apt-get12:00:000
2283275995347,5cyclictest2336618-21kworker/u8:0+flush-179:010:00:001
2283275995343,8cyclictest2331554-21latency_hist09:40:011
2283275995245,5cyclictest2322001-21latency_hist09:10:011
2283275995244,6cyclictest2366004-21latency_hist11:25:011
2283275995244,6cyclictest2301561-21/usr/sbin/munin08:05:241
2283271995249,2cyclictest2382448-21kworker/u8:3+events_unbound12:35:240
2283271995247,3cyclictest2317256-21kworker/u8:3+flush-179:009:05:210
2283281995144,5cyclictest2334750-21turbostat09:50:003
2283275995142,7cyclictest1213033-21systemd-journal09:24:541
2283275995134,16cyclictest2339772-21turbostat10:09:561
2283271995143,6cyclictest2304468-21kworker/u8:1+flush-179:008:20:010
2283271995137,12cyclictest2307693-21munin-run08:25:000
2283271995137,12cyclictest2307693-21munin-run08:24:590
4577091500,13ptp4l441ktimers/307:09:553
2283275995044,4cyclictest2265226-21kworker/u8:3+flush-179:007:20:241
2283271995042,6cyclictest2342956-21apt-get10:15:010
2283271995042,6cyclictest1-21systemd12:05:000
2283275994941,6cyclictest2306093-21latency_hist08:20:011
2283271994943,4cyclictest2289533-21kworker/u8:1+flush-179:007:40:160
2283271994941,6cyclictest1213033-21systemd-journal08:28:240
228327199491,3cyclictest0-21swapper/010:15:020
2283275994841,5cyclictest2293040-21gzip07:37:011
2283275994826,18cyclictest0-21swapper/107:45:131
228327199481,29cyclictest0-21swapper/008:50:100
228327599470,2cyclictest0-21swapper/111:30:121
2283271994741,4cyclictest2359414-21kworker/u8:1+flush-179:011:05:160
2283271994736,9cyclictest1213033-21systemd-journal08:45:010
2283275994638,6cyclictest2336618-21kworker/u8:0+events_unbound10:00:231
2283275994624,21cyclictest2390631-21unixbench_singl12:35:251
228327599461,2cyclictest2296303-21apt-get07:50:031
2283271994640,5cyclictest2355264-21kworker/u8:2+flush-179:011:00:210
2283275994540,4cyclictest2370749-21kworker/u8:2+events_unbound12:00:011
2283275994527,16cyclictest2315892-21apt-get08:50:111
2283275994522,22cyclictest2322637-21fschecks_time09:10:161
2283271994538,5cyclictest2355264-21kworker/u8:2+flush-179:011:20:000
2283271994538,5cyclictest2290607-21kworker/u8:3+events_unbound07:30:250
2283271994524,19cyclictest0-21swapper/011:00:000
2283271994520,4cyclictest0-21swapper/011:35:240
228327799440,41cyclictest0-21swapper/212:34:552
2283275994438,4cyclictest2333401-21apt-get09:45:101
2283275994435,8cyclictest1213033-21systemd-journal10:50:001
2283271994438,4cyclictest2386541-21kworker/u8:1+events_unbound12:25:190
2283271994423,3cyclictest2354971-21tr10:50:130
2283277994340,2cyclictest0-21swapper/211:59:552
2283275994335,6cyclictest2349826-21latency_hist10:35:011
2283271994335,6cyclictest1213033-21systemd-journal12:10:000
2283271994320,4cyclictest0-21swapper/007:55:240
2283277994240,1cyclictest0-21swapper/210:59:592
2283275994235,5cyclictest2314059-21turbostat08:49:551
2283275994225,15cyclictest2314020-21kworker/u8:0+flush-179:008:45:011
228327599421,37cyclictest1-21systemd07:16:231
228327199424,11cyclictest714-21Xorg11:13:590
228328199410,40cyclictest2339772-21turbostat10:05:003
228328199410,1cyclictest0-21swapper/309:22:003
2283275994134,5cyclictest2356444-21apt-get10:55:111
2283275994133,6cyclictest1213033-21systemd-journal11:01:001
2283275994121,17cyclictest2355725-21proc_pri10:50:211
228327599411,3cyclictest714-21Xorg12:30:591
2283271994135,4cyclictest2336618-21kworker/u8:0+flush-179:010:00:150
2283271994120,3cyclictest2329455-21phc2sys09:30:210
228328199400,39cyclictest2320436-21turbostat09:05:013
2283275994033,6cyclictest2290607-21kworker/u8:3+flush-179:007:30:221
2283275994022,17cyclictest714-21Xorg08:32:581
2283271994035,4cyclictest2347999-21turbostat10:34:550
2283271994034,3cyclictest2331560-21cut09:40:010
2283271994032,6cyclictest2354603-21latency_hist10:50:020
2283271994019,4cyclictest0-21swapper/012:20:220
2283281993938,1cyclictest0-21swapper/307:16:593
228328199390,4cyclictest2304508-21turbostat08:15:013
228328199390,38cyclictest2380849-21turbostat12:10:003
228328199390,38cyclictest2328381-21turbostat09:30:003
2283277993936,2cyclictest0-21swapper/208:57:592
228327799390,37cyclictest0-21swapper/207:20:592
228327799390,36cyclictest0-21swapper/209:34:592
228327599390,2cyclictest714-21Xorg09:42:581
2283271993936,2cyclictest0-21swapper/008:11:000
2283271993935,3cyclictest2293154-21systemd-run07:40:000
2283281993833,4cyclictest2301339-21turbostat08:04:593
2283281993832,5cyclictest2307692-21turbostat08:24:593
2283281993832,5cyclictest2307692-21turbostat08:24:593
228327799380,36cyclictest0-21swapper/212:07:002
228327799380,36cyclictest0-21swapper/210:05:592
2283275993833,4cyclictest2370749-21kworker/u8:2+flush-179:011:45:261
2283271993818,4cyclictest0-21swapper/009:05:020
2283281993736,1cyclictest0-21swapper/311:19:553
228328199370,36cyclictest0-21swapper/309:30:583
228328199370,36cyclictest0-21swapper/309:11:593
2283277993734,2cyclictest0-21swapper/211:08:592
2283277993734,2cyclictest0-21swapper/209:42:002
2283275993733,3cyclictest0-21swapper/112:20:011
228327599370,36cyclictest0-21swapper/109:29:541
228327199370,35cyclictest714-21Xorg07:23:590
2283281993634,1cyclictest0-21swapper/311:56:593
2283281993633,2cyclictest0-21swapper/311:23:593
228328199360,35cyclictest0-21swapper/309:37:003
228328199360,35cyclictest0-21swapper/308:55:593
228328199360,1cyclictest0-21swapper/310:58:593
2283277993633,2cyclictest0-21swapper/211:02:592
228327799360,1cyclictest0-21swapper/209:08:002
2283275993633,2cyclictest0-21swapper/108:21:591
2283275993633,2cyclictest0-21swapper/108:21:591
2283275993630,5cyclictest2369159-21kworker/u8:0+flush-179:011:44:551
228327199360,8cyclictest2348439-21cat10:30:020
2283281993533,1cyclictest0-21swapper/310:19:003
228328199350,34cyclictest0-21swapper/308:16:593
228328199350,34cyclictest0-21swapper/307:29:553
228328199350,1cyclictest0-21swapper/309:09:003
2283277993532,2cyclictest0-21swapper/208:47:592
2283277993531,2cyclictest0-21swapper/208:03:592
228327799350,1cyclictest0-21swapper/209:29:592
2283275993511,22cyclictest2284614-21cat07:10:231
2283271993530,4cyclictest2289533-21kworker/u8:1+flush-179:007:29:550
228327199351,31cyclictest0-21swapper/008:05:130
2283281993433,1cyclictest0-21swapper/309:58:593
2283277993432,1cyclictest0-21swapper/207:19:592
2283277993431,2cyclictest0-21swapper/210:49:552
2283275993424,9cyclictest0-21swapper/111:19:561
2283275993422,11cyclictest2345063-21apt-get10:20:121
2283281993331,1cyclictest0-21swapper/312:16:583
2283281993331,1cyclictest0-21swapper/308:35:583
2283281993331,1cyclictest0-21swapper/308:32:593
2283277993330,2cyclictest0-21swapper/209:49:002
2283271993328,4cyclictest0-21swapper/009:55:110
2283281993230,1cyclictest0-21swapper/311:44:583
2283281993230,1cyclictest0-21swapper/311:08:593
2283281993230,1cyclictest0-21swapper/310:36:593
2283281993230,1cyclictest0-21swapper/309:42:583
2283277993229,2cyclictest0-21swapper/210:40:592
2283277993228,3cyclictest0-21swapper/211:50:592
228327799320,30cyclictest0-21swapper/210:52:002
228327599321,27cyclictest2283163-21latency_hist07:10:021
2283281993129,1cyclictest0-21swapper/312:34:553
2283281993129,1cyclictest0-21swapper/311:37:593
2283281993129,1cyclictest0-21swapper/310:41:583
2283281993128,2cyclictest0-21swapper/307:23:593
2283275993127,3cyclictest2312457-21munin-plugin-st08:40:011
2283271993122,7cyclictest2351470-21kworker/u8:1+flush-179:010:45:000
2283281993028,1cyclictest0-21swapper/310:12:583
228328199300,28cyclictest0-21swapper/312:10:143
228328199300,28cyclictest0-21swapper/310:30:033
2283277993027,2cyclictest0-21swapper/211:46:592
2283277993027,2cyclictest0-21swapper/211:23:592
2283277993027,2cyclictest0-21swapper/211:10:132
2283277993027,2cyclictest0-21swapper/210:30:112
228327799300,2cyclictest0-21swapper/211:25:132
228327799300,28cyclictest0-21swapper/207:35:012
4577091290,7ptp4l441ktimers/312:05:003
4577091290,7ptp4l441ktimers/307:50:003
2283281992926,2cyclictest0-21swapper/311:11:593
2283281992926,2cyclictest0-21swapper/308:45:143
228328199290,27cyclictest0-21swapper/310:50:123
2283277992926,2cyclictest0-21swapper/208:25:122
2283277992926,2cyclictest0-21swapper/207:10:122
228327799290,27cyclictest0-21swapper/212:15:122
228327799290,27cyclictest0-21swapper/212:12:592
228327799290,27cyclictest0-21swapper/211:40:012
228327799290,27cyclictest0-21swapper/210:35:142
228327799290,27cyclictest0-21swapper/209:50:012
228327799290,27cyclictest0-21swapper/208:30:122
228327799290,27cyclictest0-21swapper/208:15:132
228327799290,1cyclictest0-21swapper/212:29:592
2283271992925,3cyclictest2348147-21latency_hist10:30:010
4577091280,7ptp4l441ktimers/308:54:593
4577091280,6ptp4l441ktimers/308:30:013
2283281992826,1cyclictest0-21swapper/311:04:553
2283281992826,1cyclictest0-21swapper/309:50:013
2283281992825,2cyclictest0-21swapper/311:25:133
2283281992825,2cyclictest0-21swapper/307:35:023
228328199280,4cyclictest2291151-21turbostat07:35:013
228328199280,26cyclictest0-21swapper/312:20:023
228328199280,26cyclictest0-21swapper/307:50:123
2283277992825,2cyclictest0-21swapper/212:35:132
2283277992825,2cyclictest0-21swapper/212:00:112
2283277992825,2cyclictest0-21swapper/210:25:592
2283277992825,2cyclictest0-21swapper/210:25:592
2283277992825,2cyclictest0-21swapper/210:00:122
228327799280,27cyclictest0-21swapper/211:40:012
228327799280,26cyclictest0-21swapper/212:20:022
228327799280,26cyclictest0-21swapper/209:35:122
228327799280,26cyclictest0-21swapper/207:25:122
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:30:003
4577091270,6ptp4l441ktimers/311:49:553
4577091270,6ptp4l441ktimers/307:44:563
2283281992725,1cyclictest0-21swapper/311:51:593
2283277992725,1cyclictest0-21swapper/210:00:002
2283277992724,2cyclictest0-21swapper/207:51:582
2283277992724,2cyclictest0-21swapper/207:46:002
2283277992724,2cyclictest0-21swapper/207:33:592
228327799270,25cyclictest0-21swapper/210:24:002
228327799270,24cyclictest0-21swapper/211:34:552
4577091260,5ptp4l441ktimers/312:39:553
4577091260,5ptp4l441ktimers/309:19:553
4577091260,5ptp4l441ktimers/308:10:003
4577091260,5ptp4l441ktimers/307:59:563
4577091260,5ptp4l441ktimers/307:14:563
2283281992624,1cyclictest0-21swapper/310:05:593
228327799260,25cyclictest0-21swapper/208:54:002
228327799260,24cyclictest0-21swapper/208:24:002
228327799260,24cyclictest0-21swapper/208:23:592
228327799260,24cyclictest0-21swapper/208:10:002
228327799260,24cyclictest0-21swapper/207:43:002
4577091250,5ptp4l61490irq/134-eno1-TxRx-010:29:563
4577091250,5ptp4l61490irq/134-eno1-TxRx-010:29:553
228328199250,24cyclictest0-21swapper/308:42:003
2283277992522,2cyclictest0-21swapper/208:40:132
228327799250,2cyclictest0-21swapper/209:20:122
2283277992421,2cyclictest0-21swapper/211:15:122
4577091230,4ptp4l441ktimers/311:34:553
2283277992320,2cyclictest0-21swapper/210:10:592
2283277992320,2cyclictest0-21swapper/208:13:592
2283277992320,2cyclictest0-21swapper/207:59:002
2283281992118,2cyclictest0-21swapper/310:20:123
2283277992118,2cyclictest0-21swapper/209:02:582
2283277992017,2cyclictest0-21swapper/210:16:592
2283277992017,2cyclictest0-21swapper/208:35:132
2283281991917,1cyclictest0-21swapper/310:46:003
2283277991916,2cyclictest0-21swapper/209:10:132
2283271991611,4cyclictest0-21swapper/007:10:020
2283277991310,2cyclictest0-21swapper/209:18:582
22832779930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional