You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 07:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Mar 17, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71734799114104,7cyclictest752774-21latency_hist21:00:011
7173479910692,10cyclictest760732-21latency_hist21:25:011
7173479910692,10cyclictest266-21systemd-journal00:00:021
7173459910597,6cyclictest721118-21kworker/u8:0+events_unbound20:25:010
7173459910094,5cyclictest785883-21kworker/u8:0+events_unbound22:55:010
717345999891,5cyclictest738428-21kworker/u8:1+flush-179:020:25:230
717345999888,7cyclictest751175-21latency_hist20:55:010
717347999685,8cyclictest764167-21latency_hist21:35:011
717345999687,7cyclictest266-21systemd-journal22:40:000
717345999684,4cyclictest760220-21kworker/u8:1+flush-179:021:20:230
717345999484,8cyclictest266-21systemd-journal20:05:000
717345999388,4cyclictest771026-21kworker/u8:1+events_unbound22:10:230
717347999283,7cyclictest746427-21latency_hist20:40:011
717345999285,5cyclictest725455-21kworker/u8:2+events_unbound19:50:240
717345998781,4cyclictest809993-21kworker/u8:0+flush-179:023:55:230
717347998675,8cyclictest266-21systemd-journal20:20:001
717345998679,6cyclictest721118-21kworker/u8:0+events_unbound19:55:030
717347998458,23cyclictest813012-21latency_hist00:05:001
717345998376,5cyclictest796226-21kworker/u8:1+events_unbound23:20:000
717345998275,5cyclictest814914-21kworker/u8:1+flush-179:000:15:220
717345998172,7cyclictest814847-21kworker/u8:0+flush-179:000:40:010
71734599811,77cyclictest1-21systemd23:55:000
717345998074,4cyclictest761251-21kworker/u8:2+flush-179:021:30:230
717345998072,6cyclictest749624-21kworker/u8:2+flush-179:021:05:210
717345997973,5cyclictest781910-21kworker/u8:1+events_unbound22:30:010
717345997873,4cyclictest772620-21kworker/u8:0+flush-179:022:00:020
717345997670,4cyclictest796802-21kworker/u8:3+events_unbound23:45:010
717345997570,4cyclictest704638-21kworker/u8:3+flush-179:019:15:000
717345997568,6cyclictest803116-21kworker/u8:2+flush-179:023:50:010
717347997467,5cyclictest785883-21kworker/u8:0+flush-179:023:05:011
717345997469,4cyclictest743264-21kworker/u8:2+flush-179:020:35:250
717345997368,4cyclictest796226-21kworker/u8:1+events_unbound23:25:230
717345997365,6cyclictest803137-21latency_hist23:35:010
717345997265,5cyclictest725455-21kworker/u8:2+events_unbound19:40:150
717345997265,5cyclictest721118-21kworker/u8:0+flush-179:019:20:210
717345997263,7cyclictest266-21systemd-journal19:30:010
717347997156,12cyclictest803116-21kworker/u8:2+flush-179:023:45:011
717345997165,5cyclictest738428-21kworker/u8:1+events_unbound20:15:000
717345997165,4cyclictest704638-21kworker/u8:3+events_unbound19:30:010
717345997164,6cyclictest764146-21kworker/u8:1+flush-179:021:40:010
717345997063,5cyclictest814847-21kworker/u8:0+events_unbound00:20:240
717345997063,5cyclictest721118-21kworker/u8:0+events_unbound20:45:000
717345997063,4cyclictest725455-21kworker/u8:2+flush-179:019:45:160
717345997061,6cyclictest785883-21kworker/u8:0+flush-179:023:10:190
717345996962,5cyclictest811623-21kworker/u8:4+flush-179:000:04:010
717347996860,6cyclictest728659-21latency_hist19:45:001
717347996859,6cyclictest796802-21kworker/u8:3+events_unbound00:05:011
717345996750,13cyclictest769214-21apt-get21:50:000
71735099660,63cyclictest0-21swapper/222:43:002
717347996659,5cyclictest782488-21kworker/u8:2+events_unbound22:35:221
717345996660,4cyclictest787902-21kworker/u8:1+flush-179:022:45:200
717345996658,6cyclictest740044-21latency_hist20:20:010
717345996656,4cyclictest785883-21kworker/u8:0+events_unbound22:55:200
717347996457,5cyclictest771026-21kworker/u8:1+events_unbound22:05:231
717345996453,9cyclictest774498-21apt-get22:05:100
717347996349,12cyclictest780612-21apt-get22:25:011
71734799630,61cyclictest0-21swapper/120:51:001
717345996359,3cyclictest814914-21kworker/u8:1+flush-179:000:30:230
717345996357,4cyclictest736844-21kworker/u8:2+flush-179:020:10:000
717345996356,5cyclictest754370-21latency_hist21:05:010
717345996355,6cyclictest779057-21kworker/u8:3+flush-179:022:30:200
717347996256,4cyclictest763881-21kworker/u8:0+flush-179:021:45:001
717345996256,4cyclictest752817-21kworker/u8:3+flush-179:021:15:010
717345996154,5cyclictest738428-21kworker/u8:1+events_unbound20:30:130
717347996048,9cyclictest769203-21latency_hist21:50:011
717347996048,9cyclictest765757-21latency_hist21:40:001
717345996052,6cyclictest771026-21kworker/u8:1+flush-179:022:15:270
717347995950,6cyclictest814847-21kworker/u8:0+events_unbound00:10:021
717345995954,4cyclictest796802-21kworker/u8:3+flush-179:000:05:210
717347995852,5cyclictest771026-21kworker/u8:1+events_unbound21:55:231
717347995850,6cyclictest768693-21kworker/u8:2+events_unbound21:50:021
717345995853,4cyclictest738428-21kworker/u8:1+events_unbound20:45:150
717345995852,4cyclictest772620-21kworker/u8:0+flush-179:022:25:000
717345995851,5cyclictest763881-21kworker/u8:0+flush-179:021:35:140
717347995751,4cyclictest814847-21kworker/u8:0+flush-179:000:20:151
717347995750,5cyclictest803116-21kworker/u8:2+flush-179:023:35:251
717347995749,6cyclictest752817-21kworker/u8:3+flush-179:021:04:591
717345995749,6cyclictest785883-21kworker/u8:0+flush-179:022:40:160
717347995647,7cyclictest738428-21kworker/u8:1+events_unbound20:45:251
717345995650,3cyclictest763881-21kworker/u8:0+events_unbound21:50:180
717345995644,8cyclictest266-21systemd-journal22:04:590
717347995552,2cyclictest796226-21kworker/u8:1+events_unbound23:15:251
717347995548,6cyclictest715766-21kworker/u8:1+events_unbound19:20:001
717347995544,9cyclictest757794-21apt-get21:15:101
717345995547,6cyclictest796802-21kworker/u8:3+flush-179:023:20:200
717345995447,5cyclictest796802-21kworker/u8:3+flush-179:023:35:190
717345995444,7cyclictest266-21systemd-journal19:36:220
717347995349,3cyclictest796802-21kworker/u8:3+events_unbound23:20:231
717345995349,2cyclictest1-21systemd19:20:010
717345995347,4cyclictest785883-21kworker/u8:0+flush-179:023:05:000
717347995249,2cyclictest0-21swapper/120:11:591
717347995246,4cyclictest721118-21kworker/u8:0+flush-179:019:35:001
717347995144,5cyclictest266-21systemd-journal20:28:221
717347995142,6cyclictest772620-21kworker/u8:0+events_unbound22:25:021
717347995045,4cyclictest785883-21kworker/u8:0+flush-179:022:50:011
717345995045,4cyclictest814847-21kworker/u8:0+flush-179:000:25:160
717350994946,2cyclictest0-21swapper/220:51:002
717347994943,5cyclictest781910-21kworker/u8:1+events_unbound22:30:241
717347994943,4cyclictest816734-21kworker/u8:2+events_unbound00:30:141
4577091490,14ptp4l61490irq/134-eno1-TxRx-019:10:003
717347994842,5cyclictest725455-21kworker/u8:2+flush-179:019:35:221
717347994841,4cyclictest771026-21kworker/u8:1+events_unbound22:05:011
717347994838,8cyclictest266-21systemd-journal20:01:221
717347994740,5cyclictest814847-21kworker/u8:0+events_unbound00:25:231
717345994736,8cyclictest510-21rs:main0
717347994641,4cyclictest793833-21kworker/u8:2+events_unbound23:05:231
717347994641,4cyclictest785883-21kworker/u8:0+flush-179:022:55:221
717345994640,4cyclictest793833-21kworker/u8:2+events_unbound23:05:220
71735199450,1cyclictest0-21swapper/319:46:593
717347994538,6cyclictest725455-21kworker/u8:2+events_unbound20:00:011
717347994538,5cyclictest732322-21kworker/u8:1+events_unbound20:05:211
717347994538,5cyclictest717491-21/usr/sbin/munin19:10:181
717347994337,5cyclictest814914-21kworker/u8:1+flush-179:000:15:261
717347994238,3cyclictest796802-21kworker/u8:3+flush-179:023:50:251
717347994233,7cyclictest721118-21kworker/u8:0+flush-179:020:40:221
717347994226,14cyclictest761251-21kworker/u8:2+flush-179:021:30:001
717345994236,4cyclictest755997-21kworker/u8:0+events_unbound21:15:170
71735099410,1cyclictest0-21swapper/200:23:592
71734799411,38cyclictest1-21systemd23:35:001
71734599411,3cyclictest816702-21dump-pmu-power00:15:000
717351994038,1cyclictest0-21swapper/300:19:553
717347994034,4cyclictest793833-21kworker/u8:2+flush-179:023:15:011
717347994033,5cyclictest738428-21kworker/u8:1+flush-179:020:20:121
717345994031,5cyclictest0-21swapper/020:58:590
717351993933,5cyclictest780611-21turbostat22:25:003
717351993933,4cyclictest760745-21turbostat21:29:543
717347993935,3cyclictest721118-21kworker/u8:0+flush-179:019:25:251
4577091390,6ptp4l431rcuc/322:55:003
717350993835,2cyclictest0-21swapper/222:59:552
717347993832,5cyclictest788851-21kworker/u8:3+flush-179:022:50:211
717350993733,2cyclictest0-21swapper/221:49:002
71735099370,35cyclictest0-21swapper/223:14:002
71735099370,35cyclictest0-21swapper/222:08:582
71735099370,35cyclictest0-21swapper/219:54:592
71735099370,35cyclictest0-21swapper/219:19:592
717347993730,6cyclictest725455-21kworker/u8:2+events_unbound19:45:201
717351993634,1cyclictest0-21swapper/319:14:593
717351993631,4cyclictest780611-21turbostat22:29:563
71735199360,35cyclictest0-21swapper/323:15:593
71735199360,35cyclictest0-21swapper/322:13:003
71735199360,1cyclictest0-21swapper/320:47:593
717350993633,2cyclictest0-21swapper/220:11:592
71735099360,1cyclictest0-21swapper/221:45:002
717347993629,4cyclictest0-21swapper/122:14:591
717351993533,1cyclictest0-21swapper/322:03:583
717351993533,1cyclictest0-21swapper/319:59:553
717351993533,1cyclictest0-21swapper/319:38:593
717351993533,1cyclictest0-21swapper/300:09:553
71735099350,1cyclictest0-21swapper/220:24:552
71735099350,1cyclictest0-21swapper/219:22:592
717347993529,4cyclictest0-21swapper/123:45:001
717351993431,2cyclictest0-21swapper/320:22:593
717350993431,2cyclictest0-21swapper/219:47:592
717350993430,2cyclictest0-21swapper/222:19:592
4577091340,27ptp4l441ktimers/323:40:143
717351993331,1cyclictest0-21swapper/321:24:593
71735199330,1cyclictest0-21swapper/323:35:593
71735199330,1cyclictest0-21swapper/323:30:133
717350993330,2cyclictest0-21swapper/200:01:582
717347993331,1cyclictest0-21swapper/122:19:581
717351993230,1cyclictest0-21swapper/322:42:593
717351993225,6cyclictest0-21swapper/300:37:593
71735199320,24cyclictest796779-21turbostat23:15:013
71735199320,1cyclictest0-21swapper/320:25:123
717350993228,2cyclictest0-21swapper/200:10:592
717347993228,3cyclictest0-21swapper/122:40:151
717347993227,4cyclictest816734-21kworker/u8:2+events_unbound00:35:241
717351993129,1cyclictest0-21swapper/321:12:593
717350993129,1cyclictest0-21swapper/223:44:592
717350993129,1cyclictest0-21swapper/220:19:592
717350993128,2cyclictest0-21swapper/220:05:592
71735099310,29cyclictest0-21swapper/220:35:132
717347993126,4cyclictest752817-21kworker/u8:3+flush-179:021:10:211
717347993123,5cyclictest0-21swapper/119:24:581
71735199300,2cyclictest0-21swapper/300:31:593
71735199300,28cyclictest0-21swapper/321:50:023
71735199300,28cyclictest0-21swapper/319:50:133
71735199300,28cyclictest0-21swapper/319:30:133
71735199300,26cyclictest0-21swapper/322:15:143
71735199300,1cyclictest0-21swapper/320:08:593
717350993028,1cyclictest0-21swapper/219:30:592
717350993027,2cyclictest0-21swapper/223:55:122
717350993027,2cyclictest0-21swapper/223:54:002
717350993027,2cyclictest0-21swapper/223:29:542
717350993027,2cyclictest0-21swapper/221:52:582
71735099300,2cyclictest0-21swapper/221:30:102
71735099300,28cyclictest0-21swapper/221:15:122
71735099300,28cyclictest0-21swapper/200:05:022
717347993022,6cyclictest721118-21kworker/u8:0+flush-179:019:55:001
717351992927,1cyclictest0-21swapper/300:14:553
717351992926,2cyclictest0-21swapper/300:25:133
71735199290,27cyclictest0-21swapper/321:40:033
71735199290,27cyclictest0-21swapper/320:15:153
71735199290,1cyclictest0-21swapper/323:45:153
71735099290,27cyclictest0-21swapper/222:50:132
71735099290,27cyclictest0-21swapper/222:45:122
71735099290,27cyclictest0-21swapper/222:30:142
71735099290,27cyclictest0-21swapper/222:25:012
71735099290,27cyclictest0-21swapper/222:00:132
71735099290,27cyclictest0-21swapper/220:25:122
71735099290,27cyclictest0-21swapper/200:25:142
71734799290,27cyclictest0-21swapper/121:05:131
717351992826,1cyclictest0-21swapper/322:47:003
717351992826,1cyclictest0-21swapper/319:23:593
71735199280,27cyclictest0-21swapper/323:50:133
71735199280,27cyclictest0-21swapper/322:30:133
71735199280,26cyclictest0-21swapper/323:55:123
71735199280,26cyclictest0-21swapper/322:35:123
71735199280,26cyclictest0-21swapper/321:30:113
717350992826,1cyclictest0-21swapper/223:05:122
717350992826,1cyclictest0-21swapper/219:10:132
717350992825,2cyclictest0-21swapper/220:49:552
71735099280,2cyclictest0-21swapper/223:30:142
71735099280,2cyclictest0-21swapper/222:35:132
71735099280,2cyclictest0-21swapper/221:20:132
71735099280,27cyclictest0-21swapper/219:55:012
71735099280,26cyclictest0-21swapper/221:38:592
71735099280,26cyclictest0-21swapper/221:25:032
71735099280,26cyclictest0-21swapper/200:35:132
71735099280,25cyclictest0-21swapper/220:41:592
4577091280,7ptp4l441ktimers/319:45:003
4577091280,6ptp4l441ktimers/321:10:003
4577091280,6ptp4l441ktimers/300:25:013
4577091280,6ptp4l441ktimers/300:05:013
717350992725,1cyclictest0-21swapper/223:35:132
717347992721,4cyclictest2426-10pipewire-media-23:30:001
4577091270,7ptp4l61490irq/134-eno1-TxRx-022:10:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-023:24:553
4577091270,6ptp4l61490irq/134-eno1-TxRx-020:15:003
4577091270,6ptp4l441ktimers/323:05:003
4577091270,6ptp4l441ktimers/322:00:013
4577091270,6ptp4l441ktimers/321:49:553
4577091270,6ptp4l441ktimers/321:05:003
4577091270,6ptp4l441ktimers/320:55:003
4577091270,6ptp4l441ktimers/320:44:553
4577091270,6ptp4l441ktimers/320:40:003
4577091270,5ptp4l441ktimers/323:30:013
717351992625,1cyclictest0-21swapper/323:05:133
71735199260,24cyclictest0-21swapper/320:30:123
717350992623,2cyclictest0-21swapper/221:04:002
717350992622,2cyclictest0-21swapper/221:55:592
71735099260,2cyclictest0-21swapper/221:10:592
71735099260,24cyclictest0-21swapper/223:45:022
71735099260,24cyclictest0-21swapper/222:24:592
71735099260,24cyclictest0-21swapper/219:36:592
717347992617,7cyclictest266-21systemd-journal20:35:001
4577091260,6ptp4l61490irq/134-eno1-TxRx-019:29:553
4577091260,6ptp4l441ktimers/321:40:003
4577091260,6ptp4l441ktimers/321:20:003
4577091260,6ptp4l441ktimers/321:00:003
717350992523,1cyclictest0-21swapper/221:07:592
4577091250,5ptp4l61490irq/134-eno1-TxRx-019:19:553
4577091250,4ptp4l61490irq/134-eno1-TxRx-023:00:003
231999250,14rtkit-daemon715929-21/usr/sbin/munin19:05:101
717351992419,4cyclictest735285-21turbostat20:05:003
717350992422,1cyclictest0-21swapper/219:43:592
717350992421,2cyclictest0-21swapper/200:17:592
71735099240,1cyclictest0-21swapper/220:34:592
717350992321,1cyclictest0-21swapper/200:30:582
717350992319,2cyclictest0-21swapper/223:00:592
717350992017,2cyclictest0-21swapper/223:21:582
71734599202,14cyclictest717349-21date19:10:010
717350991916,2cyclictest0-21swapper/219:25:122
717350991816,1cyclictest0-21swapper/220:00:132
717350991815,2cyclictest0-21swapper/223:17:592
71735099118,2cyclictest0-21swapper/222:10:132
7173509974,2cyclictest0-21swapper/220:57:472
7173509920,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional