You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 14:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sat Apr 25, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36816289911282,20cyclictest3757140-21latency_hist23:05:011
368162899111101,7cyclictest1213033-21systemd-journal00:40:011
36816289910695,8cyclictest1213033-21systemd-journal23:05:221
36816239910290,10cyclictest3718173-21latency_hist21:05:010
3681628999770,24cyclictest3774902-21/usr/sbin/munin00:00:221
3681623999384,7cyclictest3732748-21latency_hist21:50:010
3681623999281,9cyclictest3779470-21apt-get00:15:020
3681623998981,6cyclictest3700664-21latency_hist20:10:010
3681628998779,6cyclictest3745997-21latency_hist22:30:011
3681628998477,5cyclictest3742825-21latency_hist22:20:011
3681628998476,6cyclictest3732783-21kworker/u8:3+flush-179:021:50:261
3681628997766,9cyclictest3731417-21apt-get21:45:131
3681628997466,6cyclictest3708618-21latency_hist20:35:011
3681628997465,7cyclictest3774666-40mandb00:00:011
3681628997465,7cyclictest3774666-40mandb00:00:001
3681628997464,8cyclictest3734587-21apt-get21:55:121
3681628997463,8cyclictest3753945-21latency_hist22:55:011
3681628997363,8cyclictest3766914-21/usr/sbin/munin23:35:221
368162899731,66cyclictest1-21systemd19:40:011
3681628997164,5cyclictest3760546-21/usr/sbin/munin23:15:241
3681628997164,5cyclictest3760546-21/usr/sbin/munin23:15:241
3681628996960,7cyclictest3716823-21/usr/sbin/munin21:00:231
3681623996857,9cyclictest1213033-21systemd-journal19:40:000
3681623996758,7cyclictest3743081-21apt-get22:20:110
3681623996758,7cyclictest3743081-21apt-get22:20:110
3681623996757,7cyclictest1213033-21systemd-journal21:05:020
3681623996655,9cyclictest3715234-21apt-get20:55:120
3681628996559,4cyclictest3703850-21latency_hist20:20:001
3681628996457,5cyclictest1213033-21systemd-journal19:50:011
3681628996456,7cyclictest3701708-21kworker/u8:0+events_unbound21:00:001
4577091630,18ptp4l61490irq/134-eno1-TxRx-019:06:223
3681623996358,3cyclictest3773038-21latency_hist23:55:010
3681623996352,9cyclictest3737537-21apt-get22:05:000
3681628996251,9cyclictest3688138-21apt-get19:30:111
3681628996151,8cyclictest3765346-21apt-get23:30:101
3681623996153,6cyclictest3755808-21apt-get23:00:120
3681623996151,8cyclictest3768539-21apt-get23:40:110
3681628996052,6cyclictest3754183-21/usr/sbin/munin22:55:221
3681628996051,6cyclictest1213033-21systemd-journal21:27:231
368162899601,40cyclictest1-21systemd22:13:231
368162899591,51cyclictest0-21swapper/100:10:121
3681628995851,5cyclictest3699114-21kworker/u8:3+events_unbound20:05:241
368162899581,37cyclictest714-21Xorg00:17:591
3681623995851,5cyclictest3749427-21kworker/u8:1+events_unbound22:40:240
3681628995750,6cyclictest3694287-21kworker/u8:1+flush-179:019:55:011
3681623995740,14cyclictest3713395-21latency_hist20:50:010
231999570,6rtkit-daemon2318-21rtkit-daemon19:15:140
3681628995650,4cyclictest3769903-21kworker/u8:3+flush-179:000:25:251
3681628995649,5cyclictest3769903-21kworker/u8:3+flush-179:023:45:211
3681628995635,19cyclictest3686327-21systemd-run19:25:001
3681623995650,4cyclictest3763504-21latency_hist23:25:010
231999560,5rtkit-daemon2318-21rtkit-daemon20:38:590
3681628995547,7cyclictest3720253-21kworker/u8:0+flush-179:021:14:551
3681628995546,7cyclictest3761884-21kworker/u8:3+flush-179:023:20:221
3681623995548,6cyclictest3699114-21kworker/u8:3+flush-179:020:15:270
3681623995447,5cyclictest3761876-21kworker/u8:2+flush-179:000:25:170
3681623995446,6cyclictest3761876-21kworker/u8:2+events_unbound00:35:000
3681628995347,4cyclictest3761876-21kworker/u8:2+flush-179:023:30:001
3681628995250,1cyclictest3739386-21apt-get22:10:001
3681628995245,6cyclictest3686282-21kworker/u8:1+flush-179:019:25:211
3681628995245,5cyclictest3712064-21apt-get20:45:141
3681628995229,21cyclictest0-21swapper/122:45:151
3681623995244,6cyclictest3720272-21apt-get21:10:100
3681628995146,4cyclictest3701708-21kworker/u8:0+events_unbound20:10:241
3681628995144,6cyclictest3696507-21kworker/u8:0+flush-179:020:00:001
3681623995144,5cyclictest3769903-21kworker/u8:3+flush-179:000:10:150
3681623995143,6cyclictest3768267-21latency_hist23:40:010
3681623995142,7cyclictest1213033-21systemd-journal20:55:010
3681628995042,6cyclictest3684707-21latency_hist19:20:021
3681623995029,19cyclictest1213033-21systemd-journal22:13:230
3681623994944,4cyclictest3741251-21kworker/u8:0+flush-179:022:35:250
3681623994941,6cyclictest3697746-21apt-get20:00:110
3681628994842,5cyclictest1213033-21systemd-journal21:30:231
3681628994840,6cyclictest3680026-21kworker/u8:0+flush-179:019:10:151
3681623994836,10cyclictest3744666-21apt-get22:25:120
368162399480,3cyclictest0-21swapper/000:00:120
3681628994740,5cyclictest3749428-21/usr/sbin/munin22:40:171
3681628994739,6cyclictest3782917-21latency_hist00:25:011
3681628994739,6cyclictest3691313-21/usr/sbin/munin19:40:161
3681628994739,6cyclictest3691313-21/usr/sbin/munin19:40:161
3681623994744,2cyclictest3741251-21kworker/u8:0+flush-179:023:10:210
3681623994741,4cyclictest3752355-21kworker/u8:2+events_unbound22:55:130
3681628994636,8cyclictest3768823-21kworker/u8:0+flush-179:023:54:551
3681623994640,5cyclictest3768823-21kworker/u8:0+flush-179:023:55:260
3681623994640,5cyclictest3768823-21kworker/u8:0+flush-179:023:55:250
3681623994639,5cyclictest3784537-21kworker/u8:0+flush-179:000:35:200
3681623994637,7cyclictest3741251-21kworker/u8:0+flush-179:022:35:000
3681623994540,4cyclictest3731210-21latency_hist21:45:000
3681623994537,7cyclictest3680026-21kworker/u8:0+flush-179:019:10:200
3681623994522,20cyclictest3728398-21cpuspeed_turbos21:35:140
368162399450,2cyclictest0-21swapper/023:18:590
368162399450,2cyclictest0-21swapper/023:18:590
368162399450,20cyclictest3705462-21perf20:25:000
3681628994440,2cyclictest714-21Xorg20:45:001
3681628994436,7cyclictest3737514-21kworker/u8:2+flush-179:022:04:561
3681623994437,6cyclictest3702374-21latency_hist20:15:010
3681623994423,20cyclictest3706566-21proc_pri20:25:230
368162399441,2cyclictest3742832-21idleruntime-cro22:20:000
368162999430,1cyclictest0-21swapper/200:08:002
3681628994337,5cyclictest3723470-21kworker/u8:1+events_unbound21:20:181
368162899432,39cyclictest3742836-21turbostat22:24:551
368162899432,39cyclictest3742836-21turbostat22:24:551
3681623994338,4cyclictest3766541-21unixbench-2d23:30:230
3681623994337,4cyclictest3769903-21kworker/u8:3+events_unbound00:10:010
3681623994335,6cyclictest3726392-21awk21:30:010
368163299420,5cyclictest3742836-21turbostat22:20:003
3681628994237,4cyclictest3741251-21kworker/u8:0+flush-179:023:10:201
368162899420,40cyclictest3720034-21perf21:10:001
3681623994237,3cyclictest3686333-21systemd-run19:25:000
3681623994236,5cyclictest3704118-21kworker/u8:2+flush-179:021:55:000
3681623994234,7cyclictest3771455-21cron23:50:000
368162399420,39cyclictest1-21systemd19:50:000
368163299410,37cyclictest3686308-21turbostat19:25:003
368162899414,15cyclictest2304-21lightdm-gtk-gre00:05:591
368162899414,11cyclictest2304-21lightdm-gtk-gre20:51:591
3681628994135,4cyclictest3729557-21latency_hist21:40:011
3681628994134,5cyclictest3749176-21latency_hist22:40:011
3681623994134,5cyclictest3720253-21kworker/u8:0+flush-179:021:20:000
3681623994133,7cyclictest3723470-21kworker/u8:1+flush-179:021:20:570
368162399411,3cyclictest714-21Xorg23:06:590
3681632994034,4cyclictest3724809-21turbostat21:25:003
3681632994033,5cyclictest3708626-21turbostat20:35:013
3681632994033,5cyclictest3687898-21turbostat19:30:003
3681632994027,11cyclictest3721614-21turbostat21:15:003
3681623994037,2cyclictest3761876-21kworker/u8:2+events_unbound23:25:250
3681623994035,4cyclictest3753982-21systemd-run22:55:000
368162399400,38cyclictest714-21Xorg19:29:000
368163299390,37cyclictest3713413-21turbostat20:50:003
368162999390,36cyclictest0-21swapper/200:39:592
368162999390,30cyclictest0-21swapper/219:33:002
368162999390,2cyclictest0-21swapper/222:14:552
3681628993932,3cyclictest3710210-21dump-pmu-power20:39:591
3681628993931,5cyclictest3768823-21kworker/u8:0+flush-179:023:45:011
3681623993931,6cyclictest3694287-21kworker/u8:1+events_unbound19:50:250
3681623993924,14cyclictest3696982-21phc2sys-jitter19:55:220
3681623993917,21cyclictest3710884-21fschecks_time20:40:150
3681632993836,1cyclictest0-21swapper/321:03:593
3681632993832,4cyclictest3741231-21turbostat22:15:003
368163299380,3cyclictest3761919-21turbostat23:20:013
368163299380,3cyclictest3761919-21turbostat23:20:013
368163299380,36cyclictest0-21swapper/322:31:593
3681629993835,2cyclictest0-21swapper/221:03:592
3681629993834,2cyclictest0-21swapper/223:34:542
3681629993834,2cyclictest0-21swapper/221:54:562
3681629993833,2cyclictest0-21swapper/220:58:002
368162999380,35cyclictest0-21swapper/222:31:592
368162999380,35cyclictest0-21swapper/222:25:002
368162999380,35cyclictest0-21swapper/222:25:002
368162999380,35cyclictest0-21swapper/221:30:002
368162999380,2cyclictest0-21swapper/221:06:592
368162999380,1cyclictest0-21swapper/219:24:592
3681628993832,4cyclictest3704118-21kworker/u8:2+flush-179:020:25:231
3681623993819,17cyclictest0-21swapper/022:45:230
3681632993735,1cyclictest0-21swapper/321:54:553
3681632993734,2cyclictest0-21swapper/321:44:553
3681629993734,2cyclictest0-21swapper/223:26:592
3681629993734,2cyclictest0-21swapper/221:44:552
3681629993734,2cyclictest0-21swapper/220:34:552
3681629993726,8cyclictest0-21swapper/221:15:002
368162999370,35cyclictest0-21swapper/220:40:002
368162899374,12cyclictest2304-21lightdm-gtk-gre20:04:581
3681628993733,3cyclictest3786213-21apt-key00:35:011
368162899370,1cyclictest0-21swapper/121:43:591
3681623993731,5cyclictest3680026-21kworker/u8:0+events_unbound19:10:020
3681623993730,5cyclictest3761876-21kworker/u8:2+flush-179:000:20:170
3681623993729,7cyclictest3727013-21fschecks_time21:30:160
3681623993729,5cyclictest0-21swapper/020:32:590
3681623993717,19cyclictest0-21swapper/019:30:120
3681632993634,1cyclictest0-21swapper/323:34:553
3681632993633,2cyclictest0-21swapper/320:57:593
3681632993630,4cyclictest3720033-21turbostat21:10:003
368163299360,1cyclictest0-21swapper/319:32:593
3681629993634,1cyclictest0-21swapper/221:25:002
3681629993633,2cyclictest0-21swapper/223:51:592
3681629993632,2cyclictest0-21swapper/221:49:552
3681629993631,2cyclictest0-21swapper/200:33:002
3681628993627,6cyclictest0-21swapper/122:31:591
3681623993627,7cyclictest3692529-21unixbench-2d19:40:250
3681623993627,7cyclictest3692529-21unixbench-2d19:40:240
3681623993614,20cyclictest0-21swapper/022:05:210
3681632993533,1cyclictest0-21swapper/323:52:003
3681632993533,1cyclictest0-21swapper/300:12:593
3681632993532,2cyclictest0-21swapper/321:39:593
3681632993531,3cyclictest0-21swapper/321:49:553
3681629993532,2cyclictest0-21swapper/200:12:592
3681629993531,2cyclictest0-21swapper/219:29:552
3681629993528,5cyclictest0-21swapper/200:17:592
3681623993530,3cyclictest3735925-21systemctl22:00:000
3681632993431,2cyclictest0-21swapper/322:03:593
3681632993431,2cyclictest0-21swapper/300:32:593
3681629993430,2cyclictest0-21swapper/222:03:592
3681628993427,5cyclictest3699114-21kworker/u8:3+events_unbound20:20:131
3681632993331,1cyclictest0-21swapper/321:59:593
3681632993328,4cyclictest0-21swapper/300:17:583
368163299330,30cyclictest3714990-21turbostat20:55:013
3681629993331,1cyclictest0-21swapper/221:59:592
3681629993331,1cyclictest0-21swapper/221:39:592
3681629993329,2cyclictest0-21swapper/222:19:552
3681632993228,3cyclictest0-21swapper/320:07:593
3681632993227,2cyclictest0-21swapper/322:24:553
3681632993227,2cyclictest0-21swapper/322:24:553
3681629993228,2cyclictest0-21swapper/220:54:552
3681629993228,2cyclictest0-21swapper/220:07:592
368162999320,30cyclictest0-21swapper/219:10:132
4577091310,3ptp4l431rcuc/323:15:003
368163299310,30cyclictest0-21swapper/321:30:143
368163299310,29cyclictest0-21swapper/322:05:023
368162999310,2cyclictest0-21swapper/200:00:112
368162999310,29cyclictest0-21swapper/221:30:142
3681628993125,4cyclictest714-21Xorg21:19:591
3681632993027,2cyclictest0-21swapper/320:44:593
3681632993024,5cyclictest0-21swapper/300:00:123
368163299300,28cyclictest0-21swapper/319:50:133
368163299300,28cyclictest0-21swapper/319:10:133
3681629993026,2cyclictest0-21swapper/223:13:592
3681629993026,2cyclictest0-21swapper/220:10:592
3681629993021,7cyclictest0-21swapper/220:45:592
368162999300,28cyclictest0-21swapper/222:50:132
368162999300,28cyclictest0-21swapper/222:05:022
368162999300,27cyclictest0-21swapper/200:29:592
4577091290,7ptp4l61490irq/134-eno1-TxRx-000:30:013
4577091290,7ptp4l441ktimers/323:10:013
368163299290,27cyclictest0-21swapper/300:35:013
3681629992927,1cyclictest0-21swapper/220:44:592
3681629992925,2cyclictest0-21swapper/222:41:592
368162999290,27cyclictest0-21swapper/223:40:142
368162999290,27cyclictest0-21swapper/219:50:122
368162999290,27cyclictest0-21swapper/219:45:142
4577091280,7ptp4l441ktimers/320:00:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-021:30:013
4577091280,6ptp4l441ktimers/323:25:003
4577091280,6ptp4l441ktimers/323:05:003
4577091280,6ptp4l441ktimers/322:30:003
4577091280,6ptp4l441ktimers/320:19:553
4577091280,6ptp4l441ktimers/319:40:003
3681632992826,1cyclictest0-21swapper/322:42:003
3681632992824,2cyclictest0-21swapper/300:05:133
368163299280,27cyclictest0-21swapper/319:45:133
368163299280,26cyclictest0-21swapper/323:40:143
368163299280,1cyclictest0-21swapper/323:59:593
368163299280,1cyclictest0-21swapper/323:59:583
368163299280,1cyclictest0-21swapper/322:50:133
3681629992824,2cyclictest0-21swapper/219:44:002
3681629992824,2cyclictest0-21swapper/219:43:592
368162999280,24cyclictest0-21swapper/223:19:562
368162999280,24cyclictest0-21swapper/223:19:562
4577091270,6ptp4l441ktimers/323:29:593
4577091270,6ptp4l441ktimers/322:50:013
4577091270,6ptp4l441ktimers/320:29:553
4577091270,6ptp4l441ktimers/300:25:013
4577091270,5ptp4l61490irq/134-eno1-TxRx-020:25:003
4577091270,5ptp4l441ktimers/319:45:003
4577091270,5ptp4l441ktimers/319:45:003
3681632992725,1cyclictest0-21swapper/323:45:143
3681632992725,1cyclictest0-21swapper/320:11:003
368163299270,26cyclictest0-21swapper/320:36:593
3681629992724,2cyclictest0-21swapper/223:45:142
3681629992724,2cyclictest0-21swapper/221:15:592
3681629992723,2cyclictest0-21swapper/219:16:002
368162999270,2cyclictest0-21swapper/223:59:592
368162999270,2cyclictest0-21swapper/223:59:592
368162999270,2cyclictest0-21swapper/220:18:592
4577091260,6ptp4l441ktimers/320:05:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-022:40:003
4577091260,5ptp4l441ktimers/323:35:013
4577091260,5ptp4l441ktimers/322:59:553
4577091260,5ptp4l441ktimers/321:19:563
3681629992622,2cyclictest0-21swapper/223:03:592
4577091250,5ptp4l441ktimers/319:19:553
3681629992521,2cyclictest0-21swapper/219:59:592
368162999250,2cyclictest0-21swapper/200:23:592
3681629992421,2cyclictest0-21swapper/222:25:142
3681629992415,1cyclictest0-21swapper/222:39:592
3681628992418,4cyclictest3681637-21latency_hist19:10:011
3681629992320,2cyclictest0-21swapper/220:26:592
3681629992218,2cyclictest0-21swapper/222:57:592
3681629992118,2cyclictest0-21swapper/219:36:582
3681629991916,2cyclictest0-21swapper/220:02:592
3681629991411,2cyclictest0-21swapper/223:10:002
368162999140,1cyclictest0-21swapper/222:48:582
368162999107,2cyclictest0-21swapper/223:35:592
368162999106,2cyclictest0-21swapper/223:21:592
36816299995,2cyclictest3705457-21turbostat20:25:012
36816299940,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional