You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 04:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue May 05, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200293499111101,7cyclictest2046431-21latency_hist21:25:010
20029399910698,6cyclictest2020386-21kworker/u8:2+flush-179:020:15:011
20029399910189,10cyclictest2072419-21apt-get22:45:031
2002939999873,22cyclictest2096563-40mandb00:00:011
2002934998983,4cyclictest1988426-21kworker/u8:2+flush-179:019:35:010
2002934998977,9cyclictest1213033-21systemd-journal21:55:210
2002934998574,9cyclictest2080853-21/usr/sbin/munin23:10:230
2002939998462,6cyclictest2064714-21apt-get22:20:131
2002939998375,6cyclictest2075846-21latency_hist22:55:021
2002939998372,9cyclictest2081280-21kworker/u8:3+flush-179:023:40:011
2002934998373,7cyclictest2044839-21latency_hist21:20:020
2002939997973,4cyclictest2102810-21kworker/u8:1+flush-179:000:20:211
2002934997971,6cyclictest2014040-21latency_hist19:45:010
2002939997769,6cyclictest2101353-21latency_hist00:15:011
2002934997770,5cyclictest2031848-21latency_hist20:40:010
2002934997669,5cyclictest2014027-21kworker/u8:3+flush-179:019:50:000
2002934997464,8cyclictest2020420-21apt-get20:04:560
2002939997264,5cyclictest2054630-21kworker/u8:3+flush-179:021:50:141
2002939997164,5cyclictest2058072-21kworker/u8:1+flush-179:022:05:211
2002934996961,6cyclictest2104582-21kworker/u8:3+flush-179:000:30:010
2002939996861,5cyclictest2051708-21/usr/sbin/munin21:40:231
2002939996861,5cyclictest2025495-21latency_hist20:20:011
2002939996859,7cyclictest2002888-21kworker/u8:1+flush-179:019:20:261
2002934996862,4cyclictest2070860-21kworker/u8:1+events_unbound22:45:010
2002939996756,9cyclictest2093601-21apt-get23:50:111
2002939996660,5cyclictest2009236-21kworker/u8:1+flush-179:019:29:551
2002934996661,4cyclictest2070860-21kworker/u8:1+flush-179:023:05:180
2002939996559,4cyclictest2011102-21apt-get19:35:121
2002939996558,5cyclictest2104582-21kworker/u8:3+flush-179:000:25:261
2002939996558,4cyclictest2081280-21kworker/u8:3+flush-179:023:30:201
2002934996559,4cyclictest2048055-21kworker/u8:2+flush-179:022:00:230
2002934996559,4cyclictest2048055-21kworker/u8:2+flush-179:022:00:220
200293999640,1cyclictest0-21swapper/121:13:591
2002939996360,2cyclictest714-21Xorg23:02:591
2002939996358,4cyclictest2058072-21kworker/u8:1+flush-179:022:04:561
2002939996358,4cyclictest2058072-21kworker/u8:1+flush-179:022:04:561
2002939996358,4cyclictest2007642-21kworker/u8:0+flush-179:020:24:561
2002939996355,6cyclictest2066026-21kworker/u8:1+flush-179:022:25:141
2002939996355,6cyclictest2066026-21kworker/u8:1+flush-179:022:25:141
2002939996355,6cyclictest2038462-21latency_hist21:00:011
2002934996360,2cyclictest0-21swapper/021:42:580
2002934996357,4cyclictest2056218-21kworker/u8:0+flush-179:022:15:200
2002934996356,5cyclictest2023929-21kworker/u8:1+flush-179:021:25:140
2002934996355,6cyclictest2081280-21kworker/u8:3+flush-179:023:35:200
2002934996354,7cyclictest2056227-21latency_hist21:55:010
2002934996351,9cyclictest2007642-21kworker/u8:0+events_unbound19:50:220
2002939996256,4cyclictest2007642-21kworker/u8:0+flush-179:019:50:261
2002939996254,5cyclictest2104582-21kworker/u8:3+flush-179:000:35:151
2002934996256,5cyclictest2086792-21kworker/u8:0+events_unbound23:45:240
2002934996256,4cyclictest2007642-21kworker/u8:0+flush-179:019:55:220
2002934996255,5cyclictest2069218-21latency_hist22:35:000
2002939996155,4cyclictest2070860-21kworker/u8:1+flush-179:023:10:011
2002939996153,6cyclictest2104582-21kworker/u8:3+flush-179:000:30:221
2002939996152,7cyclictest2043488-21apt-get21:15:121
2002939996053,5cyclictest2069472-21apt-get22:35:091
2002939995952,6cyclictest2007642-21kworker/u8:0+flush-179:020:40:001
2002939995949,8cyclictest2085651-21apt-get23:25:131
2002939995853,4cyclictest1999900-21kworker/u8:3+flush-179:019:14:551
2002939995852,5cyclictest2070860-21kworker/u8:1+flush-179:023:20:211
2002939995850,6cyclictest2093345-21latency_hist23:50:011
2002934995853,3cyclictest2031896-21kworker/0:2-events21:12:200
2002934995851,5cyclictest2086792-21kworker/u8:0+events_unbound23:55:000
2002939995752,3cyclictest2007642-21kworker/u8:0+flush-179:020:45:201
2002934995752,4cyclictest2007642-21kworker/u8:0+events_unbound20:45:240
2002939995648,6cyclictest2010848-21latency_hist19:35:011
2002934995652,3cyclictest2054078-21kworker/u8:0+flush-179:021:45:200
2002934995651,4cyclictest2074271-21kworker/u8:2+events_unbound22:55:250
2002939995549,4cyclictest2045895-21kworker/u8:0+events_unbound21:30:021
2002934995550,4cyclictest2086792-21kworker/u8:0+flush-179:023:40:210
2002934995549,5cyclictest2077490-21kworker/u8:0+flush-179:023:15:220
2002934995549,5cyclictest2077490-21kworker/u8:0+flush-179:023:15:220
2002934995547,6cyclictest510-21rs:main0
2002939995449,4cyclictest2007642-21kworker/u8:0+flush-179:021:05:271
2002939995445,7cyclictest2022041-21latency_hist20:10:011
2002934995450,3cyclictest2002888-21kworker/u8:1+events_unbound19:20:220
2002934995449,4cyclictest2020386-21kworker/u8:2+flush-179:020:30:210
2002939995348,4cyclictest2056218-21kworker/u8:0+flush-179:022:10:211
2002939995348,4cyclictest2020386-21kworker/u8:2+events_unbound20:25:241
2002939995345,6cyclictest2032114-21apt-get20:40:111
2002934995349,3cyclictest2092798-21kworker/u8:1+flush-179:000:00:200
2002934995349,3cyclictest2007642-21kworker/u8:0+flush-179:021:05:180
2002934995348,3cyclictest2023929-21kworker/u8:1+flush-179:021:35:220
2002934995347,5cyclictest2048055-21kworker/u8:2+flush-179:022:15:000
2002934995345,6cyclictest2020386-21kworker/u8:2+flush-179:020:25:210
2002939995247,4cyclictest2048055-21kworker/u8:2+flush-179:021:45:151
2002939995247,4cyclictest2023929-21kworker/u8:1+events_unbound20:50:251
2002939995242,8cyclictest2071080-21apt-get22:40:091
2002934995146,4cyclictest2086792-21kworker/u8:0+flush-179:000:15:250
2002934995143,6cyclictest2007642-21kworker/u8:0+events_unbound20:10:230
2002934995141,8cyclictest2025750-21apt-get20:20:120
2002934995045,4cyclictest2056218-21kworker/u8:0+flush-179:022:20:250
2002934995043,6cyclictest2104582-21kworker/u8:3+events_unbound00:35:200
4577091490,13ptp4l441ktimers/319:10:013
2002939994943,5cyclictest2086792-21kworker/u8:0+flush-179:023:45:011
2002934994944,4cyclictest2074271-21kworker/u8:2+flush-179:023:00:170
2002934994943,5cyclictest2023929-21kworker/u8:1+events_unbound20:55:000
2002934994943,5cyclictest2007642-21kworker/u8:0+events_unbound19:25:160
2002934994943,4cyclictest2086792-21kworker/u8:0+flush-179:000:10:200
2002934994938,8cyclictest1213033-21systemd-journal20:45:010
2002939994842,4cyclictest2074271-21kworker/u8:2+flush-179:022:55:201
2002934994842,5cyclictest2081280-21kworker/u8:3+flush-179:023:30:240
2002939994743,3cyclictest2066080-21kworker/u8:3+events_unbound22:30:251
2002939994740,5cyclictest1988426-21kworker/u8:2+flush-179:019:40:151
2002934994740,5cyclictest2081280-21kworker/u8:3+events_unbound23:55:240
200293499471,43cyclictest1-21systemd23:24:200
231999460,4rtkit-daemon2318-21rtkit-daemon23:15:001
2002939994641,4cyclictest2023929-21kworker/u8:1+events_unbound21:35:191
2002939994638,6cyclictest2002888-21kworker/u8:1+flush-179:019:15:161
2002934994641,4cyclictest2007642-21kworker/u8:0+flush-179:020:15:140
2002934994640,5cyclictest2104582-21kworker/u8:3+events_unbound00:30:230
2002939994541,3cyclictest1-21systemd00:04:001
2002939994540,4cyclictest2086792-21kworker/u8:0+events_unbound00:15:201
2002939994536,7cyclictest510-21rs:main1
2002934994541,3cyclictest2070860-21kworker/u8:1+flush-179:023:25:170
2002934994539,5cyclictest2056218-21kworker/u8:0+events_unbound22:05:150
200293999440,43cyclictest0-21swapper/121:24:551
2002934994438,4cyclictest2048030-21apt-get21:30:030
200294199430,1cyclictest0-21swapper/322:09:003
200294099430,2cyclictest0-21swapper/222:08:592
2002939994337,5cyclictest2035788-21kworker/u8:2+flush-179:021:04:541
2002939994336,6cyclictest2007642-21kworker/u8:0+events_unbound19:45:201
2002934994339,3cyclictest2022103-21munin-run20:10:010
2002934994338,4cyclictest2066026-21kworker/u8:1+flush-179:022:25:150
2002934994338,4cyclictest2066026-21kworker/u8:1+flush-179:022:25:140
2002934994338,4cyclictest2023929-21kworker/u8:1+events_unbound21:00:220
231999420,4rtkit-daemon2318-21rtkit-daemon19:55:151
2002934994237,4cyclictest2002888-21kworker/u8:1+flush-179:019:15:250
2002934994236,4cyclictest1999900-21kworker/u8:3+flush-179:019:10:140
2002939994136,4cyclictest2009236-21kworker/u8:1+events_unbound20:00:251
2002939994135,4cyclictest2057823-21munin-run22:00:001
2002939994132,7cyclictest2023929-21kworker/u8:1+events_unbound21:25:201
2002941994036,2cyclictest0-21swapper/320:35:593
200294199400,38cyclictest2075856-21turbostat22:55:003
200294199400,38cyclictest2006071-21turbostat19:20:013
200293999401,2cyclictest714-21Xorg00:06:591
2002934994036,3cyclictest2066080-21kworker/u8:3+events_unbound22:50:270
2002934994035,4cyclictest2056218-21kworker/u8:0+events_unbound22:45:230
2002934994035,4cyclictest2023929-21kworker/u8:1+flush-179:020:55:260
200294199390,37cyclictest0-21swapper/319:52:593
2002940993936,2cyclictest0-21swapper/220:35:582
200294099390,36cyclictest0-21swapper/222:19:592
200294099390,30cyclictest0-21swapper/221:42:002
200294099390,30cyclictest0-21swapper/221:31:582
200294099390,30cyclictest0-21swapper/219:52:592
200294099390,2cyclictest0-21swapper/219:46:592
2002934993934,4cyclictest2069195-21kworker/u8:2+events_unbound22:35:230
200294199380,37cyclictest0-21swapper/321:31:593
200294199380,1cyclictest0-21swapper/323:14:553
2002940993835,2cyclictest0-21swapper/221:51:592
200294099380,36cyclictest0-21swapper/223:34:552
200294099380,35cyclictest0-21swapper/220:00:002
200294099380,35cyclictest0-21swapper/219:25:002
2002934993833,4cyclictest2102810-21kworker/u8:1+events_unbound00:20:220
2002941993734,2cyclictest0-21swapper/321:52:003
2002941993731,5cyclictest2009273-21turbostat19:30:003
2002940993733,2cyclictest0-21swapper/222:26:002
2002940993733,2cyclictest0-21swapper/222:25:592
2002940993733,2cyclictest0-21swapper/222:14:552
200294099370,1cyclictest0-21swapper/222:50:012
2002941993634,1cyclictest0-21swapper/320:51:583
2002941993633,2cyclictest0-21swapper/322:26:003
2002941993633,2cyclictest0-21swapper/322:25:593
2002941993630,5cyclictest2070831-21turbostat22:40:013
200294199360,35cyclictest0-21swapper/323:34:553
200294199360,35cyclictest0-21swapper/322:19:593
200294199360,1cyclictest0-21swapper/321:41:593
200294199360,1cyclictest0-21swapper/319:59:593
200294199360,1cyclictest0-21swapper/319:46:593
2002940993632,2cyclictest0-21swapper/223:28:592
200294099360,2cyclictest0-21swapper/223:14:552
2002941993530,4cyclictest2109328-21turbostat00:40:003
2002940993532,2cyclictest0-21swapper/222:31:592
2002940993532,2cyclictest0-21swapper/219:42:592
2002940993531,2cyclictest0-21swapper/220:07:592
2002939993527,6cyclictest2083804-21latency_hist23:20:011
2002939993527,6cyclictest2083804-21latency_hist23:20:011
2002941993432,1cyclictest0-21swapper/322:14:543
2002941993432,1cyclictest0-21swapper/319:42:593
2002941993429,4cyclictest2040080-21turbostat21:05:003
2002941993428,5cyclictest2085402-21turbostat23:25:003
2002940993432,1cyclictest0-21swapper/219:30:002
2002940993431,2cyclictest0-21swapper/220:48:592
2002940993430,2cyclictest0-21swapper/221:05:002
2002934993431,2cyclictest2012456-21perf19:40:000
2002941993331,2cyclictest0-21swapper/323:29:003
2002941993331,1cyclictest0-21swapper/322:31:593
2002940993330,2cyclictest0-21swapper/222:42:582
2002940993330,2cyclictest0-21swapper/222:37:592
2002940993330,2cyclictest0-21swapper/222:24:552
2002940993330,2cyclictest0-21swapper/200:29:552
2002940993330,1cyclictest0-21swapper/200:40:002
2002941993230,1cyclictest0-21swapper/322:24:563
2002941993230,1cyclictest0-21swapper/320:48:593
2002941993230,1cyclictest0-21swapper/320:07:593
2002941993229,2cyclictest0-21swapper/300:29:553
2002940993228,2cyclictest0-21swapper/220:23:582
200294099320,30cyclictest0-21swapper/221:20:002
2002941993129,1cyclictest0-21swapper/322:42:593
2002941993126,4cyclictest2059429-21turbostat22:04:593
2002941993126,4cyclictest2059429-21turbostat22:04:593
2002940993128,2cyclictest0-21swapper/223:25:002
2002940993128,2cyclictest0-21swapper/223:09:552
2002940993127,2cyclictest0-21swapper/223:05:002
4577091300,7ptp4l441ktimers/322:50:003
2002941993028,1cyclictest0-21swapper/323:09:553
2002941993027,2cyclictest0-21swapper/320:23:593
2002940993027,2cyclictest0-21swapper/223:50:132
2002940993027,2cyclictest0-21swapper/221:25:142
2002940993027,2cyclictest0-21swapper/219:30:132
2002940993025,2cyclictest0-21swapper/220:04:582
200294099300,2cyclictest0-21swapper/220:50:032
200294099300,29cyclictest0-21swapper/222:00:142
200294099300,29cyclictest0-21swapper/222:00:132
200294099300,29cyclictest0-21swapper/221:10:132
200294099300,28cyclictest0-21swapper/220:30:132
200294099300,28cyclictest0-21swapper/200:05:172
2002939993024,4cyclictest2002848-21latency_hist19:10:021
4577091290,6ptp4l441ktimers/300:00:013
2002941992927,1cyclictest0-21swapper/323:04:593
2002941992926,2cyclictest0-21swapper/323:50:123
2002941992923,5cyclictest2025503-21turbostat20:20:003
200294199290,28cyclictest0-21swapper/323:40:123
200294199290,28cyclictest0-21swapper/321:10:123
200294199290,28cyclictest0-21swapper/319:30:133
200294199290,27cyclictest0-21swapper/321:25:123
200294199290,27cyclictest0-21swapper/320:30:123
200294199290,27cyclictest0-21swapper/320:10:023
200294199290,27cyclictest0-21swapper/300:30:133
2002940992926,2cyclictest0-21swapper/223:15:142
2002940992926,2cyclictest0-21swapper/223:15:132
2002940992926,2cyclictest0-21swapper/219:38:592
200294099290,2cyclictest0-21swapper/223:36:592
200294099290,2cyclictest0-21swapper/200:20:102
200294099290,27cyclictest0-21swapper/223:40:122
200294099290,27cyclictest0-21swapper/220:10:022
200294099290,27cyclictest0-21swapper/200:30:132
4577091280,7ptp4l61490irq/134-eno1-TxRx-021:10:003
4577091280,6ptp4l441ktimers/323:40:003
4577091280,6ptp4l441ktimers/321:59:563
4577091280,6ptp4l441ktimers/319:15:013
2002941992826,1cyclictest0-21swapper/319:38:583
2002941992826,1cyclictest0-21swapper/300:20:103
2002941992825,2cyclictest0-21swapper/323:15:143
2002941992825,2cyclictest0-21swapper/323:15:133
2002941992825,2cyclictest0-21swapper/320:04:593
200294199280,26cyclictest0-21swapper/300:05:173
2002940992824,2cyclictest0-21swapper/222:52:592
2002940992824,2cyclictest0-21swapper/221:37:002
200294099280,2cyclictest0-21swapper/219:13:592
200294099280,26cyclictest0-21swapper/219:19:592
200294099280,25cyclictest0-21swapper/223:58:592
2002939992823,4cyclictest0-21swapper/120:35:011
4577091270,6ptp4l61490irq/134-eno1-TxRx-000:20:013
4577091270,6ptp4l441ktimers/320:30:013
4577091270,5ptp4l441ktimers/321:25:013
4577091270,5ptp4l441ktimers/320:59:563
231999270,15rtkit-daemon2002900-21munin-run19:10:010
2002941992724,2cyclictest0-21swapper/321:37:003
200294099270,25cyclictest0-21swapper/221:10:002
4577091260,6ptp4l441ktimers/320:44:553
4577091260,5ptp4l441ktimers/321:50:003
4577091260,5ptp4l441ktimers/319:24:563
4577091260,5ptp4l441ktimers/300:14:553
2002941992624,1cyclictest0-21swapper/321:17:593
2002941992623,2cyclictest2077439-21turbostat23:00:003
2002940992623,2cyclictest0-21swapper/220:41:002
2002940992622,2cyclictest0-21swapper/221:58:592
200294099260,1cyclictest0-21swapper/200:14:592
4577091250,4ptp4l441ktimers/300:04:563
2002940992422,1cyclictest0-21swapper/222:59:592
2002940992421,2cyclictest0-21swapper/223:45:132
2002940992421,2cyclictest0-21swapper/221:46:582
2002940992420,2cyclictest0-21swapper/220:57:592
2002941992321,1cyclictest0-21swapper/323:46:003
2002940992016,2cyclictest0-21swapper/200:19:552
2002940992016,2cyclictest0-21swapper/200:01:592
2002940991815,2cyclictest0-21swapper/221:24:562
2002940991614,1cyclictest0-21swapper/220:30:012
2002940991613,2cyclictest0-21swapper/220:15:592
20029409930,2cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional