You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 05:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sat Dec 06, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182977599109100,6cyclictest1886366-21kworker/u8:0+flush-179:022:20:000
18297779910396,5cyclictest1843948-21kworker/u8:0+events_unbound19:59:591
1829775999483,8cyclictest1917123-21/usr/sbin/munin23:40:240
1829777999281,9cyclictest1928324-21latency_hist00:15:011
1829775998978,9cyclictest1845826-21latency_hist20:00:010
1829777998580,4cyclictest1920304-21kworker/u8:1+events_unbound00:00:001
1829777998577,6cyclictest1863875-21kworker/u8:1+flush-179:021:00:001
1829775998575,8cyclictest271-21systemd-journal20:50:000
1829775998575,8cyclictest271-21systemd-journal20:50:000
1829777998478,4cyclictest1890943-21kworker/u8:3+flush-179:022:50:011
1829777998478,4cyclictest1887748-21kworker/u8:1+flush-179:022:15:001
1829775998473,9cyclictest1854047-21latency_hist20:25:010
1829777998075,4cyclictest1912339-21kworker/u8:0+events_unbound23:25:281
1829777998073,4cyclictest1874968-21kworker/u8:0+flush-179:021:35:011
1829777998064,10cyclictest271-21systemd-journal00:04:001
1829777998064,10cyclictest271-21systemd-journal00:04:001
1829775998073,5cyclictest1865684-21kworker/u8:2+flush-179:021:20:000
1829775998070,4cyclictest1876608-21kworker/u8:3+events_unbound22:00:230
1829777997970,7cyclictest1840804-21latency_hist19:45:011
1829777997870,6cyclictest1836024-21latency_hist19:30:011
182977599761,74cyclictest1-21systemd20:10:010
1829777997561,4cyclictest1831280-21kworker/u8:3+flush-179:019:20:001
1829777997367,4cyclictest1906548-21kworker/u8:2+events_unbound23:15:011
1829777997267,4cyclictest1890943-21kworker/u8:3+flush-179:023:00:001
1829777997166,4cyclictest1920350-21kworker/u8:3+events_unbound00:05:311
1829777997166,4cyclictest1874968-21kworker/u8:0+flush-179:021:30:001
1829775997059,8cyclictest1839456-21/usr/sbin/munin19:40:230
1829775996962,5cyclictest1828128-21kworker/u8:1+flush-179:019:45:170
1829777996859,6cyclictest1886129-21latency_hist22:05:021
1829781996459,3cyclictest0-21swapper/223:26:592
1829777996459,4cyclictest1920350-21kworker/u8:3+flush-179:000:15:171
1829775996459,4cyclictest1843948-21kworker/u8:0+events_unbound20:25:290
1829775996454,7cyclictest1894080-21latency_hist22:30:010
1829777996357,5cyclictest1916848-21kworker/u8:0+flush-179:023:40:241
1829775996357,4cyclictest1920350-21kworker/u8:3+flush-179:000:30:160
1829775996356,5cyclictest1920350-21kworker/u8:3+flush-179:000:10:000
1829775996348,11cyclictest1925122-21systemctl00:04:000
1829775996348,11cyclictest1925122-21systemctl00:04:000
1829786996259,1cyclictest0-21swapper/323:27:003
1829777996256,5cyclictest1865684-21kworker/u8:2+flush-179:021:10:001
1829777996255,5cyclictest1886366-21kworker/u8:0+events_unbound22:10:011
1829775996258,2cyclictest723-21Xorg22:59:590
1829775996257,4cyclictest1831280-21kworker/u8:3+flush-179:020:15:010
1829777996156,4cyclictest1916848-21kworker/u8:0+flush-179:023:40:021
1829777996156,4cyclictest1894055-21kworker/u8:1+events_unbound22:30:231
1829775996151,7cyclictest502-21rs:main0
1829777996055,4cyclictest1843948-21kworker/u8:0+flush-179:020:00:181
1829777996054,4cyclictest1859122-21kworker/u8:4+flush-179:020:40:231
1829777996052,6cyclictest1847720-21kworker/u8:2+flush-179:020:35:221
1829775996054,5cyclictest1876608-21kworker/u8:3+flush-179:021:55:010
1829775996054,4cyclictest1906548-21kworker/u8:2+flush-179:023:20:170
182977599600,58cyclictest1900740-21munin-run22:50:020
1829777995953,4cyclictest1890943-21kworker/u8:3+flush-179:023:05:001
1829777995949,8cyclictest1877113-21diskstats21:35:161
1829777995949,8cyclictest1877113-21diskstats21:35:151
1829786995854,3cyclictest0-21swapper/320:50:003
1829786995854,3cyclictest0-21swapper/320:50:003
1829781995854,2cyclictest0-21swapper/220:50:002
1829781995854,2cyclictest0-21swapper/220:49:592
1829777995852,5cyclictest1843948-21kworker/u8:0+events_unbound21:10:241
1829777995848,7cyclictest1834438-21latency_hist19:25:011
1829777995752,4cyclictest1868662-21kworker/u8:3+flush-179:021:20:231
1829777995747,6cyclictest271-21systemd-journal23:20:011
1829775995751,4cyclictest1890943-21kworker/u8:3+flush-179:022:20:250
1829775995751,4cyclictest1865684-21kworker/u8:2+flush-179:021:30:210
1829775995750,5cyclictest1920350-21kworker/u8:3+flush-179:000:15:240
1829777995650,5cyclictest1843948-21kworker/u8:0+events_unbound20:50:001
1829777995650,5cyclictest1843948-21kworker/u8:0+events_unbound20:49:591
1829775995646,7cyclictest1852446-21latency_hist20:20:020
1829775995645,9cyclictest1904150-21apt-get23:00:110
1829777995551,3cyclictest1871858-21kworker/u8:1+events_unbound21:40:211
1829777995550,4cyclictest1831280-21kworker/u8:3+flush-179:019:39:591
1829775995548,6cyclictest1843948-21kworker/u8:0+flush-179:020:04:590
1829775995548,4cyclictest1847720-21kworker/u8:2+events_unbound20:35:220
1829777995449,4cyclictest1865684-21kworker/u8:2+flush-179:021:00:211
1829777995448,5cyclictest1883598-21kworker/u8:0+flush-179:022:00:001
1829775995447,5cyclictest1828128-21kworker/u8:1+events_unbound19:50:140
1829775995342,9cyclictest1907320-21apt-get23:10:110
1829786995248,2cyclictest0-21swapper/322:50:003
1829777995247,4cyclictest1894055-21kworker/u8:1+flush-179:023:09:551
1829777995243,7cyclictest1894055-21kworker/u8:1+flush-179:022:40:241
1829775995246,4cyclictest1831280-21kworker/u8:3+flush-179:019:35:220
1829786995146,2cyclictest0-21swapper/323:37:593
1829777995146,3cyclictest1876608-21kworker/u8:3+flush-179:021:45:171
1829777995143,6cyclictest1933347-21kworker/u8:1+flush-179:000:40:001
1829775995144,5cyclictest1828128-21kworker/u8:1+flush-179:019:15:000
1829775995144,5cyclictest1828128-21kworker/u8:1+flush-179:019:14:590
1829781995047,2cyclictest0-21swapper/222:49:592
1829781995046,2cyclictest0-21swapper/223:37:592
1829781995046,2cyclictest0-21swapper/223:24:592
1829777995044,4cyclictest1920350-21kworker/u8:3+flush-179:000:25:011
1829775995045,4cyclictest1890943-21kworker/u8:3+flush-179:022:55:000
1829775995045,4cyclictest1868662-21kworker/u8:3+flush-179:021:24:550
1829775995043,5cyclictest1926770-21kworker/u8:0+flush-179:000:25:270
1829786994947,1cyclictest0-21swapper/323:24:593
1829777994943,5cyclictest1843948-21kworker/u8:0+events_unbound20:05:231
1829777994943,4cyclictest1933367-21latency_hist00:30:011
1829777994942,5cyclictest1843948-21kworker/u8:0+flush-179:020:50:201
1829777994941,7cyclictest1843948-21kworker/u8:0+flush-179:020:30:231
1829775994944,4cyclictest1816994-21kworker/u8:0+events_unbound19:25:240
1829775994842,5cyclictest1894055-21kworker/u8:1+flush-179:022:40:000
1829775994841,4cyclictest1906548-21kworker/u8:2+events_unbound23:30:140
1829775994840,6cyclictest1831280-21kworker/u8:3+flush-179:020:35:010
1829777994741,5cyclictest1906548-21kworker/u8:2+flush-179:023:20:211
1829777994740,6cyclictest1831280-21kworker/u8:3+flush-179:019:35:011
1829775994742,4cyclictest1894055-21kworker/u8:1+flush-179:022:45:000
1829775994742,4cyclictest1865684-21kworker/u8:2+flush-179:021:05:240
1829775994738,7cyclictest1928341-21apt-get00:15:000
4670791460,13ptp4l61690irq/136-eno1-TxRx-019:10:013
1829775994641,4cyclictest1914728-21kworker/u8:1+events_unbound23:35:210
1829775994639,5cyclictest1828128-21kworker/u8:1+flush-179:019:15:140
1829775994636,8cyclictest1906548-21kworker/u8:2+flush-179:023:15:230
1829777994540,4cyclictest1890943-21kworker/u8:3+events_unbound22:35:241
1829777994540,4cyclictest1868662-21kworker/u8:3+events_unbound21:20:011
1829777994540,4cyclictest1828128-21kworker/u8:1+flush-179:019:45:151
182977799451,41cyclictest1892497-21munin-run22:25:011
1829775994541,2cyclictest723-21Xorg23:48:580
1829775994536,7cyclictest1860672-21latency_hist20:45:010
1829777994439,3cyclictest1816994-21kworker/u8:0+flush-179:019:10:251
1829777994439,3cyclictest1816994-21kworker/u8:0+flush-179:019:10:251
1829775994439,4cyclictest1843948-21kworker/u8:0+flush-179:020:54:590
1829775994438,4cyclictest1904940-21kworker/u8:0+flush-179:023:05:170
1829777994327,5cyclictest1831280-21kworker/u8:3+events_unbound19:50:241
1829775994339,3cyclictest1876608-21kworker/u8:3+flush-179:021:45:200
1829775994338,3cyclictest1816994-21kworker/u8:0+flush-179:019:20:160
1829775994333,8cyclictest1864095-21apt-get20:55:120
202199420,8rtkit-daemon625582-21munin-node19:05:290
1829777994237,4cyclictest1890943-21kworker/u8:3+flush-179:022:50:211
1829777994236,4cyclictest1843948-21kworker/u8:0+flush-179:020:15:201
1829777994235,5cyclictest1843948-21kworker/u8:0+flush-179:020:10:251
1829781994136,2cyclictest0-21swapper/220:02:592
1829775994136,4cyclictest1874968-21kworker/u8:0+events_unbound21:35:240
1829775994136,4cyclictest1874968-21kworker/u8:0+events_unbound21:35:240
1829775994136,4cyclictest1871858-21kworker/u8:1+flush-179:021:40:210
1829775994128,7cyclictest1865684-21kworker/u8:2+events_unbound21:00:230
182978699400,38cyclictest1899130-21turbostat22:45:003
182978699400,38cyclictest1870209-21turbostat21:15:003
182978699400,38cyclictest1867045-21turbostat21:05:013
1829777994035,4cyclictest1920304-21kworker/u8:1+flush-179:023:50:001
1829775994036,3cyclictest1886366-21kworker/u8:0+events_unbound22:15:010
1829775994031,7cyclictest1870205-21latency_hist21:15:010
1829775994029,4cyclictest1894055-21kworker/u8:1+flush-179:022:30:250
1829786993934,4cyclictest1886144-21turbostat22:05:003
1829786993934,2cyclictest0-21swapper/300:20:593
182978699390,4cyclictest1905493-21turbostat23:05:003
182978699390,38cyclictest1859098-21turbostat20:40:013
1829781993934,2cyclictest0-21swapper/223:02:592
1829781993934,2cyclictest0-21swapper/222:05:592
182977799390,37cyclictest723-21Xorg20:23:591
182977599391,35cyclictest1887752-21munin-run22:10:000
1829786993835,2cyclictest0-21swapper/320:02:593
1829786993833,3cyclictest0-21swapper/320:10:593
1829781993834,2cyclictest0-21swapper/220:10:592
1829781993834,2cyclictest0-21swapper/200:20:592
1829781993833,2cyclictest0-21swapper/220:59:582
1829781993833,2cyclictest0-21swapper/200:18:002
182978199380,36cyclictest0-21swapper/222:29:592
182978199380,1cyclictest0-21swapper/221:34:562
182978199380,1cyclictest0-21swapper/200:04:592
182978199380,1cyclictest0-21swapper/200:04:592
182977599381,9cyclictest1930449-21apt-get00:20:120
1829786993734,2cyclictest0-21swapper/322:05:593
1829786993734,2cyclictest0-21swapper/320:59:583
1829786993733,2cyclictest0-21swapper/300:10:593
1829781993733,2cyclictest0-21swapper/219:31:582
1829781993732,2cyclictest0-21swapper/220:08:002
1829777993733,3cyclictest685-21ntpd22:25:191
1829777993731,4cyclictest1847720-21kworker/u8:2+flush-179:020:25:041
1829775993731,5cyclictest1935646-21hwlatdetect00:35:170
1829775993729,6cyclictest1837611-21latency_hist19:35:010
1829786993634,1cyclictest0-21swapper/319:31:593
1829786993633,2cyclictest0-21swapper/320:08:003
1829786993633,2cyclictest0-21swapper/300:18:003
182978699360,35cyclictest0-21swapper/319:53:003
1829781993634,1cyclictest0-21swapper/222:05:012
1829781993633,2cyclictest0-21swapper/200:10:592
1829777993630,4cyclictest1879801-21kworker/u8:2+flush-179:021:50:151
1829775993629,6cyclictest1922784-21missed_timers23:55:210
1829786993531,3cyclictest0-21swapper/321:37:593
1829786993531,3cyclictest0-21swapper/321:37:593
182978699350,1cyclictest0-21swapper/321:34:553
182978699350,1cyclictest0-21swapper/300:04:593
182978699350,1cyclictest0-21swapper/300:04:593
1829781993531,2cyclictest0-21swapper/221:37:592
1829781993531,2cyclictest0-21swapper/221:37:582
1829777993530,4cyclictest1920350-21kworker/u8:3+flush-179:000:30:281
1829775993527,7cyclictest1873972-21fschecks_count21:25:180
1829786993428,4cyclictest1882945-21turbostat21:55:013
1829775993426,6cyclictest1921900-21latency_hist23:55:010
1829786993328,4cyclictest1884529-21turbostat22:00:013
1829786993328,3cyclictest0-21swapper/320:43:583
1829781993329,3cyclictest0-21swapper/223:17:592
1829781993329,2cyclictest0-21swapper/200:33:592
1829777993329,2cyclictest1920304-21kworker/u8:1+events_unbound23:50:121
1829777993322,8cyclictest1829636-21latency_hist19:10:021
1829786993229,2cyclictest0-21swapper/323:17:593
1829786993228,2cyclictest0-21swapper/323:34:553
1829781993228,2cyclictest0-21swapper/221:55:002
182978199320,30cyclictest0-21swapper/219:35:132
1829786993128,2cyclictest0-21swapper/300:33:593
182978699310,29cyclictest0-21swapper/319:35:133
1829781993129,1cyclictest0-21swapper/222:00:012
1829781993127,2cyclictest0-21swapper/223:34:562
1829781993127,2cyclictest0-21swapper/220:43:592
1829777993127,3cyclictest1886366-21kworker/u8:0+events_unbound22:20:001
182978699306,1cyclictest0-21swapper/319:17:103
1829786993027,2cyclictest0-21swapper/319:20:133
182978699300,27cyclictest0-21swapper/321:15:153
1829781993027,2cyclictest0-21swapper/219:20:132
1829781993026,3cyclictest0-21swapper/219:15:592
1829781993026,2cyclictest0-21swapper/221:00:142
1829781993026,2cyclictest0-21swapper/220:24:592
182978199300,28cyclictest0-21swapper/222:55:142
182978199300,28cyclictest0-21swapper/222:10:142
182978199300,28cyclictest0-21swapper/221:20:132
182978199300,28cyclictest0-21swapper/221:15:142
182978199300,27cyclictest0-21swapper/221:40:122
182978199300,1cyclictest0-21swapper/220:40:012
1829777993025,4cyclictest1906548-21kworker/u8:2+flush-179:023:30:211
1829786992926,2cyclictest0-21swapper/320:24:583
182978699290,27cyclictest1926746-21turbostat00:10:003
182978699290,27cyclictest0-21swapper/322:55:143
182978699290,27cyclictest0-21swapper/322:10:153
182978699290,27cyclictest0-21swapper/321:40:113
182978699290,27cyclictest0-21swapper/321:20:143
1829781992926,2cyclictest0-21swapper/221:25:162
182978199290,27cyclictest0-21swapper/223:12:002
182978199290,27cyclictest0-21swapper/220:30:162
182978199290,27cyclictest0-21swapper/200:35:142
182978199290,21cyclictest0-21swapper/219:50:132
1829775992921,7cyclictest1883557-21fschecks_time21:55:160
1829786992825,2cyclictest0-21swapper/321:25:153
182978699280,2cyclictest0-21swapper/323:11:593
182978699280,27cyclictest0-21swapper/320:30:163
182978699280,26cyclictest0-21swapper/300:35:143
1829781992823,3cyclictest0-21swapper/219:10:202
1829781992823,3cyclictest0-21swapper/219:10:202
1829781992823,2cyclictest0-21swapper/220:26:582
1829786992724,2cyclictest0-21swapper/322:22:583
182978699270,26cyclictest0-21swapper/322:30:003
1829781992723,2cyclictest0-21swapper/221:08:592
182978199270,24cyclictest0-21swapper/200:10:002
4670791260,6ptp4l441ktimers/323:50:003
1829786992623,2cyclictest0-21swapper/321:45:593
1829786992623,2cyclictest0-21swapper/320:26:593
1829786992623,2cyclictest0-21swapper/319:11:593
1829786992623,2cyclictest0-21swapper/319:11:593
1829786992622,2cyclictest0-21swapper/323:55:153
1829786992618,6cyclictest1863857-21turbostat20:54:593
1829781992623,2cyclictest0-21swapper/222:22:582
1829781992622,2cyclictest0-21swapper/223:55:152
1829781992622,2cyclictest0-21swapper/223:50:122
4670791250,7ptp4l61690irq/136-eno1-TxRx-020:20:013
4670791250,6ptp4l61690irq/136-eno1-TxRx-022:55:003
4670791250,6ptp4l441ktimers/319:50:013
1829786992523,1cyclictest0-21swapper/321:08:593
1829786992521,2cyclictest0-21swapper/323:10:003
1829781992522,2cyclictest0-21swapper/221:45:592
1829781992521,2cyclictest0-21swapper/223:09:592
1829781992521,2cyclictest0-21swapper/219:26:592
4670791240,6ptp4l61690irq/136-eno1-TxRx-020:00:003
4670791240,5ptp4l61690irq/136-eno1-TxRx-023:45:003
4670791240,5ptp4l61690irq/136-eno1-TxRx-000:30:013
4670791240,5ptp4l441ktimers/322:35:013
1829786992422,1cyclictest0-21swapper/323:50:123
1829786992421,2cyclictest0-21swapper/319:26:583
1829781992420,2cyclictest0-21swapper/220:52:592
4670791230,5ptp4l441ktimers/322:19:553
4670791220,4ptp4l441ktimers/322:39:553
1829781992218,3cyclictest0-21swapper/222:35:592
1829781992118,2cyclictest0-21swapper/200:29:592
1829781992117,2cyclictest0-21swapper/219:59:592
1829781991916,2cyclictest0-21swapper/222:30:032
1829781991612,2cyclictest0-21swapper/222:42:592
1829781991512,2cyclictest0-21swapper/223:45:142
1829781991512,2cyclictest0-21swapper/223:43:592
1829781991511,2cyclictest0-21swapper/219:47:592
4670791140,3ptp4l441ktimers/319:40:263
1829781991310,2cyclictest0-21swapper/222:20:012
1829781991310,2cyclictest0-21swapper/220:17:592
1829781991310,2cyclictest0-21swapper/219:41:592
18297819996,2cyclictest0-21swapper/222:51:492
18297819970,6cyclictest0-21swapper/221:10:122
18297819930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional