You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 21:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sun Mar 29, 2026 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1794115999787,7cyclictest1859066-21latency_hist10:30:001
1794113999184,4cyclictest1852859-21kworker/u8:1+flush-179:010:55:000
1794115999083,5cyclictest1894356-21latency_hist12:20:011
1794115999078,9cyclictest266-21systemd-journal09:50:001
1794113998880,6cyclictest1844740-21latency_hist09:45:020
1794113998880,6cyclictest1844740-21latency_hist09:45:020
1794113998174,4cyclictest1831785-21kworker/u8:1+flush-179:009:05:210
1794113998173,6cyclictest1897537-21latency_hist12:30:020
1794113997970,7cyclictest1842895-21latency_hist09:40:000
1794115997768,7cyclictest1820515-21/usr/sbin/munin08:30:241
1794113997666,7cyclictest1870216-21latency_hist11:05:010
1794115997265,5cyclictest1800932-21kworker/u8:2+events_unbound07:35:001
1794115997264,5cyclictest1895951-21latency_hist12:25:021
1794113997165,4cyclictest1859111-21kworker/u8:3+flush-179:010:40:260
1794113996962,5cyclictest1849775-21apt-get10:00:110
1794115996860,5cyclictest1810731-21latency_hist08:00:011
1794113996555,7cyclictest266-21systemd-journal07:55:010
1794113996555,7cyclictest266-21systemd-journal07:55:010
1794115996455,7cyclictest1863856-21latency_hist10:45:011
1794113996456,6cyclictest1864105-21apt-get10:45:120
1794113996256,4cyclictest1852859-21kworker/u8:1+flush-179:011:45:260
1794113996256,4cyclictest1812299-21kworker/u8:1+flush-179:008:10:210
179411399611,58cyclictest1-21systemd12:15:000
1794115996056,3cyclictest1867066-21kworker/u8:3+events_unbound10:59:501
1794113995953,4cyclictest1867277-21apt-get10:55:130
1794113995950,7cyclictest1838090-21kworker/u8:3+events_unbound09:25:000
1794113995949,7cyclictest1848147-21kworker/u8:0+events_unbound10:00:010
1794113995744,9cyclictest266-21systemd-journal09:55:000
1794115995647,8cyclictest1841541-21apt-get09:35:131
1794115995645,9cyclictest1886643-21apt-get11:55:121
1794115995645,8cyclictest1799041-21latency_hist07:25:021
1794113995547,5cyclictest1800932-21kworker/u8:2+events_unbound07:50:020
1794113995547,5cyclictest1800932-21kworker/u8:2+events_unbound07:50:010
1794113995445,7cyclictest1828730-21/usr/sbin/munin08:55:230
1794113995445,6cyclictest1886291-21kworker/u8:0+flush-179:012:05:170
1794113995343,6cyclictest1838090-21kworker/u8:3+flush-179:010:10:010
1794113995343,6cyclictest1838090-21kworker/u8:3+flush-179:010:10:000
1794113995241,9cyclictest1860910-21apt-get10:35:100
1794115995044,5cyclictest1888250-21apt-get12:00:111
1794113995042,6cyclictest1821868-21latency_hist08:35:010
1794113995041,6cyclictest1823703-21kworker/u8:0+flush-179:008:50:220
1794113995038,9cyclictest1875054-21kworker/u8:3+flush-179:011:25:000
4577091490,14ptp4l441ktimers/307:10:013
1794113994941,6cyclictest1800932-21kworker/u8:2+flush-179:007:35:240
1794113994941,5cyclictest1899106-21kworker/u8:1+flush-179:012:40:010
1794113994835,7cyclictest1800932-21kworker/u8:2+events_unbound08:35:030
179411599470,46cyclictest1884809-21turbostat11:54:551
1794115994642,3cyclictest1823703-21kworker/u8:0+events_unbound09:00:391
1794115994639,5cyclictest1825575-21apt-get08:45:101
1794115994637,7cyclictest266-21systemd-journal12:10:351
1794113994640,3cyclictest1881662-21kworker/u8:3+events_unbound12:15:230
179411599450,43cyclictest0-21swapper/109:29:551
1794113994534,8cyclictest266-21systemd-journal10:20:000
179411399450,44cyclictest0-21swapper/011:09:590
1794115994437,5cyclictest1823771-21kworker/u8:3+flush-179:008:45:001
1794113994435,7cyclictest1787692-21kworker/u8:1+flush-179:007:20:000
179411399440,42cyclictest714-21Xorg11:27:590
179411799430,41cyclictest0-21swapper/208:00:592
1794115994337,4cyclictest1899123-21latency_hist12:35:011
1794115994337,4cyclictest1899123-21latency_hist12:35:001
1794115994332,9cyclictest1881882-21apt-get11:40:121
1794115994330,10cyclictest1874983-21apt-get11:19:591
179411599430,40cyclictest1828512-21awk08:55:001
1794113994336,5cyclictest1852859-21kworker/u8:1+events_unbound10:30:140
179411999420,41cyclictest0-21swapper/309:29:553
179411599423,2cyclictest271rcuc/110:33:581
1794115994231,9cyclictest1812866-21diskstats08:05:171
179411599420,3cyclictest1900745-21dump-pmu-power12:40:001
1794113994239,2cyclictest0-21swapper/011:32:590
1794113994236,4cyclictest1799043-21munin-run07:25:000
179411399421,39cyclictest1887988-21perf12:00:000
179411399421,39cyclictest1812328-21munin-run08:05:000
1794113994133,6cyclictest1873389-21latency_hist11:15:010
1794113994130,9cyclictest1831699-21apt-get09:04:330
179411399411,3cyclictest266-21systemd-journal11:44:550
179411999400,39cyclictest1900742-21turbostat12:40:013
179411999400,39cyclictest1828510-21turbostat08:55:003
1794117994032,7cyclictest0-21swapper/209:34:592
1794117994032,7cyclictest0-21swapper/208:21:592
1794115994035,3cyclictest1809158-21systemd-run07:55:021
1794115994035,3cyclictest1809158-21systemd-run07:55:011
179411599400,38cyclictest714-21Xorg08:24:591
1794113994034,4cyclictest1831785-21kworker/u8:1+flush-179:009:15:000
1794113994032,6cyclictest1830058-21kworker/u8:2+events_unbound09:15:240
1794113994030,7cyclictest510-21rs:main0
179411399400,39cyclictest0-21swapper/011:18:590
179411999391,37cyclictest431rcuc/312:04:553
1794115993936,2cyclictest0-21swapper/111:30:001
1794115993935,3cyclictest714-21Xorg11:33:591
1794115993928,10cyclictest1793950-21kworker/u8:0+events_unbound07:15:001
179411599391,36cyclictest1796102-21apt-get07:15:131
179411599391,2cyclictest714-21Xorg10:39:591
179411599390,36cyclictest0-21swapper/108:03:591
179411599390,2cyclictest0-21swapper/108:56:591
1794113993932,5cyclictest1838090-21kworker/u8:3+flush-179:009:30:220
1794113993931,6cyclictest1826906-21latency_hist08:50:010
179411799380,35cyclictest0-21swapper/208:40:002
1794115993834,2cyclictest0-21swapper/107:43:591
1794115993833,4cyclictest1820285-21cron08:30:001
179411599380,37cyclictest714-21Xorg09:08:591
179411599380,36cyclictest0-21swapper/110:14:591
179411599380,2cyclictest0-21swapper/112:05:591
179411599380,1cyclictest0-21swapper/109:58:591
1794113993833,4cyclictest1852859-21kworker/u8:1+flush-179:010:25:260
179411399380,37cyclictest0-21swapper/012:34:590
179411399380,37cyclictest0-21swapper/012:34:590
1794119993735,1cyclictest0-21swapper/311:29:593
179411999370,36cyclictest0-21swapper/311:38:003
179411999370,36cyclictest0-21swapper/309:09:563
179411999370,35cyclictest0-21swapper/310:41:003
1794117993734,2cyclictest0-21swapper/207:13:592
1794113993734,2cyclictest0-21swapper/011:37:000
1794119993634,1cyclictest0-21swapper/308:59:593
1794119993633,2cyclictest0-21swapper/310:28:003
1794119993628,6cyclictest1855891-21turbostat10:19:593
179411999360,35cyclictest0-21swapper/310:15:003
179411999360,35cyclictest0-21swapper/309:49:593
179411999360,35cyclictest0-21swapper/308:32:593
179411999360,35cyclictest0-21swapper/308:03:593
179411999360,2cyclictest0-21swapper/309:58:593
179411999360,1cyclictest0-21swapper/307:16:593
1794117993633,2cyclictest0-21swapper/211:46:582
179411599362,31cyclictest1802731-21apt-get07:35:151
1794113993633,2cyclictest714-21Xorg08:07:590
1794113993632,2cyclictest1857488-21apt10:25:010
1794113993631,4cyclictest1815538-21kworker/u8:0+flush-179:008:21:360
1794113993629,5cyclictest1802513-21systemd-run07:35:000
1794113993628,6cyclictest1817098-21latency_hist08:20:010
179411399362,5cyclictest1885054-21apt-get11:50:140
1794119993533,1cyclictest0-21swapper/307:43:593
1794119993533,1cyclictest0-21swapper/307:24:553
1794119993532,2cyclictest0-21swapper/308:27:593
1794117993533,1cyclictest0-21swapper/207:40:002
1794117993532,2cyclictest0-21swapper/212:21:592
1794117993532,2cyclictest0-21swapper/210:25:582
1794117993532,2cyclictest0-21swapper/210:07:592
1794117993532,2cyclictest0-21swapper/210:07:582
1794117993532,2cyclictest0-21swapper/209:44:562
1794117993532,2cyclictest0-21swapper/209:44:552
1794117993532,2cyclictest0-21swapper/209:25:002
179411799350,1cyclictest0-21swapper/209:14:552
179411799350,1cyclictest0-21swapper/207:34:592
1794115993532,2cyclictest0-21swapper/109:40:141
1794115993532,2cyclictest0-21swapper/109:40:141
1794115993530,3cyclictest1855895-21readlink10:20:001
1794115993529,4cyclictest1838151-21systemd09:25:001
1794115993529,4cyclictest1815750-21apt-get08:15:131
1794115993528,5cyclictest1872058-21apt-get11:10:141
179411599352,31cyclictest1835168-21apt-get09:15:121
1794113993532,2cyclictest0-21swapper/008:27:590
1794113993528,4cyclictest0-21swapper/012:00:110
1794113993527,5cyclictest1838090-21kworker/u8:3+events_unbound09:30:010
1794117993431,2cyclictest0-21swapper/207:29:552
179411799340,27cyclictest0-21swapper/211:50:132
179411799340,26cyclictest0-21swapper/207:15:032
1794115993430,3cyclictest1847286-21needreboot09:50:201
1794115993430,2cyclictest0-21swapper/109:11:591
1794115993430,2cyclictest0-21swapper/107:48:591
1794115993430,2cyclictest0-21swapper/107:48:591
1794115993428,4cyclictest1871840-21systemd-run11:10:001
1794115993427,6cyclictest1838090-21kworker/u8:3+flush-179:009:34:591
1794113993426,5cyclictest1823771-21kworker/u8:3+flush-179:008:40:210
4577091330,2ptp4l61490irq/134-eno1-TxRx-007:25:113
1794119993326,5cyclictest1817107-21turbostat08:20:013
1794117993330,2cyclictest0-21swapper/212:25:592
1794117993330,2cyclictest0-21swapper/211:04:542
1794117993330,2cyclictest0-21swapper/210:50:592
1794117993325,7cyclictest0-21swapper/209:55:112
1794115993331,1cyclictest0-21swapper/110:07:591
1794115993331,1cyclictest0-21swapper/110:07:591
179411599331,3cyclictest1821879-21apt-get08:35:031
179411599330,32cyclictest1856148-21apt-get10:20:121
1794113993326,5cyclictest1881662-21kworker/u8:3+flush-179:012:20:200
1794113993323,6cyclictest0-21swapper/009:46:000
1794119993230,1cyclictest0-21swapper/309:11:593
1794119993230,1cyclictest0-21swapper/307:49:003
1794119993230,1cyclictest0-21swapper/307:48:593
179411799320,30cyclictest0-21swapper/211:40:152
1794115993227,3cyclictest524-21gmain08:10:131
1794115993226,4cyclictest0-21swapper/110:00:111
1794115993213,17cyclictest0-21swapper/112:25:161
179411399320,4cyclictest1804367-21http07:40:110
1794119993129,1cyclictest0-21swapper/311:44:593
179411999310,2cyclictest0-21swapper/310:08:593
179411999310,2cyclictest0-21swapper/310:08:583
179411999310,2cyclictest0-21swapper/309:00:123
1794117993128,2cyclictest0-21swapper/212:16:592
1794117993128,2cyclictest0-21swapper/211:30:012
1794117993128,2cyclictest0-21swapper/208:44:592
1794115993127,3cyclictest1870249-21kworker/u8:0+flush-179:011:21:021
1794115993124,4cyclictest0-21swapper/111:01:581
179411599311,3cyclictest1881633-21munin-plugin-st11:40:001
1794117993027,2cyclictest0-21swapper/208:45:122
179411399301,27cyclictest1809382-21apt-get07:55:120
1794119992927,1cyclictest0-21swapper/309:40:133
1794119992927,1cyclictest0-21swapper/309:40:133
1794119992926,2cyclictest0-21swapper/311:00:003
179411999290,28cyclictest0-21swapper/309:30:593
179411999290,28cyclictest0-21swapper/307:35:153
179411999290,27cyclictest0-21swapper/312:15:123
179411999290,27cyclictest0-21swapper/310:20:123
1794117992926,2cyclictest0-21swapper/212:38:592
1794117992926,2cyclictest0-21swapper/210:56:592
1794117992926,2cyclictest0-21swapper/210:20:112
1794117992923,5cyclictest0-21swapper/208:55:132
179411799290,27cyclictest0-21swapper/211:55:152
179411799290,27cyclictest0-21swapper/209:00:122
179411799290,27cyclictest0-21swapper/208:10:132
179411799290,21cyclictest0-21swapper/208:15:132
1794115992925,3cyclictest1800925-21systemd-run07:30:011
1794115992923,4cyclictest1793950-21kworker/u8:0+events_unbound07:10:031
1794115992921,6cyclictest1863827-21kworker/u8:0+flush-179:010:45:151
1794113992925,3cyclictest1853656-21needreboot10:10:200
4577091280,7ptp4l441ktimers/312:15:003
1794119992826,1cyclictest0-21swapper/309:22:593
1794119992825,2cyclictest0-21swapper/309:15:123
179411999280,27cyclictest0-21swapper/308:20:123
179411999280,26cyclictest0-21swapper/311:20:033
179411999280,26cyclictest0-21swapper/311:10:133
179411999280,21cyclictest0-21swapper/310:00:123
1794117992825,2cyclictest0-21swapper/212:10:132
1794117992825,2cyclictest0-21swapper/211:35:132
1794117992825,2cyclictest0-21swapper/210:42:592
1794117992825,2cyclictest0-21swapper/207:53:582
1794117992825,2cyclictest0-21swapper/207:53:582
179411799280,2cyclictest0-21swapper/210:10:142
179411799280,2cyclictest0-21swapper/210:00:122
179411799280,26cyclictest0-21swapper/209:25:122
1794113992816,9cyclictest1795600-21apt-get07:15:010
4577091270,3ptp4l61490irq/134-eno1-TxRx-007:35:003
1794119992725,1cyclictest0-21swapper/308:10:143
1794119992724,2cyclictest0-21swapper/310:38:583
179411999270,26cyclictest0-21swapper/308:45:123
179411999270,26cyclictest0-21swapper/308:06:593
179411999270,26cyclictest0-21swapper/307:14:003
1794117992724,2cyclictest0-21swapper/210:49:592
179411799270,2cyclictest0-21swapper/212:00:582
1794115992723,3cyclictest1863827-21kworker/u8:0+events_unbound10:53:511
179411599270,25cyclictest0-21swapper/111:49:551
1794119992623,2cyclictest0-21swapper/311:06:583
1794119992622,3cyclictest1860665-21turbostat10:35:003
179411999260,2cyclictest0-21swapper/307:58:593
1794117992623,2cyclictest0-21swapper/207:40:112
179411799260,2cyclictest0-21swapper/209:47:002
179411799260,24cyclictest0-21swapper/210:18:592
179411799260,24cyclictest0-21swapper/207:24:582
4577091250,5ptp4l441ktimers/311:34:563
4577091250,3ptp4l61490irq/134-eno1-TxRx-007:55:013
4577091250,3ptp4l61490irq/134-eno1-TxRx-007:55:013
4577091250,3ptp4l441ktimers/312:35:003
4577091250,3ptp4l441ktimers/312:35:003
1794119992523,1cyclictest0-21swapper/312:08:003
1794119992523,1cyclictest0-21swapper/311:02:593
1794119992523,1cyclictest0-21swapper/310:46:003
179411999250,2cyclictest0-21swapper/309:52:583
179411999250,24cyclictest0-21swapper/312:28:003
179411999250,24cyclictest0-21swapper/312:21:593
179411999250,24cyclictest0-21swapper/311:49:543
179411999250,24cyclictest0-21swapper/311:18:593
179411999250,24cyclictest0-21swapper/308:44:593
1794117992522,2cyclictest0-21swapper/211:21:592
1794117992522,2cyclictest0-21swapper/211:07:592
1794117992522,2cyclictest0-21swapper/208:50:592
1794117992522,2cyclictest0-21swapper/208:09:552
1794117992522,2cyclictest0-21swapper/207:56:592
1794117992522,2cyclictest0-21swapper/207:48:002
1794117992522,2cyclictest0-21swapper/207:47:592
1794117992515,8cyclictest0-21swapper/212:35:002
1794117992515,8cyclictest0-21swapper/212:34:592
179411799250,1cyclictest0-21swapper/209:55:002
4577091240,2ptp4l441ktimers/310:54:593
1794119992422,1cyclictest0-21swapper/311:55:593
179411999240,1cyclictest0-21swapper/309:35:583
1794117992421,2cyclictest0-21swapper/209:20:012
1794117992421,2cyclictest0-21swapper/208:25:592
1794117992321,1cyclictest0-21swapper/211:19:552
1794117992320,2cyclictest0-21swapper/209:36:592
1794117992319,2cyclictest0-21swapper/209:05:132
4577091220,2ptp4l61490irq/134-eno1-TxRx-011:54:563
1794119992215,5cyclictest1823727-21turbostat08:40:003
1794117992018,1cyclictest0-21swapper/208:34:592
1794117991613,2cyclictest0-21swapper/211:14:552
179411399149,3cyclictest0-21swapper/007:10:020
179411799103,1cyclictest0-21swapper/212:08:362
179411799100,3cyclictest1878447-21turbostat11:34:552
179411799100,2cyclictest0-21swapper/210:35:162
179411799100,2cyclictest0-21swapper/210:30:172
17941179961,1cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional