You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 12:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sun Dec 28, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1905754999889,7cyclictest1958465-21kworker/u8:0+events_unbound22:00:020
1905754999280,10cyclictest266-21systemd-journal22:55:000
1905754999184,6cyclictest1938778-21kworker/u8:0+flush-179:021:00:000
1905754998883,4cyclictest1908779-21kworker/u8:2+events_unbound19:25:230
1905754998678,6cyclictest1950447-21kworker/u8:1+flush-179:021:40:010
1905755998577,6cyclictest1934257-21kworker/u8:1+flush-179:020:45:011
1905754998474,7cyclictest1934257-21kworker/u8:1+events_unbound20:45:040
1905754998375,5cyclictest1908779-21kworker/u8:2+flush-179:020:15:200
1905755998272,8cyclictest1981225-21/usr/sbin/munin23:05:221
1905754998276,5cyclictest1919247-21kworker/u8:0+flush-179:019:55:000
1905754998175,5cyclictest1979355-21kworker/u8:0+events_unbound23:00:230
1905754998072,7cyclictest1913575-21kworker/u8:0+flush-179:019:45:010
1905755997970,6cyclictest1913575-21kworker/u8:0+flush-179:019:40:221
1905754997971,6cyclictest1956828-21kworker/u8:2+flush-179:021:50:230
1905754997873,4cyclictest1995668-21kworker/u8:4+flush-179:000:00:010
1905755997770,5cyclictest1908779-21kworker/u8:2+flush-179:019:50:001
190575499760,73cyclictest1-21systemd21:50:000
1905755997568,4cyclictest1974394-21kworker/u8:2+flush-179:022:50:261
1905755997565,7cyclictest1966403-21latency_hist22:20:011
1905754997570,4cyclictest1979355-21kworker/u8:0+flush-179:023:15:010
1905754997569,5cyclictest1899281-21kworker/u8:0+events_unbound19:20:000
1905754997567,6cyclictest1952036-21kworker/u8:2+flush-179:021:40:200
1905754997466,6cyclictest1968228-21kworker/u8:0+events_unbound22:25:210
1905755997367,4cyclictest1974394-21kworker/u8:2+flush-179:023:00:001
1905755997366,5cyclictest1960030-21latency_hist22:00:011
1905754997368,3cyclictest1938778-21kworker/u8:0+events_unbound21:05:010
1905754997366,6cyclictest1963189-21kworker/u8:2+flush-179:022:10:000
1905754997163,5cyclictest1969547-21kworker/u8:1+flush-179:022:40:220
1905755997064,4cyclictest1952036-21kworker/u8:2+flush-179:021:35:181
1905755997062,6cyclictest1923151-21latency_hist20:05:011
1905755997060,8cyclictest1974598-21/usr/sbin/munin22:45:211
1905754997064,4cyclictest2002061-21kworker/u8:2+events_unbound00:10:150
1905754997062,6cyclictest1998862-21kworker/u8:1+events_unbound00:35:190
1905755996962,5cyclictest1993494-21kworker/u8:0+flush-179:000:00:221
1905755996960,7cyclictest1969578-21latency_hist22:30:011
1905754996965,3cyclictest1956828-21kworker/u8:2+events_unbound22:00:290
1905754996961,4cyclictest1979355-21kworker/u8:0+flush-179:023:30:150
1905754996954,5cyclictest1974394-21kworker/u8:2+events_unbound23:15:230
1905754996855,4cyclictest2008460-21kworker/u8:3+events_unbound00:30:150
1905755996761,4cyclictest1938778-21kworker/u8:0+flush-179:021:10:151
1905755996758,7cyclictest1994292-21apt-get23:45:151
1905755996758,7cyclictest1921547-21latency_hist20:00:011
1905754996763,3cyclictest1979355-21kworker/u8:0+flush-179:023:25:290
1905754996762,4cyclictest1924780-21kworker/u8:3+flush-179:021:20:280
1905754996762,4cyclictest1908779-21kworker/u8:2+flush-179:020:10:250
1905754996760,5cyclictest1934257-21kworker/u8:1+flush-179:020:50:210
1905754996758,4cyclictest1948861-21kworker/u8:0+events_unbound21:30:000
1905755996660,4cyclictest1929496-21kworker/u8:0+flush-179:020:30:191
1905755996658,6cyclictest2007075-21/usr/sbin/munin00:25:251
1905755996558,5cyclictest1908779-21kworker/u8:2+flush-179:020:15:231
1905754996457,5cyclictest1990877-21kworker/u8:2+flush-179:000:00:210
1905754996455,7cyclictest1922382-21kworker/u8:1+events_unbound20:00:240
1905755996357,4cyclictest1969547-21kworker/u8:1+flush-179:022:40:181
1905754996359,3cyclictest1934257-21kworker/u8:1+flush-179:020:40:250
1905755996257,4cyclictest1963189-21kworker/u8:2+flush-179:022:10:171
1905755996257,4cyclictest1924780-21kworker/u8:3+events_unbound20:25:251
1905755996256,4cyclictest1917020-21kworker/u8:1+events_unbound19:50:181
1905754996254,5cyclictest1910651-21kworker/u8:1+flush-179:019:30:210
1905755996154,5cyclictest1950707-21/usr/sbin/munin21:30:251
1905754996157,3cyclictest1966440-21kworker/u8:3+events_unbound22:20:240
1905754996156,4cyclictest1963189-21kworker/u8:2+flush-179:022:10:240
1905754996150,9cyclictest2000724-21apt-get00:05:130
1905754996150,9cyclictest1971423-21apt-get22:35:120
1905755996055,4cyclictest1908779-21kworker/u8:2+flush-179:020:10:241
1905755996054,4cyclictest1910651-21kworker/u8:1+flush-179:019:30:241
1905755996048,5cyclictest1995668-21kworker/u8:4+flush-179:023:55:251
1905754996056,3cyclictest1998862-21kworker/u8:1+flush-179:000:25:210
1905754996053,5cyclictest266-21systemd-journal20:25:000
1905754996049,5cyclictest1924780-21kworker/u8:3+events_unbound21:10:010
1905755995954,4cyclictest1982829-21kworker/u8:1+flush-179:023:14:301
1905755995953,4cyclictest1952036-21kworker/u8:2+flush-179:021:40:211
1905755995951,6cyclictest1924780-21kworker/u8:3+flush-179:020:40:011
1905754995953,4cyclictest1950447-21kworker/u8:1+events_unbound21:30:180
1905754995949,4cyclictest1908779-21kworker/u8:2+events_unbound19:55:190
1905755995854,3cyclictest1979355-21kworker/u8:0+flush-179:023:33:011
1905755995851,5cyclictest1966440-21kworker/u8:3+flush-179:022:35:251
1905754995839,4cyclictest2004692-21kworker/u8:0+events_unbound00:20:200
1905755995750,4cyclictest1979355-21kworker/u8:0+flush-179:023:20:211
1905754995752,4cyclictest1908779-21kworker/u8:2+events_unbound20:05:290
1905754995652,3cyclictest1938778-21kworker/u8:0+flush-179:021:10:200
1905754995651,4cyclictest1924780-21kworker/u8:3+events_unbound20:30:280
1905754995649,5cyclictest1905655-21kworker/u8:1+events_unbound19:10:200
1905755995550,4cyclictest1924780-21kworker/u8:3+flush-179:020:59:301
1905755995449,4cyclictest2002061-21kworker/u8:2+flush-179:000:35:251
1905755995448,4cyclictest1948861-21kworker/u8:0+flush-179:021:25:221
1905754995449,4cyclictest1982829-21kworker/u8:1+flush-179:023:45:270
1905754995449,3cyclictest1982829-21kworker/u8:1+events_unbound23:40:150
1905754995348,4cyclictest2002292-21kworker/u8:3+events_unbound00:15:230
1905755995246,4cyclictest2002292-21kworker/u8:3+flush-179:000:15:011
1905754995247,4cyclictest1969547-21kworker/u8:1+flush-179:022:55:240
1905754995246,5cyclictest1982829-21kworker/u8:1+events_unbound23:35:220
1905755995147,3cyclictest1958465-21kworker/u8:0+flush-179:022:07:291
1905755995147,3cyclictest1924780-21kworker/u8:3+flush-179:021:24:291
1905755995144,5cyclictest1955236-21kworker/u8:0+flush-179:021:45:271
1905755995046,3cyclictest1922382-21kworker/u8:1+flush-179:020:09:551
1905755995044,4cyclictest2008460-21kworker/u8:3+flush-179:000:30:201
1905754995045,4cyclictest1974394-21kworker/u8:2+flush-179:023:05:260
1905755994943,5cyclictest1956828-21kworker/u8:2+flush-179:022:00:301
1905755994939,8cyclictest1995859-21/usr/sbin/munin23:50:221
4577091480,13ptp4l61490irq/134-eno1-TxRx-019:10:003
1905755994844,3cyclictest2002292-21kworker/u8:3+flush-179:000:19:551
1905754994834,3cyclictest1995668-21kworker/u8:4+events_unbound23:50:230
1905755994742,4cyclictest1979355-21kworker/u8:0+events_unbound23:00:191
1905755994741,4cyclictest1924780-21kworker/u8:3+events_unbound21:05:161
1905755994739,6cyclictest1956828-21kworker/u8:2+flush-179:021:55:011
1905754994738,4cyclictest1945122-21kworker/u8:1+events_unbound21:15:230
1905755994641,4cyclictest1908779-21kworker/u8:2+flush-179:019:25:211
1905755994640,5cyclictest1908779-21kworker/u8:2+flush-179:020:20:171
190575899450,43cyclictest1912016-21turbostat19:30:013
1905755994542,2cyclictest0-21swapper/123:15:591
1905755994541,3cyclictest1908779-21kworker/u8:2+flush-179:019:24:561
1905755994536,6cyclictest1971168-21latency_hist22:35:011
1905754994541,3cyclictest1963189-21kworker/u8:2+flush-179:022:15:250
1905754994532,4cyclictest1924780-21kworker/u8:3+events_unbound20:35:220
1905758994336,6cyclictest1980994-21turbostat23:05:003
1905757994339,2cyclictest0-21swapper/200:09:592
1905755994338,4cyclictest266-21systemd-journal23:26:301
1905755994337,5cyclictest1-21systemd23:44:591
1905758994239,2cyclictest0-21swapper/300:09:583
1905758994238,2cyclictest0-21swapper/320:21:003
1905757994238,3cyclictest0-21swapper/220:20:592
1905755994238,3cyclictest1998862-21kworker/u8:1+flush-179:000:05:211
1905755994237,4cyclictest1966440-21kworker/u8:3+events_unbound22:20:181
1905754994238,3cyclictest1979355-21kworker/u8:0+flush-179:023:24:550
1905754994238,3cyclictest1899281-21kworker/u8:0+events_unbound19:25:000
1905754994235,5cyclictest1913577-21kworker/u8:3+events_unbound19:35:250
190575899410,38cyclictest1942520-21turbostat21:05:013
1905755994137,3cyclictest1899281-21kworker/u8:0+flush-179:019:19:561
1905755994132,6cyclictest1938778-21kworker/u8:0+events_unbound21:00:141
1905755994131,8cyclictest1906170-21diskstats19:10:171
190575899400,39cyclictest1975957-21turbostat22:50:013
1905757994036,2cyclictest0-21swapper/200:24:552
190575799400,37cyclictest0-21swapper/222:32:592
1905758993936,2cyclictest0-21swapper/300:24:553
190575899390,4cyclictest1997218-21turbostat23:54:593
190575899390,38cyclictest1992445-21turbostat23:40:013
190575899390,30cyclictest0-21swapper/320:45:003
1905757993935,2cyclictest0-21swapper/221:09:562
1905757993935,2cyclictest0-21swapper/220:55:582
190575799390,36cyclictest0-21swapper/221:35:002
1905754993934,4cyclictest1924780-21kworker/u8:3+flush-179:020:25:210
190575499391,3cyclictest211irq_work/022:30:590
190575899380,37cyclictest0-21swapper/300:33:593
1905757993836,1cyclictest0-21swapper/223:05:002
1905757993833,2cyclictest0-21swapper/223:48:002
1905755993832,5cyclictest1915195-21munin-plugin-st19:40:001
1905758993735,1cyclictest0-21swapper/321:09:553
1905758993734,2cyclictest0-21swapper/323:48:003
1905758993731,5cyclictest2005245-21turbostat00:20:003
190575899370,36cyclictest0-21swapper/322:32:593
1905757993734,2cyclictest0-21swapper/221:46:002
1905757993733,2cyclictest0-21swapper/223:29:552
1905757993733,2cyclictest0-21swapper/223:08:592
190575799370,35cyclictest0-21swapper/200:33:582
190575799370,34cyclictest0-21swapper/220:20:012
190575799370,1cyclictest0-21swapper/220:44:592
1905758993634,1cyclictest0-21swapper/323:08:593
1905758993634,1cyclictest0-21swapper/321:45:593
1905758993634,1cyclictest0-21swapper/320:55:583
1905757993632,2cyclictest0-21swapper/220:35:592
1905757993631,2cyclictest0-21swapper/222:19:552
1905755993631,4cyclictest1924780-21kworker/u8:3+flush-179:021:15:211
1905755993630,5cyclictest2004692-21kworker/u8:0+flush-179:000:24:551
1905755993626,7cyclictest266-21systemd-journal20:48:281
190575499361,4cyclictest1918377-21awk19:50:010
231999350,30rtkit-daemon2318-21rtkit-daemon19:05:351
1905758993533,1cyclictest0-21swapper/320:35:593
1905758993529,5cyclictest1947307-21turbostat21:20:003
190575799350,1cyclictest0-21swapper/222:50:012
1905755993530,4cyclictest1982829-21kworker/u8:1+flush-179:023:35:261
1905758993432,1cyclictest0-21swapper/323:29:553
1905758993431,2cyclictest0-21swapper/322:19:563
1905757993432,1cyclictest0-21swapper/200:19:592
1905758993330,2cyclictest0-21swapper/300:10:593
1905757993330,2cyclictest0-21swapper/223:36:582
1905758993227,4cyclictest1972768-21turbostat22:40:013
1905757993229,2cyclictest0-21swapper/200:10:592
1905757993228,2cyclictest0-21swapper/223:57:582
190575799320,2cyclictest0-21swapper/221:16:592
190575799320,29cyclictest0-21swapper/200:27:592
190575599320,31cyclictest0-21swapper/120:54:541
1905758993129,1cyclictest0-21swapper/323:57:593
190575899310,29cyclictest0-21swapper/321:30:143
190575899310,29cyclictest0-21swapper/319:20:143
190575899310,28cyclictest0-21swapper/323:20:023
1905757993128,2cyclictest0-21swapper/200:02:002
1905757993127,2cyclictest0-21swapper/222:40:002
190575799310,30cyclictest0-21swapper/219:20:152
190575799310,28cyclictest0-21swapper/221:38:582
1905758993028,1cyclictest0-21swapper/320:18:593
1905758993028,1cyclictest0-21swapper/300:02:003
190575899300,28cyclictest0-21swapper/322:50:023
190575899300,28cyclictest0-21swapper/300:35:143
1905757993027,2cyclictest0-21swapper/222:54:592
190575799300,29cyclictest0-21swapper/223:20:032
190575799300,29cyclictest0-21swapper/219:55:142
190575799300,28cyclictest0-21swapper/221:25:152
1905754993027,2cyclictest1974619-21http22:45:120
190575899290,2cyclictest0-21swapper/322:40:143
190575899290,2cyclictest0-21swapper/321:10:133
190575899290,28cyclictest0-21swapper/323:15:143
190575899290,28cyclictest0-21swapper/321:38:583
190575899290,28cyclictest0-21swapper/320:30:163
190575899290,27cyclictest0-21swapper/321:25:143
190575899290,27cyclictest0-21swapper/321:21:003
190575899290,21cyclictest0-21swapper/320:50:133
1905757992926,2cyclictest0-21swapper/223:15:142
1905757992926,2cyclictest0-21swapper/222:40:142
1905757992926,2cyclictest0-21swapper/221:10:142
1905757992925,2cyclictest0-21swapper/221:54:592
190575799290,27cyclictest0-21swapper/222:01:592
190575799290,27cyclictest0-21swapper/220:50:142
190575799290,27cyclictest0-21swapper/220:30:172
190575799290,27cyclictest0-21swapper/200:35:142
1905758992826,1cyclictest0-21swapper/300:29:543
1905758992825,2cyclictest0-21swapper/321:54:593
1905758992825,2cyclictest0-21swapper/320:48:003
1905758992824,2cyclictest0-21swapper/319:10:593
190575899280,27cyclictest0-21swapper/322:01:593
190575899280,1cyclictest0-21swapper/320:10:153
190575899280,1cyclictest0-21swapper/319:55:133
1905757992825,2cyclictest0-21swapper/220:47:592
1905757992825,2cyclictest0-21swapper/219:37:002
190575799280,2cyclictest0-21swapper/222:58:592
190575799280,2cyclictest0-21swapper/220:10:152
190575799280,25cyclictest0-21swapper/221:20:592
190575799280,1cyclictest0-21swapper/219:49:592
4577091270,6ptp4l441ktimers/323:00:003
4577091270,6ptp4l441ktimers/322:30:003
4577091270,6ptp4l441ktimers/322:25:013
4577091270,5ptp4l441ktimers/322:15:003
1905758992725,1cyclictest0-21swapper/319:38:593
1905758992723,3cyclictest0-21swapper/323:32:593
190575899270,25cyclictest0-21swapper/321:44:593
1905757992724,2cyclictest0-21swapper/222:05:592
1905757992724,2cyclictest0-21swapper/219:10:152
1905757992723,2cyclictest0-21swapper/223:33:002
1905757992723,2cyclictest0-21swapper/223:10:592
190575799270,2cyclictest0-21swapper/222:21:592
190575799270,2cyclictest0-21swapper/222:10:142
190575799270,25cyclictest0-21swapper/220:02:502
190575799270,25cyclictest0-21swapper/219:51:252
190575799270,25cyclictest0-21swapper/219:44:122
190575799270,25cyclictest0-21swapper/219:25:142
4577091260,6ptp4l61490irq/134-eno1-TxRx-022:00:013
4577091260,6ptp4l441ktimers/319:20:013
4577091260,5ptp4l61490irq/134-eno1-TxRx-019:49:563
1905758992623,2cyclictest1963226-21turbostat22:10:003
1905758992623,2cyclictest0-21swapper/323:10:593
190575899260,25cyclictest0-21swapper/319:33:573
190575899260,24cyclictest0-21swapper/319:50:023
190575899260,24cyclictest0-21swapper/319:44:123
190575899260,1cyclictest0-21swapper/320:09:033
1905757992623,2cyclictest0-21swapper/219:30:272
4577091250,6ptp4l61490irq/134-eno1-TxRx-023:44:563
190575899250,18cyclictest0-21swapper/320:04:423
1905757992522,2cyclictest0-21swapper/223:40:592
1905757992521,2cyclictest0-21swapper/219:15:222
190575799250,24cyclictest0-21swapper/221:44:592
1905757992219,2cyclictest0-21swapper/221:01:592
1905758992018,1cyclictest0-21swapper/320:25:593
1905757992017,2cyclictest0-21swapper/222:26:062
1905757992017,2cyclictest0-21swapper/220:25:582
190575799200,2cyclictest0-21swapper/220:09:022
1905757991916,2cyclictest0-21swapper/221:59:592
1905757991613,2cyclictest0-21swapper/223:51:372
190575499151,11cyclictest1905756-21cat19:10:020
19057579930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional