You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 19:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Mon Dec 29, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194454199106101,4cyclictest2033577-21kworker/u8:2+events_unbound12:00:001
1944538998882,4cyclictest1962222-21kworker/u8:1+flush-179:008:05:000
1944538998778,6cyclictest1955875-21latency_hist07:45:010
1944541998580,3cyclictest1956111-21kworker/u8:2+flush-179:008:00:001
1944541998576,7cyclictest2031749-21latency_hist11:40:011
1944541998072,6cyclictest1972313-21apt-get08:34:591
1944541998069,8cyclictest2022186-21latency_hist11:10:001
1944541997973,5cyclictest1999609-21kworker/u8:1+flush-179:010:05:001
1944541997972,5cyclictest1946061-21kworker/u8:1+flush-179:007:45:251
1944538997869,6cyclictest1967319-21kworker/u8:2+flush-179:008:30:270
1944541997769,6cyclictest1986855-21kworker/u8:1+flush-179:009:20:001
1944541997767,7cyclictest2025336-21kworker/u8:1+flush-179:011:20:001
1944538997769,6cyclictest2007604-21latency_hist10:25:010
1944541997671,4cyclictest2038356-21kworker/u8:0+events_unbound12:35:251
1944541997670,4cyclictest1946061-21kworker/u8:1+flush-179:007:15:241
1944538997565,8cyclictest1983951-21/usr/sbin/munin09:10:250
1944541997365,5cyclictest2005453-21kworker/u8:0+events_unbound10:30:271
1944541997166,3cyclictest2017641-21kworker/u8:1+flush-179:010:55:261
1944541997165,4cyclictest1956111-21kworker/u8:2+events_unbound07:50:241
1944541997161,7cyclictest2015818-21latency_hist10:50:011
1944541997158,9cyclictest1968871-21latency_hist08:25:011
1944541996963,4cyclictest2033577-21kworker/u8:2+events_unbound11:50:261
1944541996760,5cyclictest1974139-21kworker/u8:1+flush-179:008:55:231
1944541996758,7cyclictest1931722-21kworker/u8:0+events_unbound07:15:011
1944541996561,3cyclictest2019050-21kworker/u8:2+flush-179:011:35:001
1944541996556,7cyclictest1977581-21/usr/sbin/munin08:50:221
1944538996554,9cyclictest2035469-21diskstats11:50:170
1944541996457,5cyclictest1957697-21kworker/u8:3+flush-179:008:15:011
1944538996453,9cyclictest2009446-21apt-get10:30:140
1944538996453,9cyclictest1995122-21apt-get09:45:120
1944538996446,15cyclictest1964086-21latency_hist08:10:010
1944541996357,4cyclictest1991705-21kworker/u8:3+flush-179:009:45:011
1944541996357,3cyclictest1946061-21kworker/u8:1+events_unbound07:30:241
1944541996356,4cyclictest2038356-21kworker/u8:0+flush-179:012:10:211
1944541996347,12cyclictest2012400-21apt-get10:40:001
1944541996256,5cyclictest2038356-21kworker/u8:0+events_unbound12:20:231
1944541996253,6cyclictest2044521-21latency_hist12:20:021
1944541996251,7cyclictest266-21systemd-journal07:25:141
1944538996253,6cyclictest1970713-21latency_hist08:30:020
1944541996156,4cyclictest1999609-21kworker/u8:1+flush-179:010:05:161
1944541996156,4cyclictest1981201-21kworker/u8:2+events_unbound09:10:231
1944541996152,6cyclictest266-21systemd-journal12:26:301
194453899610,2cyclictest714-21Xorg11:21:590
1944541996054,4cyclictest1999682-21kworker/u8:2+flush-179:010:20:141
1944538996051,6cyclictest1999682-21kworker/u8:2+flush-179:010:10:150
1944538996051,6cyclictest1999682-21kworker/u8:2+flush-179:010:10:150
1944538996050,8cyclictest1979187-21apt-get08:55:130
1944538996048,9cyclictest266-21systemd-journal10:20:010
1944547995957,1cyclictest0-21swapper/311:15:593
1944541995953,5cyclictest2010765-21kworker/u8:3+flush-179:010:50:171
1944541995952,5cyclictest1991705-21kworker/u8:3+flush-179:009:45:251
1944541995950,7cyclictest1986855-21kworker/u8:1+flush-179:009:30:271
1944541995852,4cyclictest2033577-21kworker/u8:2+events_unbound12:30:191
1944538995734,21cyclictest2024011-21/usr/sbin/munin11:15:220
1944541995651,4cyclictest2025336-21kworker/u8:1+flush-179:011:45:001
1944541995650,5cyclictest2005453-21kworker/u8:0+events_unbound10:25:251
1944538995650,4cyclictest2033577-21kworker/u8:2+flush-179:012:25:200
1944541995549,4cyclictest1967319-21kworker/u8:2+flush-179:008:35:221
1944541995547,5cyclictest2019050-21kworker/u8:2+events_unbound11:30:001
1944541995541,6cyclictest1974139-21kworker/u8:1+flush-179:009:05:251
1944538995548,5cyclictest1998041-21latency_hist09:55:000
1944541995449,4cyclictest1956111-21kworker/u8:2+flush-179:008:00:211
1944538995445,6cyclictest266-21systemd-journal12:19:560
1944541995349,3cyclictest2025336-21kworker/u8:1+flush-179:011:20:241
1944538995344,6cyclictest1957698-21/usr/sbin/munin07:50:230
1944538995343,8cyclictest1931722-21kworker/u8:0+flush-179:007:40:010
1944538995343,8cyclictest1931722-21kworker/u8:0+flush-179:007:40:010
1944538995342,9cyclictest1949735-21apt-get07:25:130
1944541995241,9cyclictest1947889-21apt-get07:20:121
1944541995241,8cyclictest266-21systemd-journal12:04:591
1944538995234,16cyclictest714-21Xorg10:04:590
194453899520,38cyclictest714-21Xorg08:13:000
1944538995028,4cyclictest1952820-21latency_hist07:35:000
1944543994946,2cyclictest0-21swapper/209:32:002
1944541994945,3cyclictest1974139-21kworker/u8:1+flush-179:009:00:251
1944541994943,5cyclictest2019050-21kworker/u8:2+events_unbound11:10:211
1944541994943,4cyclictest2025336-21kworker/u8:1+events_unbound11:45:131
1944541994942,5cyclictest1974206-21kworker/u8:3+flush-179:008:40:251
1944538994942,5cyclictest1965909-21kworker/u8:0+flush-179:008:39:590
4577091480,13ptp4l61490irq/134-eno1-TxRx-007:10:013
1944541994742,4cyclictest2002865-21kworker/u8:3+events_unbound10:15:141
1944538994737,8cyclictest2040016-21apt-get12:05:110
194454799460,5cyclictest1996461-21turbostat09:50:013
1944541994637,7cyclictest1957697-21kworker/u8:3+flush-179:008:05:221
1944538994639,5cyclictest1965909-21kworker/u8:0+flush-179:008:15:250
1944538994539,5cyclictest2019050-21kworker/u8:2+flush-179:011:10:240
1944538994539,5cyclictest1993515-21/usr/sbin/munin09:40:240
1944538994539,4cyclictest2033577-21kworker/u8:2+flush-179:012:30:140
1944538994538,4cyclictest1986855-21kworker/u8:1+events_unbound09:30:150
1944538994536,7cyclictest1975996-21/usr/sbin/munin08:45:170
1944538994534,9cyclictest2012418-21http10:40:020
194453899450,43cyclictest714-21Xorg09:04:580
1944538994436,6cyclictest2025336-21kworker/u8:1+flush-179:011:45:210
1944538994432,10cyclictest2039715-21apt-get12:02:300
1944538994339,3cyclictest1981201-21kworker/u8:2+flush-179:009:20:240
194454399420,1cyclictest0-21swapper/211:28:592
1944541994236,4cyclictest1986855-21kworker/u8:1+flush-179:009:25:201
1944541994236,4cyclictest1965909-21kworker/u8:0+events_unbound08:15:231
1944538994236,4cyclictest1998014-21kworker/u8:0+events_unbound09:55:230
1944538994234,6cyclictest2030402-21apt-get11:35:120
194453899421,39cyclictest1993277-21run-parts09:40:000
1944547994138,2cyclictest0-21swapper/307:44:563
194454799410,39cyclictest1986915-21turbostat09:20:003
1944541994138,2cyclictest1981201-21kworker/u8:2+flush-179:009:50:141
1944541994137,3cyclictest1999682-21kworker/u8:2+events_unbound10:10:211
1944541994137,3cyclictest1999682-21kworker/u8:2+events_unbound10:10:201
1944541994137,2cyclictest1976014-21apt-get08:45:121
1944541994133,6cyclictest2019050-21kworker/u8:2+events_unbound11:00:181
1944541994131,5cyclictest0-21swapper/108:25:591
1944538994134,5cyclictest1931722-21kworker/u8:0+flush-179:007:10:240
194454799400,5cyclictest2006013-21turbostat10:20:003
1944541994036,3cyclictest1991705-21kworker/u8:3+flush-179:009:55:121
1944547993937,1cyclictest0-21swapper/310:30:593
1944547993933,5cyclictest1957465-21turbostat07:49:593
194454799390,5cyclictest1962253-21turbostat08:05:003
194454799390,4cyclictest2022203-21turbostat11:10:003
194454799390,4cyclictest1994871-21turbostat09:45:003
194454799390,37cyclictest1999650-21turbostat10:00:003
1944543993936,2cyclictest0-21swapper/210:46:582
1944541993934,4cyclictest1990066-21kworker/u8:0+events_unbound09:35:151
1944538993936,2cyclictest714-21Xorg11:09:590
1944538993935,3cyclictest1974139-21kworker/u8:1+flush-179:008:45:000
1944538993933,4cyclictest2017407-21munin-run10:55:000
194453899391,2cyclictest714-21Xorg11:58:000
194453899390,37cyclictest714-21Xorg12:14:000
1944547993836,1cyclictest0-21swapper/310:51:593
194454399380,35cyclictest0-21swapper/210:16:582
1944541993835,2cyclictest0-21swapper/107:45:001
1944538993832,5cyclictest2005453-21kworker/u8:0+flush-179:010:25:230
1944538993827,9cyclictest1946281-21apt-get07:15:120
194453899381,9cyclictest1949581-21sed07:25:010
1944547993734,2cyclictest2034939-21turbostat11:50:003
1944547993734,2cyclictest0-21swapper/312:30:593
194454799370,36cyclictest0-21swapper/309:13:003
194454799370,35cyclictest0-21swapper/309:35:583
194454799370,1cyclictest0-21swapper/310:59:563
1944543993734,2cyclictest0-21swapper/212:38:592
1944543993734,2cyclictest0-21swapper/211:46:592
1944543993734,2cyclictest0-21swapper/208:03:002
1944543993734,2cyclictest0-21swapper/207:56:592
194454399370,35cyclictest0-21swapper/211:40:592
194454399370,2cyclictest0-21swapper/207:27:592
194454399370,1cyclictest0-21swapper/212:01:592
194454399370,1cyclictest0-21swapper/208:13:592
1944538993735,1cyclictest0-21swapper/011:44:550
1944538993732,4cyclictest2038356-21kworker/u8:0+flush-179:012:35:260
194453899370,36cyclictest0-21swapper/010:42:590
194454799360,35cyclictest0-21swapper/312:03:593
1944543993632,2cyclictest0-21swapper/208:34:552
194454399360,1cyclictest0-21swapper/209:08:592
194454399360,1cyclictest0-21swapper/208:17:002
1944538993632,3cyclictest1978969-21systemd-run08:55:010
1944547993532,2cyclictest0-21swapper/311:41:593
1944547993529,5cyclictest1980521-21turbostat08:59:593
1944543993532,2cyclictest0-21swapper/212:33:592
1944543993532,2cyclictest0-21swapper/211:03:592
1944541993532,2cyclictest0-21swapper/110:42:591
1944538993533,1cyclictest0-21swapper/007:49:540
1944538993530,4cyclictest2020634-21systemd-run11:05:010
1944538993530,4cyclictest2005453-21kworker/u8:0+flush-179:010:55:260
1944547993432,1cyclictest0-21swapper/307:34:583
1944543993431,2cyclictest0-21swapper/210:42:592
1944543993431,2cyclictest0-21swapper/210:23:592
1944538993430,2cyclictest714-21Xorg12:23:590
1944547993328,4cyclictest2046396-21turbostat12:25:003
1944541993324,4cyclictest2039796-21kworker/u8:1+events_unbound12:05:231
1944538993328,3cyclictest0-21swapper/009:20:000
1944538993327,4cyclictest2025336-21kworker/u8:1+flush-179:011:30:170
1944538993327,4cyclictest1967319-21kworker/u8:2+events_unbound08:20:130
1944538993324,7cyclictest266-21systemd-journal09:27:310
1944547993230,1cyclictest0-21swapper/311:25:593
1944547993226,4cyclictest1951079-21turbostat07:30:003
1944541993227,4cyclictest1946061-21kworker/u8:1+events_unbound07:35:151
1944541993227,4cyclictest1946061-21kworker/u8:1+events_unbound07:35:141
4577091310,5ptp4l61490irq/134-eno1-TxRx-012:14:553
1944547993129,1cyclictest0-21swapper/308:44:543
1944543993129,1cyclictest0-21swapper/209:00:002
1944543993128,2cyclictest0-21swapper/212:07:592
1944547993028,1cyclictest0-21swapper/311:00:583
1944547993028,1cyclictest0-21swapper/310:21:593
1944547993028,1cyclictest0-21swapper/308:00:003
1944547993025,4cyclictest1977352-21turbostat08:50:013
194454799300,2cyclictest0-21swapper/312:15:153
194454799300,28cyclictest0-21swapper/311:55:133
194454799300,28cyclictest0-21swapper/310:05:143
194454799300,28cyclictest0-21swapper/307:10:133
1944543993027,2cyclictest0-21swapper/210:50:592
1944543993027,2cyclictest0-21swapper/208:35:022
1944543993027,2cyclictest0-21swapper/207:20:142
194454399300,28cyclictest0-21swapper/212:20:022
194454399300,28cyclictest0-21swapper/208:20:132
1944541993028,1cyclictest0-21swapper/109:24:001
1944538993023,5cyclictest1974139-21kworker/u8:1+events_unbound09:05:140
194453899301,3cyclictest2027227-21apt-get11:25:140
4577091290,7ptp4l441ktimers/310:39:563
4577091290,7ptp4l441ktimers/309:10:013
1944547992926,2cyclictest0-21swapper/310:10:133
1944547992926,2cyclictest0-21swapper/310:10:133
194454799290,27cyclictest0-21swapper/310:40:023
194454799290,1cyclictest0-21swapper/311:30:143
1944543992927,1cyclictest0-21swapper/209:40:142
1944543992927,1cyclictest0-21swapper/209:25:122
1944543992926,2cyclictest0-21swapper/211:21:592
1944543992926,2cyclictest0-21swapper/210:33:592
1944543992926,2cyclictest0-21swapper/210:05:592
1944543992926,2cyclictest0-21swapper/209:38:002
194454399290,28cyclictest0-21swapper/211:10:132
194454399290,28cyclictest0-21swapper/207:15:132
194454399290,27cyclictest0-21swapper/211:05:122
194454399290,27cyclictest0-21swapper/209:20:122
1944538992926,2cyclictest0-21swapper/010:05:130
1944538992922,5cyclictest0-21swapper/010:46:580
1944538992921,5cyclictest0-21swapper/008:00:000
4577091280,7ptp4l61490irq/134-eno1-TxRx-011:15:003
4577091280,7ptp4l61490irq/134-eno1-TxRx-008:20:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-011:40:003
4577091280,6ptp4l441ktimers/312:40:013
4577091280,6ptp4l441ktimers/311:55:013
4577091280,6ptp4l441ktimers/311:25:013
4577091280,6ptp4l441ktimers/309:05:003
4577091280,6ptp4l441ktimers/307:25:013
1944547992825,2cyclictest0-21swapper/310:00:133
194454799280,26cyclictest0-21swapper/308:25:043
194454799280,26cyclictest0-21swapper/308:05:033
1944543992825,2cyclictest0-21swapper/209:54:002
1944543992825,2cyclictest0-21swapper/208:25:012
194454399280,2cyclictest0-21swapper/210:25:162
194454399280,2cyclictest0-21swapper/207:10:162
194454399280,27cyclictest0-21swapper/212:20:012
194454399280,26cyclictest0-21swapper/211:50:152
194454399280,26cyclictest0-21swapper/208:05:012
194454399280,26cyclictest0-21swapper/207:46:002
4577091270,6ptp4l441ktimers/310:29:553
4577091270,6ptp4l441ktimers/309:29:563
1944547992725,1cyclictest0-21swapper/312:25:113
1944547992725,1cyclictest0-21swapper/308:22:583
1944547992724,2cyclictest0-21swapper/309:51:593
194454799270,26cyclictest0-21swapper/312:09:593
1944543992725,1cyclictest0-21swapper/211:31:592
1944543992724,2cyclictest0-21swapper/207:42:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-007:55:013
4577091260,6ptp4l441ktimers/309:24:593
4577091260,6ptp4l441ktimers/308:35:003
194454799260,24cyclictest0-21swapper/307:35:023
194454799260,24cyclictest0-21swapper/307:35:023
1944543992624,1cyclictest0-21swapper/210:39:592
1944543992623,2cyclictest0-21swapper/211:17:592
1944543992623,2cyclictest0-21swapper/209:18:592
1944543992622,2cyclictest0-21swapper/207:50:532
194454399260,24cyclictest0-21swapper/212:28:032
194454399260,24cyclictest0-21swapper/211:56:582
194454399260,24cyclictest0-21swapper/207:36:342
194454399260,24cyclictest0-21swapper/207:36:332
194454399260,24cyclictest0-21swapper/207:30:512
1944547992523,1cyclictest0-21swapper/308:35:593
194454799250,24cyclictest0-21swapper/308:50:593
194454799250,24cyclictest0-21swapper/307:15:153
1944543992523,1cyclictest0-21swapper/211:38:592
1944543992522,2cyclictest0-21swapper/208:52:582
1944543992521,2cyclictest0-21swapper/210:14:002
1944543992521,2cyclictest0-21swapper/210:13:592
4577091240,4ptp4l441ktimers/310:49:553
1944547992421,2cyclictest0-21swapper/308:10:153
1944543992422,1cyclictest0-21swapper/209:15:002
1944543992421,1cyclictest0-21swapper/208:45:002
1944543992320,2cyclictest0-21swapper/209:56:592
1944543992320,1cyclictest0-21swapper/211:00:002
1944543992220,1cyclictest0-21swapper/208:47:592
1944543992219,2cyclictest0-21swapper/212:10:592
231999200,11rtkit-daemon722273-21munin-node07:07:150
1944547992018,1cyclictest0-21swapper/309:34:563
1944543992017,2cyclictest0-21swapper/209:48:582
1944543991815,2cyclictest0-21swapper/209:04:542
1944541991814,2cyclictest0-21swapper/107:10:011
19445439962,2cyclictest0-21swapper/210:00:062
19445439940,3cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional