You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 20:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Mon Dec 08, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
368331999988,8cyclictest371493-21latency_hist07:20:010
368331998983,4cyclictest374697-21kworker/u8:0+events_unbound07:40:240
368331998579,4cyclictest374697-21kworker/u8:0+events_unbound07:50:230
368331998377,4cyclictest374697-21kworker/u8:0+events_unbound07:45:240
368331998170,9cyclictest400554-21cat08:50:000
368331998070,8cyclictest456949-21/usr/sbin/munin11:45:240
368331997969,7cyclictest446834-21latency_hist11:15:010
368332997867,8cyclictest437295-21latency_hist10:45:011
368331997772,4cyclictest452481-21kworker/u8:2+events_unbound11:55:010
368332997264,6cyclictest389040-21kworker/u8:3+flush-179:009:00:261
368331997265,5cyclictest467898-21kworker/u8:1+flush-179:012:20:270
368331997263,7cyclictest440466-21latency_hist10:55:010
368332997168,2cyclictest374697-21kworker/u8:0+flush-179:007:40:011
368332997160,8cyclictest448700-21latency_hist11:20:011
368331997165,3cyclictest426180-21kworker/u8:1+flush-179:010:10:250
368331997062,6cyclictest374697-21kworker/u8:0+flush-179:007:35:240
368331996963,4cyclictest368232-21kworker/u8:1+flush-179:007:30:250
368332996762,4cyclictest435948-21kworker/u8:0+flush-179:010:45:261
368331996761,4cyclictest389040-21kworker/u8:3+flush-179:009:00:210
368331996757,8cyclictest453478-21apt-get11:34:110
368331996558,5cyclictest422926-21kworker/u8:2+events_unbound10:05:000
368341996457,5cyclictest410226-21turbostat09:20:013
368331996456,6cyclictest467265-21kworker/u8:0+flush-179:012:35:210
368331996355,6cyclictest400651-21kworker/u8:0+flush-179:008:55:220
368331996353,7cyclictest389006-21latency_hist08:15:000
368331996353,7cyclictest389006-21latency_hist08:15:000
368332996253,7cyclictest450290-21latency_hist11:25:021
368332996253,7cyclictest424559-21latency_hist10:05:001
368331996256,5cyclictest389040-21kworker/u8:3+events_unbound08:25:120
368331996256,4cyclictest447329-21kworker/u8:1+flush-179:011:25:260
368331996255,4cyclictest447637-21diskstats11:15:150
36833199611,58cyclictest384284-21munin-run08:00:000
368332996052,6cyclictest438108-21kworker/u8:1+events_unbound11:00:001
368331996053,4cyclictest418724-21kworker/u8:1+flush-179:009:50:150
368341995957,1cyclictest0-21swapper/311:04:593
368332995953,4cyclictest434136-21kworker/u8:1+flush-179:010:40:001
368332995950,7cyclictest407579-21kworker/u8:0+flush-179:009:40:001
368331995951,6cyclictest452481-21kworker/u8:2+flush-179:011:55:260
368332995849,7cyclictest467898-21kworker/u8:1+flush-179:012:25:011
368331995853,4cyclictest418431-21/usr/sbin/munin09:45:240
368331995852,4cyclictest418724-21kworker/u8:1+flush-179:009:55:140
368331995850,6cyclictest452481-21kworker/u8:2+flush-179:011:39:590
368332995745,9cyclictest392202-21latency_hist08:25:001
36833199571,54cyclictest435746-21munin-run10:40:010
368332995650,4cyclictest447329-21kworker/u8:1+flush-179:011:30:001
368332995645,8cyclictest466510-21apt-get12:15:121
368331995647,5cyclictest422970-21kworker/u8:3+events_unbound10:30:000
368331995647,5cyclictest422970-21kworker/u8:3+events_unbound10:30:000
368332995551,3cyclictest425499-21kworker/u8:0+flush-179:010:10:001
368332995549,4cyclictest426180-21kworker/u8:1+flush-179:010:10:221
368332995444,8cyclictest368549-21apt-get07:10:111
368332995443,8cyclictest466254-21latency_hist12:15:011
368331995449,4cyclictest440501-21kworker/u8:3+flush-179:011:05:220
368331995448,4cyclictest422970-21kworker/u8:3+flush-179:010:15:290
368331995445,7cyclictest400651-21kworker/u8:0+flush-179:008:55:000
368332995342,9cyclictest271-21systemd-journal08:05:011
368332995248,3cyclictest389040-21kworker/u8:3+flush-179:008:59:091
368331995246,4cyclictest467265-21kworker/u8:0+flush-179:012:35:000
368331995246,4cyclictest407579-21kworker/u8:0+flush-179:009:20:250
368331995244,6cyclictest416592-21latency_hist09:40:000
368332995144,5cyclictest271-21systemd-journal11:07:111
368332995142,7cyclictest463081-21latency_hist12:05:011
368331995146,4cyclictest410271-21kworker/u8:3+flush-179:009:25:230
368331995145,4cyclictest368232-21kworker/u8:1+flush-179:007:25:230
368331995143,5cyclictest464666-21latency_hist12:10:010
368332995049,1cyclictest0-21swapper/112:05:591
368332995041,7cyclictest455118-21latency_hist11:40:011
368331995044,4cyclictest438108-21kworker/u8:1+flush-179:010:59:560
368332994942,6cyclictest407579-21kworker/u8:0+flush-179:009:30:261
368332994942,5cyclictest412080-21apt-get09:25:131
368332994941,6cyclictest368247-21latency_hist07:10:021
368331994940,6cyclictest407579-21kworker/u8:0+events_unbound09:45:000
4670791480,12ptp4l441ktimers/307:10:003
368332994845,2cyclictest389040-21kworker/u8:3+events_unbound08:25:221
368331994841,5cyclictest464701-21kworker/u8:3+flush-179:012:15:010
368332994740,5cyclictest461476-21latency_hist12:00:011
368332994737,7cyclictest471036-21latency_hist12:30:001
368331994740,5cyclictest447329-21kworker/u8:1+events_unbound11:20:240
368331994641,4cyclictest430963-21kworker/u8:2+flush-179:010:30:230
368331994641,3cyclictest415035-21systemd-run09:35:010
368332994544,1cyclictest0-21swapper/112:35:591
368332994539,5cyclictest407579-21kworker/u8:0+flush-179:009:20:251
368332994539,4cyclictest374697-21kworker/u8:0+flush-179:008:10:211
368332994539,4cyclictest374697-21kworker/u8:0+flush-179:008:10:201
368332994538,5cyclictest374697-21kworker/u8:0+flush-179:008:10:001
368331994540,4cyclictest425499-21kworker/u8:0+flush-179:010:05:240
368331994540,4cyclictest374697-21kworker/u8:0+flush-179:008:40:220
368331994539,4cyclictest455158-21kworker/u8:0+flush-179:011:45:010
368331994539,4cyclictest374697-21kworker/u8:0+flush-179:008:35:210
368332994435,7cyclictest271-21systemd-journal11:15:001
368331994438,4cyclictest435948-21kworker/u8:0+flush-179:010:40:230
36833699430,41cyclictest0-21swapper/210:07:582
368332994338,4cyclictest464647-21kworker/u8:2+flush-179:012:30:231
368331994338,4cyclictest389040-21kworker/u8:3+flush-179:009:05:240
368331994331,5cyclictest464647-21kworker/u8:2+events_unbound12:25:230
36834199420,40cyclictest400413-21turbostat08:50:003
36833299420,1cyclictest0-21swapper/109:09:581
368331994236,4cyclictest368232-21kworker/u8:1+events_unbound07:20:130
368331994234,6cyclictest461094-21kworker/u8:1+flush-179:012:05:010
36833199420,5cyclictest387426-21apt08:10:010
368332994133,5cyclictest430963-21kworker/u8:2+flush-179:010:30:141
368331994136,4cyclictest389040-21kworker/u8:3+flush-179:008:15:170
368331994133,6cyclictest467492-21swap12:15:230
368331994133,6cyclictest410227-21latency_hist09:20:020
368341994034,5cyclictest405204-21turbostat09:05:003
36834199400,5cyclictest455130-21turbostat11:40:003
368332994034,4cyclictest418724-21kworker/u8:1+flush-179:009:55:001
368332994032,7cyclictest374676-21awk07:30:001
368331994036,3cyclictest438917-21systemd-run10:50:010
368331994036,3cyclictest422970-21kworker/u8:3+events_unbound10:20:250
36834199390,38cyclictest464683-21turbostat12:10:013
36834199390,38cyclictest432521-21turbostat10:30:003
36834199390,38cyclictest432521-21turbostat10:30:003
36833699390,36cyclictest0-21swapper/211:44:552
36833699390,36cyclictest0-21swapper/210:19:562
36834199380,37cyclictest458301-21turbostat11:50:013
36833699380,36cyclictest0-21swapper/209:34:552
36833699380,35cyclictest0-21swapper/212:26:592
36833699380,35cyclictest0-21swapper/209:55:002
36833699380,35cyclictest0-21swapper/208:09:552
368332993835,2cyclictest723-21Xorg08:36:591
368332993835,2cyclictest0-21swapper/107:21:001
36833299380,37cyclictest723-21Xorg08:54:001
368331993832,4cyclictest374697-21kworker/u8:0+flush-179:008:20:260
368341993733,2cyclictest0-21swapper/311:06:003
368341993732,4cyclictest419797-21turbostat09:50:003
36834199370,1cyclictest0-21swapper/308:36:003
368336993734,2cyclictest0-21swapper/208:21:592
36833699370,1cyclictest0-21swapper/211:10:592
368332993734,2cyclictest0-21swapper/111:47:001
368332993734,2cyclictest0-21swapper/109:56:591
368332993729,6cyclictest374697-21kworker/u8:0+flush-179:007:40:221
368332993728,6cyclictest456711-21latency_hist11:45:011
36833299370,36cyclictest0-21swapper/111:51:581
368331993732,4cyclictest389040-21kworker/u8:3+events_unbound09:10:140
368341993633,2cyclictest0-21swapper/307:42:583
368341993632,2cyclictest0-21swapper/308:55:593
368341993631,4cyclictest390605-21turbostat08:20:003
36834199360,35cyclictest0-21swapper/310:01:593
36834199360,35cyclictest0-21swapper/307:22:593
36834199360,1cyclictest0-21swapper/312:24:563
368336993634,1cyclictest0-21swapper/211:09:592
36833699360,1cyclictest0-21swapper/210:24:552
36833699360,1cyclictest0-21swapper/208:15:582
368332993632,3cyclictest384257-21munin-run08:00:011
368332993630,4cyclictest374697-21kworker/u8:0+flush-179:008:35:011
368332993628,4cyclictest408883-21apt-get09:15:161
368331993632,3cyclictest440501-21kworker/u8:3+flush-179:011:05:000
368341993532,2cyclictest0-21swapper/307:58:583
368336993533,1cyclictest0-21swapper/211:05:002
368336993533,1cyclictest0-21swapper/207:20:012
368336993532,2cyclictest0-21swapper/211:45:582
368332993527,6cyclictest418191-21latency_hist09:45:011
202199350,9rtkit-daemon3365616-21munin-node07:05:410
368341993431,2cyclictest0-21swapper/311:15:593
368341993429,4cyclictest453530-21turbostat11:35:003
368341993429,4cyclictest437308-21turbostat10:45:003
368336993432,1cyclictest0-21swapper/207:44:582
368336993431,2cyclictest0-21swapper/209:41:592
368332993429,4cyclictest422970-21kworker/u8:3+flush-179:010:20:261
368332993428,4cyclictest379502-21kworker/u8:3+flush-179:007:50:001
368331993430,3cyclictest384280-21kworker/u8:3+flush-179:008:00:250
368331993429,4cyclictest389040-21kworker/u8:3+flush-179:008:30:250
36833199341,30cyclictest0-21swapper/007:10:140
368341993331,1cyclictest0-21swapper/311:27:593
368341993330,2cyclictest0-21swapper/311:54:593
368341993329,3cyclictest426157-21turbostat10:10:003
368336993330,2cyclictest0-21swapper/211:53:592
368336993330,2cyclictest0-21swapper/210:03:592
368336993330,2cyclictest0-21swapper/207:40:012
368332993330,2cyclictest723-21Xorg08:17:001
368332993330,2cyclictest0-21swapper/109:10:591
368332993329,2cyclictest723-21Xorg07:17:591
368332993326,5cyclictest435948-21kworker/u8:0+flush-179:010:54:561
368332993326,5cyclictest418724-21kworker/u8:1+flush-179:009:45:181
368332993326,5cyclictest389040-21kworker/u8:3+flush-179:008:45:231
36833299331,30cyclictest397501-21apt-get08:40:131
368341993230,1cyclictest0-21swapper/311:24:593
368341993230,1cyclictest0-21swapper/309:12:593
368341993230,1cyclictest0-21swapper/307:45:593
36833699320,30cyclictest0-21swapper/212:40:012
36833699320,30cyclictest0-21swapper/207:20:122
368332993229,2cyclictest723-21Xorg07:52:591
368332993227,4cyclictest368232-21kworker/u8:1+flush-179:007:35:001
368341993129,1cyclictest0-21swapper/312:04:593
368341993129,1cyclictest0-21swapper/310:59:563
368341993129,1cyclictest0-21swapper/309:58:593
368341993129,1cyclictest0-21swapper/308:23:003
368341993129,1cyclictest0-21swapper/307:38:593
368341993127,3cyclictest446838-21turbostat11:15:003
36834199310,30cyclictest0-21swapper/307:33:593
368336993129,1cyclictest0-21swapper/209:30:002
368336993128,2cyclictest0-21swapper/210:52:592
368336993128,2cyclictest0-21swapper/208:49:562
368336993028,1cyclictest0-21swapper/208:45:002
368336993028,1cyclictest0-21swapper/207:49:592
368336993027,2cyclictest0-21swapper/210:10:142
368336993027,2cyclictest0-21swapper/209:24:562
368336993027,2cyclictest0-21swapper/208:35:002
368336993027,2cyclictest0-21swapper/208:25:032
368336993027,2cyclictest0-21swapper/207:25:132
36833699300,2cyclictest0-21swapper/212:20:162
36833699300,29cyclictest0-21swapper/209:10:132
368332993024,5cyclictest428815-21phc2sys10:15:281
4670791290,7ptp4l441ktimers/309:09:593
4670791290,6ptp4l441ktimers/308:05:003
368341992927,1cyclictest0-21swapper/312:19:553
368341992927,1cyclictest0-21swapper/310:51:003
368341992927,1cyclictest0-21swapper/308:33:593
368341992927,1cyclictest0-21swapper/308:25:023
36834199290,28cyclictest0-21swapper/309:35:143
368336992926,2cyclictest0-21swapper/209:00:162
368336992926,2cyclictest0-21swapper/208:39:552
36833699290,27cyclictest0-21swapper/212:30:152
36833699290,27cyclictest0-21swapper/212:05:172
36833699290,27cyclictest0-21swapper/210:45:162
36833699290,27cyclictest0-21swapper/210:35:152
36833699290,27cyclictest0-21swapper/209:55:132
36833699290,27cyclictest0-21swapper/209:45:142
36833699290,27cyclictest0-21swapper/209:35:142
36833699290,27cyclictest0-21swapper/208:10:112
36833699290,27cyclictest0-21swapper/208:10:102
36833699290,27cyclictest0-21swapper/207:55:162
4670791280,5ptp4l441ktimers/310:35:003
368341992826,1cyclictest0-21swapper/310:47:593
368341992826,1cyclictest0-21swapper/310:35:153
368341992826,1cyclictest0-21swapper/309:25:143
368341992826,1cyclictest0-21swapper/307:29:593
36834199280,27cyclictest0-21swapper/308:05:153
36834199280,26cyclictest0-21swapper/312:30:133
36834199280,26cyclictest0-21swapper/312:25:133
36833699280,2cyclictest0-21swapper/211:30:142
36833699280,2cyclictest0-21swapper/211:15:022
36833699280,26cyclictest0-21swapper/212:00:592
36833699280,21cyclictest0-21swapper/207:30:132
36833699280,1cyclictest0-21swapper/209:19:592
368332992822,4cyclictest447329-21kworker/u8:1+flush-179:011:34:591
4670791270,6ptp4l61690irq/136-eno1-TxRx-008:54:553
4670791270,6ptp4l61690irq/136-eno1-TxRx-007:20:003
4670791270,6ptp4l441ktimers/312:39:553
4670791270,6ptp4l441ktimers/312:14:563
4670791270,6ptp4l441ktimers/309:25:013
4670791270,5ptp4l441ktimers/312:00:003
368341992723,3cyclictest4672291phc2sys10:14:003
368336992723,2cyclictest0-21swapper/209:00:002
36833699270,25cyclictest0-21swapper/207:10:302
36833299270,25cyclictest430935-21turbostat10:29:551
36833299270,25cyclictest430935-21turbostat10:29:551
4670791260,6ptp4l441ktimers/309:55:023
4670791260,5ptp4l441ktimers/309:44:553
4670791260,5ptp4l441ktimers/309:34:563
4670791260,5ptp4l441ktimers/308:14:553
4670791260,5ptp4l441ktimers/308:14:553
4670791260,4ptp4l61690irq/136-eno1-TxRx-010:24:563
368336992623,2cyclictest0-21swapper/210:28:592
368336992623,2cyclictest0-21swapper/210:28:592
36833699260,24cyclictest0-21swapper/210:58:592
368332992623,2cyclictest723-21Xorg11:03:591
4670791250,5ptp4l441ktimers/311:44:563
4670791250,4ptp4l61690irq/136-eno1-TxRx-010:19:563
368341992523,1cyclictest0-21swapper/307:52:003
36834199250,1cyclictest0-21swapper/308:40:143
36834199250,1cyclictest0-21swapper/307:10:133
368336992523,1cyclictest0-21swapper/208:04:592
368336992522,2cyclictest0-21swapper/211:35:592
368336992522,2cyclictest0-21swapper/210:31:592
368336992320,2cyclictest0-21swapper/211:25:582
368336992219,2cyclictest0-21swapper/212:19:002
368336992219,2cyclictest0-21swapper/209:05:592
368336992219,2cyclictest0-21swapper/207:51:002
368336992118,2cyclictest0-21swapper/211:56:592
368336991915,2cyclictest0-21swapper/208:51:592
368336991411,2cyclictest0-21swapper/210:41:592
3683369996,2cyclictest0-21swapper/212:13:282
3683369996,2cyclictest0-21swapper/211:20:072
3683369930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional