You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 22:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Wed Mar 18, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6998979910496,6cyclictest736670-21latency_hist09:05:011
699895999787,8cyclictest788156-21latency_hist11:45:010
699897999586,6cyclictest762700-21latency_hist10:25:011
699897999182,6cyclictest730307-21latency_hist08:45:001
699897998377,4cyclictest761103-21latency_hist10:20:011
699897998377,4cyclictest761103-21latency_hist10:20:011
699897998375,5cyclictest698242-21kworker/u8:0+flush-179:007:35:211
699895998373,8cyclictest770885-21/usr/sbin/munin10:50:240
699895998172,7cyclictest722345-21latency_hist08:20:000
699895997772,4cyclictest738491-21kworker/u8:1+flush-179:009:20:010
699895997769,6cyclictest266-21systemd-journal07:15:010
699895997768,6cyclictest704798-21/usr/sbin/munin07:25:230
699897997667,7cyclictest762735-21kworker/u8:3+flush-179:010:40:001
699897997564,9cyclictest266-21systemd-journal11:05:011
699897997265,5cyclictest746222-21apt-get09:35:021
699897997261,8cyclictest746206-21latency_hist09:35:001
699897997064,4cyclictest266-21systemd-journal07:47:511
699895997064,5cyclictest727092-21kworker/u8:3+events_unbound08:40:000
699897996960,7cyclictest789406-21kworker/u8:3+events_unbound12:05:001
699895996962,5cyclictest266-21systemd-journal09:14:550
699895996960,7cyclictest793181-21apt-get12:00:000
699902996861,5cyclictest743051-21turbostat09:25:003
699897996859,6cyclictest754429-21latency_hist10:00:011
699895996762,3cyclictest698242-21kworker/u8:0+flush-179:007:15:180
699895996659,4cyclictest711187-21kworker/u8:1+flush-179:007:50:010
699897996556,6cyclictest765905-21kworker/u8:2+flush-179:011:00:011
699895996559,4cyclictest789406-21kworker/u8:3+flush-179:012:05:190
699897996459,3cyclictest789406-21kworker/u8:3+flush-179:012:15:001
699895996459,3cyclictest755509-21kworker/u8:1+events_unbound10:15:280
699895996459,3cyclictest755509-21kworker/u8:1+events_unbound10:15:280
699895996255,5cyclictest765905-21kworker/u8:2+flush-179:010:55:120
699895996155,4cyclictest717555-21kworker/u8:1+flush-179:008:25:220
69989599611,56cyclictest1-21systemd11:16:270
699902996058,1cyclictest0-21swapper/307:50:003
699902996052,6cyclictest722348-21turbostat08:20:003
699895996054,4cyclictest795575-21kworker/u8:0+flush-179:012:10:150
699895996054,4cyclictest727092-21kworker/u8:3+flush-179:008:50:210
699897995952,5cyclictest266-21systemd-journal10:04:271
699897995848,8cyclictest266-21systemd-journal10:30:271
699897995832,24cyclictest743035-21latency_hist09:25:011
699895995852,4cyclictest739310-21kworker/u8:2+flush-179:009:45:220
699897995751,5cyclictest775461-21kworker/u8:3+events_unbound11:15:231
699897995750,5cyclictest725527-21latency_hist08:30:011
699897995734,20cyclictest759504-21latency_hist10:15:011
699895995749,6cyclictest748309-21/usr/sbin/munin09:40:240
699895995747,7cyclictest795575-21kworker/u8:0+flush-179:012:40:000
699897995650,4cyclictest711187-21kworker/u8:1+flush-179:007:50:211
699897995649,5cyclictest701365-21latency_hist07:15:001
699897995648,6cyclictest266-21systemd-journal09:06:271
699895995648,6cyclictest762735-21kworker/u8:3+events_unbound10:45:000
699895995648,6cyclictest762735-21kworker/u8:3+events_unbound10:44:590
699895995648,5cyclictest723987-21kworker/u8:0+flush-179:008:55:200
699897995545,8cyclictest733730-21apt-get08:55:111
699895995547,6cyclictest701399-21kworker/u8:3+events_unbound07:30:240
699895995546,6cyclictest799808-21latency_hist12:20:020
699902995452,1cyclictest0-21swapper/307:17:593
699897995434,18cyclictest733512-21systemd-run08:55:001
699895995441,10cyclictest757668-21apt-get10:10:000
699895995348,4cyclictest739310-21kworker/u8:2+flush-179:009:20:220
699900995249,2cyclictest0-21swapper/207:53:592
699897995248,3cyclictest723987-21kworker/u8:0+events_unbound08:35:231
699897995232,18cyclictest764322-21systemd-run10:30:011
699897995228,21cyclictest717616-21systemd-run08:05:011
699895995243,7cyclictest743067-21kworker/u8:0+events_unbound09:30:230
699897995145,4cyclictest701399-21kworker/u8:3+flush-179:007:20:271
699897995143,7cyclictest266-21systemd-journal08:10:011
699897995143,6cyclictest795575-21kworker/u8:0+flush-179:012:30:231
699895995145,4cyclictest739310-21kworker/u8:2+flush-179:009:35:220
699895995142,5cyclictest762735-21kworker/u8:3+flush-179:010:30:170
699895995045,4cyclictest774508-21kworker/u8:0+flush-179:011:09:560
699895995043,5cyclictest783423-21kworker/u8:3+events_unbound11:30:230
699895995042,6cyclictest781791-21latency_hist11:25:010
699895995042,5cyclictest804574-21latency_hist12:35:010
699895995039,8cyclictest744620-21latency_hist09:30:010
699895994943,4cyclictest801638-21kworker/u8:1+flush-179:012:25:150
4577091490,13ptp4l61490irq/134-eno1-TxRx-007:10:013
699897994828,18cyclictest714-21Xorg11:33:001
699895994843,4cyclictest781826-21kworker/u8:0+flush-179:011:45:220
699895994843,4cyclictest755509-21kworker/u8:1+events_unbound10:00:230
699897994744,2cyclictest803023-21kworker/u8:2+events_unbound12:35:221
699897994737,8cyclictest757242-21apt-get10:05:221
699895994742,4cyclictest762501-21kworker/u8:0+events_unbound10:25:230
699897994642,3cyclictest711252-21systemd-run07:45:011
699897994640,4cyclictest711207-21kworker/u8:2+flush-179:008:15:211
699897994623,4cyclictest770405-21timerandwakeup10:45:231
699895994641,3cyclictest723987-21kworker/u8:0+flush-179:008:45:160
699895994638,6cyclictest786556-21latency_hist11:40:010
699897994537,6cyclictest788169-21apt-get11:45:001
699895994538,5cyclictest749639-21kworker/u8:0+flush-179:009:55:280
699895994530,11cyclictest266-21systemd-journal08:15:000
699897994436,6cyclictest781826-21kworker/u8:0+events_unbound11:45:021
699897994436,6cyclictest762735-21kworker/u8:3+flush-179:010:40:171
699897994436,6cyclictest762735-21kworker/u8:3+flush-179:010:40:171
699895994440,2cyclictest791622-21systemd-run11:55:000
699895994440,2cyclictest791622-21systemd-run11:54:590
699895994438,4cyclictest777266-21apt-get11:10:110
699895994435,7cyclictest789406-21kworker/u8:3+events_unbound12:24:590
699897994339,3cyclictest770656-21turbostat10:54:541
699897994337,4cyclictest720748-21latency_hist08:15:011
699897994336,5cyclictest751480-21/usr/sbin/munin09:50:221
699897994335,6cyclictest725782-21apt-get08:30:101
699897994334,7cyclictest800052-21/usr/sbin/munin12:20:241
699895994339,3cyclictest711187-21kworker/u8:1+flush-179:007:50:210
699895994338,4cyclictest717555-21kworker/u8:1+flush-179:008:30:200
699895994336,5cyclictest727092-21kworker/u8:3+flush-179:009:00:190
699902994236,5cyclictest796637-21turbostat12:10:003
699902994236,5cyclictest790017-21turbostat11:50:013
69990299420,39cyclictest723955-21turbostat08:25:003
699895994235,5cyclictest759525-21perf10:14:590
699895994233,7cyclictest711207-21kworker/u8:2+flush-179:007:45:000
69990299410,39cyclictest780203-21turbostat11:19:593
69990099410,2cyclictest0-21swapper/212:38:592
699897994135,5cyclictest749639-21kworker/u8:0+flush-179:009:45:001
699895994136,3cyclictest770650-21idleruntime-cro10:50:000
699895994135,5cyclictest711207-21kworker/u8:2+events_unbound08:00:230
699895994134,5cyclictest791563-21kworker/u8:1+events_unbound12:00:230
699895994134,5cyclictest711207-21kworker/u8:2+flush-179:007:55:140
699902994038,1cyclictest0-21swapper/307:28:593
699897994036,3cyclictest783423-21kworker/u8:3+flush-179:011:36:001
699897994036,3cyclictest266-21systemd-journal12:05:281
699895994035,4cyclictest727092-21kworker/u8:3+flush-179:008:40:150
699895994035,4cyclictest698242-21kworker/u8:0+flush-179:007:35:190
69989599401,37cyclictest0-21swapper/010:20:590
69989599400,38cyclictest723957-21perf08:25:000
699902993934,4cyclictest759524-21turbostat10:14:593
699902993932,5cyclictest749665-21turbostat09:45:003
699902993931,6cyclictest733495-21turbostat08:55:003
69990299390,4cyclictest791592-21turbostat11:55:003
69990299390,4cyclictest791592-21turbostat11:54:593
69990299390,4cyclictest731906-21turbostat08:50:003
69990099390,36cyclictest0-21swapper/208:42:582
699895993934,4cyclictest739310-21kworker/u8:2+flush-179:009:50:160
699895993931,6cyclictest765905-21kworker/u8:2+flush-179:011:00:190
699902993835,2cyclictest0-21swapper/309:33:593
699902993832,4cyclictest798213-21turbostat12:15:013
699900993834,2cyclictest0-21swapper/208:59:552
69990099380,35cyclictest0-21swapper/209:45:592
699897993834,3cyclictest702329-21needreboot07:15:211
699897993833,4cyclictest698242-21kworker/u8:0+flush-179:007:30:211
699897993831,5cyclictest795575-21kworker/u8:0+flush-179:012:30:001
69989799380,37cyclictest0-21swapper/111:22:591
699895993833,4cyclictest711207-21kworker/u8:2+flush-179:008:05:210
699895993833,3cyclictest765905-21kworker/u8:2+flush-179:011:25:210
699902993734,2cyclictest0-21swapper/308:11:593
699902993731,5cyclictest803002-21turbostat12:29:593
69990299370,36cyclictest0-21swapper/310:44:593
69990299370,36cyclictest0-21swapper/310:44:583
699900993734,2cyclictest0-21swapper/210:15:592
699900993734,2cyclictest0-21swapper/210:15:592
699900993734,2cyclictest0-21swapper/207:40:002
69990099370,2cyclictest0-21swapper/207:22:002
699897993733,3cyclictest791622-21systemd-run11:55:001
699897993733,3cyclictest791622-21systemd-run11:55:001
699895993732,3cyclictest767456-21cron10:40:000
69990299360,1cyclictest0-21swapper/310:30:593
69990299360,1cyclictest0-21swapper/310:19:563
69990299360,1cyclictest0-21swapper/310:19:563
69990299360,1cyclictest0-21swapper/308:01:583
699900993633,2cyclictest0-21swapper/209:42:592
69990099360,1cyclictest0-21swapper/210:24:002
699897993633,2cyclictest0-21swapper/109:14:591
699897993626,7cyclictest783375-21latency_hist11:30:011
69990299350,1cyclictest0-21swapper/310:20:593
699900993533,1cyclictest0-21swapper/208:19:592
699900993532,2cyclictest0-21swapper/207:41:592
69990099350,1cyclictest0-21swapper/211:28:592
699895993529,4cyclictest727092-21kworker/u8:3+flush-179:009:05:190
699902993432,1cyclictest0-21swapper/311:22:003
699902993432,1cyclictest0-21swapper/308:29:593
699902993432,1cyclictest0-21swapper/307:53:003
699900993432,1cyclictest0-21swapper/212:00:002
699900993431,2cyclictest0-21swapper/212:04:552
699900993431,2cyclictest0-21swapper/207:31:582
699897993431,2cyclictest714-21Xorg11:14:591
699897993431,2cyclictest714-21Xorg07:58:591
699897993427,5cyclictest701399-21kworker/u8:3+flush-179:007:30:011
699902993331,1cyclictest0-21swapper/311:14:553
69990299330,29cyclictest0-21swapper/310:55:113
699900993331,1cyclictest0-21swapper/210:34:582
699897993328,4cyclictest714-21Xorg09:15:591
699902993229,2cyclictest0-21swapper/311:42:593
69990099320,30cyclictest0-21swapper/211:18:002
69989799320,4cyclictest908065-21snmpd08:20:121
699895993226,5cyclictest698242-21kworker/u8:0+flush-179:007:20:160
699902993127,2cyclictest0-21swapper/311:55:133
699902993124,5cyclictest799834-21turbostat12:20:013
69990299310,28cyclictest0-21swapper/311:05:123
699900993129,1cyclictest0-21swapper/210:54:592
699897993126,4cyclictest776768-21timerandwakeup11:05:221
4577091310,4ptp4l441ktimers/308:44:563
699902993027,2cyclictest0-21swapper/309:05:593
699902993025,2cyclictest0-21swapper/312:20:123
699902993024,5cyclictest735083-21turbostat09:00:003
69990299300,28cyclictest0-21swapper/309:25:133
699900993028,1cyclictest0-21swapper/207:29:592
69990099300,28cyclictest0-21swapper/210:05:232
4577091300,7ptp4l441ktimers/312:05:003
699902992927,1cyclictest0-21swapper/307:35:023
699902992925,3cyclictest0-21swapper/311:36:593
69990299290,28cyclictest0-21swapper/312:35:123
69990299290,28cyclictest0-21swapper/312:30:133
69990299290,28cyclictest0-21swapper/309:10:123
69990299290,27cyclictest0-21swapper/310:25:123
699900992926,2cyclictest0-21swapper/212:06:582
699900992926,2cyclictest0-21swapper/209:35:022
699900992926,2cyclictest0-21swapper/209:02:592
69990099290,28cyclictest0-21swapper/211:10:142
69990099290,27cyclictest0-21swapper/212:23:592
69990099290,27cyclictest0-21swapper/211:45:032
69990099290,27cyclictest0-21swapper/210:40:132
69990099290,27cyclictest0-21swapper/210:40:132
69990099290,27cyclictest0-21swapper/208:10:142
69990099290,26cyclictest0-21swapper/207:19:552
699897992924,4cyclictest723987-21kworker/u8:0+flush-179:008:45:221
699897992920,7cyclictest751244-21latency_hist09:50:011
4577091290,7ptp4l441ktimers/309:05:013
4577091290,4ptp4l61490irq/134-eno1-TxRx-008:39:553
699902992827,1cyclictest0-21swapper/308:30:123
69990299280,2cyclictest0-21swapper/311:30:123
69990299280,26cyclictest0-21swapper/311:25:123
699900992825,2cyclictest0-21swapper/212:25:582
699900992825,2cyclictest0-21swapper/212:15:142
699900992825,2cyclictest0-21swapper/210:00:122
699900992825,2cyclictest0-21swapper/208:05:112
69990099280,26cyclictest0-21swapper/208:35:112
69990099280,25cyclictest0-21swapper/211:02:582
69990099280,19cyclictest0-21swapper/212:12:582
69989799281,26cyclictest714-21Xorg11:55:581
4577091280,6ptp4l441ktimers/308:10:013
699902992725,1cyclictest0-21swapper/309:35:013
69990299270,26cyclictest0-21swapper/307:12:083
699897992721,5cyclictest789406-21kworker/u8:3+flush-179:012:15:221
4577091270,6ptp4l61490irq/134-eno1-TxRx-011:05:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:50:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-007:35:003
4577091270,6ptp4l441ktimers/310:55:003
699902992623,2cyclictest0-21swapper/309:47:593
699902992623,2cyclictest0-21swapper/307:20:153
699902992620,4cyclictest757673-21turbostat10:10:003
69990099260,2cyclictest0-21swapper/212:32:592
69990099260,2cyclictest0-21swapper/210:55:122
69990099260,24cyclictest0-21swapper/211:05:122
69990099260,24cyclictest0-21swapper/210:50:002
69990099260,24cyclictest0-21swapper/210:10:592
69990099260,24cyclictest0-21swapper/209:51:592
69990099260,24cyclictest0-21swapper/209:34:592
69990099260,24cyclictest0-21swapper/208:30:132
69990099260,24cyclictest0-21swapper/208:02:582
69990099260,18cyclictest0-21swapper/207:10:332
4577091260,6ptp4l61490irq/134-eno1-TxRx-009:19:553
4577091260,6ptp4l441ktimers/308:00:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-010:40:013
4577091260,5ptp4l441ktimers/309:54:563
4577091260,5ptp4l441ktimers/307:44:553
4577091260,4ptp4l441ktimers/310:00:003
231999260,16rtkit-daemon524-21gmain07:05:120
69990099250,23cyclictest0-21swapper/211:42:592
69990099250,23cyclictest0-21swapper/208:50:592
699897992522,2cyclictest714-21Xorg09:26:591
4577091250,5ptp4l61490irq/134-eno1-TxRx-010:05:003
699900992422,1cyclictest0-21swapper/208:48:592
699900992422,1cyclictest0-21swapper/207:49:592
699900992421,2cyclictest0-21swapper/210:25:122
699900992421,2cyclictest0-21swapper/208:25:122
69990099240,1cyclictest0-21swapper/210:39:592
69990099240,1cyclictest0-21swapper/209:20:002
699900992320,2cyclictest0-21swapper/209:29:592
699900992320,2cyclictest0-21swapper/209:24:552
699900992219,2cyclictest0-21swapper/211:54:592
699900992219,2cyclictest0-21swapper/211:54:582
699900992219,2cyclictest0-21swapper/208:20:112
699900992118,2cyclictest0-21swapper/211:32:002
699900992018,1cyclictest0-21swapper/209:05:592
699900991917,1cyclictest0-21swapper/209:10:592
699897991914,4cyclictest0-21swapper/107:10:031
699900991714,1cyclictest0-21swapper/211:36:582
699900991512,1cyclictest0-21swapper/207:56:002
699900991511,2cyclictest0-21swapper/211:23:582
6999009997,1cyclictest0-21swapper/209:59:572
6999009930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional