You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 12:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Fri Mar 27, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
326375199122115,5cyclictest3305377-21kworker/u8:2+events_unbound21:45:000
326375199118101,14cyclictest3284315-21http20:15:010
326375299117100,15cyclictest3281117-21kworker/u8:3+flush-179:020:45:011
326375299114102,10cyclictest3304053-21latency_hist21:15:011
326375199114100,11cyclictest266-21systemd-journal00:00:000
32637519910496,6cyclictest3289335-21kworker/u8:2+flush-179:020:40:010
32637519910093,5cyclictest3341547-21kworker/u8:3+flush-179:023:45:010
3263752999587,6cyclictest3305377-21kworker/u8:2+flush-179:021:20:011
3263752999587,6cyclictest3305377-21kworker/u8:2+flush-179:021:20:011
3263751999483,8cyclictest266-21systemd-journal22:30:150
3263752999388,3cyclictest3351570-21kworker/u8:4+events_unbound00:05:251
3263751999382,9cyclictest3295889-21latency_hist20:50:010
3263752999286,4cyclictest3281117-21kworker/u8:3+events_unbound20:50:021
3263752999082,6cyclictest3341547-21kworker/u8:3+events_unbound23:35:001
3263752998780,5cyclictest3312274-21kworker/u8:0+events_unbound21:45:021
3263751998777,8cyclictest266-21systemd-journal21:00:010
3263751998680,4cyclictest3281117-21kworker/u8:3+flush-179:021:05:010
3263751998679,5cyclictest3341547-21kworker/u8:3+events_unbound23:35:220
3263751998676,5cyclictest3305377-21kworker/u8:2+flush-179:021:40:010
3263752998579,5cyclictest3341547-21kworker/u8:3+events_unbound00:04:011
3263752998576,7cyclictest3349988-21kworker/u8:1+flush-179:000:10:131
3263751998474,8cyclictest3328840-21apt-get22:55:120
3263752998375,6cyclictest3250856-21kworker/u8:1+flush-179:019:30:201
3263752998374,6cyclictest3356327-21latency_hist00:20:021
3263751998377,4cyclictest3281117-21kworker/u8:3+flush-179:020:20:220
3263752998276,4cyclictest3266290-21kworker/u8:2+events_unbound19:35:221
3263751998275,5cyclictest3330226-21kworker/u8:3+flush-179:023:04:590
3263752998176,4cyclictest3316700-21kworker/u8:1+flush-179:022:09:591
3263751998175,4cyclictest3355395-21kworker/u8:0+events_unbound00:15:230
3263751998073,4cyclictest3266290-21kworker/u8:2+events_unbound19:25:140
3263752997974,4cyclictest3339947-21kworker/u8:2+events_unbound23:40:161
3263752997972,5cyclictest3305377-21kworker/u8:2+events_unbound22:00:141
3263751997669,5cyclictest3316700-21kworker/u8:1+events_unbound22:25:010
3263751997664,4cyclictest3355395-21kworker/u8:0+events_unbound00:20:150
3263752997570,4cyclictest3351570-21kworker/u8:4+flush-179:000:34:541
3263751997571,2cyclictest1-21systemd23:35:010
3263751997569,4cyclictest3271638-21kworker/u8:0+events_unbound19:40:000
3263751997568,5cyclictest3317017-21kworker/u8:2+events_unbound22:35:240
3263752997468,4cyclictest3250856-21kworker/u8:1+events_unbound19:20:181
3263752997364,4cyclictest3341547-21kworker/u8:3+events_unbound23:45:141
3263751997367,4cyclictest3317017-21kworker/u8:2+flush-179:022:45:210
3263752997267,4cyclictest3326987-21kworker/u8:0+events_unbound22:50:141
3263752997263,7cyclictest3356572-21/usr/sbin/munin00:20:241
3263751997264,6cyclictest3351570-21kworker/u8:4+flush-179:000:25:230
3263751997263,7cyclictest3326987-21kworker/u8:0+events_unbound23:10:000
3263751997166,4cyclictest3305377-21kworker/u8:2+events_unbound21:20:200
3263751997165,4cyclictest3351570-21kworker/u8:4+events_unbound00:35:230
3263751997165,4cyclictest3317017-21kworker/u8:2+events_unbound22:40:250
3263751997162,4cyclictest3250856-21kworker/u8:1+events_unbound19:10:230
3263752997066,3cyclictest3295351-21kworker/u8:0+events_unbound21:05:191
3263752996964,4cyclictest3316700-21kworker/u8:1+events_unbound23:00:231
3263752996964,4cyclictest3281104-21kworker/u8:1+events_unbound20:20:221
3263752996964,3cyclictest3314343-21kworker/u8:3+events_unbound21:59:551
3263752996964,3cyclictest3314343-21kworker/u8:3+events_unbound21:59:551
3263752996963,4cyclictest3341547-21kworker/u8:3+flush-179:023:50:201
3263752996963,4cyclictest3326987-21kworker/u8:0+events_unbound23:10:131
3263752996963,4cyclictest3281117-21kworker/u8:3+flush-179:020:05:161
3263751996962,6cyclictest3281104-21kworker/u8:1+flush-179:020:15:260
3263751996956,9cyclictest3319359-21apt-get22:25:130
3263752996863,4cyclictest3316963-21kworker/u8:0+events_unbound22:20:011
3263752996863,4cyclictest3271638-21kworker/u8:0+flush-179:020:00:201
3263751996861,4cyclictest3281117-21kworker/u8:3+flush-179:020:30:260
3263752996761,4cyclictest3309094-21kworker/u8:1+events_unbound21:30:131
3263752996760,5cyclictest3307481-21kworker/u8:0+events_unbound21:25:191
3263752996756,5cyclictest3317017-21kworker/u8:2+events_unbound22:40:141
3263751996761,4cyclictest3337438-21kworker/u8:1+flush-179:023:25:220
3263751996761,4cyclictest3281117-21kworker/u8:3+events_unbound20:05:230
3263751996757,4cyclictest3266290-21kworker/u8:2+events_unbound19:20:010
3263752996661,4cyclictest3281104-21kworker/u8:1+flush-179:020:15:231
3263752996660,4cyclictest3316700-21kworker/u8:1+events_unbound23:05:151
3263752996659,6cyclictest3312274-21kworker/u8:0+events_unbound21:40:241
3263751996659,6cyclictest3326987-21kworker/u8:0+events_unbound23:10:250
3263751996559,4cyclictest3250856-21kworker/u8:1+flush-179:019:30:210
3263752996457,5cyclictest3287959-21/usr/sbin/munin20:25:231
3263751996458,4cyclictest3271638-21kworker/u8:0+events_unbound20:00:130
3263752996358,3cyclictest3344914-21kworker/u8:0+events_unbound23:55:171
3263752996356,5cyclictest3323845-21latency_hist22:40:011
3263751996357,5cyclictest3281117-21kworker/u8:3+events_unbound20:25:240
3263752996258,3cyclictest3317017-21kworker/u8:2+flush-179:022:34:551
3263752996257,4cyclictest3326987-21kworker/u8:0+events_unbound23:20:141
3263752996256,5cyclictest3271638-21kworker/u8:0+events_unbound19:45:191
3263752996156,3cyclictest3337438-21kworker/u8:1+flush-179:023:25:151
3263752996055,4cyclictest3250856-21kworker/u8:1+events_unbound19:25:191
3263752996052,6cyclictest3265528-21kworker/u8:0+flush-179:019:15:141
3263751996054,4cyclictest3266290-21kworker/u8:2+events_unbound19:55:000
3263751995950,7cyclictest3326987-21kworker/u8:0+events_unbound22:50:200
3263752995853,4cyclictest3316700-21kworker/u8:1+flush-179:022:55:201
3263752995853,4cyclictest3309094-21kworker/u8:1+events_unbound21:35:211
3263752995851,5cyclictest510-21rs:main1
3263751995847,4cyclictest3295351-21kworker/u8:0+events_unbound21:15:140
3263751995847,4cyclictest3295351-21kworker/u8:0+events_unbound21:15:140
3263752995751,4cyclictest3317017-21kworker/u8:2+events_unbound22:45:191
3263751995752,4cyclictest3341547-21kworker/u8:3+events_unbound00:04:020
3263751995751,4cyclictest3341547-21kworker/u8:3+flush-179:023:50:210
3263752995651,4cyclictest3281117-21kworker/u8:3+events_unbound21:00:151
3263752995649,5cyclictest3317017-21kworker/u8:2+flush-179:022:20:161
3263752995644,6cyclictest3266290-21kworker/u8:2+events_unbound19:40:151
3263751995651,4cyclictest3351570-21kworker/u8:4+flush-179:000:33:170
3263751995651,4cyclictest3349988-21kworker/u8:1+flush-179:000:05:230
3263751995651,4cyclictest3295351-21kworker/u8:0+events_unbound20:50:220
3263751995649,5cyclictest3326987-21kworker/u8:0+events_unbound23:15:160
3263752995550,4cyclictest3266290-21kworker/u8:2+flush-179:019:55:201
3263752995548,6cyclictest3339947-21kworker/u8:2+flush-179:023:40:001
3263751995549,4cyclictest3302734-21apt-get21:10:100
3263752995348,4cyclictest3282697-21kworker/u8:0+events_unbound20:11:111
3263751995347,5cyclictest3326987-21kworker/u8:0+flush-179:023:20:190
3263751995343,5cyclictest3305377-21kworker/u8:2+events_unbound21:25:120
3263752995247,4cyclictest3351570-21kworker/u8:4+flush-179:000:35:221
3263752995246,4cyclictest3289536-21/usr/sbin/munin20:30:181
3263752995244,6cyclictest3271638-21kworker/u8:0+flush-179:019:50:101
3263751995247,4cyclictest3349988-21kworker/u8:1+flush-179:000:10:230
3263752995146,4cyclictest3316700-21kworker/u8:1+flush-179:022:25:211
3263752995144,5cyclictest3306168-21apt-get21:20:111
3263751995046,3cyclictest3289335-21kworker/u8:2+flush-179:020:44:560
3263751995045,4cyclictest3309094-21kworker/u8:1+flush-179:021:30:150
3263751995044,4cyclictest3271638-21kworker/u8:0+flush-179:019:45:210
3263755994844,2cyclictest0-21swapper/219:53:002
4577091470,13ptp4l441ktimers/319:09:553
3263756994644,1cyclictest0-21swapper/319:52:593
3263751994436,6cyclictest3344936-21latency_hist23:45:000
3263751994434,8cyclictest3314876-21apt-get22:00:010
3263751994434,8cyclictest3314876-21apt-get22:00:000
3263752994339,3cyclictest3289335-21kworker/u8:2+events_unbound20:35:211
3263751994340,2cyclictest191rcuc/019:55:590
3263751994336,6cyclictest3315351-21apt-key22:00:020
3263752994237,4cyclictest3326987-21kworker/u8:0+flush-179:023:15:211
3263756994034,5cyclictest3336499-21turbostat23:20:013
326375699400,38cyclictest0-21swapper/319:19:553
326375599400,37cyclictest0-21swapper/223:21:592
3263752994035,4cyclictest3281117-21kworker/u8:3+flush-179:020:55:261
326375599390,36cyclictest0-21swapper/219:19:562
3263752993932,5cyclictest3351570-21kworker/u8:4+events_unbound00:25:141
326375299390,37cyclictest714-21Xorg19:12:591
3263751993934,4cyclictest3316700-21kworker/u8:1+flush-179:022:15:170
326375199391,37cyclictest211irq_work/021:47:590
326375199391,37cyclictest211irq_work/021:05:590
326375699380,37cyclictest3316990-21turbostat22:10:003
3263755993835,2cyclictest0-21swapper/222:39:542
3263755993834,2cyclictest0-21swapper/223:40:582
3263755993834,2cyclictest0-21swapper/223:19:562
3263755993834,2cyclictest0-21swapper/221:04:562
326375599380,36cyclictest0-21swapper/223:36:002
326375599380,2cyclictest0-21swapper/220:00:592
3263752993833,4cyclictest3316700-21kworker/u8:1+events_unbound22:14:161
3263751993834,3cyclictest3274804-21munin-run19:45:000
231999380,4rtkit-daemon2318-21rtkit-daemon22:11:470
3263756993735,1cyclictest0-21swapper/322:39:553
3263756993735,1cyclictest0-21swapper/321:04:563
326375699370,35cyclictest0-21swapper/320:35:593
3263755993734,2cyclictest0-21swapper/220:39:552
3263755993733,3cyclictest0-21swapper/221:15:592
3263755993733,3cyclictest0-21swapper/221:15:592
326375599370,35cyclictest0-21swapper/221:45:592
231999370,3rtkit-daemon2318-21rtkit-daemon19:24:000
3263756993633,1cyclictest0-21swapper/321:40:593
3263756993630,4cyclictest3286139-21turbostat20:20:003
326375699360,35cyclictest0-21swapper/323:35:593
326375699360,1cyclictest0-21swapper/323:21:583
3263755993633,2cyclictest0-21swapper/222:01:582
326375599360,2cyclictest0-21swapper/219:26:592
3263756993533,1cyclictest0-21swapper/323:40:583
3263756993533,1cyclictest0-21swapper/322:01:593
3263756993529,4cyclictest3273239-21turbostat19:40:003
3263755993532,2cyclictest0-21swapper/221:40:592
3263755993531,2cyclictest0-21swapper/200:25:592
3263756993432,1cyclictest0-21swapper/321:15:593
3263756993432,1cyclictest0-21swapper/321:15:593
3263756993431,2cyclictest0-21swapper/300:39:593
3263755993431,2cyclictest0-21swapper/200:39:592
326375599340,31cyclictest0-21swapper/200:07:582
4577091330,12ptp4l441ktimers/319:45:003
3263756993330,2cyclictest0-21swapper/320:59:593
3263755993330,2cyclictest0-21swapper/222:29:562
3263755993330,2cyclictest0-21swapper/220:20:002
3263755993329,2cyclictest0-21swapper/221:54:552
3263756993230,1cyclictest0-21swapper/322:29:563
3263756993230,1cyclictest0-21swapper/321:54:553
3263756993230,1cyclictest0-21swapper/300:26:003
3263756993228,3cyclictest0-21swapper/323:59:553
3263755993230,1cyclictest0-21swapper/219:40:002
3263755993228,2cyclictest0-21swapper/220:09:552
3263755993227,2cyclictest0-21swapper/223:59:562
3263752993228,2cyclictest714-21Xorg21:50:591
3263756993128,2cyclictest0-21swapper/320:09:553
326375699310,30cyclictest0-21swapper/300:07:593
3263755993129,1cyclictest0-21swapper/220:59:592
3263755993127,2cyclictest0-21swapper/222:57:582
3263755993127,2cyclictest0-21swapper/221:36:592
3263755993127,2cyclictest0-21swapper/220:40:592
3263756993028,1cyclictest0-21swapper/322:57:593
3263756993028,1cyclictest0-21swapper/321:32:593
326375699300,28cyclictest0-21swapper/323:45:013
326375699300,1cyclictest0-21swapper/320:00:593
3263755993027,2cyclictest0-21swapper/221:21:592
326375599300,28cyclictest0-21swapper/223:10:122
326375599300,28cyclictest0-21swapper/221:30:122
326375599300,28cyclictest0-21swapper/220:20:132
3263751993025,4cyclictest3316963-21kworker/u8:0+events_unbound22:07:590
3263756992927,1cyclictest0-21swapper/321:36:593
3263756992926,2cyclictest0-21swapper/323:10:133
326375699290,2cyclictest0-21swapper/319:20:113
326375699290,28cyclictest0-21swapper/320:40:123
326375699290,28cyclictest0-21swapper/319:30:123
326375699290,27cyclictest0-21swapper/321:10:123
326375699290,27cyclictest0-21swapper/320:20:143
3263755992925,2cyclictest0-21swapper/223:50:592
3263755992924,3cyclictest0-21swapper/222:50:592
326375599290,27cyclictest0-21swapper/223:45:002
326375599290,27cyclictest0-21swapper/221:10:122
326375599290,25cyclictest0-21swapper/200:17:592
3263751992926,2cyclictest0-21swapper/021:50:590
4577091280,7ptp4l441ktimers/300:15:003
3263756992826,1cyclictest0-21swapper/323:50:593
3263756992826,1cyclictest0-21swapper/321:21:593
3263755992825,2cyclictest0-21swapper/219:30:122
3263755992824,2cyclictest0-21swapper/222:11:592
3263755992824,2cyclictest0-21swapper/220:34:552
3263755992824,2cyclictest0-21swapper/220:27:002
326375599280,2cyclictest0-21swapper/219:20:112
326375599280,2cyclictest0-21swapper/200:21:582
326375599280,26cyclictest0-21swapper/219:46:592
326375599280,25cyclictest0-21swapper/222:42:592
4577091270,7ptp4l61490irq/134-eno1-TxRx-023:30:003
4577091270,7ptp4l441ktimers/323:35:013
4577091270,6ptp4l441ktimers/323:10:003
4577091270,6ptp4l441ktimers/323:05:013
4577091270,6ptp4l441ktimers/320:15:013
3263756992724,2cyclictest0-21swapper/320:34:553
326375699270,26cyclictest0-21swapper/322:45:583
326375699270,26cyclictest0-21swapper/320:49:553
326375699270,25cyclictest0-21swapper/319:10:113
326375699270,24cyclictest3317525-21turbostat22:20:013
326375699270,20cyclictest0-21swapper/319:47:003
326375599270,2cyclictest0-21swapper/222:31:592
4577091260,7ptp4l441ktimers/321:29:553
4577091260,7ptp4l441ktimers/321:10:013
4577091260,6ptp4l61490irq/134-eno1-TxRx-022:25:013
4577091260,6ptp4l61490irq/134-eno1-TxRx-000:04:553
4577091260,6ptp4l441ktimers/322:34:553
4577091260,5ptp4l441ktimers/320:54:563
3263756992625,1cyclictest0-21swapper/321:46:593
3263756992624,1cyclictest0-21swapper/322:51:003
3263756992624,1cyclictest0-21swapper/300:22:593
326375699260,25cyclictest0-21swapper/321:57:593
326375699260,25cyclictest0-21swapper/321:57:583
3263755992623,2cyclictest0-21swapper/200:31:002
3263755992622,2cyclictest0-21swapper/223:30:592
3263755992622,2cyclictest0-21swapper/222:08:002
3263755992622,2cyclictest0-21swapper/200:11:002
326375599260,24cyclictest0-21swapper/222:16:592
326375599260,24cyclictest0-21swapper/221:57:592
326375599260,24cyclictest0-21swapper/221:57:592
326375599260,24cyclictest0-21swapper/220:49:552
326375599260,24cyclictest0-21swapper/219:10:102
4577091250,5ptp4l441ktimers/319:59:553
3263756992523,1cyclictest0-21swapper/322:11:593
3263756992523,1cyclictest0-21swapper/320:26:593
3263756992523,1cyclictest0-21swapper/300:30:593
326375699250,24cyclictest0-21swapper/322:42:593
326375699250,1cyclictest0-21swapper/300:17:593
3263755992521,2cyclictest0-21swapper/223:01:002
3263755992521,2cyclictest0-21swapper/222:45:592
3263755992521,2cyclictest0-21swapper/221:05:592
3263755992521,2cyclictest0-21swapper/219:55:592
3263755992521,2cyclictest0-21swapper/200:00:592
4577091240,4ptp4l441ktimers/319:29:563
3263755992421,2cyclictest0-21swapper/223:05:142
3263751992420,3cyclictest0-21swapper/019:10:010
3263755992220,1cyclictest0-21swapper/222:24:582
231999220,13rtkit-daemon495-21gpm19:08:451
3263755992018,1cyclictest0-21swapper/220:15:002
3263755991815,2cyclictest0-21swapper/219:44:582
3263755991814,2cyclictest0-21swapper/221:26:592
3263755991714,2cyclictest0-21swapper/220:50:032
32637559970,6cyclictest0-21swapper/223:26:092
32637559930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional