You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 07:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Thu Apr 02, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306451499110104,5cyclictest3134934-21kworker/u8:0+flush-179:000:04:021
30645149910698,6cyclictest3154062-21apt-get23:50:041
30645139910192,7cyclictest3082190-21latency_hist20:05:010
30645139910190,8cyclictest266-21systemd-journal00:03:590
3064514999690,4cyclictest3142372-21kworker/u8:1+flush-179:023:25:201
3064514999386,5cyclictest3122269-21kworker/u8:2+events_unbound22:20:251
3064514999382,8cyclictest3134934-21kworker/u8:0+events_unbound00:05:191
3064513999083,5cyclictest3167090-21latency_hist00:30:020
3064514998980,6cyclictest3082426-21kworker/u8:0+events_unbound20:05:211
3064514998980,6cyclictest3078996-21latency_hist19:55:021
3064514998676,5cyclictest3134934-21kworker/u8:0+events_unbound22:55:241
3064514998480,3cyclictest3134934-21kworker/u8:0+flush-179:023:20:231
3064514998480,3cyclictest3134934-21kworker/u8:0+flush-179:023:20:221
3064514998477,6cyclictest3086932-21kworker/u8:3+events_unbound20:20:231
3064514998476,6cyclictest3096506-21latency_hist20:50:011
3064514998378,4cyclictest3052081-21kworker/u8:2+events_unbound19:25:131
3064514998378,3cyclictest3091719-21kworker/u8:0+flush-179:021:00:201
3064514998277,4cyclictest3122269-21kworker/u8:2+flush-179:022:15:261
3064514998276,4cyclictest3147718-21kworker/u8:3+events_unbound23:35:141
3064514998176,4cyclictest3155876-21kworker/u8:3+events_unbound00:10:201
3064514998076,3cyclictest3091719-21kworker/u8:0+events_unbound20:40:241
3064514998075,4cyclictest3095646-21kworker/u8:1+events_unbound20:50:221
3064514998073,5cyclictest3134934-21kworker/u8:0+events_unbound23:40:191
3064514997975,3cyclictest3091719-21kworker/u8:0+flush-179:021:15:211
3064514997973,4cyclictest3052081-21kworker/u8:2+events_unbound19:30:201
3064514997969,4cyclictest3115842-21kworker/u8:0+events_unbound22:00:231
3064514997672,3cyclictest3155876-21kworker/u8:3+flush-179:000:35:221
3064514997670,4cyclictest3160762-21kworker/u8:2+flush-179:000:20:201
3064513997666,7cyclictest266-21systemd-journal23:30:000
3064514997570,4cyclictest3119089-21kworker/u8:3+flush-179:022:25:211
3064514997569,4cyclictest3119089-21kworker/u8:3+events_unbound23:05:201
3064514997569,4cyclictest3088591-21kworker/u8:2+events_unbound20:25:141
3064514997468,5cyclictest3102905-21kworker/u8:2+flush-179:021:40:261
3064514997468,4cyclictest3160762-21kworker/u8:2+flush-179:000:15:221
3064513997463,8cyclictest510-21rs:main0
3064513997462,10cyclictest3157523-40mandb00:00:010
3064514997367,4cyclictest3115842-21kworker/u8:0+events_unbound21:55:211
3064513997365,6cyclictest3077411-21latency_hist19:50:000
3064513997362,9cyclictest3114025-21apt-get21:45:000
3064514997267,4cyclictest3160762-21kworker/u8:2+events_unbound00:25:161
3064514997267,4cyclictest3069190-21kworker/u8:1+events_unbound19:45:251
3064514997266,4cyclictest3142372-21kworker/u8:1+events_unbound23:45:131
3064514997264,5cyclictest3131819-21kworker/u8:1+events_unbound22:40:161
3064514997263,6cyclictest3130177-21latency_hist22:35:011
3064514997166,4cyclictest3115842-21kworker/u8:0+flush-179:021:50:261
3064514997166,3cyclictest3091719-21kworker/u8:0+flush-179:021:20:211
3064514997165,5cyclictest3139768-21kworker/u8:2+events_unbound23:10:181
3064514997164,5cyclictest3128626-21kworker/u8:2+events_unbound22:39:591
3064513997163,6cyclictest3094921-21latency_hist20:45:010
3064514997065,4cyclictest3085342-21kworker/u8:1+events_unbound20:30:241
3064514996962,5cyclictest3091719-21kworker/u8:0+flush-179:021:05:201
3064513996961,6cyclictest3099955-21apt-get21:00:120
3064514996763,3cyclictest3110810-21kworker/u8:1+flush-179:022:05:251
3064514996762,4cyclictest3052081-21kworker/u8:2+events_unbound20:10:201
3064514996761,4cyclictest3091719-21kworker/u8:0+events_unbound21:25:141
3064513996756,9cyclictest3133625-21apt-get22:45:110
3064513996656,8cyclictest3132040-21apt-get22:40:110
3064513996655,9cyclictest3114529-21apt-get21:45:110
3064513996655,9cyclictest266-21systemd-journal20:25:000
3064514996459,4cyclictest3065953-21kworker/u8:0+flush-179:019:15:251
3064514996459,3cyclictest3110810-21kworker/u8:1+flush-179:022:10:211
3064514996457,6cyclictest3065953-21kworker/u8:0+events_unbound19:15:001
3064514996358,4cyclictest3091719-21kworker/u8:0+flush-179:020:35:261
3064514996357,4cyclictest3052081-21kworker/u8:2+events_unbound19:20:121
3064514996258,3cyclictest3091719-21kworker/u8:0+events_unbound21:10:191
3064514996257,4cyclictest3074040-21kworker/u8:3+flush-179:020:00:211
3064513996254,5cyclictest3134934-21kworker/u8:0+flush-179:000:05:210
3064513996253,6cyclictest510-21rs:main0
3064514996157,3cyclictest3119089-21kworker/u8:3+events_unbound22:50:241
3064514996157,3cyclictest3091719-21kworker/u8:0+flush-179:020:55:221
3064514996157,3cyclictest3052081-21kworker/u8:2+flush-179:020:15:201
3064514996154,5cyclictest266-21systemd-journal21:34:261
3064513996156,3cyclictest3077427-21kworker/u8:0+events_unbound19:55:260
3064513996153,6cyclictest3170296-21latency_hist00:40:010
3064514996055,4cyclictest3134934-21kworker/u8:0+events_unbound23:05:001
3064514996055,4cyclictest3131819-21kworker/u8:1+events_unbound22:45:251
3064513995950,7cyclictest3139768-21kworker/u8:2+flush-179:023:10:010
3064514995854,3cyclictest3102905-21kworker/u8:2+flush-179:021:39:551
3064514995854,3cyclictest3102905-21kworker/u8:2+events_unbound21:45:181
3064513995844,8cyclictest266-21systemd-journal20:30:260
3064513995750,5cyclictest3085361-21latency_hist20:15:010
3064514995551,3cyclictest3142372-21kworker/u8:1+flush-179:023:15:221
3064514995442,10cyclictest3157523-40mandb00:00:011
3064513995448,4cyclictest3102905-21kworker/u8:2+flush-179:021:30:260
3064513995447,5cyclictest3070790-21latency_hist19:30:000
3064514995348,4cyclictest3052081-21kworker/u8:2+flush-179:019:35:241
3064513995347,5cyclictest3098108-21turbostat20:59:540
3064514995247,4cyclictest3074040-21kworker/u8:3+events_unbound19:55:191
3064514995247,4cyclictest3069190-21kworker/u8:1+events_unbound19:40:221
3064513995143,6cyclictest3066249-21/usr/sbin/munin19:15:220
4577091500,13ptp4l61490irq/134-eno1-TxRx-019:10:013
3064513995040,8cyclictest3167346-21apt-get00:30:120
3064513995040,8cyclictest3167346-21apt-get00:30:120
3064514994944,4cyclictest3142372-21kworker/u8:1+events_unbound23:30:241
3064513994944,3cyclictest3074078-21apt-key19:40:010
3064513994811,36cyclictest714-21Xorg21:26:590
3064513994740,5cyclictest3102871-21latency_hist21:10:010
3064513994739,6cyclictest3124046-21/usr/sbin/munin22:15:180
306451399471,44cyclictest3112431-21munin-run21:40:000
3064514994640,4cyclictest3155876-21kworker/u8:3+flush-179:000:30:131
3064514994640,4cyclictest3155876-21kworker/u8:3+flush-179:000:30:121
3064513994637,7cyclictest0-21swapper/021:20:130
3064513994539,5cyclictest3085342-21kworker/u8:1+flush-179:020:20:000
3064513994538,5cyclictest3069190-21kworker/u8:1+flush-179:019:35:000
306451399450,43cyclictest714-21Xorg20:49:000
306452099440,43cyclictest3117462-21turbostat21:55:003
306451699442,40cyclictest0-21swapper/220:59:542
306451699440,41cyclictest0-21swapper/220:48:592
306451399449,32cyclictest0-21swapper/023:40:110
3064513994434,8cyclictest3144768-21apt-get23:20:110
3064513994434,8cyclictest3144768-21apt-get23:20:110
3064513994433,6cyclictest0-21swapper/023:47:000
3064513994433,6cyclictest0-21swapper/019:43:590
306451699430,41cyclictest0-21swapper/223:24:592
306451699430,41cyclictest0-21swapper/223:24:582
3064513994334,7cyclictest3120878-21/usr/sbin/munin22:05:180
3064516994239,2cyclictest0-21swapper/222:55:012
3064513994239,2cyclictest0-21swapper/023:01:590
306451399420,33cyclictest714-21Xorg19:12:590
3064513994135,4cyclictest3131815-21systemd-run22:40:000
3064513994128,10cyclictest3105421-21needreboot21:15:210
3064513994127,11cyclictest3125674-21apt-get22:20:140
3064520994038,1cyclictest0-21swapper/320:41:583
3064520994038,1cyclictest0-21swapper/319:15:583
3064516994038,1cyclictest0-21swapper/223:40:002
3064516994037,2cyclictest0-21swapper/223:01:592
306451399409,4cyclictest0-21swapper/022:03:590
3064513994033,5cyclictest3128630-21systemd-run22:30:010
306451399401,3cyclictest3069211-21grep19:25:000
306451399400,38cyclictest714-21Xorg20:25:590
306451399400,38cyclictest714-21Xorg20:09:590
3064520993937,1cyclictest0-21swapper/321:02:593
3064520993936,1cyclictest0-21swapper/320:24:553
306452099390,38cyclictest3146102-21turbostat23:25:013
306452099390,38cyclictest3146102-21turbostat23:25:013
3064516993934,2cyclictest0-21swapper/221:12:592
306451699390,2cyclictest0-21swapper/219:13:002
3064514993933,4cyclictest3064399-21latency_hist19:10:011
3064513993936,2cyclictest0-21swapper/021:12:590
3064513993930,6cyclictest3142372-21kworker/u8:1+flush-179:023:15:220
306451399390,2cyclictest0-21swapper/022:34:590
306452099381,36cyclictest67-21kworker/3:1+events23:38:593
306451699380,35cyclictest0-21swapper/219:55:002
3064513993833,3cyclictest3150876-21perf23:40:000
3064513993829,7cyclictest266-21systemd-journal00:19:590
3064513993812,11cyclictest3155188-21grep23:50:190
306451399380,2cyclictest0-21swapper/023:13:590
3064520993735,1cyclictest0-21swapper/321:43:593
306452099370,36cyclictest0-21swapper/321:33:593
306452099370,1cyclictest0-21swapper/300:35:593
3064516993734,2cyclictest0-21swapper/223:30:592
3064516993734,2cyclictest0-21swapper/222:01:592
306451699370,35cyclictest0-21swapper/223:41:592
306451699370,35cyclictest0-21swapper/222:34:592
306451699370,35cyclictest0-21swapper/220:25:592
306451699370,35cyclictest0-21swapper/220:09:592
306451699370,35cyclictest0-21swapper/200:34:592
306451699370,35cyclictest0-21swapper/200:34:582
3064513993734,2cyclictest0-21swapper/019:51:590
3064513993732,3cyclictest3123825-21ls22:15:000
3064520993634,1cyclictest0-21swapper/323:42:583
3064520993634,1cyclictest0-21swapper/300:29:003
3064520993634,1cyclictest0-21swapper/300:10:593
306452099360,35cyclictest0-21swapper/323:14:593
306452099360,35cyclictest0-21swapper/322:54:593
306452099360,35cyclictest0-21swapper/322:36:003
306452099360,35cyclictest0-21swapper/321:24:593
306452099360,35cyclictest0-21swapper/321:17:593
306452099360,35cyclictest0-21swapper/321:06:593
306452099360,35cyclictest0-21swapper/320:56:583
306452099360,35cyclictest0-21swapper/320:32:003
306452099360,35cyclictest0-21swapper/320:28:583
306452099360,35cyclictest0-21swapper/320:11:003
306452099360,35cyclictest0-21swapper/300:16:593
306452099360,1cyclictest0-21swapper/322:06:593
3064516993634,1cyclictest0-21swapper/219:35:002
3064513993631,3cyclictest3162327-21perf00:15:000
3064513993631,3cyclictest3138124-21sendmail23:00:000
3064513993627,5cyclictest0-21swapper/020:35:130
306451399361,6cyclictest0-21swapper/021:55:130
3064520993533,1cyclictest0-21swapper/323:27:583
3064520993533,1cyclictest0-21swapper/323:09:593
3064520993533,1cyclictest0-21swapper/321:49:593
3064520993533,1cyclictest0-21swapper/319:29:003
306452099350,1cyclictest0-21swapper/322:32:593
306452099350,1cyclictest0-21swapper/321:57:593
3064516993532,2cyclictest0-21swapper/221:30:002
3064516993532,2cyclictest0-21swapper/219:27:002
3064516993532,2cyclictest0-21swapper/200:05:582
3064520993432,1cyclictest0-21swapper/323:33:003
3064520993432,1cyclictest0-21swapper/322:58:593
3064520993432,1cyclictest0-21swapper/322:47:593
3064520993432,1cyclictest0-21swapper/319:49:593
3064520993432,1cyclictest0-21swapper/319:30:583
3064516993431,2cyclictest0-21swapper/219:43:002
306451699340,2cyclictest0-21swapper/223:13:592
3064520993331,1cyclictest0-21swapper/322:01:593
3064520993331,1cyclictest0-21swapper/321:37:593
3064520993331,1cyclictest0-21swapper/321:25:593
3064520993331,1cyclictest0-21swapper/319:43:003
3064520993331,1cyclictest0-21swapper/300:33:583
3064520993331,1cyclictest0-21swapper/300:33:583
3064520993331,1cyclictest0-21swapper/300:00:003
3064516993330,2cyclictest0-21swapper/221:47:592
306451399339,8cyclictest0-21swapper/000:20:220
3064520993230,1cyclictest0-21swapper/322:23:003
3064520993230,1cyclictest0-21swapper/300:23:593
306452099320,2cyclictest0-21swapper/320:36:593
3064516993230,1cyclictest0-21swapper/222:15:002
3064516993230,1cyclictest0-21swapper/221:35:002
3064516993230,1cyclictest0-21swapper/219:24:592
3064516993229,2cyclictest0-21swapper/223:55:592
3064516993229,2cyclictest0-21swapper/222:45:112
3064516993229,2cyclictest0-21swapper/221:40:132
306451699320,30cyclictest0-21swapper/200:11:592
306451699320,29cyclictest0-21swapper/221:55:132
3064520993129,1cyclictest0-21swapper/322:25:583
3064516993129,1cyclictest0-21swapper/223:00:002
3064516993128,2cyclictest0-21swapper/221:00:592
3064516993128,2cyclictest0-21swapper/220:21:592
3064516993128,2cyclictest0-21swapper/200:00:132
3064516993127,2cyclictest0-21swapper/222:17:592
306451699310,2cyclictest0-21swapper/200:25:102
306451699310,28cyclictest0-21swapper/221:05:122
306451699310,27cyclictest0-21swapper/220:15:132
3064513993110,8cyclictest0-21swapper/021:50:250
4577091300,7ptp4l441ktimers/320:00:013
4577091300,6ptp4l441ktimers/322:15:003
306452099300,2cyclictest3160732-21turbostat00:10:003
306452099300,28cyclictest0-21swapper/323:50:033
3064516993028,1cyclictest0-21swapper/220:00:002
3064516993026,2cyclictest0-21swapper/220:34:592
306451699300,27cyclictest0-21swapper/200:35:122
306451699300,21cyclictest0-21swapper/220:35:142
3064513993019,7cyclictest714-21Xorg20:54:590
4577091290,7ptp4l441ktimers/323:50:003
4577091290,6ptp4l441ktimers/323:05:013
4577091290,6ptp4l441ktimers/320:09:593
3064520992927,1cyclictest0-21swapper/320:45:123
3064520992927,1cyclictest0-21swapper/319:53:593
3064520992926,2cyclictest0-21swapper/323:16:583
306452099290,27cyclictest0-21swapper/322:15:143
306452099290,27cyclictest0-21swapper/320:00:133
3064516992926,2cyclictest0-21swapper/223:07:592
3064516992926,2cyclictest0-21swapper/222:20:142
3064516992926,2cyclictest0-21swapper/220:10:112
306451699290,27cyclictest0-21swapper/222:40:132
306451699290,27cyclictest0-21swapper/221:20:132
306451699290,27cyclictest0-21swapper/219:18:582
4577091280,6ptp4l441ktimers/319:24:563
3064520992826,1cyclictest0-21swapper/319:13:593
3064520992826,1cyclictest0-21swapper/300:04:583
3064516992825,2cyclictest0-21swapper/223:29:562
4577091270,6ptp4l61490irq/134-eno1-TxRx-019:40:013
4577091270,6ptp4l441ktimers/320:54:563
4577091270,5ptp4l441ktimers/320:19:563
3064516992725,1cyclictest0-21swapper/200:24:582
3064516992724,2cyclictest0-21swapper/220:04:002
4577091260,5ptp4l441ktimers/322:44:593
4577091260,4ptp4l61490irq/134-eno1-TxRx-021:15:013
3064516992623,2cyclictest0-21swapper/220:53:002
3064516992523,1cyclictest0-21swapper/219:40:002
3064516992522,2cyclictest0-21swapper/222:08:002
3064516992522,2cyclictest0-21swapper/219:49:002
306451699250,2cyclictest0-21swapper/200:19:002
306451699250,18cyclictest0-21swapper/222:28:592
3064516992320,2cyclictest0-21swapper/223:19:002
3064516992220,1cyclictest0-21swapper/222:39:592
231999220,12rtkit-daemon495-21gpm19:05:280
3064516992118,2cyclictest0-21swapper/220:41:582
3064516992018,1cyclictest0-21swapper/223:49:592
3064516992017,2cyclictest0-21swapper/221:51:592
3064516991916,2cyclictest0-21swapper/223:50:122
3064516991815,2cyclictest0-21swapper/221:18:592
306451699139,3cyclictest0-21swapper/221:37:592
30645169964,1cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional