You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 12:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Apr 28, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
362074399115106,7cyclictest3630446-21latency_hist19:40:010
362074599109101,5cyclictest3616145-21kworker/u8:0+flush-179:019:45:001
36207439910196,4cyclictest3637061-21kworker/u8:1+events_unbound20:25:000
36207459910088,9cyclictest1213033-21systemd-journal23:00:011
3620743999488,5cyclictest3637061-21kworker/u8:1+events_unbound20:55:010
3620743999184,5cyclictest3637061-21kworker/u8:1+flush-179:020:55:240
3620745999082,6cyclictest3636810-21latency_hist20:00:011
3620745999081,6cyclictest3712687-21latency_hist23:55:011
3620743999081,6cyclictest3672580-21kworker/u8:1+flush-179:021:55:210
3620745998779,6cyclictest3639999-21latency_hist20:10:011
3620743998779,6cyclictest3704479-21latency_hist23:30:020
3620743998779,6cyclictest3616145-21kworker/u8:0+flush-179:019:50:000
3620743998577,6cyclictest3698150-21unin-run23:10:010
3620745998373,7cyclictest3665742-21kworker/u8:3+flush-179:022:15:001
3620745998372,9cyclictest3681879-21apt-get22:15:431
3620743998375,5cyclictest3619154-21kworker/u8:2+flush-179:019:10:140
3620743998375,5cyclictest3619154-21kworker/u8:2+flush-179:019:10:140
3620743998068,5cyclictest3637061-21kworker/u8:1+events_unbound20:30:010
3620743997972,5cyclictest3706046-21kworker/u8:3+events_unbound23:40:140
3620745997867,8cyclictest3641582-21latency_hist20:15:011
3620743997872,5cyclictest3644962-21kworker/u8:3+flush-179:020:40:250
3620745997765,8cyclictest1213033-21systemd-journal21:59:421
3620743997768,7cyclictest3702891-21latency_hist23:25:020
3620745997665,9cyclictest3653242-21apt-get20:50:091
3620745997567,6cyclictest3709517-21latency_hist23:45:011
3620743997568,5cyclictest3672580-21kworker/u8:1+events_unbound22:25:220
3620743997562,10cyclictest1213033-21systemd-journal21:50:010
3620743997469,3cyclictest3641616-21kworker/u8:2+flush-179:020:20:010
3620743997467,5cyclictest3665742-21kworker/u8:3+flush-179:021:35:260
3620743997466,6cyclictest3616145-21kworker/u8:0+flush-179:019:25:250
3620743997465,6cyclictest3644962-21kworker/u8:3+flush-179:020:35:140
3620745997365,5cyclictest3665720-21latency_hist21:30:011
3620745997363,7cyclictest3637061-21kworker/u8:1+flush-179:021:10:011
3620743997365,6cyclictest3632049-21latency_hist19:45:010
3620743997364,6cyclictest3637061-21kworker/u8:1+flush-179:020:45:210
3620743997358,11cyclictest3714276-40logrotate00:00:000
3620745997263,6cyclictest3678709-21latency_hist22:10:011
3620745997255,15cyclictest3714553-21/usr/sbin/munin00:00:171
3620743997264,6cyclictest3672580-21kworker/u8:1+flush-179:022:35:180
3620745997163,6cyclictest3717527-21latency_hist00:10:011
3620745997061,7cyclictest3706065-21latency_hist23:35:001
3620745997058,10cyclictest3662515-21kworker/u8:2+flush-179:021:35:011
3620743997064,4cyclictest3637061-21kworker/u8:1+flush-179:020:30:240
3620743997057,9cyclictest3707655-21latency_hist23:40:000
3620743996965,3cyclictest3637061-21kworker/u8:1+flush-179:020:05:260
3620743996761,5cyclictest3619154-21kworker/u8:2+events_unbound19:15:250
3620743996761,4cyclictest3616145-21kworker/u8:0+flush-179:020:00:240
3620745996647,17cyclictest3707945-21apt-key23:40:021
3620743996660,4cyclictest3717764-21kworker/u8:3+events_unbound00:10:190
3620743996654,9cyclictest1213033-21systemd-journal00:20:440
3620743996557,6cyclictest3694927-21latency_hist23:00:010
362074399651,61cyclictest1-21systemd19:59:430
3620745996456,6cyclictest3712924-21/usr/sbin/munin23:55:221
3620743996458,4cyclictest3702924-21kworker/u8:1+flush-179:023:30:210
3620745996356,5cyclictest3690200-21apt-key22:45:001
3620745996355,6cyclictest3701561-21apt-get23:20:121
3620743996357,4cyclictest3723618-21kworker/u8:2+events_unbound00:30:230
3620743996354,6cyclictest3693333-21latency_hist22:55:010
3620745996251,9cyclictest3637366-21diskstats20:00:161
3620743996257,4cyclictest3672580-21kworker/u8:1+flush-179:022:40:240
3620743996257,4cyclictest3659385-21kworker/u8:0+flush-179:021:10:250
3620750996159,1cyclictest0-21swapper/323:06:003
3620745996152,7cyclictest3633889-21apt-get19:50:111
3620743996155,4cyclictest3708167-21kworker/u8:2+events_unbound00:00:280
3620743996155,4cyclictest3698098-21kworker/u8:1+flush-179:023:10:140
3620743996155,4cyclictest3665742-21kworker/u8:3+flush-179:021:50:170
3620743996155,4cyclictest3665742-21kworker/u8:3+flush-179:021:50:160
3620743996154,5cyclictest3665742-21kworker/u8:3+flush-179:022:15:260
3620743996154,4cyclictest3725984-21kworker/u8:3+events_unbound00:35:240
3620745996051,7cyclictest3695195-21apt-get23:00:121
3620745996049,8cyclictest3699696-21latency_hist23:15:001
3620743996054,4cyclictest3715978-21kworker/u8:0+events_unbound00:05:190
3620743996053,5cyclictest3672580-21kworker/u8:1+flush-179:022:45:170
3620743996052,5cyclictest3665742-21kworker/u8:3+events_unbound22:10:190
3620745995947,10cyclictest3662784-21/usr/sbin/munin21:20:231
3620743995953,3cyclictest3672580-21kworker/u8:1+flush-179:022:00:150
3620743995950,7cyclictest3694946-21kworker/u8:3+flush-179:023:00:150
3620743995852,4cyclictest3637061-21kworker/u8:1+flush-179:021:05:210
3620743995851,5cyclictest3665742-21kworker/u8:3+events_unbound22:10:010
3620745995743,8cyclictest3665742-21kworker/u8:3+flush-179:021:35:221
3620745995734,20cyclictest3651402-21latency_hist20:45:011
3620743995751,4cyclictest3699685-21kworker/u8:0+events_unbound23:45:150
3620743995750,5cyclictest3672580-21kworker/u8:1+events_unbound22:30:240
3620743995743,11cyclictest3720708-21apt-get00:19:590
3620745995648,7cyclictest3637061-21kworker/u8:1+events_unbound20:50:001
3620743995650,4cyclictest3625467-21kworker/u8:3+events_unbound19:30:140
3620743995543,10cyclictest1213033-21systemd-journal21:34:420
3620745995446,6cyclictest3699685-21kworker/u8:0+flush-179:023:15:231
3620745995445,6cyclictest3725746-21latency_hist00:35:021
3620745995442,10cyclictest3637061-21kworker/u8:1+events_unbound21:00:171
3620743995345,6cyclictest3625423-21latency_hist19:25:010
3620743995143,6cyclictest3683540-21latency_hist22:25:000
3620743995143,6cyclictest3656416-21/usr/sbin/munin21:00:210
3620743995140,10cyclictest3628834-21kworker/u8:2+flush-179:019:50:200
4577091490,14ptp4l441ktimers/319:10:003
3620745994943,4cyclictest3668883-21kworker/u8:0+flush-179:021:45:231
3620745994939,8cyclictest3641819-21/usr/sbin/munin20:15:251
3620743994945,3cyclictest3723618-21kworker/u8:2+events_unbound00:27:580
3620745994840,6cyclictest1213033-21systemd-journal00:20:001
3620745994740,5cyclictest1213033-21systemd-journal23:27:501
3620745994738,7cyclictest1213033-21systemd-journal23:46:431
3620743994740,5cyclictest3706046-21kworker/u8:3+flush-179:023:50:150
362075099460,44cyclictest3702897-21turbostat23:25:013
3620745994638,6cyclictest3627524-21apt-get19:30:111
3620745994637,7cyclictest3616145-21kworker/u8:0+flush-179:019:35:221
3620743994642,3cyclictest3659385-21kworker/u8:0+events_unbound21:15:160
3620743994636,8cyclictest3640253-21apt-get20:10:120
3620745994539,5cyclictest3641616-21kworker/u8:2+flush-179:020:20:151
3620745994536,7cyclictest3685174-21kworker/u8:2+events_unbound22:40:001
3620743994541,3cyclictest3699685-21kworker/u8:0+events_unbound23:15:250
3620745994333,8cyclictest3685364-21/usr/sbin/munin22:30:231
3620743994337,4cyclictest3668883-21kworker/u8:0+flush-179:021:40:210
3620743994336,5cyclictest3662515-21kworker/u8:2+events_unbound21:25:130
3620750994234,6cyclictest3715954-21turbostat00:05:013
362075099420,41cyclictest0-21swapper/321:58:593
3620745994236,5cyclictest3694946-21kworker/u8:3+events_unbound23:10:001
3620745994236,5cyclictest3616145-21kworker/u8:0+flush-179:019:30:011
3620745994235,5cyclictest3714339-21kworker/u8:1+events_unbound00:20:141
3620745994135,4cyclictest3683537-21cron22:25:001
3620745994134,5cyclictest3672580-21kworker/u8:1+flush-179:022:00:171
362074599411,38cyclictest714-21Xorg21:17:591
3620750994035,4cyclictest3701303-21turbostat23:20:003
3620750994034,5cyclictest3681940-21turbostat22:20:003
362075099400,4cyclictest3725751-21turbostat00:35:003
362075099400,39cyclictest3678723-21turbostat22:10:003
3620745994038,1cyclictest0-21swapper/119:17:591
3620745993935,3cyclictest3637061-21kworker/u8:1+flush-179:020:30:141
3620745993932,5cyclictest3654826-21apt-get20:55:111
3620745993930,6cyclictest0-21swapper/119:10:591
3620745993930,6cyclictest0-21swapper/119:10:591
362075099380,37cyclictest3636811-21turbostat20:00:013
362074999380,36cyclictest0-21swapper/221:24:592
362074999380,35cyclictest0-21swapper/223:54:552
3620745993835,2cyclictest714-21Xorg00:26:591
3620743993835,2cyclictest1213033-21systemd-journal21:22:350
3620750993734,2cyclictest0-21swapper/322:28:593
3620750993734,2cyclictest0-21swapper/321:09:003
3620750993734,2cyclictest0-21swapper/319:12:003
3620750993734,2cyclictest0-21swapper/319:11:593
362075099370,36cyclictest3714282-21turbostat23:59:593
362075099370,34cyclictest0-21swapper/320:05:593
362075099370,1cyclictest0-21swapper/322:12:593
3620749993734,2cyclictest0-21swapper/222:45:592
3620749993733,2cyclictest0-21swapper/220:00:592
3620749993733,2cyclictest0-21swapper/200:34:552
3620749993733,2cyclictest0-21swapper/200:20:582
362074999370,35cyclictest0-21swapper/221:30:592
362074999370,35cyclictest0-21swapper/200:10:002
362074999370,2cyclictest0-21swapper/219:26:592
3620745993736,1cyclictest0-21swapper/119:45:591
3620745993732,4cyclictest3637061-21kworker/u8:1+flush-179:020:25:151
3620750993634,1cyclictest0-21swapper/320:52:593
3620750993634,1cyclictest0-21swapper/319:27:593
3620750993633,2cyclictest0-21swapper/323:51:583
3620750993633,2cyclictest0-21swapper/321:37:003
362075099360,35cyclictest0-21swapper/323:34:593
362075099360,35cyclictest0-21swapper/322:54:593
362075099360,35cyclictest0-21swapper/322:48:003
362075099360,35cyclictest0-21swapper/321:29:593
362075099360,35cyclictest0-21swapper/321:00:593
362075099360,35cyclictest0-21swapper/320:42:593
362075099360,35cyclictest0-21swapper/320:34:553
362075099360,35cyclictest0-21swapper/320:18:593
362075099360,35cyclictest0-21swapper/320:04:593
362075099360,35cyclictest0-21swapper/300:05:583
3620749993633,2cyclictest0-21swapper/221:47:592
362074999360,1cyclictest0-21swapper/200:25:592
3620750993533,1cyclictest0-21swapper/323:27:003
362075099350,34cyclictest0-21swapper/319:40:593
362075099350,1cyclictest0-21swapper/323:49:593
362074999350,1cyclictest0-21swapper/221:45:002
3620745993531,3cyclictest3670762-21munin-plugin-st21:44:591
3620745993530,4cyclictest3644962-21kworker/u8:3+flush-179:020:35:221
3620745993530,3cyclictest0-21swapper/122:45:011
3620745993529,5cyclictest3619154-21kworker/u8:2+events_unbound19:20:181
4577091340,3ptp4l441ktimers/300:35:593
3620750993432,1cyclictest0-21swapper/322:00:583
3620750993429,4cyclictest3722571-21turbostat00:25:003
3620749993431,2cyclictest0-21swapper/222:42:582
3620750993331,1cyclictest0-21swapper/321:34:553
3620749993330,2cyclictest0-21swapper/220:41:592
3620749993330,2cyclictest0-21swapper/219:55:592
3620749993330,2cyclictest0-21swapper/219:54:002
3620749993329,2cyclictest0-21swapper/223:49:562
3620745993327,5cyclictest3672580-21kworker/u8:1+flush-179:022:50:171
362074599331,29cyclictest0-21swapper/121:10:141
231999330,9rtkit-daemon1139113-21packagekitd19:06:060
3620750993229,2cyclictest0-21swapper/320:11:593
3620749993229,2cyclictest0-21swapper/223:09:552
3620749993229,2cyclictest0-21swapper/222:16:592
3620749993229,2cyclictest0-21swapper/221:04:542
3620745993226,5cyclictest3665742-21kworker/u8:3+flush-179:021:50:221
3620745993226,5cyclictest3665742-21kworker/u8:3+flush-179:021:50:221
3620745993225,5cyclictest3725984-21kworker/u8:3+flush-179:000:35:221
3620750993128,2cyclictest0-21swapper/322:56:583
3620749993128,2cyclictest0-21swapper/221:10:592
3620749993128,2cyclictest0-21swapper/200:17:592
3620749993128,2cyclictest0-21swapper/200:02:592
3620750993028,1cyclictest0-21swapper/320:36:593
3620749993027,2cyclictest0-21swapper/223:24:552
3620749993027,2cyclictest0-21swapper/222:29:582
362074999300,29cyclictest0-21swapper/219:20:122
362074999300,28cyclictest0-21swapper/220:35:592
3620750992927,1cyclictest0-21swapper/300:14:593
3620750992926,2cyclictest0-21swapper/323:40:033
3620750992926,2cyclictest0-21swapper/323:01:593
3620750992926,2cyclictest0-21swapper/319:30:123
362075099290,27cyclictest0-21swapper/320:45:143
362075099290,1cyclictest0-21swapper/320:55:123
362074999290,2cyclictest0-21swapper/222:05:122
362074999290,27cyclictest0-21swapper/222:35:112
362074999290,27cyclictest0-21swapper/222:20:132
362074999290,27cyclictest0-21swapper/221:50:142
362074999290,27cyclictest0-21swapper/221:50:132
362074999290,27cyclictest0-21swapper/220:55:132
362074999290,27cyclictest0-21swapper/219:35:132
362074999290,27cyclictest0-21swapper/219:15:162
362074999290,27cyclictest0-21swapper/200:00:012
3620745992925,3cyclictest3685252-21latency_hist22:30:011
3620745992922,5cyclictest3717764-21kworker/u8:3+flush-179:000:10:231
4577091280,7ptp4l441ktimers/319:40:003
4577091280,6ptp4l441ktimers/300:30:003
3620750992826,1cyclictest0-21swapper/322:30:143
3620750992826,1cyclictest0-21swapper/321:40:593
3620750992826,1cyclictest0-21swapper/320:25:143
3620750992825,2cyclictest0-21swapper/322:20:123
3620750992822,5cyclictest3623824-21turbostat19:20:003
362075099280,27cyclictest0-21swapper/321:50:143
362075099280,27cyclictest0-21swapper/321:50:133
362075099280,27cyclictest0-21swapper/319:47:003
362075099280,26cyclictest0-21swapper/300:20:013
3620749992825,2cyclictest0-21swapper/222:30:142
3620749992825,2cyclictest0-21swapper/221:36:592
3620749992825,2cyclictest0-21swapper/221:28:592
362074999280,2cyclictest0-21swapper/222:10:112
362074999280,27cyclictest0-21swapper/220:10:142
362074999280,27cyclictest0-21swapper/219:30:012
362074999280,26cyclictest0-21swapper/223:02:592
362074999280,26cyclictest0-21swapper/220:15:142
362074999280,26cyclictest0-21swapper/219:47:592
4577091270,6ptp4l441ktimers/323:40:003
4577091270,6ptp4l441ktimers/321:15:003
4577091270,6ptp4l441ktimers/320:24:593
4577091270,6ptp4l441ktimers/319:55:013
3620749992724,2cyclictest0-21swapper/222:59:002
3620749992724,2cyclictest0-21swapper/200:38:592
362074999270,25cyclictest0-21swapper/219:12:592
362074999270,25cyclictest0-21swapper/219:12:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-021:20:013
4577091260,5ptp4l441ktimers/321:50:013
4577091260,5ptp4l441ktimers/321:24:563
3620750992624,1cyclictest0-21swapper/322:41:583
362075099260,24cyclictest0-21swapper/323:10:133
3620749992624,1cyclictest0-21swapper/223:14:562
3620749992624,1cyclictest0-21swapper/221:10:002
3620749992623,2cyclictest0-21swapper/223:44:542
3620749992623,2cyclictest0-21swapper/223:26:592
3620749992623,2cyclictest0-21swapper/220:54:002
3620749992623,2cyclictest0-21swapper/200:13:592
362074999260,25cyclictest0-21swapper/223:35:592
362074999260,24cyclictest0-21swapper/220:07:592
4577091250,4ptp4l61490irq/134-eno1-TxRx-022:40:003
4577091250,4ptp4l441ktimers/319:24:553
3620749992523,1cyclictest0-21swapper/220:25:002
362074999250,2cyclictest0-21swapper/220:30:132
3620749992220,1cyclictest0-21swapper/223:32:002
3620745992113,6cyclictest3620814-21sed19:10:021
3620749991917,1cyclictest0-21swapper/220:29:582
3620749991916,2cyclictest0-21swapper/223:17:592
3620749991815,2cyclictest0-21swapper/221:18:592
3620749991412,1cyclictest0-21swapper/222:00:142
3620749991412,1cyclictest0-21swapper/220:48:592
362074999119,1cyclictest0-21swapper/221:58:592
36207499997,1cyclictest0-21swapper/219:40:592
36207499996,2cyclictest0-21swapper/222:53:232
36207499930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional