You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 11:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Thu Mar 12, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35761549910396,5cyclictest3616586-21kworker/u8:0+flush-179:021:20:000
35761549910393,7cyclictest3640741-21latency_hist22:30:010
35761589910191,7cyclictest3588787-21latency_hist19:50:021
3576154999785,9cyclictest3673254-21cp00:10:010
3576154999582,10cyclictest266-21systemd-journal00:25:010
3576154998778,6cyclictest3622976-21latency_hist21:35:000
3576154998478,4cyclictest3602526-21journal-offline20:30:180
3576158997766,8cyclictest3663274-21latency_hist23:40:011
3576158997668,6cyclictest3632532-21latency_hist22:05:001
3576154997568,5cyclictest3659835-21latency_hist23:30:010
3576158997466,6cyclictest3579252-21latency_hist19:20:001
3576158997155,13cyclictest266-21systemd-journal22:00:011
3576158997155,13cyclictest266-21systemd-journal22:00:011
3576154997161,7cyclictest3630929-21latency_hist22:00:020
3576154997161,7cyclictest3630929-21latency_hist22:00:010
3576158997062,5cyclictest3624576-21latency_hist21:40:011
3576158996960,7cyclictest3673141-21latency_hist00:10:001
3576154996861,5cyclictest3585669-21kworker/u8:0+flush-179:020:05:230
3576154996860,6cyclictest3583123-21kworker/u8:1+events_unbound19:35:010
3576154996758,6cyclictest266-21systemd-journal00:04:000
3576158996560,4cyclictest3636749-21kworker/u8:0+events_unbound22:30:001
3576158996533,4cyclictest3595165-21turbostat20:14:551
3576158996456,6cyclictest3661423-21latency_hist23:35:001
3576154996456,6cyclictest3647105-21latency_hist22:50:010
3576158996356,5cyclictest3624838-21apt-get21:40:121
3576158996351,10cyclictest3611337-21latency_hist21:00:021
3576154996252,7cyclictest3669927-40mandb00:00:010
3576158996139,19cyclictest3655311-21apt-get23:15:121
3576154996051,6cyclictest510-21rs:main0
3576158995950,7cyclictest3601562-21kworker/u8:2+events_unbound21:25:011
3576158995947,6cyclictest3601562-21kworker/u8:2+events_unbound21:00:191
3576158995945,11cyclictest266-21systemd-journal22:13:181
3576154995850,6cyclictest266-21systemd-journal19:59:590
3576158995754,2cyclictest3611827-21kworker/u8:1+events_unbound21:15:011
3576158995751,4cyclictest3588823-21kworker/u8:3+events_unbound20:20:251
3576158995748,6cyclictest3663246-21kworker/u8:0+flush-179:000:35:191
3576154995751,4cyclictest3626164-21cron21:45:000
3576154995750,5cyclictest3582421-21latency_hist19:30:020
3576154995649,5cyclictest3637309-21apt-get22:20:030
3576154995647,6cyclictest3585669-21kworker/u8:0+flush-179:019:40:200
3576158995447,5cyclictest3620601-21kworker/u8:1+events_unbound21:30:011
3576158995447,3cyclictest3588823-21kworker/u8:3+flush-179:019:50:211
3576158995423,6cyclictest0-21swapper/119:23:591
3576158995346,5cyclictest3642317-21kworker/u8:1+flush-179:022:35:001
3576158995343,7cyclictest3576031-21latency_hist19:10:021
3576154995348,4cyclictest3636749-21kworker/u8:0+flush-179:022:30:210
3576154995339,6cyclictest3588823-21kworker/u8:3+flush-179:020:15:260
3576159995249,2cyclictest0-21swapper/222:08:592
3576158995246,4cyclictest3663334-21kworker/u8:2+events_unbound00:04:011
3576158995244,6cyclictest3642317-21kworker/u8:1+events_unbound22:45:231
3576154995239,9cyclictest266-21systemd-journal23:50:180
3576158995141,7cyclictest266-21systemd-journal23:55:021
3576154995145,4cyclictest3601550-21kworker/u8:1+events_unbound20:35:230
3576154995144,5cyclictest3579797-21diskstats19:20:120
3576154995143,6cyclictest3561218-21kworker/u8:2+flush-179:019:10:160
3576154995141,8cyclictest266-21systemd-journal22:05:000
4577091500,14ptp4l441ktimers/319:10:003
3576158995045,3cyclictest3656921-21kworker/u8:1+events_unbound23:25:221
3576161994947,1cyclictest0-21swapper/321:25:593
3576158994942,5cyclictest3620601-21kworker/u8:1+flush-179:022:05:221
3576158994941,6cyclictest3654189-21kworker/u8:1+flush-179:023:10:211
3576158994939,6cyclictest3570232-21kworker/u8:0+flush-179:019:25:201
3576158994843,4cyclictest3588823-21kworker/u8:3+flush-179:019:59:551
3576158994843,3cyclictest3647085-21kworker/u8:3+events_unbound22:55:181
3576158994839,6cyclictest3595152-21latency_hist20:10:021
3576154994843,4cyclictest0-21swapper/019:46:000
3576154994837,9cyclictest3678204-21kworker/u8:4+flush-179:000:30:200
3576158994742,4cyclictest3588823-21kworker/u8:3+flush-179:020:25:231
357615899470,45cyclictest714-21Xorg22:40:591
3576154994737,8cyclictest3660091-21apt-get23:30:110
3576154994711,33cyclictest0-21swapper/020:20:130
3576158994640,5cyclictest3663246-21kworker/u8:0+flush-179:000:25:181
3576158994639,5cyclictest3601550-21kworker/u8:1+flush-179:020:35:211
3576158994634,10cyclictest3585669-21kworker/u8:0+events_unbound19:40:151
3576154994610,33cyclictest0-21swapper/021:20:130
357616199450,44cyclictest3630927-21turbostat22:00:013
357616199450,44cyclictest3630927-21turbostat22:00:003
3576158994536,6cyclictest3663246-21kworker/u8:0+events_unbound23:40:131
3576158994534,8cyclictest3585669-21kworker/u8:0+flush-179:020:05:011
3576158994530,12cyclictest3663246-21kworker/u8:0+flush-179:000:20:011
3576154994539,4cyclictest3607892-21apt-get20:50:020
3576161994439,4cyclictest3663286-21turbostat23:39:593
3576161994438,5cyclictest3683213-21turbostat00:40:013
357615999440,41cyclictest0-21swapper/222:47:592
3576158994439,4cyclictest3601562-21kworker/u8:2+events_unbound22:15:191
3576158994439,4cyclictest3601562-21kworker/u8:2+events_unbound22:15:191
3576158994437,5cyclictest3583123-21kworker/u8:1+flush-179:019:39:591
3576158994433,9cyclictest3678196-21ls00:25:011
3576154994438,5cyclictest3637323-21kworker/u8:3+events_unbound22:20:010
3576154994438,5cyclictest3637323-21kworker/u8:3+events_unbound22:20:010
357615999430,2cyclictest0-21swapper/219:37:592
3576158994337,5cyclictest3570232-21kworker/u8:0+flush-179:019:30:161
3576154994337,4cyclictest3665131-21apt-get23:45:150
3576154994235,5cyclictest3585669-21kworker/u8:0+flush-179:020:10:230
357616199410,39cyclictest3596741-21turbostat20:15:013
3576158994137,2cyclictest3644172-21kworker/u8:2+events_unbound23:05:231
3576158994134,5cyclictest3601562-21kworker/u8:2+flush-179:021:15:251
3576154994136,3cyclictest3613192-21awk21:05:010
357615499411,3cyclictest3616354-21apt21:15:000
3576158994032,6cyclictest3668044-21latency_hist23:55:011
357616199390,3cyclictest3584016-21turbostat19:35:003
357616199390,38cyclictest3614772-21turbostat21:09:593
357616199390,38cyclictest3587216-21turbostat19:45:003
357615999390,1cyclictest0-21swapper/221:19:552
3576158993930,6cyclictest3647085-21kworker/u8:3+flush-179:022:50:211
357615899390,37cyclictest714-21Xorg21:05:591
3576154993932,5cyclictest3655055-21latency_hist23:15:010
3576154993932,5cyclictest3644173-21/usr/sbin/munin22:40:180
3576161993831,5cyclictest3648698-21turbostat22:55:003
357615999380,36cyclictest0-21swapper/221:36:592
357615999380,35cyclictest0-21swapper/221:45:592
357615999380,35cyclictest0-21swapper/219:29:552
3576158993829,7cyclictest3678204-21kworker/u8:4+events_unbound00:30:191
3576158993828,6cyclictest0-21swapper/121:52:001
357615899380,37cyclictest0-21swapper/123:04:551
3576154993835,2cyclictest714-21Xorg19:18:000
3576154993833,4cyclictest3609961-21/usr/sbin/munin20:55:140
3576154993827,9cyclictest3593584-21awk20:05:000
357615499380,2cyclictest0-21swapper/021:50:590
3576161993732,4cyclictest3645529-21turbostat22:45:003
3576161993731,5cyclictest3658259-21turbostat23:25:003
357616199370,35cyclictest0-21swapper/321:01:003
3576159993734,2cyclictest0-21swapper/223:23:592
357615999370,35cyclictest0-21swapper/221:27:002
357615899373,5cyclictest0-21swapper/121:30:041
3576158993731,5cyclictest3601562-21kworker/u8:2+flush-179:021:45:231
3576154993733,3cyclictest1-21systemd23:39:590
3576154993733,3cyclictest1-21systemd21:30:010
357615499371,7cyclictest2379109-21munin-node22:55:110
3576161993634,1cyclictest0-21swapper/323:09:553
3576161993634,1cyclictest0-21swapper/322:14:563
357616199360,35cyclictest0-21swapper/323:18:593
357616199360,35cyclictest0-21swapper/322:30:593
357616199360,35cyclictest0-21swapper/322:19:553
357616199360,35cyclictest0-21swapper/322:19:553
357615999360,1cyclictest0-21swapper/223:54:002
357615999360,1cyclictest0-21swapper/219:54:562
3576158993624,9cyclictest3656921-21kworker/u8:1+events_unbound23:20:141
3576154993632,3cyclictest3614770-21cron21:09:590
3576154993628,6cyclictest3626405-21/usr/sbin/munin21:45:160
3576161993533,1cyclictest0-21swapper/323:59:543
3576161993533,1cyclictest0-21swapper/321:51:593
357616199350,34cyclictest0-21swapper/323:27:593
357616199350,1cyclictest0-21swapper/321:13:593
3576159993533,1cyclictest0-21swapper/220:49:592
357615899351,6cyclictest57850irq/129-enp2s0-TxRx-000:10:131
3576154993532,2cyclictest0-21swapper/022:08:590
3576161993432,1cyclictest0-21swapper/300:01:593
3576161993429,4cyclictest3588794-21turbostat19:50:013
3576159993431,2cyclictest0-21swapper/221:01:582
3576158993429,4cyclictest3601562-21kworker/u8:2+flush-179:020:50:211
3576158993426,6cyclictest3601772-21apt20:30:111
357615899341,30cyclictest0-21swapper/122:20:031
3576154993431,2cyclictest714-21Xorg22:52:590
3576154993427,5cyclictest3673634-21apt-get00:10:010
3576154993411,11cyclictest266-21systemd-journal23:15:570
3576161993331,1cyclictest0-21swapper/322:35:593
3576161993331,1cyclictest0-21swapper/320:19:583
3576161993327,5cyclictest3651889-21turbostat23:05:003
357615899331,28cyclictest0-21swapper/120:15:151
3576154993329,3cyclictest3653593-21latency_hist23:10:010
3576154993329,2cyclictest714-21Xorg20:42:000
3576154993327,5cyclictest3679136-21hwlatdetect00:25:190
357615499331,29cyclictest3663545-21apt-get23:40:120
3576154993311,9cyclictest3584011-21turbostat.cron19:39:550
3576161993230,1cyclictest0-21swapper/323:53:003
3576159993229,2cyclictest0-21swapper/223:32:592
3576159993229,2cyclictest0-21swapper/220:50:592
3576158993229,2cyclictest0-21swapper/123:46:591
3576158993228,2cyclictest714-21Xorg19:15:001
3576158993226,5cyclictest3601550-21kworker/u8:1+flush-179:020:40:271
3576154993228,3cyclictest0-21swapper/023:25:000
3576154993226,4cyclictest3624747-21latency_hist21:40:010
3576154993223,7cyclictest3589044-21apt-get19:50:110
3576161993129,1cyclictest0-21swapper/320:59:593
357616199310,30cyclictest0-21swapper/320:44:563
357615999310,29cyclictest0-21swapper/223:35:022
357615999310,29cyclictest0-21swapper/223:25:122
357615999310,29cyclictest0-21swapper/222:20:012
357615999310,29cyclictest0-21swapper/200:25:152
3576154993128,2cyclictest714-21Xorg20:28:000
3576154993127,3cyclictest484-21dbus-daemon23:05:000
3576154993123,6cyclictest3606533-21/usr/sbin/munin20:45:170
4577091300,7ptp4l441ktimers/322:30:003
4577091300,6ptp4l441ktimers/320:10:013
3576161993028,1cyclictest0-21swapper/323:43:593
3576161993028,1cyclictest0-21swapper/321:24:563
357616199300,28cyclictest0-21swapper/319:35:113
3576159993028,1cyclictest0-21swapper/220:44:592
3576159993028,1cyclictest0-21swapper/200:20:012
3576159993027,2cyclictest0-21swapper/220:22:582
3576159993027,2cyclictest0-21swapper/219:22:592
357615999300,2cyclictest0-21swapper/220:04:542
357615999300,28cyclictest0-21swapper/223:13:592
3576158993024,5cyclictest3606279-21kworker/u8:0+flush-179:020:45:201
4577091290,7ptp4l61490irq/134-eno1-TxRx-000:10:003
4577091290,7ptp4l441ktimers/300:35:003
4577091290,6ptp4l441ktimers/319:15:013
3576161992927,1cyclictest0-21swapper/320:21:583
3576161992926,2cyclictest0-21swapper/322:45:133
3576161992926,2cyclictest0-21swapper/321:30:023
3576161992923,5cyclictest3579260-21turbostat19:20:013
357616199290,27cyclictest0-21swapper/300:25:033
3576159992927,1cyclictest0-21swapper/222:40:002
3576159992926,2cyclictest0-21swapper/222:30:122
3576159992926,2cyclictest0-21swapper/222:25:132
3576159992926,2cyclictest0-21swapper/221:10:132
3576159992926,2cyclictest0-21swapper/219:10:112
3576159992925,2cyclictest0-21swapper/222:20:022
3576159992925,2cyclictest0-21swapper/222:20:012
357615999290,27cyclictest0-21swapper/223:45:142
357615999290,27cyclictest0-21swapper/223:15:142
357615999290,27cyclictest0-21swapper/223:05:122
357615999290,27cyclictest0-21swapper/221:55:152
357615999290,27cyclictest0-21swapper/221:55:142
357615999290,27cyclictest0-21swapper/221:00:012
357615999290,27cyclictest0-21swapper/220:35:122
357615999290,27cyclictest0-21swapper/220:08:582
357615999290,1cyclictest0-21swapper/220:10:142
3576158992925,3cyclictest3643914-21sendmail22:40:011
3576154992925,3cyclictest3674992-21turbostat00:19:550
3576154992911,5cyclictest3683256-21true00:40:010
4577091280,7ptp4l61490irq/134-eno1-TxRx-019:29:563
4577091280,7ptp4l441ktimers/323:14:553
4577091280,7ptp4l441ktimers/320:34:553
4577091280,6ptp4l61490irq/134-eno1-TxRx-019:55:013
4577091280,5ptp4l441ktimers/319:25:003
3576161992827,1cyclictest0-21swapper/320:35:123
3576161992826,1cyclictest0-21swapper/323:34:553
3576161992826,1cyclictest0-21swapper/322:57:593
3576161992825,2cyclictest0-21swapper/320:45:133
3576161992825,2cyclictest0-21swapper/300:24:593
357616199280,27cyclictest0-21swapper/322:08:593
357616199280,27cyclictest0-21swapper/320:50:013
3576159992826,1cyclictest0-21swapper/220:20:002
3576159992825,2cyclictest0-21swapper/223:55:122
3576159992825,2cyclictest0-21swapper/221:30:012
357615999280,2cyclictest0-21swapper/222:55:112
357615999280,26cyclictest0-21swapper/219:45:132
357615999280,26cyclictest0-21swapper/219:30:112
4577091270,6ptp4l61490irq/134-eno1-TxRx-023:50:013
4577091270,4ptp4l441ktimers/321:40:003
4577091270,4ptp4l441ktimers/321:19:553
357616199270,26cyclictest0-21swapper/320:00:133
357616199270,1cyclictest0-21swapper/300:15:133
3576159992724,2cyclictest0-21swapper/222:01:592
3576159992724,2cyclictest0-21swapper/200:39:002
3576159992724,2cyclictest0-21swapper/200:14:592
3576154992716,10cyclictest3635566-21unixbench-2d22:10:250
4577091260,6ptp4l61490irq/134-eno1-TxRx-022:24:563
4577091260,5ptp4l61490irq/134-eno1-TxRx-021:49:563
4577091260,5ptp4l61490irq/134-eno1-TxRx-000:15:013
4577091260,5ptp4l441ktimers/320:29:563
4577091260,4ptp4l441ktimers/322:04:563
3576159992623,2cyclictest0-21swapper/222:42:592
3576159992623,2cyclictest0-21swapper/221:41:592
3576159992623,2cyclictest0-21swapper/221:21:592
3576159992623,2cyclictest0-21swapper/219:40:592
3576159992622,2cyclictest0-21swapper/221:51:592
4577091250,5ptp4l61490irq/134-eno1-TxRx-021:45:013
4577091250,4ptp4l441ktimers/319:59:553
3576159992523,1cyclictest0-21swapper/200:10:002
357615999250,2cyclictest0-21swapper/219:19:002
3576159992421,2cyclictest0-21swapper/221:05:142
3576159992320,2cyclictest0-21swapper/200:23:592
3576154992315,6cyclictest3576262-21cat19:10:010
3576159992219,2cyclictest0-21swapper/223:02:592
3576159992219,2cyclictest0-21swapper/222:10:592
3576159992118,2cyclictest0-21swapper/220:31:002
3576159991916,2cyclictest0-21swapper/219:55:592
3576159991715,1cyclictest0-21swapper/200:00:582
3576159991714,1cyclictest0-21swapper/220:26:592
3576159991310,2cyclictest0-21swapper/223:42:592
357615999107,2cyclictest0-21swapper/200:33:592
35761599985,2cyclictest0-21swapper/222:50:382
35761599920,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional