You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 18:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sat Mar 21, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6245719911697,5cyclictest266-21systemd-journal09:19:590
6245739910191,7cyclictest700307-21latency_hist11:05:021
6245739910191,7cyclictest627633-21latency_hist07:20:011
6245739910085,12cyclictest701904-21apt-get11:10:001
624573999989,7cyclictest266-21systemd-journal08:05:001
624571999585,7cyclictest716454-21kworker/u8:0+events_unbound11:55:000
624571999488,4cyclictest690483-21kworker/u8:2+events_unbound11:00:000
624571998777,8cyclictest643832-21latency_hist08:10:010
624571998678,6cyclictest664511-21latency_hist09:15:010
624571998675,8cyclictest703737-21latency_hist11:15:010
62457199860,84cyclictest1-21systemd08:59:590
624571998575,7cyclictest711697-21latency_hist11:40:010
624573998373,7cyclictest674590-21latency_hist09:45:001
624571998275,5cyclictest678396-21kworker/u8:0+flush-179:010:10:230
624571998168,10cyclictest266-21systemd-journal08:20:010
624573997970,6cyclictest724477-21kworker/u8:0+events_unbound12:20:001
624573997869,7cyclictest650200-21latency_hist08:30:011
624571997668,6cyclictest624429-21latency_hist07:10:020
62457199760,75cyclictest0-21swapper/011:32:590
624571997569,4cyclictest721238-21kworker/u8:2+events_unbound12:25:010
624573997365,6cyclictest632382-21kworker/u8:2+flush-179:007:50:011
624571997364,7cyclictest698755-21kworker/u8:1+flush-179:011:15:190
624571997267,3cyclictest721238-21kworker/u8:2+flush-179:012:35:230
624571997264,6cyclictest635867-21kworker/u8:1+flush-179:007:55:010
624573997167,3cyclictest624520-21kworker/u8:1+flush-179:007:35:211
624573997166,3cyclictest680953-21latency_hist10:05:011
624573997063,5cyclictest656565-21latency_hist08:50:021
624573996962,5cyclictest3985583-21kworker/u8:4+events_unbound07:15:011
624573996962,5cyclictest3985583-21kworker/u8:4+events_unbound07:15:011
624571996764,2cyclictest1-21systemd12:00:000
624571996761,4cyclictest669540-21kworker/u8:1+flush-179:009:45:240
624571996659,5cyclictest647079-21kworker/u8:3+flush-179:008:30:210
624571996650,5cyclictest688374-21kworker/u8:3+events_unbound10:35:010
624573996558,5cyclictest662928-21latency_hist09:10:001
624573996557,6cyclictest651785-21latency_hist08:35:001
624573996552,10cyclictest632406-21latency_hist07:35:011
624571996561,3cyclictest624520-21kworker/u8:1+flush-179:007:24:550
624571996559,4cyclictest727711-21kworker/u8:3+flush-179:012:30:210
624571996556,6cyclictest635883-21latency_hist07:45:010
624573996427,22cyclictest671652-21apt-get09:35:111
624573996427,22cyclictest671652-21apt-get09:35:101
624571996460,3cyclictest698755-21kworker/u8:1+flush-179:012:15:230
624571996457,5cyclictest659725-21kworker/u8:0+events_unbound09:05:240
624571996454,7cyclictest266-21systemd-journal09:55:010
624571996354,7cyclictest678396-21kworker/u8:0+flush-179:010:15:200
624571996255,5cyclictest659725-21kworker/u8:0+flush-179:009:25:230
624573996153,6cyclictest635867-21kworker/u8:1+flush-179:008:15:211
624571996155,4cyclictest649678-21kworker/u8:1+events_unbound08:40:140
624571996053,5cyclictest682523-21kworker/u8:1+flush-179:010:20:220
624571995953,5cyclictest659725-21kworker/u8:0+flush-179:009:20:250
624571995850,6cyclictest669540-21kworker/u8:1+flush-179:009:35:230
624571995850,6cyclictest669540-21kworker/u8:1+flush-179:009:35:230
624571995750,4cyclictest698755-21kworker/u8:1+events_unbound11:10:020
624573995647,7cyclictest729253-21latency_hist12:35:011
624571995651,4cyclictest632382-21kworker/u8:2+flush-179:007:55:250
624571995649,5cyclictest632382-21kworker/u8:2+flush-179:008:25:150
624571995646,6cyclictest721238-21kworker/u8:2+flush-179:012:25:140
624571995644,9cyclictest266-21systemd-journal10:55:000
624571995548,5cyclictest698755-21kworker/u8:1+flush-179:012:05:150
624571995548,5cyclictest698755-21kworker/u8:1+flush-179:012:05:150
624571995548,5cyclictest624520-21kworker/u8:1+flush-179:007:10:160
624571995548,5cyclictest624520-21kworker/u8:1+flush-179:007:10:150
624571995544,9cyclictest266-21systemd-journal10:10:000
624573995447,5cyclictest701872-21kworker/u8:2+flush-179:011:25:221
624573995442,9cyclictest667706-21latency_hist09:25:011
624571995449,4cyclictest647066-21kworker/u8:0+flush-179:008:20:250
624573995345,6cyclictest718332-21apt-get12:00:111
62457399533,34cyclictest679523-21cat10:00:011
624571995348,3cyclictest698755-21kworker/u8:1+flush-179:011:40:190
624571995347,4cyclictest676168-21kworker/u8:3+flush-179:010:00:200
624571995241,9cyclictest266-21systemd-journal11:25:000
624573995145,4cyclictest693978-21kworker/u8:3+flush-179:010:50:231
624573995144,5cyclictest510-21rs:main1
624571995142,7cyclictest659725-21kworker/u8:0+flush-179:009:30:200
624577995047,2cyclictest0-21swapper/207:40:592
624573995041,7cyclictest677759-21latency_hist09:55:011
624571995040,4cyclictest669540-21kworker/u8:1+events_unbound09:40:220
624573994942,6cyclictest702389-21/usr/sbin/munin11:10:231
62457399491,33cyclictest714-21Xorg09:27:581
4577091490,14ptp4l61490irq/134-eno1-TxRx-007:10:003
624573994827,19cyclictest0-21swapper/112:40:001
624571994830,15cyclictest266-21systemd-journal11:50:000
624573994742,4cyclictest682523-21kworker/u8:1+flush-179:010:15:211
624573994738,7cyclictest629234-21latency_hist07:25:011
624571994741,5cyclictest656610-21kworker/u8:3+flush-179:009:00:200
624571994739,6cyclictest693943-21latency_hist10:45:010
624571994731,14cyclictest632382-21kworker/u8:2+flush-179:008:10:210
624573994640,5cyclictest710361-21apt-get11:35:131
62457399460,42cyclictest671530-21dpkg09:35:021
624571994642,3cyclictest698755-21kworker/u8:1+flush-179:012:00:240
624571994641,4cyclictest628198-21kworker/u8:0+events_unbound07:30:230
624573994525,18cyclictest0-21swapper/112:25:481
62457399452,38cyclictest656820-21apt-get08:50:131
624571994541,3cyclictest673050-21kworker/u8:2+events_unbound09:55:180
624571994539,5cyclictest649678-21kworker/u8:1+flush-179:008:45:250
624573994435,7cyclictest688374-21kworker/u8:3+flush-179:010:35:021
624573994425,17cyclictest705928-21fschecks_count11:20:151
624577994340,2cyclictest0-21swapper/210:23:582
624573994313,1cyclictest0-21swapper/110:34:591
624571994339,3cyclictest685187-21kworker/u8:2+flush-179:010:25:160
624582994239,2cyclictest0-21swapper/307:16:593
624573994235,6cyclictest669540-21kworker/u8:1+flush-179:009:50:011
624573994232,8cyclictest635867-21kworker/u8:1+flush-179:008:05:161
624571994237,4cyclictest632382-21kworker/u8:2+flush-179:007:45:210
624571994234,7cyclictest698755-21kworker/u8:1+events_unbound12:15:000
624573994137,3cyclictest680967-21turbostat10:09:561
624573994135,4cyclictest698755-21kworker/u8:1+flush-179:012:00:011
624573994131,9cyclictest690483-21kworker/u8:2+flush-179:010:55:171
624573994120,19cyclictest0-21swapper/111:15:241
62457399411,11cyclictest653648-21apt-get08:40:141
62457399410,40cyclictest721253-21turbostat12:14:551
62457399410,39cyclictest726048-21basename12:25:001
62458299400,39cyclictest692347-21turbostat10:40:003
62457399401,37cyclictest714-21Xorg09:02:591
62457399401,11cyclictest692612-21apt-get10:40:131
624571994036,3cyclictest714-21Xorg08:35:590
624571994036,3cyclictest690483-21kworker/u8:2+events_unbound10:45:180
624571994034,5cyclictest3985583-21kworker/u8:4+flush-179:007:15:240
624573993935,3cyclictest632382-21kworker/u8:2+flush-179:007:58:511
624573993934,3cyclictest630853-21true07:30:001
624573993933,5cyclictest682523-21kworker/u8:1+flush-179:010:30:011
624573993930,7cyclictest678396-21kworker/u8:0+flush-179:010:10:201
624573993930,5cyclictest0-21swapper/108:59:591
62457399391,4cyclictest639057-21/usr/sbin/munin07:55:011
62457399390,37cyclictest714-21Xorg12:06:591
62457399390,37cyclictest714-21Xorg12:06:591
624571993934,4cyclictest701872-21kworker/u8:2+flush-179:011:25:270
62458299380,36cyclictest637478-21turbostat07:50:003
62458299380,35cyclictest0-21swapper/312:30:593
624577993835,2cyclictest0-21swapper/212:16:592
62457799380,35cyclictest0-21swapper/212:13:592
62457799380,35cyclictest0-21swapper/210:27:592
624573993834,2cyclictest714-21Xorg11:40:591
624571993833,4cyclictest691006-21apt-get10:35:100
624571993829,7cyclictest629472-21/usr/sbin/munin07:25:170
624577993734,2cyclictest0-21swapper/211:25:592
624577993734,2cyclictest0-21swapper/208:42:592
62457799370,35cyclictest0-21swapper/208:24:562
62457799370,1cyclictest0-21swapper/209:20:002
624573993726,8cyclictest653391-21latency_hist08:40:011
624571993727,8cyclictest632419-21apt-get07:35:020
624582993634,1cyclictest0-21swapper/308:57:583
624582993633,2cyclictest0-21swapper/311:38:593
62458299360,35cyclictest0-21swapper/310:26:583
624577993634,1cyclictest0-21swapper/211:59:592
624577993634,1cyclictest0-21swapper/207:19:592
624577993633,2cyclictest0-21swapper/208:54:562
624573993629,6cyclictest663183-21apt-get09:10:101
62457399361,33cyclictest665471-21strings09:15:181
62458299350,34cyclictest0-21swapper/308:41:583
62458299350,1cyclictest0-21swapper/311:55:593
62458299350,1cyclictest0-21swapper/307:56:003
62457799350,1cyclictest0-21swapper/210:47:592
624573993530,3cyclictest0-21swapper/110:45:121
624573993516,18cyclictest714302-21ntp_kernel_err11:45:191
62457399350,30cyclictest715140-21apt-get11:50:131
624571993527,6cyclictest698958-21/usr/sbin/munin11:00:220
624582993432,1cyclictest0-21swapper/309:55:593
624582993432,1cyclictest0-21swapper/307:14:553
624582993432,1cyclictest0-21swapper/307:14:553
624582993431,2cyclictest0-21swapper/308:01:583
624577993431,2cyclictest0-21swapper/210:59:562
624577993431,2cyclictest0-21swapper/209:35:592
624577993431,2cyclictest0-21swapper/209:35:592
62457399341,8cyclictest686723-21ntp_192.168.11410:20:221
624571993425,5cyclictest0-21swapper/008:55:000
4577091340,6ptp4l441ktimers/311:50:003
624582993331,1cyclictest0-21swapper/310:51:003
624582993330,2cyclictest0-21swapper/309:42:593
624577993331,1cyclictest0-21swapper/210:39:592
62457399331,30cyclictest0-21swapper/108:20:131
624582993230,1cyclictest0-21swapper/312:29:593
624577993229,2cyclictest0-21swapper/207:33:582
62457399324,25cyclictest714-21Xorg08:12:591
624582993129,1cyclictest0-21swapper/311:31:593
624582993129,1cyclictest0-21swapper/310:08:583
624582993128,2cyclictest0-21swapper/311:24:593
624577993128,2cyclictest0-21swapper/212:03:592
624577993128,2cyclictest0-21swapper/211:39:552
624577993128,2cyclictest0-21swapper/211:08:582
62457799310,29cyclictest0-21swapper/207:25:592
62457399318,21cyclictest708955-21expr11:30:121
624582993028,1cyclictest0-21swapper/311:30:003
624582993028,1cyclictest0-21swapper/310:31:003
624582993028,1cyclictest0-21swapper/308:22:593
62458299300,28cyclictest0-21swapper/312:05:123
62458299300,28cyclictest0-21swapper/312:05:123
624577993028,1cyclictest0-21swapper/212:25:592
624577993028,1cyclictest0-21swapper/209:30:592
624577993027,2cyclictest0-21swapper/208:00:132
62457799300,2cyclictest0-21swapper/211:20:132
62457799300,28cyclictest0-21swapper/208:10:132
624571993026,3cyclictest635867-21kworker/u8:1+flush-179:008:02:290
4577091300,7ptp4l441ktimers/308:40:013
624582992928,1cyclictest0-21swapper/307:39:593
624582992926,2cyclictest0-21swapper/309:30:133
62458299290,27cyclictest0-21swapper/308:10:123
62458299290,1cyclictest0-21swapper/309:20:123
624577992926,2cyclictest0-21swapper/211:00:122
624577992926,2cyclictest0-21swapper/210:00:142
62457799290,27cyclictest0-21swapper/211:50:122
62457799290,27cyclictest0-21swapper/210:40:122
62457799290,27cyclictest0-21swapper/210:10:112
62457799290,27cyclictest0-21swapper/210:05:122
62457799290,27cyclictest0-21swapper/209:55:152
62457799290,27cyclictest0-21swapper/209:20:112
62457799290,27cyclictest0-21swapper/208:15:112
4577091290,6ptp4l441ktimers/307:45:003
624582992826,1cyclictest0-21swapper/311:10:023
624582992826,1cyclictest0-21swapper/311:00:123
624582992826,1cyclictest0-21swapper/309:13:593
624582992825,2cyclictest0-21swapper/307:25:133
62458299280,2cyclictest0-21swapper/308:25:143
62458299280,27cyclictest0-21swapper/310:10:123
62458299280,26cyclictest0-21swapper/310:40:123
62458299280,26cyclictest0-21swapper/309:25:033
62458299280,26cyclictest0-21swapper/309:00:123
624577992825,2cyclictest0-21swapper/211:30:122
624577992825,2cyclictest0-21swapper/211:10:042
624577992825,2cyclictest0-21swapper/207:49:552
62457799280,26cyclictest0-21swapper/210:30:132
62457799280,26cyclictest0-21swapper/209:00:112
62457799280,25cyclictest0-21swapper/209:09:552
4577091280,7ptp4l61490irq/134-eno1-TxRx-009:54:563
4577091280,7ptp4l441ktimers/309:40:013
4577091280,7ptp4l441ktimers/309:40:003
4577091280,6ptp4l441ktimers/308:49:563
4577091280,5ptp4l441ktimers/308:10:003
4577091280,4ptp4l441ktimers/310:49:563
4577091280,4ptp4l441ktimers/309:10:013
624582992725,1cyclictest0-21swapper/307:30:143
624577992725,1cyclictest0-21swapper/207:11:592
624577992725,1cyclictest0-21swapper/207:11:592
624577992724,2cyclictest0-21swapper/209:44:592
62457799270,24cyclictest0-21swapper/209:50:002
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:24:553
4577091270,6ptp4l441ktimers/310:05:003
4577091270,5ptp4l61490irq/134-eno1-TxRx-012:05:003
62458299260,1cyclictest0-21swapper/311:06:003
624577992624,1cyclictest0-21swapper/211:19:592
624577992623,2cyclictest0-21swapper/210:19:002
624577992623,2cyclictest0-21swapper/208:38:002
624577992623,2cyclictest0-21swapper/207:21:592
62457799260,24cyclictest0-21swapper/209:10:132
62457799260,24cyclictest0-21swapper/207:59:552
62457399260,7cyclictest624671-21cat07:10:021
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:59:593
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:25:003
4577091260,5ptp4l441ktimers/311:44:593
4577091260,5ptp4l441ktimers/311:20:003
4577091260,4ptp4l441ktimers/312:39:563
4577091260,4ptp4l441ktimers/312:15:003
624582992522,2cyclictest0-21swapper/308:50:133
62458299250,2cyclictest0-21swapper/308:34:593
62458299250,24cyclictest0-21swapper/307:52:593
624577992523,1cyclictest0-21swapper/208:32:592
624577992522,1cyclictest0-21swapper/209:26:592
62457799250,2cyclictest0-21swapper/207:53:592
62457799250,2cyclictest0-21swapper/207:37:592
4577091250,5ptp4l61490irq/134-eno1-TxRx-009:50:003
4577091250,4ptp4l61490irq/134-eno1-TxRx-009:19:553
4577091250,4ptp4l441ktimers/312:19:553
4577091250,4ptp4l441ktimers/307:24:553
624577992421,2cyclictest0-21swapper/210:52:582
4577091240,4ptp4l441ktimers/311:54:553
4577091240,4ptp4l441ktimers/310:20:003
4577091240,4ptp4l441ktimers/308:19:553
624577992320,2cyclictest0-21swapper/211:47:592
624577992220,1cyclictest0-21swapper/212:21:592
624577992219,2cyclictest0-21swapper/212:06:592
624577992219,2cyclictest0-21swapper/212:06:592
624577992219,2cyclictest0-21swapper/209:54:542
624577992218,2cyclictest0-21swapper/208:45:582
624577992017,2cyclictest0-21swapper/211:42:592
624577991916,2cyclictest351rcuc/212:39:562
624577991614,1cyclictest0-21swapper/208:06:592
624577991613,2cyclictest0-21swapper/208:27:582
62457799119,1cyclictest0-21swapper/212:33:002
6245779970,6cyclictest0-21swapper/208:59:202
6245779931,1cyclictest71-21kworker/2:1-mm_percpu_wq07:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional