You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 04:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Fri Dec 26, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
430133999691,4cyclictest462773-21kworker/u8:0+events_unbound21:00:001
430133999685,8cyclictest519309-21latency_hist23:45:011
430132999481,11cyclictest448452-21/usr/sbin/munin20:05:220
430133999058,25cyclictest0-21swapper/120:11:591
430133998783,3cyclictest520879-21kworker/u8:0+events_unbound23:55:241
430133998782,4cyclictest449847-21kworker/u8:3+events_unbound20:25:251
430140998651,32cyclictest0-21swapper/320:11:583
430133998677,3cyclictest502836-21kworker/u8:1+events_unbound23:00:221
430133998478,5cyclictest514504-21kworker/u8:0+events_unbound23:35:021
430133998452,31cyclictest0-21swapper/120:34:591
430133998378,4cyclictest428275-21kworker/u8:3+events_unbound19:45:231
430132998272,7cyclictest476866-21latency_hist21:35:010
430133998176,4cyclictest514505-21kworker/u8:3+events_unbound23:50:271
430132997966,11cyclictest446347-21apt-get20:00:000
430133997873,4cyclictest493350-21kworker/u8:0+events_unbound22:45:251
430132997769,6cyclictest470494-21latency_hist21:15:010
430140997543,30cyclictest0-21swapper/320:35:003
430132997567,6cyclictest520895-21latency_hist23:50:010
430133997464,4cyclictest467342-21kworker/u8:4+events_unbound21:25:181
430132997164,4cyclictest520879-21kworker/u8:0+flush-179:000:00:000
430132997154,15cyclictest464379-21apt-get20:55:140
430133997060,7cyclictest512680-21latency_hist23:25:011
430133996965,3cyclictest460365-21kworker/u8:1+events_unbound20:45:181
430133996964,4cyclictest455594-21kworker/u8:0+events_unbound20:40:201
430133996963,4cyclictest480095-21kworker/u8:3+events_unbound21:50:141
430132996958,8cyclictest439968-21kworker/u8:1+flush-179:019:50:210
430133996863,4cyclictest436769-21kworker/u8:1+events_unbound19:30:141
430132996849,16cyclictest514266-21latency_hist23:30:010
430133996662,3cyclictest444800-21kworker/u8:2+events_unbound20:20:241
430133996661,4cyclictest488259-21kworker/u8:3+flush-179:022:10:211
430133996551,11cyclictest507647-21apt-get23:10:001
430133996452,10cyclictest515856-21latency_hist23:35:011
430132996454,7cyclictest527618-21kworker/u8:1+flush-179:000:10:230
430133996358,4cyclictest489905-21kworker/u8:2+flush-179:022:20:041
430133996358,4cyclictest462773-21kworker/u8:0+events_unbound21:05:161
430133996353,8cyclictest526234-21/usr/sbin/munin00:05:281
430133996258,3cyclictest473652-21kworker/u8:2+events_unbound21:36:191
430133996157,3cyclictest439968-21kworker/u8:1+flush-179:019:58:191
430133996156,4cyclictest480095-21kworker/u8:3+events_unbound22:00:261
430133996154,5cyclictest524607-21kworker/u8:3+flush-179:000:03:591
430133996056,3cyclictest434177-21kworker/u8:1+events_unbound19:20:171
430133996055,4cyclictest428275-21kworker/u8:3+flush-179:019:50:251
430132996050,8cyclictest480315-21apt-get21:45:130
430133995953,4cyclictest439968-21kworker/u8:1+flush-179:020:00:261
430132995953,4cyclictest489905-21kworker/u8:2+flush-179:022:15:150
430132995950,7cyclictest462793-21apt-get20:50:130
430132995949,8cyclictest515866-21apt-get23:35:000
430133995854,3cyclictest489849-21kworker/u8:1+events_unbound22:35:211
430133995853,4cyclictest486407-21kworker/u8:2+events_unbound22:05:171
430133995853,4cyclictest473652-21kworker/u8:2+events_unbound21:40:161
430133995753,3cyclictest532910-21kworker/u8:1+flush-179:000:35:191
430132995750,5cyclictest444800-21kworker/u8:2+flush-179:020:40:000
430133995651,4cyclictest489849-21kworker/u8:1+events_unbound22:30:191
430133995646,7cyclictest266-21systemd-journal19:44:591
430132995650,4cyclictest488259-21kworker/u8:3+flush-179:022:10:250
430132995646,7cyclictest489905-21kworker/u8:2+flush-179:022:25:220
430133995551,3cyclictest467342-21kworker/u8:4+events_unbound21:17:591
430133995551,3cyclictest426853-21kworker/u8:0+events_unbound19:25:181
430133995551,3cyclictest426853-21kworker/u8:0+events_unbound19:25:181
430133995550,4cyclictest467342-21kworker/u8:4+flush-179:021:24:561
430133995550,4cyclictest462774-21kworker/u8:3+events_unbound21:02:591
430132995547,6cyclictest478728-21apt-get21:40:110
430132995427,5cyclictest496744-21apt-get22:35:130
430133995348,4cyclictest509528-21kworker/u8:0+flush-179:023:19:561
430133995348,4cyclictest502836-21kworker/u8:1+events_unbound23:10:191
430132995332,19cyclictest462539-21munin-plugin-st20:50:000
430133995248,3cyclictest527618-21kworker/u8:1+flush-179:000:14:561
430133995248,3cyclictest462773-21kworker/u8:0+events_unbound20:53:171
430133995247,4cyclictest489849-21kworker/u8:1+flush-179:022:15:281
430132995246,4cyclictest527575-21kworker/u8:0+flush-179:000:20:000
430132995245,5cyclictest509482-21latency_hist23:15:010
430133995147,3cyclictest498829-21kworker/u8:2+flush-179:022:55:261
430133995146,4cyclictest444800-21kworker/u8:2+events_unbound20:35:161
430132995123,5cyclictest0-21swapper/019:17:580
430133995046,3cyclictest514505-21kworker/u8:3+events_unbound23:46:181
430133995046,3cyclictest498829-21kworker/u8:2+flush-179:022:44:551
430132995045,4cyclictest493350-21kworker/u8:0+flush-179:022:50:190
4577091490,13ptp4l61490irq/134-eno1-TxRx-019:10:013
430135994946,2cyclictest0-21swapper/220:31:582
430133994945,3cyclictest493350-21kworker/u8:0+events_unbound22:50:271
430133994945,3cyclictest480095-21kworker/u8:3+events_unbound21:49:181
430132994945,3cyclictest444800-21kworker/u8:2+flush-179:020:01:000
430132994944,4cyclictest486-21NetworkManager00:04:000
430132994941,6cyclictest472074-21kworker/u8:1+events_unbound21:20:000
430133994844,3cyclictest473652-21kworker/u8:2+events_unbound21:34:191
430133994843,4cyclictest444800-21kworker/u8:2+flush-179:020:15:261
430133994843,4cyclictest444800-21kworker/u8:2+flush-179:020:15:251
430132994740,5cyclictest530814-21kworker/u8:2+flush-179:000:40:000
430133994640,5cyclictest529426-21apt-get00:15:131
430132994638,6cyclictest436769-21kworker/u8:1+events_unbound19:30:000
430132994638,6cyclictest436769-21kworker/u8:1+events_unbound19:30:000
430132994636,8cyclictest467342-21kworker/u8:4+events_unbound21:20:240
43013299461,42cyclictest714-21Xorg21:51:590
430132994538,5cyclictest514505-21kworker/u8:3+events_unbound23:40:190
430133994440,3cyclictest438366-21kworker/u8:0+events_unbound19:39:181
430132994439,4cyclictest522534-21kworker/u8:2+flush-179:000:05:320
430132994439,3cyclictest440003-21munin-run19:40:000
430132994438,4cyclictest489905-21kworker/u8:2+flush-179:022:20:180
430132994436,5cyclictest462774-21kworker/u8:3+flush-179:021:00:220
430132994433,9cyclictest266-21systemd-journal19:30:170
430133994339,3cyclictest532910-21kworker/u8:1+events_unbound00:28:181
430133994238,3cyclictest489849-21kworker/u8:1+flush-179:022:29:561
430132994239,2cyclictest714-21Xorg23:08:590
430132994237,3cyclictest506054-21munin-run23:05:000
430132994234,6cyclictest462773-21kworker/u8:0+events_unbound21:05:240
430132994233,7cyclictest266-21systemd-journal21:40:000
430133994137,3cyclictest449781-21kworker/u8:1+events_unbound20:08:181
430132994131,8cyclictest451642-21apt-get20:15:150
430132994131,8cyclictest451642-21apt-get20:15:150
430140994033,6cyclictest436812-21turbostat19:30:003
430140994033,6cyclictest436812-21turbostat19:30:003
430135994037,2cyclictest0-21swapper/223:38:592
430135994037,2cyclictest0-21swapper/220:18:592
430135994037,2cyclictest0-21swapper/220:18:582
430133994031,7cyclictest431760-21latency_hist19:15:011
430132994033,4cyclictest714-21Xorg22:30:590
430132994030,8cyclictest516370-21apt-get23:35:120
430132994030,6cyclictest0-21swapper/022:59:590
43014099390,38cyclictest467336-21turbostat21:05:003
430135993936,2cyclictest0-21swapper/200:38:592
430133993934,4cyclictest532910-21kworker/u8:1+events_unbound00:30:211
430132993928,8cyclictest510-21rs:main0
43013599380,36cyclictest0-21swapper/220:52:592
43013599380,35cyclictest0-21swapper/222:55:002
43013599380,35cyclictest0-21swapper/222:33:592
43013599380,35cyclictest0-21swapper/221:06:592
43013599380,35cyclictest0-21swapper/219:35:002
430133993834,3cyclictest467342-21kworker/u8:4+events_unbound21:11:181
430133993833,4cyclictest462773-21kworker/u8:0+events_unbound21:56:181
430132993833,3cyclictest455594-21kworker/u8:0+events_unbound20:35:010
430132993827,8cyclictest527575-21kworker/u8:0+flush-179:000:20:160
43014099370,36cyclictest0-21swapper/323:48:593
430135993734,2cyclictest0-21swapper/222:50:012
430135993734,2cyclictest0-21swapper/222:14:002
430135993733,2cyclictest0-21swapper/200:10:002
43013599370,35cyclictest0-21swapper/223:24:592
43013599370,35cyclictest0-21swapper/221:11:592
43013599370,35cyclictest0-21swapper/200:24:582
430133993733,3cyclictest527575-21kworker/u8:0+events_unbound00:24:181
430133993732,4cyclictest513645-21needreboot23:25:201
430132993733,2cyclictest522491-21apt-get23:55:000
430132993730,5cyclictest462773-21kworker/u8:0+flush-179:021:55:250
430132993728,6cyclictest480095-21kworker/u8:3+flush-179:022:00:170
430132993727,6cyclictest0-21swapper/020:26:590
430140993634,1cyclictest0-21swapper/321:33:003
430140993631,4cyclictest441593-21turbostat19:49:553
43014099360,35cyclictest0-21swapper/323:41:593
43014099360,35cyclictest0-21swapper/319:39:003
43014099360,35cyclictest0-21swapper/300:23:003
430135993634,1cyclictest0-21swapper/222:04:592
430135993633,2cyclictest0-21swapper/219:56:582
430132993633,2cyclictest714-21Xorg20:22:590
430132993631,4cyclictest530814-21kworker/u8:2+events_unbound00:25:250
430132993631,3cyclictest714-21Xorg19:42:590
430132993631,3cyclictest428275-21kworker/u8:3+events_unbound19:10:040
430140993533,1cyclictest0-21swapper/323:37:593
430140993532,2cyclictest0-21swapper/319:57:593
43014099350,34cyclictest0-21swapper/323:22:593
43014099350,1cyclictest0-21swapper/322:48:593
430135993533,1cyclictest0-21swapper/221:59:592
430135993532,2cyclictest0-21swapper/223:15:592
430135993532,2cyclictest0-21swapper/223:00:592
430135993532,2cyclictest0-21swapper/220:55:592
430132993532,2cyclictest0-21swapper/023:23:580
430132993531,3cyclictest434321-21hwlatdetect19:20:170
430132993529,4cyclictest462773-21kworker/u8:0+flush-179:021:30:010
43013299351,32cyclictest714-21Xorg19:45:580
430140993432,1cyclictest0-21swapper/323:59:553
430140993432,1cyclictest0-21swapper/322:52:593
430140993432,1cyclictest0-21swapper/322:19:553
430132993429,3cyclictest501270-21cron22:50:000
430140993331,1cyclictest0-21swapper/322:09:593
430140993331,1cyclictest0-21swapper/320:17:593
430140993331,1cyclictest0-21swapper/320:17:593
43014099330,1cyclictest0-21swapper/320:37:003
430135993330,2cyclictest0-21swapper/223:09:002
430135993330,2cyclictest0-21swapper/221:49:542
430135993330,2cyclictest0-21swapper/200:11:592
430135993329,2cyclictest0-21swapper/200:18:592
430132993325,5cyclictest0-21swapper/000:30:130
43013299331,29cyclictest0-21swapper/020:10:150
430140993230,1cyclictest0-21swapper/322:23:593
430140993230,1cyclictest0-21swapper/322:02:593
430140993230,1cyclictest0-21swapper/321:19:543
430140993230,1cyclictest0-21swapper/320:29:553
430140993230,1cyclictest0-21swapper/320:08:593
430140993230,1cyclictest0-21swapper/300:09:593
430140993229,2cyclictest0-21swapper/322:56:593
430140993229,2cyclictest0-21swapper/320:54:003
430135993230,1cyclictest0-21swapper/223:30:012
430135993230,1cyclictest0-21swapper/222:39:582
430135993229,2cyclictest0-21swapper/222:15:592
430133993227,4cyclictest428275-21kworker/u8:3+events_unbound19:17:401
430132993229,2cyclictest0-21swapper/022:42:000
430140993129,1cyclictest0-21swapper/319:54:553
430140993129,1cyclictest0-21swapper/300:37:593
43014099310,29cyclictest0-21swapper/319:40:143
430135993128,2cyclictest0-21swapper/223:47:592
430140993028,1cyclictest0-21swapper/320:01:593
430140993027,2cyclictest0-21swapper/323:04:563
430135993028,1cyclictest0-21swapper/220:25:592
430135993027,2cyclictest0-21swapper/222:40:582
430135993027,2cyclictest0-21swapper/222:20:022
430135993027,2cyclictest0-21swapper/221:40:132
43013599300,29cyclictest0-21swapper/222:25:142
43013599300,29cyclictest0-21swapper/219:20:122
43013599300,28cyclictest0-21swapper/200:30:132
430132993021,5cyclictest0-21swapper/023:18:590
430140992927,1cyclictest0-21swapper/322:40:133
430140992926,2cyclictest0-21swapper/321:52:593
43014099290,28cyclictest0-21swapper/319:10:133
430135992926,2cyclictest0-21swapper/223:53:592
430135992926,2cyclictest0-21swapper/220:20:132
43013599290,27cyclictest0-21swapper/223:10:022
43013599290,27cyclictest0-21swapper/221:35:132
43013599290,27cyclictest0-21swapper/221:25:162
43013599290,27cyclictest0-21swapper/221:15:172
43013599290,26cyclictest0-21swapper/219:29:592
43013599290,26cyclictest0-21swapper/219:29:592
43013599290,1cyclictest0-21swapper/219:15:142
4578291280,2phc2sys0-21swapper/319:15:003
4577091280,6ptp4l441ktimers/321:30:013
4577091280,6ptp4l441ktimers/321:14:573
4577091280,4ptp4l441ktimers/323:50:013
430140992825,2cyclictest0-21swapper/319:33:583
43014099280,27cyclictest0-21swapper/300:00:133
43014099280,26cyclictest0-21swapper/323:25:143
43014099280,26cyclictest0-21swapper/321:45:153
430135992826,1cyclictest0-21swapper/222:59:592
430135992826,1cyclictest0-21swapper/219:55:002
430135992825,2cyclictest0-21swapper/219:35:582
43013599280,2cyclictest0-21swapper/221:53:002
43013599280,26cyclictest0-21swapper/222:05:012
43013599280,26cyclictest0-21swapper/220:45:162
43013599280,26cyclictest0-21swapper/220:00:022
43013599280,26cyclictest0-21swapper/200:25:142
430133992823,4cyclictest430147-21apt-key19:10:031
430132992824,2cyclictest0-21swapper/020:40:210
4577091270,7ptp4l61490irq/134-eno1-TxRx-023:20:003
4577091270,7ptp4l441ktimers/322:40:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-021:40:003
4577091270,6ptp4l441ktimers/322:15:003
4577091270,6ptp4l441ktimers/321:25:003
4577091270,6ptp4l441ktimers/320:25:003
4577091270,6ptp4l441ktimers/300:30:003
4577091270,5ptp4l441ktimers/300:20:003
430140992725,1cyclictest0-21swapper/323:10:033
430135992725,1cyclictest0-21swapper/221:25:002
430135992725,1cyclictest0-21swapper/220:40:002
430135992724,2cyclictest0-21swapper/219:12:002
43013599270,2cyclictest0-21swapper/220:43:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-020:44:593
4577091260,6ptp4l441ktimers/322:34:553
4577091260,6ptp4l441ktimers/320:59:553
4577091260,5ptp4l61490irq/134-eno1-TxRx-021:45:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-020:50:003
430140992624,1cyclictest0-21swapper/323:09:553
430135992623,2cyclictest0-21swapper/220:12:582
430135992623,2cyclictest0-21swapper/220:09:002
430135992622,2cyclictest0-21swapper/223:55:592
43013599260,24cyclictest0-21swapper/221:32:002
43013599260,24cyclictest0-21swapper/219:48:532
43013599260,24cyclictest0-21swapper/219:41:212
4577091250,6ptp4l61490irq/134-eno1-TxRx-023:35:013
4577091250,5ptp4l61490irq/134-eno1-TxRx-019:25:013
4577091250,4ptp4l441ktimers/300:34:553
430140992523,1cyclictest0-21swapper/321:55:583
430140992523,1cyclictest0-21swapper/321:09:003
4577091240,4ptp4l61490irq/134-eno1-TxRx-000:14:563
4577091240,3ptp4l441ktimers/322:29:563
430135992321,1cyclictest0-21swapper/223:44:592
430135992118,2cyclictest0-21swapper/221:04:592
43013299201,15cyclictest430131-21dpkg19:10:030
430135991714,2cyclictest0-21swapper/223:33:592
430135991613,2cyclictest0-21swapper/200:01:592
4301359930,2cyclictest0-21swapper/219:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional