You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 05:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Fri Jan 02, 2026 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
336678599109101,5cyclictest3473712-21latency_hist00:40:010
33667909910898,7cyclictest3460568-40logrotate00:00:011
33667909910898,7cyclictest3460568-40logrotate00:00:001
3366790999989,7cyclictest3421850-21latency_hist22:00:011
3366785998068,10cyclictest3418918-21apt-get21:50:110
3366785997666,7cyclictest3406997-21latency_hist21:15:010
3366785997466,6cyclictest3465407-21apt-get00:11:300
3366790997265,5cyclictest3366695-21kworker/u8:1+flush-179:019:20:211
3366790997265,5cyclictest3366695-21kworker/u8:1+flush-179:019:20:211
3366790997161,7cyclictest3472093-21latency_hist00:35:011
3366790997161,7cyclictest3472093-21latency_hist00:35:001
3366790996861,5cyclictest3373053-21latency_hist19:30:001
3366785996857,9cyclictest3404081-21apt-get21:05:130
3366790996751,13cyclictest3393462-21kworker/u8:0+flush-179:021:10:261
3366790996659,5cyclictest3393462-21kworker/u8:0+flush-179:021:05:001
3366785996660,4cyclictest3410708-21apt-get21:25:130
3366785996660,4cyclictest3410708-21apt-get21:25:130
3366785996634,22cyclictest510-21rs:main0
3366785996634,22cyclictest510-21rs:main0
3366785996555,7cyclictest3451025-21latency_hist23:30:010
3366785996456,6cyclictest3452866-21apt-get23:35:130
3366785996152,6cyclictest3415478-21latency_hist21:40:010
3366790995949,8cyclictest3413627-21latency_hist21:35:001
336679099590,56cyclictest0-21swapper/123:48:591
3366785995850,6cyclictest3376264-21apt-get19:40:010
336679099571,4cyclictest0-21swapper/120:00:121
3366790995546,7cyclictest3463809-21kworker/u8:1+flush-179:000:10:001
3366790995546,7cyclictest3463809-21kworker/u8:1+flush-179:000:10:001
3366785995547,6cyclictest3351141-21kworker/u8:2+flush-179:019:25:010
3366785995547,6cyclictest3351141-21kworker/u8:2+flush-179:019:25:010
3366785995546,7cyclictest3441719-21/usr/sbin/munin23:00:240
3366791995450,2cyclictest0-21swapper/219:15:592
3366790995448,4cyclictest3351141-21kworker/u8:2+flush-179:019:50:241
336679099541,48cyclictest3389496-21apt-get20:20:121
3366785995448,4cyclictest484-21dbus-daemon00:03:590
3366785995443,8cyclictest266-21systemd-journal20:30:290
336679099532,8cyclictest3434852-21apt-get22:40:131
3366785995349,2cyclictest714-21Xorg20:20:590
3366790995227,22cyclictest3462232-21latency_hist00:05:011
336678599521,49cyclictest714-21Xorg20:29:580
336678599520,47cyclictest0-21swapper/022:40:130
3366790995146,4cyclictest3366695-21kworker/u8:1+events_unbound19:15:251
3366790995131,18cyclictest714-21Xorg20:50:591
3366785995146,4cyclictest3421821-21kworker/u8:2+flush-179:022:35:260
3366790995041,7cyclictest3463809-21kworker/u8:1+flush-179:000:10:151
336679099500,47cyclictest0-21swapper/119:40:121
3366785995044,4cyclictest3463862-21kworker/u8:2+flush-179:000:20:020
3366785995043,5cyclictest3386036-21kworker/u8:0+flush-179:020:15:000
3366785995041,7cyclictest3384461-21latency_hist20:05:010
3366790994942,5cyclictest3443069-21latency_hist23:05:011
3366790994939,8cyclictest3397697-21/usr/sbin/munin20:45:251
3366785994941,6cyclictest3444655-21latency_hist23:10:010
3366785994940,7cyclictest3470753-21apt-get00:30:130
3366785994940,7cyclictest3470753-21apt-get00:30:120
3366790994845,2cyclictest3423485-21systemd-run22:05:001
3366790994841,5cyclictest3457372-21kworker/u8:0+flush-179:023:55:001
3366790994838,8cyclictest3400867-21/usr/sbin/munin20:55:241
336678599480,45cyclictest3420505-21apt-get21:55:130
4577091470,12ptp4l441ktimers/319:10:013
3366790994741,4cyclictest3410454-21latency_hist21:25:021
3366785994740,5cyclictest3399045-21latency_hist20:50:010
3366785994722,13cyclictest0-21swapper/020:00:010
336678599471,18cyclictest3371722-21apt-get19:25:130
3366790994640,5cyclictest3426641-21kworker/u8:3+events_unbound22:25:261
3366790994626,18cyclictest266-21systemd-journal20:38:281
3366790994626,18cyclictest266-21systemd-journal20:38:281
3366785994639,6cyclictest3432984-21kworker/u8:1+flush-179:023:10:220
3366790994539,4cyclictest3449431-21kworker/u8:0+flush-179:023:30:261
3366790994529,15cyclictest3412087-21kworker/u8:3+flush-179:021:45:251
3366785994527,17cyclictest3439555-21apt-key22:55:010
3366785994526,17cyclictest3408884-21gpgv21:20:010
336678599450,42cyclictest714-21Xorg22:25:590
3366790994439,4cyclictest3393462-21kworker/u8:0+flush-179:021:25:261
3366790994439,4cyclictest3393462-21kworker/u8:0+flush-179:021:25:261
336679099443,10cyclictest714-21Xorg22:34:591
3366785994435,7cyclictest3422095-21/usr/sbin/munin22:00:180
336678599440,28cyclictest0-21swapper/019:40:130
3366790994334,6cyclictest3374619-21kworker/u8:1+flush-179:019:35:251
3366790994321,20cyclictest3446091-21unixbench-2d23:10:261
336679099430,41cyclictest3418685-21turbostat21:54:551
3366790994239,2cyclictest714-21Xorg21:37:001
3366790994238,3cyclictest3374623-21kworker/u8:3+flush-179:020:15:271
3366790994237,4cyclictest3447804-21kworker/u8:2+flush-179:023:20:211
3366790994237,3cyclictest3392447-21systemd-run20:30:011
3366790994235,5cyclictest3394006-21munin-run20:35:011
3366790994233,7cyclictest266-21systemd-journal23:05:291
3366790994232,8cyclictest3378351-21apt-get19:45:131
3366790994217,24cyclictest0-21swapper/123:44:591
3366790994217,23cyclictest0-21swapper/123:25:281
336679099421,4cyclictest3425046-21idleruntime-cro22:10:001
3366790994214,24cyclictest0-21swapper/122:36:591
336679099421,38cyclictest266-21systemd-journal22:24:591
336679099421,38cyclictest266-21systemd-journal22:24:591
3366785994224,16cyclictest3441642-21apt-key23:00:010
336678599420,1cyclictest0-21swapper/023:34:590
336679099414,13cyclictest2304-21lightdm-gtk-gre22:15:591
3366790994130,8cyclictest3436219-21kworker/u8:0+flush-179:022:50:231
336679099412,8cyclictest0-21swapper/121:43:581
3366790994118,4cyclictest3466116-21tune2fs00:15:161
3366790994117,4cyclictest0-21swapper/122:45:231
3366785994134,5cyclictest3432990-21latency_hist22:35:020
336678599411,3cyclictest714-21Xorg20:15:590
336679399400,5cyclictest3462246-21turbostat00:05:013
336679399400,5cyclictest3412046-21turbostat21:30:003
336679399400,5cyclictest3412046-21turbostat21:30:003
336679399400,39cyclictest3457402-21turbostat23:50:003
336679399400,39cyclictest3376238-21turbostat19:40:003
336679099405,16cyclictest3386232-21cat20:10:011
336679099404,11cyclictest714-21Xorg00:39:591
3366785994037,2cyclictest3460737-21latency_hist00:00:010
3366785994037,2cyclictest3460737-21latency_hist00:00:010
336678599401,37cyclictest714-21Xorg23:43:590
336678599401,26cyclictest3373292-21/usr/sbin/munin19:30:260
336678599400,38cyclictest714-21Xorg19:46:590
336678599400,14cyclictest714-21Xorg20:59:580
336679399390,38cyclictest0-21swapper/321:36:593
336679099394,14cyclictest2304-21lightdm-gtk-gre00:22:001
336679099392,31cyclictest3366940-21apt-get19:10:121
3366790993922,16cyclictest0-21swapper/121:06:001
3366790993916,4cyclictest0-21swapper/122:55:221
3366785993919,18cyclictest3469738-21phc2sys00:25:230
336678599390,27cyclictest3403831-21munin-run21:04:590
336679199380,35cyclictest0-21swapper/221:56:582
336679199380,35cyclictest0-21swapper/221:39:552
336679099383,9cyclictest714-21Xorg20:43:001
336679099383,13cyclictest2304-21lightdm-gtk-gre00:26:591
3366790993816,3cyclictest0-21swapper/121:15:231
3366790993816,20cyclictest0-21swapper/120:00:011
3366785993832,4cyclictest3467077-21grep00:19:590
3366785993823,13cyclictest3447688-21unixbench-2d23:15:270
336678599381,3cyclictest714-21Xorg21:45:590
336678599380,37cyclictest0-21swapper/023:20:590
3366791993735,1cyclictest0-21swapper/222:19:592
3366791993734,2cyclictest0-21swapper/221:42:582
3366791993734,2cyclictest0-21swapper/220:19:592
3366791993734,2cyclictest0-21swapper/219:41:002
3366791993733,2cyclictest0-21swapper/223:45:592
336679099375,12cyclictest2304-21lightdm-gtk-gre23:16:591
3366790993733,2cyclictest714-21Xorg20:13:591
3366790993730,5cyclictest3449431-21kworker/u8:0+flush-179:023:36:591
3366785993731,4cyclictest3397498-21systemd-run20:45:000
3366785993729,6cyclictest266-21systemd-journal20:55:010
3366785993723,12cyclictest0-21swapper/022:25:000
3366785993723,12cyclictest0-21swapper/022:25:000
3366793993634,1cyclictest0-21swapper/320:06:583
3366793993631,4cyclictest3437777-21turbostat22:50:003
336679199360,1cyclictest0-21swapper/220:12:002
3366790993633,2cyclictest0-21swapper/122:12:581
3366785993628,6cyclictest266-21systemd-journal23:52:300
336678599362,30cyclictest3462488-21apt-get00:05:130
336678599362,30cyclictest3462488-21apt-get00:05:130
3366793993533,1cyclictest0-21swapper/320:40:003
3366793993533,1cyclictest0-21swapper/320:40:003
3366793993533,1cyclictest0-21swapper/319:15:583
336679399350,34cyclictest0-21swapper/300:14:553
336679399350,1cyclictest0-21swapper/300:21:003
3366791993532,2cyclictest0-21swapper/221:20:002
3366791993532,2cyclictest0-21swapper/200:37:592
3366791993532,2cyclictest0-21swapper/200:01:592
3366791993532,1cyclictest0-21swapper/220:05:012
3366785993531,2cyclictest0-21swapper/019:53:590
3366785993530,4cyclictest3454184-21kworker/u8:1+flush-179:023:45:270
3366785993526,7cyclictest3426529-21unixbench_multi22:10:260
336678599351,19cyclictest714-21Xorg22:15:590
3366793993432,1cyclictest0-21swapper/321:18:593
3366791993432,1cyclictest0-21swapper/223:39:582
3366791993432,1cyclictest0-21swapper/200:24:592
3366791993431,2cyclictest0-21swapper/222:30:592
3366785993431,2cyclictest0-21swapper/021:44:590
3366785993427,5cyclictest3385102-21fschecks_time20:05:160
3366785993425,7cyclictest3367290-21fschecks_time19:10:170
3366785993424,8cyclictest3409104-21/usr/sbin/munin21:20:160
3366793993331,1cyclictest0-21swapper/320:34:553
3366785993328,4cyclictest3437805-21systemd-run22:50:010
336679199320,30cyclictest0-21swapper/223:23:592
336679199320,2cyclictest0-21swapper/222:47:592
3366785993226,4cyclictest0-21swapper/021:35:000
3366793993129,1cyclictest0-21swapper/322:28:593
3366793993129,1cyclictest0-21swapper/322:15:593
3366791993129,1cyclictest0-21swapper/220:30:012
3366791993128,2cyclictest0-21swapper/220:20:592
3366793993028,1cyclictest0-21swapper/323:24:553
3366793993028,1cyclictest0-21swapper/321:05:593
336679399300,28cyclictest0-21swapper/319:20:123
336679399300,28cyclictest0-21swapper/319:20:123
3366791993027,2cyclictest0-21swapper/223:40:592
3366791993026,2cyclictest0-21swapper/200:11:592
336679199300,28cyclictest0-21swapper/222:40:132
3366785993024,4cyclictest3424142-21hwlatdetect22:05:200
3366785993014,14cyclictest3368658-21cut19:15:120
3366793992927,1cyclictest0-21swapper/322:58:593
3366793992927,1cyclictest0-21swapper/322:39:593
3366793992927,1cyclictest0-21swapper/320:55:003
3366793992927,1cyclictest0-21swapper/300:35:003
3366793992927,1cyclictest0-21swapper/300:34:593
3366791992927,1cyclictest0-21swapper/200:27:592
3366791992926,2cyclictest0-21swapper/223:12:592
336679199290,2cyclictest0-21swapper/223:06:592
336679199290,27cyclictest0-21swapper/223:00:022
336679199290,27cyclictest0-21swapper/222:55:022
336679199290,27cyclictest0-21swapper/222:00:132
336679199290,27cyclictest0-21swapper/221:10:142
336679199290,27cyclictest0-21swapper/221:00:172
336679199290,27cyclictest0-21swapper/220:35:172
336679199290,27cyclictest0-21swapper/220:35:162
336679199290,27cyclictest0-21swapper/219:50:152
336679199290,27cyclictest0-21swapper/219:20:122
336679199290,27cyclictest0-21swapper/219:20:112
3366790992926,2cyclictest0-21swapper/119:30:121
3366793992826,1cyclictest0-21swapper/322:20:593
3366793992826,1cyclictest0-21swapper/322:20:593
3366793992826,1cyclictest0-21swapper/322:11:583
3366793992825,2cyclictest0-21swapper/321:10:153
336679399280,27cyclictest0-21swapper/319:50:143
336679399280,26cyclictest0-21swapper/323:00:023
336679399280,26cyclictest0-21swapper/321:20:023
336679399280,26cyclictest0-21swapper/320:25:153
336679399280,26cyclictest0-21swapper/319:25:133
336679399280,26cyclictest0-21swapper/300:25:143
3366791992825,2cyclictest0-21swapper/223:25:162
3366791992825,2cyclictest0-21swapper/222:20:142
3366791992825,2cyclictest0-21swapper/222:20:132
3366791992825,2cyclictest0-21swapper/220:46:582
3366791992825,2cyclictest0-21swapper/220:05:142
336679199280,2cyclictest0-21swapper/219:25:132
336679199280,26cyclictest0-21swapper/223:59:592
336679199280,26cyclictest0-21swapper/223:59:582
336679199280,26cyclictest0-21swapper/221:20:022
336679199280,26cyclictest0-21swapper/221:05:132
336679199280,26cyclictest0-21swapper/220:30:162
4577091270,6ptp4l441ktimers/322:55:003
4577091270,6ptp4l441ktimers/300:10:003
4577091270,6ptp4l441ktimers/300:10:003
3366793992725,1cyclictest0-21swapper/323:54:553
3366793992725,1cyclictest0-21swapper/322:09:593
3366793992725,1cyclictest0-21swapper/322:00:143
3366793992725,1cyclictest0-21swapper/320:20:133
3366793992725,1cyclictest0-21swapper/320:14:583
3366793992724,2cyclictest3446250-21turbostat23:15:013
336679399270,26cyclictest0-21swapper/322:40:133
336679399270,1cyclictest0-21swapper/321:40:153
3366791992724,2cyclictest0-21swapper/223:16:592
3366791992724,2cyclictest0-21swapper/221:28:582
3366791992724,2cyclictest0-21swapper/221:28:582
336679199270,1cyclictest0-21swapper/200:30:022
336679199270,1cyclictest0-21swapper/200:30:022
4577091260,5ptp4l441ktimers/323:35:013
4577091260,4ptp4l61490irq/134-eno1-TxRx-019:50:013
4577091260,4ptp4l441ktimers/321:00:003
3366793992624,1cyclictest0-21swapper/323:19:593
3366793992623,2cyclictest0-21swapper/321:47:593
3366793992623,2cyclictest0-21swapper/320:17:593
336679399260,24cyclictest0-21swapper/319:10:143
3366791992624,1cyclictest0-21swapper/223:54:592
3366791992623,2cyclictest0-21swapper/220:43:332
3366791992623,2cyclictest0-21swapper/219:59:542
336679199260,2cyclictest0-21swapper/222:26:582
336679199260,2cyclictest0-21swapper/221:54:002
336679199260,2cyclictest0-21swapper/219:35:012
336679199260,24cyclictest0-21swapper/222:08:002
336679199260,24cyclictest0-21swapper/219:45:332
336679199260,24cyclictest0-21swapper/219:30:112
4577091250,6ptp4l61490irq/134-eno1-TxRx-023:10:003
4577091250,5ptp4l61490irq/134-eno1-TxRx-020:05:013
4577091250,4ptp4l61490irq/134-eno1-TxRx-022:35:003
4577091250,4ptp4l441ktimers/321:59:563
4577091250,4ptp4l441ktimers/321:55:003
4577091250,4ptp4l441ktimers/320:50:003
4577091250,4ptp4l441ktimers/320:45:003
4577091250,4ptp4l441ktimers/300:00:013
4577091250,4ptp4l441ktimers/300:00:013
3366793992523,1cyclictest0-21swapper/319:33:583
336679399250,24cyclictest0-21swapper/321:01:523
336679399250,24cyclictest0-21swapper/319:58:053
336679399250,24cyclictest0-21swapper/319:40:303
336679399250,24cyclictest0-21swapper/300:19:583
3366791992522,2cyclictest0-21swapper/222:13:162
3366791992522,2cyclictest0-21swapper/220:56:002
4577091240,4ptp4l441ktimers/323:45:003
4577091240,4ptp4l441ktimers/323:40:013
4577091240,4ptp4l441ktimers/321:35:003
3366793992422,1cyclictest0-21swapper/323:27:593
3366791992421,2cyclictest0-21swapper/223:33:542
3366791992421,2cyclictest0-21swapper/221:45:592
3366791992421,2cyclictest0-21swapper/221:34:002
336679199240,1cyclictest0-21swapper/200:15:022
336678599249,13cyclictest3366808-21cat19:10:020
3366793992220,1cyclictest0-21swapper/300:38:003
3366791992220,1cyclictest0-21swapper/220:54:572
3366791992219,2cyclictest0-21swapper/200:05:132
3366791992219,2cyclictest0-21swapper/200:05:122
231999210,13rtkit-daemon3203871-21ntpd19:05:061
3366791991813,3cyclictest3434600-21turbostat22:40:002
336679199169,4cyclictest0-21swapper/219:10:132
33667919996,2cyclictest0-21swapper/222:50:512
33667919940,1cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional