You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 10:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sat May 16, 2026 00:44:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31266159910392,7cyclictest3167395-21latency_hist21:15:001
31266139910090,7cyclictest3128092-21latency_hist19:15:010
3126615999885,11cyclictest3159475-21kworker/u8:3+flush-179:020:50:241
3126613999892,4cyclictest3159475-21kworker/u8:3+flush-179:021:00:010
3126615999583,8cyclictest3148026-21latency_hist20:15:021
3126615999485,6cyclictest3212763-21latency_hist23:35:011
3126613999488,4cyclictest3210228-21kworker/u8:1+flush-179:023:25:240
3126613999485,7cyclictest1213033-21systemd-journal22:00:000
3126613999386,5cyclictest3191322-21http22:30:000
3126613999080,7cyclictest3144835-21/usr/sbin/munin20:05:240
3126615998779,5cyclictest3134515-21latency_hist19:35:001
3126615998576,6cyclictest3156261-21latency_hist20:40:011
3126615998475,7cyclictest3158108-21apt-get20:45:101
3126615998469,12cyclictest3144356-21apt-get20:05:001
3126613998477,5cyclictest3191282-21kworker/u8:1+flush-179:023:10:150
3126613998373,8cyclictest3220793-21cupsd00:00:010
3126613998373,8cyclictest3220793-21cupsd00:00:010
3126613998274,6cyclictest3219133-21latency_hist23:55:010
3126613998271,8cyclictest1213033-21systemd-journal00:05:010
3126615998069,8cyclictest3207998-21apt-get23:20:111
3126613997870,6cyclictest3149892-21apt-get20:20:120
3126615997566,7cyclictest3137946-21/usr/sbin/munin19:45:231
3126615997566,7cyclictest3137946-21/usr/sbin/munin19:45:221
3126615997565,7cyclictest3139533-21/usr/sbin/munin19:50:241
3126615997465,6cyclictest1213033-21systemd-journal20:40:411
3126613997468,5cyclictest3228998-21kworker/u8:2+flush-179:000:29:560
3126615997364,6cyclictest3227419-21latency_hist00:20:011
3126615997262,8cyclictest3220721-40logrotate00:00:011
3126615997262,8cyclictest3220721-40logrotate00:00:011
3126613997165,4cyclictest3203624-21kworker/u8:0+flush-179:023:05:190
3126613997165,4cyclictest3139340-21kworker/u8:2+flush-179:019:55:240
3126613997162,6cyclictest1-21systemd22:40:000
3126615996959,8cyclictest3188353-21kworker/u8:0+flush-179:022:25:241
3126613996960,7cyclictest1213033-21systemd-journal22:04:550
3126613996862,4cyclictest3164268-21kworker/u8:2+flush-179:021:25:160
3126615996657,6cyclictest3184917-21latency_hist22:10:011
3126615996556,7cyclictest3130010-21apt-get19:20:121
3126613996556,6cyclictest3223975-21latency_hist00:10:020
3126613996556,6cyclictest3223975-21latency_hist00:10:010
3126613996553,9cyclictest3225692-21store00:15:010
3126615996455,6cyclictest1213033-21systemd-journal23:02:531
3126615996455,6cyclictest1213033-21systemd-journal23:02:531
3126615996454,8cyclictest3128328-21/usr/sbin/munin19:15:241
3126613996453,9cyclictest3195002-21apt-get22:40:120
3126613996453,9cyclictest3195002-21apt-get22:40:120
3126615996357,4cyclictest3221016-21kworker/u8:0+flush-179:000:10:241
3126615996351,7cyclictest3159475-21kworker/u8:3+flush-179:021:15:161
3126613996358,4cyclictest3114080-21kworker/u8:0+flush-179:019:19:550
3126613996356,5cyclictest3159475-21kworker/u8:3+flush-179:021:20:220
3126613996352,8cyclictest3142472-21apt-get20:00:020
3126615996250,9cyclictest1213033-21systemd-journal21:49:531
3126613996255,4cyclictest3186487-21kworker/u8:3+flush-179:022:15:220
4577091610,9ptp4l441ktimers/319:10:013
3126613996156,3cyclictest3172213-21kworker/u8:1+flush-179:021:45:240
3126613996153,6cyclictest3204581-21kworker/u8:3+flush-179:000:20:160
3126613996149,10cyclictest3197964-21kworker/u8:3+events_unbound22:50:030
3126615996053,5cyclictest3148264-21/usr/sbin/munin20:15:241
3126613996056,3cyclictest3134506-21kworker/u8:3+flush-179:020:15:240
3126613996054,4cyclictest3167422-21awk21:15:010
3126613995844,9cyclictest3209327-21latency_hist23:25:010
3126613995749,6cyclictest3110885-21kworker/u8:2+flush-179:019:25:140
3126613995748,6cyclictest3134506-21kworker/u8:3+flush-179:020:25:240
3126613995745,9cyclictest3191765-21cp22:30:010
3126615995647,7cyclictest3176962-21latency_hist21:45:021
3126615995647,6cyclictest3217547-21latency_hist23:50:001
3126615995647,6cyclictest3217547-21latency_hist23:50:001
3126613995648,6cyclictest3224011-21kworker/u8:1+flush-179:000:15:160
3126613995643,10cyclictest1213033-21systemd-journal20:45:000
3126620995452,1cyclictest0-21swapper/319:12:003
3126613995444,7cyclictest3203624-21kworker/u8:0+flush-179:023:15:200
3126615995347,5cyclictest3154636-21kworker/u8:2+flush-179:020:35:011
3126615995344,6cyclictest3198415-21/usr/sbin/munin22:50:151
3126615995244,6cyclictest3175338-21kworker/u8:0+flush-179:021:55:251
3126615995244,6cyclictest3159475-21kworker/u8:3+flush-179:021:20:181
3126613995244,6cyclictest3194983-21kworker/u8:2+flush-179:022:50:000
3126613995243,7cyclictest3161026-21latency_hist20:55:010
3126615995141,7cyclictest1213033-21systemd-journal19:28:541
3126613995145,4cyclictest3159475-21kworker/u8:3+events_unbound21:00:150
3126613995145,4cyclictest3159475-21kworker/u8:3+events_unbound21:00:150
3126613995143,6cyclictest3110885-21kworker/u8:2+flush-179:019:20:260
3126613995044,5cyclictest3164268-21kworker/u8:2+events_unbound21:05:230
3126615994942,5cyclictest3230606-21latency_hist00:30:011
3126613994939,8cyclictest3114080-21kworker/u8:0+flush-179:019:40:150
3126615994838,8cyclictest3213019-21apt-get23:35:101
3126613994843,4cyclictest3185155-21kworker/u8:2+flush-179:022:10:260
3126613994838,7cyclictest3146678-21/usr/sbin/munin20:10:210
3126613994742,4cyclictest3154636-21kworker/u8:2+flush-179:020:35:270
3126613994737,8cyclictest3174021-21apt-get21:35:110
3126613994736,9cyclictest3228998-21kworker/u8:2+flush-179:000:30:200
3126613994736,9cyclictest3228998-21kworker/u8:2+flush-179:000:30:190
3126615994638,6cyclictest3159475-21kworker/u8:3+flush-179:021:00:181
3126615994638,6cyclictest3159475-21kworker/u8:3+flush-179:021:00:171
3126615994636,8cyclictest1213033-21systemd-journal20:10:001
3126613994640,4cyclictest3159440-21latency_hist20:50:000
3126615994535,8cyclictest3203624-21kworker/u8:0+flush-179:023:05:241
3126613994536,6cyclictest3159475-21kworker/u8:3+flush-179:021:30:150
312662099440,43cyclictest3176970-21turbostat21:45:003
3126613994440,2cyclictest714-21Xorg20:34:590
3126613994439,4cyclictest3175338-21kworker/u8:0+flush-179:022:05:230
3126613994439,4cyclictest3114080-21kworker/u8:0+flush-179:019:30:270
3126613994425,16cyclictest1213033-21systemd-journal21:52:530
3126615994335,6cyclictest3136124-21latency_hist19:40:011
3126615994334,7cyclictest3142625-21store20:00:011
3126613994334,6cyclictest3114080-21kworker/u8:0+events_unbound19:45:210
3126613994334,6cyclictest3114080-21kworker/u8:0+events_unbound19:45:210
3126613994332,7cyclictest3214337-21kworker/u8:4+flush-179:023:40:200
312662099420,3cyclictest3149621-21turbostat20:20:003
3126615994234,6cyclictest1213033-21systemd-journal21:35:511
3126615994229,12cyclictest3180118-21kworker/u8:2+flush-179:021:55:001
3126613994231,7cyclictest0-21swapper/023:01:590
3126613994231,7cyclictest0-21swapper/023:01:590
3126615994137,3cyclictest3204581-21kworker/u8:3+flush-179:023:50:241
3126615994137,3cyclictest1-21systemd00:04:011
3126615994133,6cyclictest3215961-21latency_hist23:45:011
3126615994131,7cyclictest1213033-21systemd-journal00:35:001
3126615994131,7cyclictest1213033-21systemd-journal00:34:591
3126613994137,3cyclictest3204581-21kworker/u8:3+flush-179:023:49:560
3126613994137,3cyclictest3204581-21kworker/u8:3+flush-179:023:49:560
3126613994136,4cyclictest3134506-21kworker/u8:3+events_unbound19:35:210
3126620994038,1cyclictest0-21swapper/319:49:563
3126620994038,1cyclictest0-21swapper/319:49:563
3126620994034,5cyclictest3136131-21turbostat19:39:593
312662099400,38cyclictest3217554-21turbostat23:50:003
312662099400,38cyclictest3217554-21turbostat23:50:003
312661999400,2cyclictest0-21swapper/219:12:592
3126615994032,6cyclictest3186742-21/usr/sbin/munin22:15:251
3126613994032,6cyclictest3194983-21kworker/u8:2+flush-179:022:55:150
3126620993934,4cyclictest3161036-21turbostat20:55:003
3126620993934,4cyclictest3142481-21turbostat20:00:003
312662099390,38cyclictest3172187-21turbostat21:30:013
312661999390,36cyclictest0-21swapper/222:23:582
312661999390,36cyclictest0-21swapper/220:36:592
312661599395,31cyclictest3191721-21dpkg22:30:021
3126615993935,3cyclictest3150635-21kworker/u8:1+flush-179:020:25:251
3126615993934,4cyclictest3191282-21kworker/u8:1+flush-179:023:10:261
3126615993933,5cyclictest3144400-21kworker/u8:0+flush-179:020:20:151
312661599391,2cyclictest714-21Xorg22:48:001
312662099380,4cyclictest3184929-21turbostat22:10:003
312661999380,36cyclictest0-21swapper/223:58:592
312661999380,36cyclictest0-21swapper/223:58:592
312661999380,36cyclictest0-21swapper/219:39:002
3126613993832,4cyclictest3140422-21grep19:50:220
3126620993731,5cyclictest3223979-21turbostat00:10:013
3126620993731,5cyclictest3223979-21turbostat00:10:003
3126620993731,5cyclictest3206153-21turbostat23:15:003
3126620993731,5cyclictest3146197-21turbostat20:10:013
312662099370,36cyclictest0-21swapper/323:18:593
3126619993734,2cyclictest0-21swapper/223:50:592
3126619993734,2cyclictest0-21swapper/221:47:592
3126619993734,2cyclictest0-21swapper/221:40:582
3126613993728,5cyclictest3232458-21apt-get00:35:150
3126620993634,1cyclictest0-21swapper/319:24:543
3126620993634,1cyclictest0-21swapper/319:18:593
3126620993633,2cyclictest0-21swapper/321:08:003
312662099360,1cyclictest0-21swapper/323:31:593
312662099360,1cyclictest0-21swapper/321:30:593
312661599369,10cyclictest3210130-21diskstats23:25:151
3126615993632,3cyclictest3229058-21systemd-run00:25:011
312661599360,25cyclictest0-21swapper/122:15:011
4577091350,28ptp4l441ktimers/319:50:133
3126620993533,1cyclictest0-21swapper/322:21:003
3126620993533,1cyclictest0-21swapper/321:15:593
3126620993529,5cyclictest3154667-21turbostat20:35:003
312662099350,1cyclictest0-21swapper/321:57:593
312661999350,1cyclictest0-21swapper/223:21:592
3126615993531,3cyclictest3173773-21munin-plugin-st21:34:591
3126615993531,3cyclictest3114080-21kworker/u8:0+flush-179:019:10:111
3126615993530,4cyclictest3164268-21kworker/u8:2+flush-179:021:25:231
3126615993528,6cyclictest3219184-21kworker/u8:2+flush-179:000:05:221
3126615993528,6cyclictest3219184-21kworker/u8:2+flush-179:000:05:221
3126620993432,1cyclictest0-21swapper/320:42:593
3126620993432,1cyclictest0-21swapper/300:22:593
3126620993431,2cyclictest0-21swapper/320:55:593
3126620993429,4cyclictest3209341-21turbostat23:25:003
3126620993427,6cyclictest3186517-21turbostat22:15:003
3126619993431,2cyclictest0-21swapper/222:09:582
3126615993429,4cyclictest3194983-21kworker/u8:2+flush-179:022:55:211
3126613993431,2cyclictest3189739-21systemd-run22:25:010
3126613993430,3cyclictest3213724-21strings23:35:180
3126613993427,5cyclictest3203624-21kworker/u8:0+flush-179:023:30:140
3126620993331,1cyclictest0-21swapper/322:34:593
3126620993331,1cyclictest0-21swapper/321:38:583
3126620993331,1cyclictest0-21swapper/320:25:583
3126620993330,2cyclictest0-21swapper/300:16:593
3126620993327,5cyclictest3219143-21turbostat23:55:003
3126619993330,2cyclictest0-21swapper/220:04:542
3126619993330,2cyclictest0-21swapper/200:37:592
3126615993328,4cyclictest3204581-21kworker/u8:3+flush-179:023:15:571
3126615993327,4cyclictest3136376-21apt-get19:40:121
312661599331,4cyclictest3164479-21apt-get21:05:131
3126620993231,1cyclictest0-21swapper/323:44:593
3126620993230,1cyclictest0-21swapper/322:49:593
3126620993230,1cyclictest0-21swapper/321:21:593
3126619993230,1cyclictest0-21swapper/221:29:592
3126619993229,2cyclictest0-21swapper/223:05:592
3126615993226,5cyclictest3154636-21kworker/u8:2+flush-179:020:55:171
3126613993229,2cyclictest0-21swapper/021:19:590
312661399321,29cyclictest0-21swapper/021:40:130
3126620993129,1cyclictest0-21swapper/323:37:593
3126620993126,4cyclictest3148039-21turbostat20:15:003
3126620993125,5cyclictest3132937-21turbostat19:30:003
3126619993128,2cyclictest0-21swapper/219:24:002
3126615993127,3cyclictest3182167-21tr22:00:111
3126615993123,7cyclictest3233644-21unixbench-2d00:35:261
312661599311,29cyclictest0-21swapper/122:35:131
3126620993028,1cyclictest0-21swapper/322:54:563
3126620993028,1cyclictest0-21swapper/322:27:593
3126619993028,1cyclictest0-21swapper/222:30:012
3126619993027,2cyclictest0-21swapper/222:49:542
3126619993027,2cyclictest0-21swapper/220:43:592
312661999300,28cyclictest0-21swapper/221:50:132
312661599300,28cyclictest714-21Xorg22:24:581
3126620992927,1cyclictest0-21swapper/320:36:003
3126620992927,1cyclictest0-21swapper/300:39:593
3126620992926,2cyclictest0-21swapper/321:00:143
3126620992926,2cyclictest0-21swapper/321:00:143
312662099290,2cyclictest0-21swapper/300:15:013
312662099290,27cyclictest0-21swapper/323:05:113
312662099290,27cyclictest0-21swapper/323:00:123
312662099290,27cyclictest0-21swapper/323:00:123
312662099290,1cyclictest0-21swapper/320:00:033
3126619992927,1cyclictest0-21swapper/219:49:592
3126619992927,1cyclictest0-21swapper/219:49:582
3126619992926,2cyclictest0-21swapper/221:05:112
3126619992926,2cyclictest0-21swapper/220:55:142
3126619992926,2cyclictest0-21swapper/220:50:132
3126619992926,2cyclictest0-21swapper/220:25:132
3126619992926,2cyclictest0-21swapper/220:10:032
3126619992926,2cyclictest0-21swapper/219:50:132
3126619992926,2cyclictest0-21swapper/219:18:592
312661999290,2cyclictest0-21swapper/223:40:122
312661999290,27cyclictest0-21swapper/222:50:032
312661999290,27cyclictest0-21swapper/222:10:132
312661999290,27cyclictest0-21swapper/221:15:142
312661999290,27cyclictest0-21swapper/221:00:152
312661999290,27cyclictest0-21swapper/221:00:152
312661999290,27cyclictest0-21swapper/220:15:132
312661999290,27cyclictest0-21swapper/220:05:032
312661999290,27cyclictest0-21swapper/219:55:132
312661999290,27cyclictest0-21swapper/200:15:022
312661999290,27cyclictest0-21swapper/200:05:132
312661999290,27cyclictest0-21swapper/200:05:132
3126615992925,2cyclictest714-21Xorg22:41:591
3126615992925,2cyclictest714-21Xorg22:41:591
4577091280,6ptp4l441ktimers/300:35:003
4577091280,6ptp4l441ktimers/300:34:593
3126620992826,1cyclictest0-21swapper/322:42:593
3126620992826,1cyclictest0-21swapper/322:42:593
3126620992826,1cyclictest0-21swapper/320:20:133
312662099280,2cyclictest0-21swapper/323:25:123
312662099280,26cyclictest0-21swapper/300:25:143
3126619992825,2cyclictest0-21swapper/223:02:592
3126619992825,2cyclictest0-21swapper/223:02:592
312661999280,2cyclictest0-21swapper/223:25:132
312661999280,26cyclictest0-21swapper/220:20:132
312661999280,26cyclictest0-21swapper/200:10:112
4577091270,7ptp4l61490irq/134-eno1-TxRx-019:35:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-021:49:563
4577091270,6ptp4l441ktimers/321:15:013
4577091270,5ptp4l441ktimers/300:00:003
4577091270,5ptp4l441ktimers/300:00:003
3126620992725,1cyclictest0-21swapper/322:35:593
3126619992724,2cyclictest0-21swapper/222:30:122
3126619992724,2cyclictest0-21swapper/221:56:582
3126619992724,2cyclictest0-21swapper/221:22:592
3126619992724,2cyclictest0-21swapper/200:00:592
312661999270,25cyclictest0-21swapper/222:59:002
312661999270,25cyclictest0-21swapper/200:32:002
312661999270,25cyclictest0-21swapper/200:32:002
4577091260,5ptp4l441ktimers/323:00:013
4577091260,5ptp4l441ktimers/322:04:553
4577091260,5ptp4l441ktimers/321:55:003
3126620992624,1cyclictest0-21swapper/300:00:593
3126619992623,2cyclictest0-21swapper/222:16:592
3126619992623,2cyclictest0-21swapper/221:35:002
3126619992622,2cyclictest0-21swapper/200:21:592
312661999260,24cyclictest0-21swapper/200:25:132
4577091250,5ptp4l441ktimers/322:20:013
4577091250,4ptp4l441ktimers/319:44:563
3126620992523,1cyclictest0-21swapper/320:45:583
3126619992522,2cyclictest0-21swapper/221:13:592
3126619992522,2cyclictest0-21swapper/220:45:592
3126619992521,2cyclictest0-21swapper/223:49:552
3126619992521,2cyclictest0-21swapper/223:49:542
312661999250,2cyclictest0-21swapper/222:45:002
312661999250,2cyclictest0-21swapper/222:44:592
3126619992422,1cyclictest0-21swapper/222:04:592
3126619992421,2cyclictest0-21swapper/219:25:122
3126619992320,2cyclictest0-21swapper/223:36:592
3126619992320,2cyclictest0-21swapper/221:38:592
3126619992320,2cyclictest0-21swapper/220:34:592
3126619992219,2cyclictest0-21swapper/219:30:592
3126619992219,1cyclictest0-21swapper/223:15:592
3126615992219,2cyclictest3126630-21latency_hist19:10:011
231999210,12rtkit-daemon495-21gpm19:05:520
3126619992018,1cyclictest0-21swapper/223:14:592
3126619991815,2cyclictest0-21swapper/222:36:592
3126619991613,2cyclictest0-21swapper/219:40:122
3126619991412,1cyclictest0-21swapper/223:30:132
31266199930,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional