You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 07:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Tue Aug 18, 2026 00:44:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293030899129122,5cyclictest2947753-21latency_hist20:05:001
293030899126116,7cyclictest2931814-21latency_hist19:15:011
293030899121111,8cyclictest1213033-21systemd-journal23:15:011
293030899117109,5cyclictest2939830-21kworker/u8:0+flush-179:020:15:211
293030899115106,7cyclictest288088-21cups-browsed00:00:011
293030899110102,5cyclictest2967203-21kworker/u8:2+flush-179:021:25:011
293030899110102,5cyclictest2967203-21kworker/u8:2+flush-179:021:25:001
29303049910798,6cyclictest2965519-21apt-get20:58:410
29303049910798,6cyclictest2965519-21apt-get20:58:400
29303089910696,8cyclictest1213033-21systemd-journal23:00:021
29303089910696,8cyclictest1213033-21systemd-journal23:00:011
29303089910593,9cyclictest2981751-21apt-get21:50:111
29303089910395,6cyclictest2995859-21kworker/u8:2+flush-179:022:50:171
29303089910387,14cyclictest3009055-21kworker/u8:1+flush-179:000:30:251
29303089910191,8cyclictest2995824-21latency_hist22:35:011
29303089910088,9cyclictest2964175-21apt-get20:55:141
29303089910088,9cyclictest2964175-21apt-get20:55:141
29303049910092,6cyclictest3028245-21latency_hist00:15:010
2930308999991,5cyclictest2999018-21latency_hist22:45:001
2930304999990,6cyclictest2997668-21kworker/u8:1+flush-179:022:50:210
2930308999891,4cyclictest2967203-21kworker/u8:2+flush-179:021:15:251
2930308999888,7cyclictest2987864-21latency_hist22:10:011
2930304999889,7cyclictest3009055-21kworker/u8:1+flush-179:000:25:190
2930308999687,7cyclictest2975163-21kworker/u8:3+flush-179:022:00:011
2930304999585,8cyclictest3009333-21apt-get23:15:100
2930304999384,7cyclictest1213033-21systemd-journal20:24:590
2930308999185,4cyclictest2967203-21kworker/u8:2+flush-179:021:05:181
2930308999176,14cyclictest2991105-21kworker/u8:3+events_unbound22:40:001
2930308999083,6cyclictest3009112-21kworker/u8:3+flush-179:023:45:011
2930308999082,6cyclictest2949593-21apt-get20:10:131
2930308999079,8cyclictest2957332-21kworker/u8:3+events_unbound20:55:001
2930308999067,20cyclictest2960505-21apt-get20:45:001
2930304999081,7cyclictest2995859-21kworker/u8:2+events_unbound22:40:190
2930304998980,6cyclictest2963921-21latency_hist20:55:010
2930308998883,3cyclictest3029846-21latency_hist00:20:011
2930304998880,6cyclictest2954105-21kworker/u8:0+flush-179:020:30:000
2930304998877,9cyclictest3012530-21apt-get23:25:130
2930304998680,4cyclictest2936587-21kworker/u8:1+flush-179:019:55:230
2930304998578,5cyclictest2954105-21kworker/u8:0+flush-179:020:30:280
2930308998478,4cyclictest2995859-21kworker/u8:2+flush-179:023:00:251
2930308998372,8cyclictest3010692-21latency_hist23:20:011
2930304998371,9cyclictest1213033-21systemd-journal19:40:000
2930304998276,4cyclictest2936587-21kworker/u8:1+flush-179:019:50:170
2930304998276,4cyclictest2936587-21kworker/u8:1+flush-179:019:50:160
2930304998275,5cyclictest2933680-21apt-get19:20:110
2930308998173,6cyclictest1213033-21systemd-journal22:14:411
2930308998171,7cyclictest2975670-21diskstats21:30:141
2930304998173,6cyclictest3010943-21apt-get23:20:120
2930304998173,6cyclictest3010943-21apt-get23:20:120
2930304998171,7cyclictest3009112-21kworker/u8:3+events_unbound23:45:240
2930304998171,7cyclictest3009112-21kworker/u8:3+events_unbound23:45:240
2930308998070,8cyclictest2976970-21apt-get21:35:141
2930304998072,6cyclictest3025311-21/usr/sbin/munin00:05:200
2930304997971,6cyclictest2967203-21kworker/u8:2+flush-179:021:20:240
2930304997971,6cyclictest2967203-21kworker/u8:2+flush-179:021:20:240
2930304997968,8cyclictest510-21rs:main0
2930304997968,8cyclictest2991042-21latency_hist22:20:010
2930308997872,5cyclictest3009055-21kworker/u8:1+flush-179:023:35:001
2930308997869,7cyclictest3006141-21/usr/sbin/munin23:05:151
2930304997873,3cyclictest2991105-21kworker/u8:3+flush-179:022:55:220
2930304997873,3cyclictest2991105-21kworker/u8:3+flush-179:022:55:220
2930308997654,20cyclictest1213033-21systemd-journal22:50:011
2930304997663,10cyclictest3005652-21apt-get23:05:020
2930308997572,2cyclictest3009112-21kworker/u8:3+flush-179:023:50:011
2930308997572,2cyclictest3009112-21kworker/u8:3+flush-179:023:50:011
2930308997565,8cyclictest2967203-21kworker/u8:2+events_unbound21:50:001
2930304997562,9cyclictest2957332-21kworker/u8:3+flush-179:020:45:210
2930304997562,10cyclictest1213033-21systemd-journal19:15:000
2930304997469,3cyclictest2978281-21sshd21:36:400
2930304997463,8cyclictest3006162-21kworker/u8:0+events_unbound23:10:210
2930308997364,7cyclictest1213033-21systemd-journal20:40:011
2930308997364,6cyclictest3009112-21kworker/u8:3+flush-179:023:35:241
2930308997364,6cyclictest3009055-21kworker/u8:1+flush-179:000:35:221
2930308997263,7cyclictest1213033-21systemd-journal00:04:401
2930308997258,12cyclictest2985745-21kworker/u8:0+flush-179:022:15:161
2930304997265,5cyclictest2995859-21kworker/u8:2+flush-179:022:45:170
2930308997164,5cyclictest2965075-21kworker/u8:0+flush-179:021:00:251
2930308997162,6cyclictest2936587-21kworker/u8:1+flush-179:019:40:161
2930304997168,2cyclictest3009055-21kworker/u8:1+events_unbound00:05:010
2930304997167,3cyclictest2991105-21kworker/u8:3+flush-179:022:25:400
2930304997162,6cyclictest2936587-21kworker/u8:1+flush-179:019:40:230
2930304997160,8cyclictest2975163-21kworker/u8:3+flush-179:022:00:220
2930308997062,5cyclictest3012275-21latency_hist23:25:011
2930308997062,5cyclictest3012275-21latency_hist23:25:011
2930304997062,6cyclictest2967203-21kworker/u8:2+events_unbound21:10:220
2930304997062,6cyclictest2947738-21kworker/u8:2+flush-179:020:05:210
2930304997062,5cyclictest3009055-21kworker/u8:1+flush-179:023:30:200
2930304996959,8cyclictest3023449-40mandb00:00:010
2930304996860,5cyclictest2954105-21kworker/u8:0+flush-179:020:39:400
2930308996757,8cyclictest2943225-21apt-get19:50:101
2930308996757,8cyclictest2943225-21apt-get19:50:101
2930304996757,8cyclictest2967203-21kworker/u8:2+events_unbound21:20:010
2930308996663,1cyclictest3022326-21kworker/u8:0+flush-179:000:05:271
2930308996659,5cyclictest2939830-21kworker/u8:0+flush-179:019:45:151
2930308996659,5cyclictest2932807-21kworker/u8:3+flush-179:019:25:241
2930308996659,5cyclictest2932807-21kworker/u8:3+flush-179:019:25:241
2930308996658,6cyclictest2955966-21apt-get20:30:121
2930308996452,9cyclictest2936587-21kworker/u8:1+flush-179:019:30:141
2930304996457,5cyclictest1213033-21systemd-journal23:02:250
2930304996456,6cyclictest3009055-21kworker/u8:1+flush-179:000:20:280
2930304996455,7cyclictest3020469-21/usr/sbin/munin23:50:170
2930304996455,7cyclictest2967203-21kworker/u8:2+flush-179:021:05:220
293030899631,7cyclictest2992667-21perf22:25:001
2930308996255,5cyclictest2967203-21kworker/u8:2+flush-179:021:10:141
2930308996255,5cyclictest2950914-21kworker/u8:1+events_unbound20:30:011
2930308996149,9cyclictest2952792-21apt-get20:20:131
2930304996158,2cyclictest2932807-21kworker/u8:3+events_unbound19:15:230
2930304996154,5cyclictest2975163-21kworker/u8:3+flush-179:021:40:180
2930308996047,7cyclictest2975163-21kworker/u8:3+events_unbound22:00:151
2930304996054,5cyclictest2985745-21kworker/u8:0+flush-179:022:20:150
2930308995950,6cyclictest510-21rs:main1
2930304995955,3cyclictest23940-21sendmail-mta21:30:100
2930304995952,6cyclictest3009055-21kworker/u8:1+events_unbound00:35:260
2930304995952,6cyclictest2947738-21kworker/u8:2+flush-179:020:15:010
2930304995952,6cyclictest2936587-21kworker/u8:1+flush-179:019:30:150
2930304995952,5cyclictest3009055-21kworker/u8:1+events_unbound23:40:230
2930308995855,2cyclictest1213033-21systemd-journal20:10:001
2930308995849,7cyclictest1213033-21systemd-journal19:55:011
2930304995847,8cyclictest2967203-21kworker/u8:2+flush-179:021:25:190
293030499581,55cyclictest2952517-21dump-pmu-power20:20:000
2930304995750,4cyclictest2967203-21kworker/u8:2+flush-179:021:54:590
2930308995648,6cyclictest3009112-21kworker/u8:3+flush-179:023:25:261
2930304995543,10cyclictest2983337-21apt-get21:55:150
2930304995448,4cyclictest3009112-21kworker/u8:3+events_unbound23:35:210
2930308995348,4cyclictest3026694-21kworker/u8:3+flush-179:000:30:001
2930304995346,4cyclictest2967203-21kworker/u8:2+flush-179:022:05:150
293031499520,42cyclictest2952528-21turbostat20:20:003
2930308995247,3cyclictest3009055-21kworker/u8:1+flush-179:000:25:011
2930304995243,7cyclictest3009055-21kworker/u8:1+events_unbound00:15:140
2930314995144,6cyclictest3025088-21turbostat00:05:003
2930308995145,4cyclictest3009112-21kworker/u8:3+flush-179:023:50:221
2930308995143,7cyclictest2978578-21apt-get21:40:131
2930304995142,7cyclictest1213033-21systemd-journal21:02:410
2930304995045,4cyclictest2994771-21kworker/u8:1+flush-179:022:30:220
4577091480,13ptp4l61490irq/134-eno1-TxRx-019:10:013
293030499485,40cyclictest151ktimers/020:40:140
2930304994835,10cyclictest1213033-21systemd-journal19:49:400
2930304994742,4cyclictest2936638-21systemd-run19:30:010
2930304994742,4cyclictest2936638-21systemd-run19:30:000
293031299450,1cyclictest0-21swapper/223:04:592
2930308994542,2cyclictest3009055-21kworker/u8:1+events_unbound00:10:141
2930308994539,5cyclictest2912560-21kworker/u8:2+flush-179:019:19:411
2930304994540,4cyclictest2939830-21kworker/u8:0+flush-179:020:00:250
2930304994537,6cyclictest2996079-21apt-get22:35:110
293031299440,2cyclictest0-21swapper/220:56:002
293031299440,2cyclictest0-21swapper/220:55:592
2930308994437,5cyclictest2936587-21kworker/u8:1+flush-179:019:40:001
2930308994337,5cyclictest2932807-21kworker/u8:3+flush-179:019:20:221
2930308994335,7cyclictest2967203-21kworker/u8:2+events_unbound21:25:231
2930304994336,5cyclictest2981496-21latency_hist21:50:010
2930314994237,4cyclictest2987876-21turbostat22:10:003
293031499420,2cyclictest0-21swapper/300:39:593
293031299420,39cyclictest0-21swapper/221:55:002
293030899420,5cyclictest2994237-21munin-run22:30:011
2930314994133,6cyclictest2935024-21turbostat19:25:013
293031299410,39cyclictest0-21swapper/222:12:592
2930304994136,4cyclictest2986314-21kworker/u8:1+flush-179:022:10:150
2930314994033,5cyclictest2967181-21turbostat21:05:003
293031499400,38cyclictest0-21swapper/300:19:553
293031299400,2cyclictest0-21swapper/200:39:592
2930314993934,4cyclictest3034634-21turbostat00:35:003
293031499390,1cyclictest0-21swapper/323:05:003
2930312993935,2cyclictest0-21swapper/223:19:592
2930312993934,3cyclictest0-21swapper/219:17:582
2930312993934,2cyclictest0-21swapper/221:34:552
293031299390,36cyclictest0-21swapper/223:58:592
293031299390,36cyclictest0-21swapper/200:19:552
293031299390,30cyclictest0-21swapper/222:49:552
2930314993835,2cyclictest0-21swapper/323:19:593
2930314993835,2cyclictest0-21swapper/319:17:593
2930314993831,5cyclictest2957313-21turbostat20:35:013
2930312993836,1cyclictest0-21swapper/222:10:012
2930312993834,2cyclictest0-21swapper/223:39:592
2930312993834,2cyclictest0-21swapper/200:35:002
293031299380,36cyclictest0-21swapper/220:18:592
2930314993734,2cyclictest0-21swapper/321:34:543
2930314993732,4cyclictest0-21swapper/321:23:593
2930314993732,4cyclictest0-21swapper/321:23:593
2930314993730,5cyclictest2965597-21turbostat21:00:013
2930314993730,5cyclictest2965597-21turbostat21:00:003
293031499370,36cyclictest0-21swapper/323:58:593
2930312993734,2cyclictest0-21swapper/219:39:552
2930312993732,3cyclictest0-21swapper/221:24:002
2930312993732,3cyclictest0-21swapper/221:23:592
2930312993730,5cyclictest0-21swapper/221:15:592
293031299370,2cyclictest0-21swapper/222:42:592
2930314993634,1cyclictest0-21swapper/323:39:593
2930314993630,5cyclictest3018660-21turbostat23:45:003
293031499360,1cyclictest0-21swapper/322:49:553
2930312993632,2cyclictest0-21swapper/222:36:002
2930312993632,2cyclictest0-21swapper/219:49:552
2930312993628,7cyclictest0-21swapper/200:20:592
2930314993533,1cyclictest0-21swapper/319:39:553
2930314993532,1cyclictest0-21swapper/323:09:553
2930314993529,5cyclictest2938195-21turbostat19:35:003
2930314993528,6cyclictest2936605-21turbostat19:30:013
2930314993528,6cyclictest2936605-21turbostat19:30:003
2930312993533,1cyclictest0-21swapper/221:05:002
2930312993531,2cyclictest0-21swapper/223:09:562
2930304993528,5cyclictest2930201-21latency_hist19:10:020
2930314993432,1cyclictest0-21swapper/319:49:553
2930314993430,3cyclictest0-21swapper/321:15:593
2930312993430,2cyclictest0-21swapper/222:04:542
2930312993428,4cyclictest0-21swapper/222:51:592
2930314993331,1cyclictest0-21swapper/322:35:593
2930314993330,2cyclictest0-21swapper/322:13:593
2930314993330,2cyclictest0-21swapper/322:04:553
2930314993328,4cyclictest0-21swapper/322:52:003
2930314993325,7cyclictest0-21swapper/320:40:143
293031499330,28cyclictest0-21swapper/321:05:143
293031299330,25cyclictest0-21swapper/220:26:582
293031299330,25cyclictest0-21swapper/219:12:592
293031299330,21cyclictest0-21swapper/200:05:162
2930314993227,4cyclictest0-21swapper/300:20:593
2930312993229,2cyclictest0-21swapper/223:45:002
2930312993228,2cyclictest0-21swapper/223:14:552
2930312993228,2cyclictest0-21swapper/219:32:592
2930312993228,2cyclictest0-21swapper/200:25:592
293031299320,30cyclictest0-21swapper/200:00:592
293031299320,2cyclictest0-21swapper/220:40:142
293031299320,28cyclictest0-21swapper/223:20:142
293031299320,28cyclictest0-21swapper/223:20:142
2930314993129,1cyclictest0-21swapper/323:14:553
293031499310,29cyclictest0-21swapper/322:25:143
293031499310,26cyclictest0-21swapper/323:20:143
293031499310,26cyclictest0-21swapper/323:20:143
293031499310,1cyclictest0-21swapper/320:26:593
293031499310,18cyclictest0-21swapper/319:12:593
2930312993128,2cyclictest0-21swapper/219:30:012
2930312993128,2cyclictest0-21swapper/219:30:012
2930312993127,2cyclictest0-21swapper/222:30:582
293031299310,2cyclictest0-21swapper/200:14:592
293031299310,29cyclictest0-21swapper/222:25:142
4577091300,6ptp4l441ktimers/320:05:003
2930314993028,1cyclictest0-21swapper/321:52:593
2930314993028,1cyclictest0-21swapper/300:25:593
2930314993027,2cyclictest0-21swapper/322:41:593
2930314993027,2cyclictest0-21swapper/321:43:593
2930314993026,2cyclictest0-21swapper/322:58:593
2930314993026,2cyclictest0-21swapper/322:58:593
293031499300,29cyclictest0-21swapper/320:13:593
293031499300,28cyclictest0-21swapper/319:40:143
2930312993027,2cyclictest0-21swapper/221:43:582
2930312993026,2cyclictest0-21swapper/219:58:582
293031299300,28cyclictest0-21swapper/220:50:152
293031299300,27cyclictest0-21swapper/220:13:582
293031299300,26cyclictest0-21swapper/221:05:152
4577091290,7ptp4l441ktimers/323:30:003
4577091290,6ptp4l441ktimers/319:55:003
4577091290,6ptp4l441ktimers/319:54:593
2930314992926,2cyclictest0-21swapper/322:30:593
2930314992926,2cyclictest0-21swapper/319:58:593
293031499290,28cyclictest0-21swapper/320:50:153
293031499290,27cyclictest0-21swapper/323:30:133
293031499290,27cyclictest0-21swapper/300:05:163
2930312992926,2cyclictest0-21swapper/222:59:002
2930312992926,2cyclictest0-21swapper/222:58:592
2930312992926,2cyclictest0-21swapper/219:40:142
293031299290,2cyclictest0-21swapper/223:30:132
293030899290,4cyclictest2930352-21grep19:10:021
4577091280,7ptp4l61490irq/134-eno1-TxRx-021:30:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-021:15:013
293031499280,26cyclictest0-21swapper/321:55:593
293031499280,26cyclictest0-21swapper/321:47:593
2930312992824,2cyclictest0-21swapper/220:37:002
2930312992822,5cyclictest0-21swapper/221:39:592
2930312992822,4cyclictest0-21swapper/223:25:142
293031299280,25cyclictest0-21swapper/221:47:592
4577091270,6ptp4l61490irq/134-eno1-TxRx-022:20:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-020:40:003
4577091270,6ptp4l441ktimers/323:50:023
4577091270,6ptp4l441ktimers/323:50:013
4577091270,6ptp4l441ktimers/320:09:543
4577091270,6ptp4l441ktimers/300:14:553
2930314992723,3cyclictest0-21swapper/321:39:593
2930312992724,2cyclictest0-21swapper/220:47:582
2930312992724,2cyclictest0-21swapper/219:54:592
2930312992724,2cyclictest0-21swapper/219:54:592
2930312992722,2cyclictest0-21swapper/220:07:002
293031299270,24cyclictest0-21swapper/221:55:592
4577091260,5ptp4l441ktimers/320:24:553
2930314992624,1cyclictest0-21swapper/320:47:593
2930312992623,2cyclictest0-21swapper/220:21:002
4577091250,5ptp4l441ktimers/323:54:563
2930312992521,2cyclictest0-21swapper/222:23:002
293031299250,2cyclictest0-21swapper/223:45:142
293031299250,2cyclictest0-21swapper/223:45:132
293031299250,2cyclictest0-21swapper/221:10:592
2930312992422,1cyclictest0-21swapper/222:19:592
2930312992421,2cyclictest0-21swapper/219:21:002
2930314992321,1cyclictest0-21swapper/322:22:593
2930312992320,2cyclictest0-21swapper/220:33:592
2930312992219,2cyclictest0-21swapper/220:00:152
2930312991713,2cyclictest0-21swapper/221:25:592
293031299100,1cyclictest0-21swapper/223:51:132
29303129930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional