You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 19:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Tue Dec 16, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2932031999279,9cyclictest3020893-21latency_hist11:45:011
2932031998871,14cyclictest3000173-21kworker/u8:2+flush-179:010:55:261
2932031998477,4cyclictest2986926-21latency_hist10:00:001
2932031998172,6cyclictest3009479-21latency_hist11:10:011
2932031998170,9cyclictest2948137-21apt-get07:59:561
2932031997266,4cyclictest3003108-21latency_hist10:50:011
2932031997164,4cyclictest2938591-21kworker/u8:3+events_unbound07:35:001
2932031996962,5cyclictest2931943-21kworker/u8:3+events_unbound07:15:001
2932031996961,6cyclictest3027520-21latency_hist12:05:011
2932030996963,4cyclictest2968824-21kworker/u8:3+events_unbound09:05:250
293203099690,5cyclictest714-21Xorg11:32:590
2932031996643,21cyclictest266-21systemd-journal08:55:011
2932030996357,4cyclictest2946771-21kworker/u8:1+events_unbound08:10:020
2932031996254,6cyclictest2936969-21latency_hist07:25:011
2932030996151,8cyclictest3011323-21apt-get11:15:130
2932030996151,8cyclictest3006544-21/usr/sbin/munin11:00:240
2932030996052,6cyclictest3027528-21apt-get12:04:590
2932030996052,6cyclictest2998329-21latency_hist10:35:010
2932030995952,5cyclictest2996554-21kworker/u8:0+flush-179:010:35:240
2932031995852,4cyclictest3015473-21kworker/u8:0+flush-179:011:30:261
2932030995852,4cyclictest2985299-21kworker/u8:0+flush-179:010:05:170
2932030995851,5cyclictest3034444-21kworker/u8:2+flush-179:012:40:000
2932031995749,6cyclictest2992198-21/usr/sbin/munin10:15:241
2932031995749,6cyclictest2992198-21/usr/sbin/munin10:15:241
2932034995653,2cyclictest0-21swapper/207:16:002
2932030995651,4cyclictest2946771-21kworker/u8:1+events_unbound08:15:250
2932030995650,5cyclictest2996554-21kworker/u8:0+flush-179:010:55:000
2932031995544,9cyclictest2971258-21apt-get09:10:141
2932030995547,6cyclictest3025920-21latency_hist12:00:010
2932030995547,6cyclictest3025920-21latency_hist12:00:000
2932031995445,7cyclictest3035995-21latency_hist12:30:001
2932030995450,3cyclictest2946771-21kworker/u8:1+events_unbound08:05:010
2932030995449,4cyclictest2931881-21kworker/u8:2+events_unbound07:25:000
2932030995447,5cyclictest3027497-21kworker/u8:1+flush-179:012:05:180
2932030995443,9cyclictest3032696-21store12:20:010
2932030995443,9cyclictest3032696-21store12:20:000
2932031995342,9cyclictest266-21systemd-journal11:40:001
2932030995348,4cyclictest2956189-21kworker/u8:2+flush-179:008:25:240
2932030995247,4cyclictest2944983-21kworker/u8:0+flush-179:007:55:150
2932031995147,2cyclictest714-21Xorg10:43:001
2932030995148,2cyclictest0-21swapper/007:15:590
2932030995146,4cyclictest3009514-21kworker/u8:3+flush-179:011:35:260
2932030995137,12cyclictest2967588-21apt-get09:00:010
2932030995043,5cyclictest2945205-21apt-get07:50:120
4577091490,13ptp4l441ktimers/307:10:013
2932030994940,7cyclictest2933526-21apt-get07:15:010
2932031994839,7cyclictest3013220-21diskstats11:20:161
2932031994838,8cyclictest2957740-21latency_hist08:30:011
2932030994842,4cyclictest2978950-21kworker/u8:3+flush-179:009:35:230
2932031994539,4cyclictest2968824-21kworker/u8:3+flush-179:009:20:001
2932030994540,4cyclictest3015473-21kworker/u8:0+flush-179:011:40:230
2932030994539,4cyclictest2968824-21kworker/u8:3+flush-179:009:20:240
2932031994439,4cyclictest2978950-21kworker/u8:3+flush-179:009:54:381
293203099444,8cyclictest2954824-21apt-get08:20:140
2932030994440,3cyclictest484-21dbus-daemon07:30:010
2932030994439,4cyclictest2978950-21kworker/u8:3+flush-179:009:45:240
2932030994439,4cyclictest2957768-21kworker/u8:1+events_unbound08:30:250
2932031994339,3cyclictest2991397-21kworker/u8:2+flush-179:010:20:241
2932031994336,5cyclictest2978950-21kworker/u8:3+flush-179:009:50:001
2932031994335,7cyclictest2996554-21kworker/u8:0+flush-179:010:40:011
2932030994334,7cyclictest3027497-21kworker/u8:1+flush-179:012:20:030
2932036994240,1cyclictest0-21swapper/311:09:593
2932036994236,5cyclictest2974195-21turbostat09:20:013
2932031994224,16cyclictest266-21systemd-journal12:19:081
2932031994224,16cyclictest266-21systemd-journal12:19:081
2932030994237,4cyclictest2957768-21kworker/u8:1+flush-179:008:40:230
2932030994237,4cyclictest2938591-21kworker/u8:3+events_unbound07:40:240
2932030994236,3cyclictest3009517-21systemd-run11:09:590
2932034994139,1cyclictest0-21swapper/209:39:592
2932031994135,4cyclictest3006004-21kworker/u8:1+flush-179:011:00:131
2932036994034,5cyclictest2954554-21turbostat08:19:593
2932036994034,5cyclictest0-21swapper/309:48:593
2932036994033,6cyclictest0-21swapper/308:35:593
2932036994033,6cyclictest0-21swapper/308:35:593
2932031994038,1cyclictest0-21swapper/109:04:551
293203099405,34cyclictest3020900-21apt-get11:45:020
2932030994035,4cyclictest3034444-21kworker/u8:2+flush-179:012:30:240
2932030994034,4cyclictest3006308-21munin-run11:00:000
2932030994030,6cyclictest0-21swapper/010:15:590
2932030994030,6cyclictest0-21swapper/010:15:590
293203099401,35cyclictest2987196-21apt-get10:00:140
293203499390,36cyclictest0-21swapper/208:58:592
2932031993935,3cyclictest714-21Xorg07:45:591
2932031993933,5cyclictest2991397-21kworker/u8:2+flush-179:010:25:261
2932031993933,4cyclictest3015473-21kworker/u8:0+flush-179:011:55:261
2932031993933,4cyclictest3015473-21kworker/u8:0+flush-179:011:55:251
293203199393,31cyclictest2966215-21apt-get08:55:141
2932031993930,6cyclictest510-21rs:main1
2932030993932,5cyclictest3015473-21kworker/u8:0+events_unbound12:25:210
2932030993931,6cyclictest2951606-21kworker/u8:0+flush-179:008:50:220
293203499380,35cyclictest0-21swapper/210:05:592
2932031993835,2cyclictest3012714-21systemd-run11:20:011
2932031993830,6cyclictest3029603-21/usr/sbin/munin12:10:161
2932030993834,3cyclictest714-21Xorg08:45:580
2932030993834,3cyclictest2986976-21systemd-run10:00:010
2932030993834,3cyclictest2971468-21kworker/u8:0+flush-179:009:19:560
2932030993833,4cyclictest2988506-21kworker/u8:1+events_unbound10:10:140
2932030993833,4cyclictest2971468-21kworker/u8:0+events_unbound09:10:200
2932030993830,6cyclictest3009461-21kworker/u8:0+flush-179:011:15:000
2932030993830,6cyclictest3001524-21latency_hist10:45:000
293203099382,30cyclictest3014519-21apt-get11:25:150
2932036993734,2cyclictest0-21swapper/309:33:593
293203499370,1cyclictest0-21swapper/208:39:552
293203499370,1cyclictest0-21swapper/208:39:552
2932031993732,3cyclictest2946566-21systemd-run07:55:001
293203199370,34cyclictest3027528-21apt-get12:05:011
2932030993731,5cyclictest2934008-21kworker/u8:0+events_unbound07:35:240
2932036993631,4cyclictest2971013-21turbostat09:09:593
2932036993630,5cyclictest2962796-21turbostat08:45:003
2932036993630,4cyclictest2956171-21turbostat08:25:003
2932034993633,2cyclictest0-21swapper/210:01:592
2932031993627,7cyclictest266-21systemd-journal07:20:011
2932030993631,3cyclictest2978999-21systemd-run09:35:010
2932030993630,4cyclictest3012711-21kworker/u8:1+events_unbound11:20:200
2932030993626,8cyclictest2968086-21apt-get09:00:120
2932036993533,1cyclictest0-21swapper/309:00:593
2932034993533,1cyclictest0-21swapper/207:40:002
2932031993531,3cyclictest0-21swapper/107:40:011
2932031993530,3cyclictest2948453-21apt-get08:00:151
2932031993529,4cyclictest2957768-21kworker/u8:1+events_unbound08:40:231
2932030993531,3cyclictest714-21Xorg09:26:590
2932030993527,6cyclictest2996554-21kworker/u8:0+flush-179:010:30:000
2932030993525,5cyclictest0-21swapper/007:33:590
2932036993432,1cyclictest0-21swapper/308:09:003
2932036993429,4cyclictest2998343-21turbostat10:35:003
293203699340,1cyclictest0-21swapper/311:45:133
2932034993431,2cyclictest0-21swapper/209:07:002
2932031993428,5cyclictest2968824-21kworker/u8:3+events_unbound09:25:271
2932031993426,7cyclictest2990585-21cp10:10:011
293203199341,32cyclictest2956164-21awk08:25:011
2932030993426,5cyclictest2946771-21kworker/u8:1+flush-179:008:10:160
2932036993328,4cyclictest2986928-21turbostat10:00:013
2932034993330,2cyclictest0-21swapper/209:22:592
2932031993329,3cyclictest714-21Xorg09:43:591
2932031993328,4cyclictest2975783-21cron09:25:001
2932031993324,7cyclictest2952957-21latency_hist08:15:001
293203699320,30cyclictest0-21swapper/307:15:013
293203699320,26cyclictest0-21swapper/312:25:143
293203699320,1cyclictest0-21swapper/310:40:143
2932034993229,2cyclictest0-21swapper/209:11:592
2932034993228,2cyclictest0-21swapper/208:25:592
293203499320,30cyclictest0-21swapper/207:52:592
2932031993227,4cyclictest3012711-21kworker/u8:1+flush-179:011:25:261
2932031993226,5cyclictest2985299-21kworker/u8:0+flush-179:010:00:261
2932031993225,5cyclictest2978962-21latency_hist09:35:011
2932031993224,6cyclictest2937209-21/usr/sbin/munin07:25:231
293203199321,29cyclictest0-21swapper/112:35:111
293203099321,4cyclictest0-21swapper/012:10:130
2932036993125,5cyclictest2938568-21turbostat07:30:003
2932036993125,5cyclictest0-21swapper/311:20:153
2932036993119,11cyclictest2957755-21turbostat08:30:013
293203699310,1cyclictest0-21swapper/308:02:583
293203699310,1cyclictest0-21swapper/307:15:023
2932034993128,2cyclictest0-21swapper/210:17:002
2932034993128,2cyclictest0-21swapper/210:16:592
2932031993129,1cyclictest3021408-21apt-get11:45:141
2932031993127,3cyclictest0-21swapper/110:55:011
2932031993126,4cyclictest2946771-21kworker/u8:1+flush-179:008:05:161
2932030993128,2cyclictest2991397-21kworker/u8:2+events_unbound10:20:150
2932030993127,3cyclictest2985366-21sh09:55:010
2932030993125,4cyclictest2978950-21kworker/u8:3+flush-179:009:40:220
2932030993122,7cyclictest2956189-21kworker/u8:2+events_unbound08:35:200
2932030993122,7cyclictest2956189-21kworker/u8:2+events_unbound08:35:190
2932030993121,5cyclictest0-21swapper/007:45:150
293203099310,28cyclictest3022994-21apt-get11:50:150
4577091300,7ptp4l441ktimers/307:40:003
2932036993024,5cyclictest2948201-21turbostat08:00:003
2932034993027,2cyclictest0-21swapper/212:05:132
2932034993027,2cyclictest0-21swapper/211:35:152
2932034993027,2cyclictest0-21swapper/211:10:142
2932034993027,2cyclictest0-21swapper/211:00:142
2932034993027,2cyclictest0-21swapper/210:55:152
2932034993027,2cyclictest0-21swapper/210:10:032
293203499300,2cyclictest0-21swapper/212:35:102
293203499300,2cyclictest0-21swapper/207:10:152
293203499300,29cyclictest0-21swapper/211:25:162
2932031993026,3cyclictest492-21polkitd11:50:261
2932031993025,4cyclictest3009461-21kworker/u8:0+flush-179:011:15:001
2932031993025,4cyclictest2985299-21kworker/u8:0+events_unbound10:05:261
293203199301,27cyclictest714-21Xorg08:16:591
4577091290,7ptp4l61490irq/134-eno1-TxRx-012:15:013
293203699290,28cyclictest0-21swapper/312:15:143
293203699290,28cyclictest0-21swapper/312:15:143
293203699290,27cyclictest0-21swapper/312:30:133
293203699290,27cyclictest0-21swapper/309:25:153
2932034992927,1cyclictest0-21swapper/211:55:152
2932034992927,1cyclictest0-21swapper/211:55:152
2932034992926,2cyclictest0-21swapper/207:25:142
293203499290,2cyclictest0-21swapper/208:06:582
293203499290,27cyclictest0-21swapper/212:10:132
293203499290,27cyclictest0-21swapper/212:00:142
293203499290,27cyclictest0-21swapper/211:45:032
293203499290,27cyclictest0-21swapper/209:50:592
2932031992924,4cyclictest2968824-21kworker/u8:3+flush-179:009:05:211
2932031992924,4cyclictest2963457-21gltestperf08:45:171
2932031992917,10cyclictest2980575-21munin-run09:40:001
293203199290,2cyclictest714-21Xorg08:40:001
293203199290,2cyclictest714-21Xorg08:39:591
293203199290,28cyclictest0-21swapper/112:30:151
293203199290,1cyclictest0-21swapper/108:34:581
2932030992924,4cyclictest1-21systemd10:50:000
4577091280,7ptp4l441ktimers/307:35:013
4577091280,6ptp4l61490irq/134-eno1-TxRx-007:45:003
4577091280,6ptp4l441ktimers/312:40:003
2932036992826,1cyclictest0-21swapper/309:50:143
2932036992826,1cyclictest0-21swapper/308:50:143
2932036992825,2cyclictest0-21swapper/310:10:013
2932036992823,4cyclictest0-21swapper/311:59:593
2932036992823,4cyclictest0-21swapper/311:59:593
293203699280,27cyclictest0-21swapper/311:40:143
293203699280,27cyclictest0-21swapper/309:40:143
293203699280,26cyclictest0-21swapper/312:20:033
293203699280,26cyclictest0-21swapper/311:30:143
293203699280,26cyclictest0-21swapper/310:45:143
293203699280,26cyclictest0-21swapper/310:25:153
293203699280,26cyclictest0-21swapper/309:20:153
293203699280,26cyclictest0-21swapper/307:20:133
293203699280,21cyclictest0-21swapper/311:35:023
2932034992825,2cyclictest0-21swapper/211:05:142
2932034992825,2cyclictest0-21swapper/208:41:592
2932034992825,2cyclictest0-21swapper/207:30:152
293203499280,27cyclictest0-21swapper/209:00:032
293203499280,26cyclictest0-21swapper/211:50:142
293203499280,26cyclictest0-21swapper/210:50:152
293203499280,26cyclictest0-21swapper/208:20:132
293203499280,26cyclictest0-21swapper/207:40:122
293203499280,25cyclictest0-21swapper/208:19:342
2932031992826,1cyclictest2942031-21apt-get07:40:131
4577091270,7ptp4l61490irq/134-eno1-TxRx-010:25:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-008:35:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-007:50:013
4577091270,6ptp4l441ktimers/312:04:553
4577091270,6ptp4l441ktimers/310:59:553
4577091270,6ptp4l441ktimers/308:49:543
4577091270,5ptp4l441ktimers/310:55:003
293203699270,26cyclictest0-21swapper/310:04:273
293203699270,26cyclictest0-21swapper/308:10:133
293203699270,26cyclictest0-21swapper/307:51:553
2932034992723,2cyclictest0-21swapper/207:20:252
293203499270,25cyclictest0-21swapper/211:30:152
293203499270,25cyclictest0-21swapper/210:20:132
293203499270,25cyclictest0-21swapper/208:12:362
293203499270,25cyclictest0-21swapper/208:03:112
293203499270,25cyclictest0-21swapper/207:45:512
293203199270,2cyclictest2997283-21df_inode10:30:151
4577091260,6ptp4l61490irq/134-eno1-TxRx-011:05:013
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:40:003
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:20:013
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:20:013
4577091260,5ptp4l441ktimers/309:39:573
4577091260,4ptp4l441ktimers/311:54:563
2932036992624,1cyclictest0-21swapper/308:55:143
293203699260,24cyclictest0-21swapper/311:10:143
2932034992623,2cyclictest0-21swapper/211:25:012
2932034992623,2cyclictest0-21swapper/210:30:182
2932034992623,2cyclictest0-21swapper/208:51:592
293203499260,2cyclictest0-21swapper/207:56:252
293203499260,24cyclictest0-21swapper/212:20:022
293203499260,24cyclictest0-21swapper/210:40:252
293203499260,24cyclictest0-21swapper/210:25:282
293203499260,24cyclictest0-21swapper/209:25:152
293203499260,24cyclictest0-21swapper/208:49:342
4577091250,5ptp4l61490irq/134-eno1-TxRx-012:10:003
4577091250,5ptp4l61490irq/134-eno1-TxRx-011:29:553
4577091250,4ptp4l441ktimers/311:19:553
2932036992523,1cyclictest0-21swapper/310:05:573
293203699250,24cyclictest0-21swapper/309:10:593
2932034992522,2cyclictest0-21swapper/211:40:152
2932034992522,2cyclictest0-21swapper/210:45:172
2932034992522,2cyclictest0-21swapper/209:31:032
2932034992521,2cyclictest0-21swapper/209:59:272
293203499250,2cyclictest0-21swapper/210:35:162
293203499250,2cyclictest0-21swapper/209:49:172
293203499250,2cyclictest0-21swapper/209:17:052
2932034992421,2cyclictest0-21swapper/211:15:172
2932031992420,3cyclictest0-21swapper/107:10:021
2932034992320,2cyclictest0-21swapper/208:33:572
2932034992219,2cyclictest0-21swapper/212:30:142
2932034992219,2cyclictest0-21swapper/209:44:202
2932034992119,1cyclictest0-21swapper/212:20:022
2932034992119,1cyclictest0-21swapper/212:20:022
2932030992115,4cyclictest0-21swapper/007:10:020
293203499118,2cyclictest0-21swapper/212:26:592
29320349930,1cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional