You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 16:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Tue Nov 18, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30502499910492,5cyclictest3055010-21kworker/u8:2+events_unbound07:35:010
3050249999989,7cyclictest3082375-21latency_hist08:50:010
3050249999894,3cyclictest3074662-21kworker/u8:0+events_unbound08:30:250
3050249999079,8cyclictest3137766-21latency_hist11:40:010
3050249998882,5cyclictest3103290-21kworker/u8:2+events_unbound10:05:020
3050249998881,5cyclictest3116290-21kworker/u8:2+flush-179:010:35:260
3050250998776,8cyclictest3144120-21apt-get12:00:001
3050249998777,8cyclictest3053636-21/usr/sbin/munin07:20:230
3050250998679,5cyclictest3077634-21kworker/u8:1+flush-179:008:35:001
3050250998673,5cyclictest3074662-21kworker/u8:0+flush-179:008:40:001
3050249998474,7cyclictest3087155-21latency_hist09:05:000
3050250998372,8cyclictest3116300-21latency_hist10:35:001
3050249998277,4cyclictest3113161-21kworker/u8:1+events_unbound11:25:280
3050250998175,4cyclictest3063261-21kworker/u8:0+events_unbound07:55:241
3050249998170,4cyclictest3147600-21kworker/u8:1+flush-179:012:15:270
3050250998073,5cyclictest3123418-21kworker/u8:0+events_unbound10:55:301
3050249997975,3cyclictest3147600-21kworker/u8:1+flush-179:012:10:260
3050249997965,5cyclictest3113161-21kworker/u8:1+events_unbound11:30:010
3050249997669,5cyclictest3043891-21kworker/u8:1+events_unbound07:50:180
3050249997570,4cyclictest3103290-21kworker/u8:2+flush-179:010:15:260
3050249997562,11cyclictest3119759-21apt-get10:45:000
3050250997464,7cyclictest3132737-21latency_hist11:25:011
3050249997468,5cyclictest3085805-21kworker/u8:0+events_unbound09:20:240
3050249997368,4cyclictest3072873-21kworker/u8:3+events_unbound08:20:240
3050249997365,6cyclictest3088976-21/usr/sbin/munin09:10:250
3050249997359,4cyclictest3043891-21kworker/u8:1+events_unbound08:00:200
3050250997262,7cyclictest3101465-21latency_hist09:50:011
3050250997165,5cyclictest3121084-21kworker/u8:2+events_unbound10:45:251
3050249997167,3cyclictest3085805-21kworker/u8:0+flush-179:009:50:160
305025099700,68cyclictest723-21Xorg07:52:591
3050249997066,3cyclictest3099916-21kworker/u8:3+events_unbound10:20:250
3050249997066,3cyclictest3072873-21kworker/u8:3+flush-179:008:25:260
3050249997065,4cyclictest3136150-21kworker/u8:0+events_unbound12:00:250
3050249997065,4cyclictest3127994-21kworker/u8:2+flush-179:011:20:300
3050249997063,5cyclictest3051838-21kworker/u8:3+flush-179:007:20:000
3050249996963,5cyclictest3072873-21kworker/u8:3+events_unbound09:05:230
3050249996861,5cyclictest3113161-21kworker/u8:1+events_unbound10:50:210
3050250996761,4cyclictest3043891-21kworker/u8:1+flush-179:007:25:181
3050249996762,4cyclictest3072873-21kworker/u8:3+flush-179:008:35:220
3050249996761,4cyclictest3077634-21kworker/u8:1+events_unbound08:40:190
3050249996756,8cyclictest3051790-21latency_hist07:15:000
3050249996646,15cyclictest3066210-21apt-get08:00:010
3050250996559,4cyclictest3123418-21kworker/u8:0+events_unbound11:05:001
3050250996559,4cyclictest3123418-21kworker/u8:0+events_unbound11:05:001
3050250996558,5cyclictest3155511-21kworker/u8:3+events_unbound12:35:021
3050249996561,3cyclictest3085805-21kworker/u8:0+flush-179:009:25:210
3050249996558,6cyclictest3123418-21kworker/u8:0+events_unbound10:55:130
3050249996460,3cyclictest3150727-21kworker/u8:2+flush-179:012:20:200
3050249996460,3cyclictest3043891-21kworker/u8:1+events_unbound08:05:220
3050249996459,4cyclictest3137822-21kworker/u8:2+flush-179:011:40:220
305024999640,62cyclictest0-21swapper/009:43:590
3050250996358,3cyclictest3121588-21kworker/u8:3+flush-179:010:54:591
3050250996357,4cyclictest3139635-21kworker/u8:3+flush-179:011:45:211
3050250996357,4cyclictest3113161-21kworker/u8:1+flush-179:011:35:231
3050250996353,7cyclictest3096719-21kworker/u8:1+flush-179:009:35:251
3050249996257,4cyclictest3102092-21kworker/u8:1+flush-179:010:00:230
3050249996257,4cyclictest3043891-21kworker/u8:1+events_unbound08:10:260
3050249996256,4cyclictest3055010-21kworker/u8:2+flush-179:007:35:230
3050249996255,4cyclictest3072873-21kworker/u8:3+events_unbound08:55:200
3050249996247,9cyclictest3099916-21kworker/u8:3+events_unbound10:10:140
3050249996247,9cyclictest3099916-21kworker/u8:3+events_unbound10:10:140
3050250996156,3cyclictest3043891-21kworker/u8:1+flush-179:008:00:151
3050250996154,5cyclictest3072873-21kworker/u8:3+flush-179:008:25:221
3050249996157,3cyclictest3136150-21kworker/u8:0+flush-179:011:45:220
3050249996146,12cyclictest3116313-21apt-get10:35:000
3050250996055,4cyclictest3113161-21kworker/u8:1+flush-179:011:25:241
3050250996054,4cyclictest3113161-21kworker/u8:1+flush-179:011:15:171
3050250996049,9cyclictest3103309-21apt-get09:55:121
3050250996047,4cyclictest3048857-21kworker/u8:0+flush-179:007:15:291
3050250995954,3cyclictest3043891-21kworker/u8:1+flush-179:008:05:211
3050250995952,5cyclictest3077634-21kworker/u8:1+flush-179:008:50:281
3050249995954,4cyclictest3099916-21kworker/u8:3+flush-179:009:45:240
3050249995851,5cyclictest3113161-21kworker/u8:1+events_unbound11:00:140
3050249995851,5cyclictest3113161-21kworker/u8:1+events_unbound11:00:140
3050250995750,5cyclictest3103290-21kworker/u8:2+flush-179:010:05:231
3050250995646,8cyclictest3059799-21gzip07:38:281
3050249995652,3cyclictest3113161-21kworker/u8:1+flush-179:010:45:230
3050250995549,5cyclictest3103290-21kworker/u8:2+flush-179:010:15:181
3050249995550,4cyclictest3077634-21kworker/u8:1+flush-179:008:50:270
3050249995547,3cyclictest3085805-21kworker/u8:0+events_unbound09:35:210
3050250995448,5cyclictest3072873-21kworker/u8:3+flush-179:008:55:261
3050250995445,7cyclictest3085805-21kworker/u8:0+flush-179:009:40:291
3050250995439,13cyclictest3085805-21kworker/u8:0+flush-179:009:25:241
3050249995348,4cyclictest3136150-21kworker/u8:0+flush-179:011:50:210
3050249995348,4cyclictest3063261-21kworker/u8:0+events_unbound08:15:250
3050250995247,4cyclictest3137822-21kworker/u8:2+events_unbound11:40:241
3050250995243,5cyclictest3155511-21kworker/u8:3+flush-179:012:35:261
3050249995248,3cyclictest3147600-21kworker/u8:1+flush-179:012:30:260
3050250995144,5cyclictest3113161-21kworker/u8:1+events_unbound11:35:011
3050249995045,4cyclictest3113161-21kworker/u8:1+events_unbound11:15:230
3050250994944,4cyclictest3147606-21kworker/u8:3+events_unbound12:19:591
3050249994944,4cyclictest3043891-21kworker/u8:1+events_unbound07:25:150
4670791480,13ptp4l441ktimers/307:10:013
3050250994839,7cyclictest3099916-21kworker/u8:3+flush-179:010:00:151
3050250994838,7cyclictest3093517-21latency_hist09:25:001
3050249994844,3cyclictest3136150-21kworker/u8:0+flush-179:012:05:200
3050250994737,8cyclictest3113128-21latency_hist10:25:011
3050250994736,8cyclictest3152588-21/usr/sbin/munin12:25:251
3050249994641,4cyclictest3055010-21kworker/u8:2+flush-179:007:40:240
3050250994540,3cyclictest3055010-21kworker/u8:2+events_unbound07:40:221
3050249994540,4cyclictest3136150-21kworker/u8:0+flush-179:011:55:150
3050249994540,4cyclictest3113161-21kworker/u8:1+events_unbound11:10:220
3050249994436,6cyclictest3085805-21kworker/u8:0+flush-179:009:20:000
4670791430,6ptp4l431rcuc/308:25:003
3050250994338,4cyclictest3150727-21kworker/u8:2+events_unbound12:20:281
3050250994337,5cyclictest3113161-21kworker/u8:1+flush-179:011:10:151
3050250994335,6cyclictest3058156-21latency_hist07:35:011
3050250994330,12cyclictest3050138-21kworker/u8:2+flush-179:007:10:271
3050250994237,4cyclictest3113161-21kworker/u8:1+flush-179:012:00:261
3050250994237,3cyclictest3072873-21kworker/u8:3+flush-179:009:30:201
3050250994231,8cyclictest3126633-21apt-get11:05:141
305025499410,39cyclictest0-21swapper/211:31:002
3050250994136,4cyclictest3085805-21kworker/u8:0+flush-179:009:00:231
3050249994136,4cyclictest3112075-21kworker/u8:0+events_unbound10:25:170
3050255994034,4cyclictest3072844-21turbostat08:20:013
3050250994035,4cyclictest3099916-21kworker/u8:3+flush-179:010:10:181
3050250994035,4cyclictest3099916-21kworker/u8:3+flush-179:010:10:181
3050250994035,4cyclictest3043891-21kworker/u8:1+flush-179:008:10:231
3050250994034,5cyclictest3113161-21kworker/u8:1+flush-179:010:35:281
3050250994034,5cyclictest3087199-21kworker/u8:1+flush-179:009:15:191
305025099400,38cyclictest723-21Xorg08:43:591
305025099400,38cyclictest3113137-21turbostat10:29:551
305025499390,37cyclictest0-21swapper/210:06:592
3050250993933,4cyclictest3043891-21kworker/u8:1+flush-179:008:20:161
305025099390,2cyclictest723-21Xorg09:53:591
3050249993936,2cyclictest0-21swapper/012:40:000
3050249993935,3cyclictest3102092-21kworker/u8:1+flush-179:009:55:010
3050249993935,3cyclictest3043891-21kworker/u8:1+events_unbound07:45:230
305025499380,36cyclictest0-21swapper/212:15:592
305025499380,35cyclictest0-21swapper/209:37:592
305025499380,35cyclictest0-21swapper/208:04:562
3050250993835,2cyclictest0-21swapper/107:49:001
3050250993833,4cyclictest3136150-21kworker/u8:0+events_unbound12:05:231
3050250993830,6cyclictest3118198-21kworker/u8:0+events_unbound10:40:251
305025099380,2cyclictest723-21Xorg08:46:001
3050249993833,4cyclictest3072873-21kworker/u8:3+events_unbound09:30:250
3050255993734,2cyclictest0-21swapper/307:39:593
3050255993734,2cyclictest0-21swapper/307:29:553
305025599370,36cyclictest0-21swapper/311:29:563
305025599370,36cyclictest0-21swapper/311:19:593
305025599370,36cyclictest0-21swapper/311:09:553
3050254993734,2cyclictest0-21swapper/209:48:592
3050254993734,2cyclictest0-21swapper/208:41:592
305025499370,35cyclictest0-21swapper/211:37:582
3050250993732,4cyclictest3072873-21kworker/u8:3+events_unbound09:10:191
3050250993732,4cyclictest3063261-21kworker/u8:0+flush-179:008:15:281
3050249993732,4cyclictest3113161-21kworker/u8:1+events_unbound11:07:300
3050255993634,1cyclictest0-21swapper/312:34:563
3050255993634,1cyclictest0-21swapper/309:04:543
3050255993634,1cyclictest0-21swapper/307:46:593
3050255993634,1cyclictest0-21swapper/307:20:003
3050255993633,2cyclictest0-21swapper/312:21:593
3050255993633,2cyclictest0-21swapper/309:54:593
305025599360,35cyclictest0-21swapper/311:14:593
305025599360,35cyclictest0-21swapper/310:28:593
3050254993633,2cyclictest0-21swapper/208:29:592
3050254993633,2cyclictest0-21swapper/207:40:592
3050255993532,1cyclictest0-21swapper/309:15:593
305025599351,1cyclictest431rcuc/307:44:593
3050254993532,2cyclictest0-21swapper/212:33:582
305025499350,1cyclictest0-21swapper/209:09:592
3050255993431,2cyclictest0-21swapper/308:05:593
305025599341,31cyclictest3136190-21sleep11:34:593
3050255993326,5cyclictest3153949-21turbostat12:30:003
3050254993330,2cyclictest0-21swapper/211:21:592
3050254993330,2cyclictest0-21swapper/210:19:002
3050254993330,2cyclictest0-21swapper/208:33:592
3050254993329,2cyclictest0-21swapper/209:43:592
3050255993230,1cyclictest0-21swapper/309:34:583
3050255993227,4cyclictest3121614-21turbostat10:50:003
305025599320,30cyclictest0-21swapper/309:40:593
3050254993228,2cyclictest0-21swapper/208:53:592
3050250993226,5cyclictest3142326-21timerwakeupswit11:50:271
3050250993220,4cyclictest3147600-21kworker/u8:1+flush-179:012:10:261
3050249993227,4cyclictest3150727-21kworker/u8:2+events_unbound12:27:290
4670791310,1ptp4l431rcuc/310:20:003
3050255993129,1cyclictest0-21swapper/311:59:003
3050255993129,1cyclictest0-21swapper/311:01:003
3050255993129,1cyclictest0-21swapper/311:01:003
3050255993128,2cyclictest0-21swapper/310:10:593
3050255993128,2cyclictest0-21swapper/310:10:593
3050254993128,2cyclictest0-21swapper/208:16:002
3050255993028,1cyclictest0-21swapper/311:43:003
305025599300,2cyclictest0-21swapper/307:20:133
305025599300,28cyclictest0-21swapper/312:00:033
305025599300,28cyclictest0-21swapper/307:10:173
3050254993027,2cyclictest0-21swapper/208:35:152
3050254993026,2cyclictest0-21swapper/210:58:592
3050250993024,5cyclictest3088673-21grep09:05:271
3050255992927,1cyclictest0-21swapper/310:50:153
3050255992926,2cyclictest0-21swapper/311:38:593
3050255992926,2cyclictest0-21swapper/309:20:143
3050255992925,2cyclictest0-21swapper/307:55:143
3050255992924,4cyclictest3077607-21turbostat08:35:013
305025599290,27cyclictest0-21swapper/311:20:153
305025599290,27cyclictest0-21swapper/310:05:033
3050254992926,2cyclictest0-21swapper/208:10:152
3050254992926,2cyclictest0-21swapper/207:45:142
3050254992926,2cyclictest0-21swapper/207:20:132
3050254992925,2cyclictest0-21swapper/212:06:592
305025499290,2cyclictest0-21swapper/210:33:592
305025499290,27cyclictest0-21swapper/212:10:142
305025499290,27cyclictest0-21swapper/212:00:022
305025499290,27cyclictest0-21swapper/211:40:152
305025499290,27cyclictest0-21swapper/211:25:162
305025499290,27cyclictest0-21swapper/210:40:182
305025499290,27cyclictest0-21swapper/209:55:132
305025499290,27cyclictest0-21swapper/209:50:592
305025499290,27cyclictest0-21swapper/208:05:152
305025499290,27cyclictest0-21swapper/207:25:142
3050255992826,1cyclictest4670791ptp4l10:20:163
3050255992826,1cyclictest0-21swapper/309:25:133
3050255992825,1cyclictest4670791ptp4l08:25:163
305025599280,27cyclictest0-21swapper/308:55:163
305025599280,26cyclictest0-21swapper/310:30:153
305025599280,26cyclictest0-21swapper/309:35:173
305025599280,26cyclictest0-21swapper/308:10:163
3050254992825,2cyclictest0-21swapper/211:50:152
3050254992825,2cyclictest0-21swapper/209:24:592
3050254992825,2cyclictest0-21swapper/209:00:142
3050254992825,2cyclictest0-21swapper/208:20:142
305025499280,26cyclictest0-21swapper/212:30:002
305025499280,26cyclictest0-21swapper/207:55:132
305025499280,26cyclictest0-21swapper/207:35:142
3050255992724,2cyclictest431rcuc/308:39:553
3050255992724,2cyclictest0-21swapper/311:46:593
305025599270,26cyclictest0-21swapper/312:08:583
305025599270,1cyclictest0-21swapper/312:12:003
3050254992724,2cyclictest0-21swapper/209:17:002
3050254992724,2cyclictest0-21swapper/207:30:592
3050254992723,2cyclictest0-21swapper/209:30:592
305025499270,25cyclictest0-21swapper/207:52:582
305025499270,25cyclictest0-21swapper/207:12:582
305025499270,1cyclictest0-21swapper/209:28:592
3050250992719,7cyclictest3051838-21kworker/u8:3+events_unbound07:20:231
4670791260,4ptp4l61690irq/136-eno1-TxRx-012:40:023
3050255992624,1cyclictest0-21swapper/308:48:593
305025599260,25cyclictest0-21swapper/309:59:553
305025599260,25cyclictest0-21swapper/308:04:593
305025599260,24cyclictest0-21swapper/307:50:123
305025599260,1cyclictest0-21swapper/307:31:593
3050254992623,2cyclictest0-21swapper/211:05:592
3050254992623,2cyclictest0-21swapper/210:45:032
3050254992622,2cyclictest0-21swapper/211:47:592
305025499260,24cyclictest0-21swapper/207:18:082
4670791250,3ptp4l441ktimers/312:20:013
3050255992521,3cyclictest431rcuc/310:44:563
3050254992522,2cyclictest0-21swapper/211:00:142
3050254992522,2cyclictest0-21swapper/211:00:142
3050254992522,2cyclictest0-21swapper/209:11:592
202199250,13rtkit-daemon3048876-21apt-get07:05:121
4670791240,6ptp4l61690irq/136-eno1-TxRx-009:50:013
4670791240,3ptp4l61690irq/136-eno1-TxRx-011:54:553
4670791240,3ptp4l61690irq/136-eno1-TxRx-011:00:003
4670791240,3ptp4l61690irq/136-eno1-TxRx-008:45:003
4670791240,3ptp4l441ktimers/310:39:563
4670791240,3ptp4l441ktimers/308:55:013
4670791230,3ptp4l61690irq/136-eno1-TxRx-010:05:013
4670791230,3ptp4l441ktimers/309:14:563
3050255992321,1cyclictest0-21swapper/309:05:583
3050254992321,1cyclictest0-21swapper/210:25:582
3050254992320,2cyclictest0-21swapper/208:45:592
3050254992220,1cyclictest0-21swapper/211:57:592
3050254992118,2cyclictest0-21swapper/210:38:592
3050254992017,2cyclictest0-21swapper/211:19:582
3050254991917,1cyclictest0-21swapper/211:15:002
3050254991916,2cyclictest0-21swapper/210:01:592
305024999192,13cyclictest3050251-21latency_hist07:10:010
3050254991613,2cyclictest0-21swapper/210:23:592
3050254991411,2cyclictest0-21swapper/208:58:002
3050254991310,2cyclictest0-21swapper/212:21:592
305025499108,2cyclictest0-21swapper/212:39:552
30502549985,2cyclictest0-21swapper/210:50:152
30502549985,2cyclictest0-21swapper/210:10:592
30502549985,2cyclictest0-21swapper/210:10:592
30502549930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional