You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 00:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue May 19, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3032704994840,5cyclictest3272711-21latency_hist11:00:000
3032712994339,3cyclictest3058476-21kworker/u8:1+flush-259:008:00:012
3032714994133,5cyclictest3355704-21latency_hist12:20:013
3032707994036,3cyclictest3277865-21kworker/u8:1+events_unbound11:10:011
3032712993531,3cyclictest3210777-21kworker/u8:2+flush-259:010:05:212
3032712993431,2cyclictest3355931-21kworker/u8:4+flush-259:012:35:002
3032712993431,2cyclictest3303711-21kworker/u8:0+flush-259:012:00:162
3032712993429,4cyclictest3189713-21latency_hist09:40:002
3032714993226,4cyclictest3267996-21diskstats10:55:153
3032712993229,2cyclictest3184801-21kworker/u8:1+events_unbound09:40:222
3032712993228,3cyclictest3277865-21kworker/u8:1+events_unbound11:25:212
3032707993226,4cyclictest3043399-21latency_hist07:20:011
3032712993128,2cyclictest3210992-21kworker/u8:3+flush-259:010:25:212
3032712993027,2cyclictest4077320-21kworker/u8:3+events_unbound07:10:182
3032712993027,2cyclictest3101028-21kworker/u8:4+flush-259:009:35:012
3032707993025,3cyclictest3329465-21latency_hist11:55:001
3032714992822,4cyclictest3226273-21latency_hist10:15:013
3032712992825,2cyclictest3137517-21kworker/u8:5+events_unbound09:10:172
3032712992824,3cyclictest3210992-21kworker/u8:3+flush-259:010:30:222
3032707992824,3cyclictest3226499-21kworker/u8:4+flush-259:010:20:211
3032704992821,5cyclictest335557-21systemd-journal11:55:000
303270499281,25cyclictest1-21systemd12:30:540
3032714992721,4cyclictest3101028-21kworker/u8:4+flush-259:008:30:013
3032714992720,5cyclictest3130997-21ntpq08:40:203
3032712992724,2cyclictest3137517-21kworker/u8:5+flush-259:010:00:012
3032707992723,3cyclictest335557-21systemd-journal09:42:561
3032704992722,3cyclictest3278088-21/usr/sbin/munin11:05:150
3032714992620,4cyclictest3231465-21latency_hist10:20:013
3032714992619,5cyclictest3236642-21latency_hist10:25:003
3032712992621,4cyclictest3360954-21latency_hist12:25:002
3032714992521,3cyclictest3058476-21kworker/u8:1+flush-259:008:15:173
3032712992522,2cyclictest3293546-21kworker/u8:4+flush-259:011:35:162
3032712992521,3cyclictest3226499-21kworker/u8:4+events_unbound10:58:572
3032714992419,3cyclictest3334643-21apt-get12:00:013
3032714992417,5cyclictest3350555-21latency_hist12:15:013
3032712992420,3cyclictest3257309-21kworker/u8:1+flush-259:010:48:572
3032707992421,2cyclictest3111328-21kworker/u8:2+events_unbound08:28:551
3032707992420,3cyclictest335557-21systemd-journal10:44:561
3032707992420,3cyclictest3080188-21/usr/sbin/munin07:55:161
3032707992419,4cyclictest3209918-21ntpq09:55:231
3032712992320,2cyclictest3210992-21kworker/u8:3+events_unbound10:35:222
3032712992320,2cyclictest3132560-21kworker/u8:0+flush-259:009:50:172
3032712992320,2cyclictest3121813-21kworker/u8:3+flush-259:008:55:252
3032712992320,2cyclictest3058476-21kworker/u8:1+events_unbound08:30:122
3032712992319,3cyclictest3267798-21kworker/u8:2+events_unbound11:05:152
3032712992318,3cyclictest3293317-21latency_hist11:20:012
3032707992318,4cyclictest3169276-21cat09:20:011
3032704992317,4cyclictest3090273-21apt-get08:05:010
3032714992219,2cyclictest4166533-21kworker/u8:2+flush-259:007:40:223
3032712992218,3cyclictest3058476-21kworker/u8:1+events_unbound08:22:572
3032712992216,4cyclictest3376382-21latency_hist12:39:592
3032712992216,4cyclictest3079523-21latency_hist07:55:002
3032707992219,2cyclictest3058476-21kworker/u8:1+events_unbound08:30:161
3032707992218,3cyclictest3226499-21kworker/u8:4+events_unbound10:28:521
3032707992216,4cyclictest335557-21systemd-journal12:13:551
303270499227,5cyclictest3163918-21diskstats09:15:140
3032704992215,5cyclictest3184573-21latency_hist09:35:000
3032714992115,4cyclictest3313953-21latency_hist11:40:013
3032714992114,5cyclictest335557-21systemd-journal07:20:013
3032712992118,2cyclictest3210777-21kworker/u8:2+flush-259:010:05:002
3032712992118,2cyclictest3132560-21kworker/u8:0+events_unbound09:45:182
3032712992118,2cyclictest3132560-21kworker/u8:0+events_unbound08:45:182
3032712992118,2cyclictest3058476-21kworker/u8:1+flush-259:008:00:152
3032712992117,3cyclictest3303917-21kworker/u8:3+events_unbound12:10:562
3032707992118,2cyclictest3319344-21kworker/u8:2+events_unbound11:59:081
3032707992118,2cyclictest3303711-21kworker/u8:0+flush-259:011:45:241
3032707992118,2cyclictest3058476-21kworker/u8:1+flush-259:008:45:581
3032707992117,3cyclictest3137517-21kworker/u8:5+events_unbound09:13:581
3032707992117,3cyclictest3132560-21kworker/u8:0+events_unbound09:50:571
3032707992115,4cyclictest3334664-21http12:00:011
3032704992116,3cyclictest335557-21systemd-journal10:10:550
3032704992116,3cyclictest3252346-21/usr/sbin/munin10:40:180
303270499210,19cyclictest1-21systemd12:15:540
3032714992015,4cyclictest507-21in:imuxsock07:50:013
3032714992015,3cyclictest3126623-21journal-offline08:38:333
3032714992015,3cyclictest3126623-21journal-offline08:38:323
3032714992014,4cyclictest3308825-21cron11:35:003
3032712992017,2cyclictest3293546-21kworker/u8:4+events_unbound11:44:542
3032712992017,2cyclictest3293546-21kworker/u8:4+events_unbound11:30:182
3032712992017,2cyclictest3277865-21kworker/u8:1+flush-259:011:55:212
3032712992017,2cyclictest3027755-21kworker/u8:4+events_unbound07:30:182
3032712992016,3cyclictest4166533-21kworker/u8:2+events_unbound07:38:212
3032712992016,3cyclictest3226499-21kworker/u8:4+events_unbound10:20:152
3032707992017,2cyclictest3303711-21kworker/u8:0+events_unbound11:44:051
3032707992016,3cyclictest3277865-21kworker/u8:1+events_unbound11:25:161
3032707992016,3cyclictest3210992-21kworker/u8:3+events_unbound10:15:561
3032707992014,4cyclictest3169068-21cp09:20:001
3032704992014,4cyclictest3334643-21apt-get12:00:010
3032704992013,5cyclictest3266674-21ntpq10:50:210
3032714991914,3cyclictest3277865-21kworker/u8:1+flush-259:011:25:163
3032714991914,3cyclictest3267798-21kworker/u8:2+flush-259:011:10:003
3032714991914,3cyclictest3184833-21apt-get09:35:113
3032714991912,5cyclictest3168683-21latency_hist09:20:013
3032712991917,2cyclictest3101028-21kworker/u8:4+events_unbound09:15:222
3032712991916,2cyclictest3048771-21kworker/u8:0+flush-259:007:45:252
3032712991915,3cyclictest3355931-21kworker/u8:4+events_unbound12:25:572
3032712991915,3cyclictest3101028-21kworker/u8:4+events_unbound09:05:192
3032707991916,2cyclictest3132560-21kworker/u8:0+flush-259:009:48:451
3032707991916,2cyclictest3132560-21kworker/u8:0+flush-259:008:50:151
3032707991916,2cyclictest3132560-21kworker/u8:0+events_unbound10:03:481
3032707991916,2cyclictest3058476-21kworker/u8:1+flush-259:008:20:161
3032707991916,2cyclictest3058476-21kworker/u8:1+events_unbound08:10:231
3032707991915,3cyclictest3277865-21kworker/u8:1+events_unbound12:16:571
3032707991915,3cyclictest3210992-21kworker/u8:3+events_unbound10:05:181
3032707991913,5cyclictest3095815-21latency_hist08:10:001
3032704991913,4cyclictest509-21rs:main0
3032704991913,4cyclictest3309259-21diskstats11:35:110
3032704991913,4cyclictest3246117-21ntpq10:30:200
3032704991913,4cyclictest3204270-21ntpq09:50:210
3032704991912,1cyclictest60350irq/132-enp0s29f1:rx-011:10:120
3032714991815,2cyclictest2971-21cron09:55:003
3032714991814,2cyclictest0-21swapper/308:50:003
3032712991815,2cyclictest3132560-21kworker/u8:0+flush-259:009:25:182
3032712991815,2cyclictest3132560-21kworker/u8:0+flush-259:008:50:232
3032712991815,2cyclictest3058476-21kworker/u8:1+events_unbound08:30:012
3032712991812,5cyclictest3068392-21ntpq07:40:192
3032707991815,3cyclictest3303917-21kworker/u8:3+events_unbound12:06:551
3032707991815,2cyclictest3293546-21kworker/u8:4+events_unbound11:36:571
3032707991815,2cyclictest3267798-21kworker/u8:2+events_unbound11:20:231
3032707991815,2cyclictest3058476-21kworker/u8:1+events_unbound08:15:231
3032707991814,3cyclictest4166533-21kworker/u8:2+flush-259:007:35:211
3032707991814,3cyclictest3101028-21kworker/u8:4+events_unbound09:32:581
3032707991814,3cyclictest3058476-21kworker/u8:1+events_unbound08:04:561
3032707991814,3cyclictest3058476-21kworker/u8:1+events_unbound07:33:191
3032707991814,3cyclictest3048771-21kworker/u8:0+flush-259:007:30:011
3032704991815,2cyclictest3158994-21irqcore09:10:170
3032704991814,3cyclictest3027755-21kworker/u8:4+flush-259:007:15:170
3032704991812,4cyclictest3136631-21ntpq08:45:200
3032714991713,3cyclictest3132560-21kworker/u8:0+flush-259:010:00:253
3032714991713,2cyclictest0-21swapper/309:10:003
3032712991714,2cyclictest3132560-21kworker/u8:0+events_unbound10:41:572
3032712991714,2cyclictest3095471-21kworker/u8:0+events_unbound08:16:582
3032712991713,3cyclictest3303711-21kworker/u8:0+events_unbound12:09:542
3032712991713,3cyclictest3132560-21kworker/u8:0+flush-259:010:50:262
3032707991714,2cyclictest3371245-21cron12:35:001
3032707991714,2cyclictest3267798-21kworker/u8:2+flush-259:011:10:161
3032707991714,2cyclictest3101028-21kworker/u8:4+events_unbound09:08:561
3032707991714,2cyclictest3027755-21kworker/u8:4+events_unbound07:40:191
3032707991713,3cyclictest3361217-21apt-get12:25:111
3032704991714,2cyclictest60350irq/132-enp0s29f1:rx-011:02:150
3032704991714,2cyclictest60350irq/132-enp0s29f1:rx-009:35:120
3032704991714,2cyclictest3131896-21idleruntime-cro08:45:010
3032704991713,3cyclictest3121813-21kworker/u8:3+flush-259:008:35:170
3032704991713,3cyclictest3121813-21kworker/u8:3+flush-259:008:35:160
3032704991713,2cyclictest60350irq/132-enp0s29f1:rx-008:10:170
3032704991713,2cyclictest3158318-21turbostat09:10:000
3032704991711,4cyclictest335557-21systemd-journal08:23:300
3032704991710,5cyclictest3235783-21ntpq10:20:220
3032714991613,2cyclictest3355931-21kworker/u8:4+flush-259:012:25:243
3032714991613,2cyclictest3033330-21irqcore07:10:163
3032714991612,3cyclictest3256392-21ntp_kernel_pll_10:40:213
3032712991613,2cyclictest4166533-21kworker/u8:2+flush-259:007:20:212
3032712991613,2cyclictest3210992-21kworker/u8:3+events_unbound10:13:522
3032712991613,2cyclictest3058476-21kworker/u8:1+flush-259:008:10:162
3032712991612,3cyclictest3303711-21kworker/u8:0+events_unbound11:45:262
3032712991611,4cyclictest3079417-21kworker/u8:2+events_unbound08:06:072
303271299160,14cyclictest1-21systemd11:25:012
3032707991613,2cyclictest3293546-21kworker/u8:4+flush-259:011:30:241
3032707991613,2cyclictest3226499-21kworker/u8:4+events_unbound10:58:551
3032707991612,3cyclictest3132560-21kworker/u8:0+events_unbound11:02:571
3032704991614,2cyclictest60350irq/132-enp0s29f1:rx-012:21:120
3032704991614,1cyclictest0-21swapper/010:50:000
3032704991613,2cyclictest3346092-21irqcore12:10:170
3032704991612,3cyclictest60350irq/132-enp0s29f1:rx-011:40:130
3032704991612,3cyclictest60350irq/132-enp0s29f1:rx-011:30:170
3032704991612,3cyclictest3226499-21kworker/u8:4+flush-259:010:18:560
3032704991612,2cyclictest60350irq/132-enp0s29f1:rx-010:25:230
303271499159,5cyclictest335557-21systemd-journal08:02:553
3032714991512,2cyclictest3329453-21cron11:55:013
3032714991512,2cyclictest3242476-21irqcore10:30:143
3032714991510,3cyclictest3137517-21kworker/u8:5+flush-259:009:10:253
303271299159,4cyclictest3038662-21diskstats07:15:152
3032712991511,3cyclictest3303711-21kworker/u8:0+events_unbound11:54:402
3032712991511,3cyclictest3132560-21kworker/u8:0+events_unbound11:02:212
3032712991511,3cyclictest3058476-21kworker/u8:1+events_unbound09:00:292
3032707991512,3cyclictest3121813-21kworker/u8:3+events_unbound08:55:221
3032707991512,2cyclictest3210992-21kworker/u8:3+events_unbound10:30:551
3032707991511,3cyclictest3210992-21kworker/u8:3+events_unbound10:10:161
3032707991511,3cyclictest3032913-21apt-get07:10:131
3032707991510,4cyclictest3262673-21apt-get10:50:131
3032707991510,4cyclictest3079515-21apt-get07:55:001
3032704991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:190
3032704991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:210
3032704991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:200
3032704991513,1cyclictest60350irq/132-enp0s29f1:rx-007:55:120
3032704991512,2cyclictest60350irq/132-enp0s29f1:rx-009:00:140
3032704991512,2cyclictest60350irq/132-enp0s29f1:rx-007:45:140
3032704991512,2cyclictest60350irq/132-enp0s29f1:rx-007:35:180
3032704991512,2cyclictest60350irq/132-enp0s29f1:rx-007:28:060
3032704991512,2cyclictest60350irq/132-enp0s29f1:rx-007:20:240
3032714991411,2cyclictest3058476-21kworker/u8:1+flush-259:007:35:253
3032714991410,3cyclictest3147939-21sh09:00:003
3032712991411,2cyclictest3287682-21unixbench_multi11:10:252
303270799148,4cyclictest3126773-21latency_hist08:40:011
303270799148,4cyclictest3126773-21latency_hist08:40:001
3032707991411,2cyclictest4166533-21kworker/u8:2+flush-259:007:20:161
3032707991411,2cyclictest3370991-21kworker/u8:0+flush-259:012:39:201
3032707991411,2cyclictest3210992-21kworker/u8:3+flush-259:010:35:161
3032707991411,2cyclictest3132560-21kworker/u8:0+events_unbound10:45:191
3032707991411,2cyclictest3069922-21irqcore07:45:171
3032707991410,3cyclictest3148199-21apt-get09:00:131
303270499147,5cyclictest3292454-21ntpq11:15:230
3032704991413,1cyclictest60350irq/132-enp0s29f1:rx-008:28:560
3032704991412,2cyclictest60350irq/132-enp0s29f1:rx-012:07:480
3032704991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:230
3032704991412,1cyclictest60350irq/132-enp0s29f1:rx-008:56:090
3032704991412,1cyclictest60350irq/132-enp0s29f1:rx-007:42:580
3032704991412,1cyclictest60350irq/132-enp0s29f1:rx-007:10:160
3032704991411,2cyclictest60350irq/132-enp0s29f1:rx-012:00:110
3032704991411,2cyclictest60350irq/132-enp0s29f1:rx-011:25:140
3032704991411,2cyclictest60350irq/132-enp0s29f1:rx-011:24:530
3032704991411,2cyclictest60350irq/132-enp0s29f1:rx-009:58:130
303271299139,3cyclictest3277865-21kworker/u8:1+flush-259:012:15:262
303271299139,3cyclictest3226499-21kworker/u8:4+events_unbound10:17:472
3032712991311,1cyclictest0-21swapper/208:35:192
3032712991311,1cyclictest0-21swapper/208:35:192
3032707991310,2cyclictest3132560-21kworker/u8:0+flush-259:009:35:241
3032704991312,1cyclictest60350irq/132-enp0s29f1:rx-012:27:170
3032704991311,2cyclictest60350irq/132-enp0s29f1:rx-012:36:270
3032704991311,1cyclictest60350irq/132-enp0s29f1:rx-009:25:230
3032704991310,2cyclictest60350irq/132-enp0s29f1:rx-009:44:170
3032704991310,2cyclictest3247433-21fschecks_time10:35:160
3032704991310,2cyclictest3216468-21fschecks_time10:05:150
3032704991310,2cyclictest3195181-21cpuspeed_turbos09:45:130
303271499128,3cyclictest3043842-21cut07:20:153
303271299128,3cyclictest3048771-21kworker/u8:0+events_unbound07:27:102
303270799129,2cyclictest3121813-21kworker/u8:3+events_unbound08:40:211
303270799128,3cyclictest3267798-21kworker/u8:2+events_unbound11:19:031
3032704991210,1cyclictest60350irq/132-enp0s29f1:rx-007:50:140
303270799118,2cyclictest3179369-21cron09:30:011
303270799106,3cyclictest3355739-21kworker/u8:0+flush-259:012:20:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional