You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 23:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 13, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2962142993832,4cyclictest3142805-21latency_hist10:05:011
2962142993431,2cyclictest3201150-21kworker/u8:1+flush-259:011:35:001
2962137993431,2cyclictest3210799-21kworker/u8:2+flush-259:011:55:000
2962142993226,4cyclictest335557-21systemd-journal08:15:011
2962147993124,5cyclictest3003328-21latency_hist07:50:013
2962137993021,8cyclictest2967311-21kworker/u8:1+flush-259:008:05:000
2962147992925,3cyclictest3178992-21kworker/u8:2+flush-259:010:40:013
2962144992825,2cyclictest2929507-21kworker/u8:5+flush-259:007:15:252
2962144992622,3cyclictest3267256-21kworker/u8:4+events_unbound12:05:292
2962144992621,4cyclictest335557-21systemd-journal08:00:012
2962142992621,3cyclictest507-21in:imuxsock09:14:591
2962137992623,2cyclictest507-21in:imuxsock10:10:000
2962137992621,4cyclictest335557-21systemd-journal10:35:010
2962142992520,3cyclictest3210799-21kworker/u8:2+flush-259:011:15:451
2962142992519,4cyclictest335557-21systemd-journal09:55:001
2962144992420,3cyclictest2967311-21kworker/u8:1+flush-259:008:50:252
2962144992417,4cyclictest3039443-21latency_hist08:25:012
2962142992421,2cyclictest2947008-21kworker/u8:0+events_unbound07:10:011
2962142992421,2cyclictest2947008-21kworker/u8:0+events_unbound07:10:001
2962142992420,3cyclictest3018645-21apt-get08:03:391
2962142992418,3cyclictest3111767-21kworker/u8:1+events_unbound09:50:011
2962144992319,3cyclictest3043717-21ntpq08:25:222
2962142992319,3cyclictest2929507-21kworker/u8:5+flush-259:007:15:211
2962142992219,2cyclictest3201150-21kworker/u8:1+events_unbound11:40:011
2962142992218,3cyclictest3267256-21kworker/u8:4+flush-259:012:05:001
2962142992218,3cyclictest3101643-21kworker/u8:3+events_unbound11:25:001
2962142992218,3cyclictest3101643-21kworker/u8:3+events_unbound11:12:441
2962142992218,3cyclictest3065208-21kworker/u8:2+events_unbound09:29:431
2962142992218,3cyclictest3065208-21kworker/u8:2+events_unbound09:29:421
2962142992218,3cyclictest3023995-21kworker/u8:0+events_unbound09:22:441
2962142992216,4cyclictest335557-21systemd-journal07:15:001
2962137992218,2cyclictest3101643-21kworker/u8:3+flush-259:010:25:170
2962147992117,2cyclictest0-21swapper/309:35:003
2962147992117,2cyclictest0-21swapper/309:34:593
2962147992114,5cyclictest3148135-21cp10:10:013
2962144992118,2cyclictest3178992-21kworker/u8:2+events_unbound10:40:132
2962144992118,2cyclictest3023995-21kworker/u8:0+events_unbound08:49:592
2962142992117,3cyclictest3101643-21kworker/u8:3+events_unbound09:55:431
2962142992115,4cyclictest335557-21systemd-journal10:57:431
2962147992015,4cyclictest3054060-21ntpq08:35:223
2962144992016,3cyclictest3179477-21gpgv10:40:012
2962144992016,3cyclictest3023995-21kworker/u8:0+events_unbound09:05:162
2962142992017,2cyclictest3278657-21irqcore12:15:171
2962142992017,2cyclictest3158718-21kworker/u8:0+flush-259:010:35:231
2962142992013,5cyclictest3201153-21diskstats11:00:141
2962137992015,4cyclictest335557-21systemd-journal11:33:430
2962137992014,4cyclictest3252185-21turbostat11:50:000
296213799201,1cyclictest3096464-21turbostat09:20:000
2962147991916,2cyclictest3148642-21apt-get10:10:123
2962147991913,4cyclictest335557-21systemd-journal10:41:433
2962144991916,2cyclictest3210799-21kworker/u8:2+flush-259:011:22:192
2962142991916,2cyclictest3178992-21kworker/u8:2+events_unbound10:49:431
2962142991916,2cyclictest3101643-21kworker/u8:3+events_unbound11:38:441
2962142991916,2cyclictest3065208-21kworker/u8:2+events_unbound08:59:421
2962142991916,2cyclictest3023995-21kworker/u8:0+events_unbound08:49:551
2962142991915,3cyclictest3101643-21kworker/u8:3+events_unbound10:51:431
2962142991915,3cyclictest3101643-21kworker/u8:3+events_unbound10:21:441
2962142991915,3cyclictest3101643-21kworker/u8:3+events_unbound10:10:451
2962142991915,3cyclictest3023995-21kworker/u8:0+events_unbound08:15:291
2962137991916,2cyclictest3267256-21kworker/u8:4+flush-259:012:04:570
2962137991916,2cyclictest3201150-21kworker/u8:1+events_unbound11:35:150
2962147991815,2cyclictest3075473-21cut09:00:013
2962147991815,2cyclictest2929507-21kworker/u8:5+flush-259:007:30:283
2962144991815,2cyclictest2967311-21kworker/u8:1+flush-259:007:25:202
2962144991814,3cyclictest3065208-21kworker/u8:2+events_unbound08:55:172
2962144991813,4cyclictest3267255-21kworker/u8:3+flush-259:012:10:452
2962142991815,2cyclictest3195587-21kworker/u8:0+flush-259:011:05:211
2962142991815,2cyclictest3111767-21kworker/u8:1+events_unbound10:19:431
2962142991815,2cyclictest2967311-21kworker/u8:1+flush-259:008:44:441
2962142991815,2cyclictest2967311-21kworker/u8:1+events_unbound07:25:141
2962142991814,3cyclictest3023995-21kworker/u8:0+events_unbound08:50:151
2962142991814,2cyclictest3231622-21sh11:30:001
2962147991714,2cyclictest0-21swapper/309:15:003
2962147991712,3cyclictest335557-21systemd-journal12:13:463
2962144991715,1cyclictest3111767-21kworker/u8:1+events_unbound09:39:442
2962144991714,2cyclictest3283522-21kworker/u8:2+flush-259:012:20:482
2962144991714,2cyclictest3210799-21kworker/u8:2+flush-259:011:55:202
2962144991714,2cyclictest3210799-21kworker/u8:2+flush-259:011:25:172
2962144991714,2cyclictest3013852-21kworker/u8:3+flush-259:008:05:252
2962144991712,4cyclictest335557-21systemd-journal11:45:002
2962144991712,4cyclictest3199907-21ntpq10:55:222
2962142991714,2cyclictest3275373-21kthreadcore12:10:181
2962142991714,2cyclictest2967311-21kworker/u8:1+events_unbound07:55:251
2962142991713,3cyclictest3267256-21kworker/u8:4+events_unbound12:35:331
2962142991713,3cyclictest3267255-21kworker/u8:3+events_unbound12:05:211
2962142991713,3cyclictest3111767-21kworker/u8:1+events_unbound10:07:451
2962142991713,3cyclictest3111767-21kworker/u8:1+events_unbound09:34:501
2962142991713,3cyclictest3111767-21kworker/u8:1+events_unbound09:34:491
2962142991711,4cyclictest335557-21systemd-journal09:44:591
2962137991714,2cyclictest60350irq/132-enp0s29f1:rx-011:56:240
2962137991714,2cyclictest60350irq/132-enp0s29f1:rx-010:15:100
2962137991712,4cyclictest3085283-21ntpq09:05:210
2962147991614,1cyclictest3096468-21idleruntime-cro09:19:593
2962144991612,3cyclictest3111767-21kworker/u8:1+events_unbound09:50:032
2962144991612,3cyclictest3101643-21kworker/u8:3+events_unbound11:30:242
2962144991612,3cyclictest3023995-21kworker/u8:0+flush-259:009:15:232
2962142991613,2cyclictest3076579-21irqcore09:00:171
2962142991613,2cyclictest3036844-21kthreadcore08:20:191
2962142991613,2cyclictest2988101-21kworker/u8:2+events_unbound07:35:141
2962142991613,2cyclictest2967311-21kworker/u8:1+flush-259:007:20:151
2962142991612,3cyclictest3283522-21kworker/u8:2+events_unbound12:20:201
2962142991612,3cyclictest3101643-21kworker/u8:3+events_unbound10:25:141
2962142991612,3cyclictest2967311-21kworker/u8:1+flush-259:008:05:401
2962137991614,1cyclictest60350irq/132-enp0s29f1:rx-007:25:210
2962137991613,2cyclictest60350irq/132-enp0s29f1:rx-012:10:210
2962137991613,2cyclictest60350irq/132-enp0s29f1:rx-007:50:260
2962137991613,2cyclictest3023995-21kworker/u8:0+flush-259:008:34:440
2962137991612,3cyclictest335557-21systemd-journal11:15:000
2962137991612,3cyclictest3111767-21kworker/u8:1+flush-259:009:50:520
2962137991612,3cyclictest3101883-21apt-get09:25:120
2962137991612,3cyclictest3101883-21apt-get09:25:120
296213799160,14cyclictest3298611-21unin-run12:35:000
2962147991512,2cyclictest0-21swapper/307:55:003
2962144991513,1cyclictest0-21swapper/208:20:002
2962144991512,2cyclictest3101643-21kworker/u8:3+flush-259:010:25:182
2962144991512,2cyclictest3023995-21kworker/u8:0+flush-259:008:35:192
2962144991511,3cyclictest335557-21systemd-journal11:04:442
2962144991511,3cyclictest3278242-21apt-get12:15:132
2962144991511,3cyclictest3111767-21kworker/u8:1+flush-259:009:55:252
2962144991511,3cyclictest3065208-21kworker/u8:2+events_unbound09:10:152
2962144991511,3cyclictest2914218-21kworker/u8:2+events_unbound07:10:142
2962144991510,4cyclictest509-21rs:main2
2962142991512,2cyclictest3101643-21kworker/u8:3+flush-259:011:45:151
2962142991512,2cyclictest2967311-21kworker/u8:1+events_unbound07:50:231
2962142991511,3cyclictest3023995-21kworker/u8:0+flush-259:009:15:261
296213799158,5cyclictest3033396-21ntpq08:15:230
2962137991514,1cyclictest60350irq/132-enp0s29f1:rx-012:15:160
2962137991514,1cyclictest60350irq/132-enp0s29f1:rx-008:10:040
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-011:05:260
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-011:00:150
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-010:20:240
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-009:30:120
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-009:30:110
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-009:20:230
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:180
2962137991513,1cyclictest60350irq/132-enp0s29f1:rx-007:55:210
2962137991513,1cyclictest2988546-21irqcore07:35:160
2962137991512,2cyclictest60350irq/132-enp0s29f1:rx-012:40:000
2962137991512,2cyclictest3225609-21ntp_kernel_pll_11:20:230
2962137991512,2cyclictest3101643-21kworker/u8:3+events_unbound11:15:190
2962137991510,4cyclictest60350irq/132-enp0s29f1:rx-008:35:130
2962147991411,2cyclictest3252171-21idleruntime-cro11:50:003
2962147991411,2cyclictest3121197-21needreboot09:40:213
2962147991411,2cyclictest3111767-21kworker/u8:1+events_unbound10:15:213
2962147991411,2cyclictest0-21swapper/311:54:593
2962147991411,2cyclictest0-21swapper/307:15:003
296214499149,4cyclictest3190671-21/usr/sbin/munin10:50:142
2962144991412,1cyclictest3241901-21cron11:40:002
2962144991411,2cyclictest3283522-21kworker/u8:2+events_unbound12:25:192
2962144991411,2cyclictest3158718-21kworker/u8:0+flush-259:010:30:212
2962144991410,3cyclictest3178992-21kworker/u8:2+flush-259:010:50:012
2962144991410,3cyclictest3111767-21kworker/u8:1+events_unbound09:41:452
2962144991410,3cyclictest3065208-21kworker/u8:2+flush-259:009:00:172
296214299149,3cyclictest2998154-21cron07:45:011
2962142991411,2cyclictest3201150-21kworker/u8:1+events_unbound11:55:381
2962142991411,2cyclictest3101643-21kworker/u8:3+flush-259:009:35:241
2962142991411,2cyclictest3002350-21needreboot07:45:201
2962142991410,3cyclictest3158718-21kworker/u8:0+events_unbound10:30:241
2962142991410,3cyclictest3101643-21kworker/u8:3+events_unbound11:50:121
2962142991410,3cyclictest3101643-21kworker/u8:3+events_unbound10:42:441
2962142991410,3cyclictest3083586-21tr09:05:181
2962137991413,1cyclictest60350irq/132-enp0s29f1:rx-010:53:540
2962137991413,1cyclictest60350irq/132-enp0s29f1:rx-008:56:290
2962137991413,1cyclictest60350irq/132-enp0s29f1:rx-007:16:520
2962137991412,2cyclictest60350irq/132-enp0s29f1:rx-011:42:510
2962137991412,1cyclictest60350irq/132-enp0s29f1:rx-012:25:160
2962137991412,1cyclictest60350irq/132-enp0s29f1:rx-010:55:270
2962137991412,1cyclictest60350irq/132-enp0s29f1:rx-010:35:240
2962137991412,1cyclictest60350irq/132-enp0s29f1:rx-008:40:220
2962137991411,2cyclictest60350irq/132-enp0s29f1:rx-010:03:120
2962137991411,2cyclictest60350irq/132-enp0s29f1:rx-009:45:240
2962137991410,3cyclictest3283522-21kworker/u8:2+flush-259:012:20:170
296214799139,3cyclictest3122468-21apt-get09:45:103
296214799139,2cyclictest2967311-21kworker/u8:1+flush-259:008:45:153
296214799138,4cyclictest3210799-21kworker/u8:2+flush-259:012:00:153
2962147991310,2cyclictest509-21rs:main3
2962147991310,2cyclictest3159089-21cpuspeed_turbos10:20:133
2962147991310,2cyclictest3133034-21fschecks_time09:55:153
2962147991310,2cyclictest3042009-21tr08:25:193
2962147991310,1cyclictest0-21swapper/310:55:203
296214499139,3cyclictest3267256-21kworker/u8:4+events_unbound12:30:252
296214499139,3cyclictest3101643-21kworker/u8:3+flush-259:011:50:202
2962144991311,2cyclictest2967311-21kworker/u8:1+events_unbound08:10:162
2962144991310,2cyclictest3206244-21cpuspeed_turbos11:05:132
2962144991310,2cyclictest3107224-21fschecks_count09:30:152
2962144991310,2cyclictest3107224-21fschecks_count09:30:142
2962144991310,2cyclictest2974287-21kthreadcore07:20:172
296214299138,4cyclictest3283522-21kworker/u8:2+flush-259:012:30:011
2962142991310,2cyclictest3023995-21kworker/u8:0+events_unbound08:37:551
2962142991310,2cyclictest2929507-21kworker/u8:5+flush-259:007:34:301
2962137991312,1cyclictest60350irq/132-enp0s29f1:rx-010:11:240
2962137991311,2cyclictest60350irq/132-enp0s29f1:rx-009:03:530
2962137991311,1cyclictest60350irq/132-enp0s29f1:rx-009:41:420
2962137991311,1cyclictest60350irq/132-enp0s29f1:rx-009:10:260
2962137991311,1cyclictest60350irq/132-enp0s29f1:rx-008:20:150
2962137991311,1cyclictest60350irq/132-enp0s29f1:rx-007:45:120
2962137991310,2cyclictest60350irq/132-enp0s29f1:rx-012:08:530
2962137991310,2cyclictest60350irq/132-enp0s29f1:rx-010:40:100
2962137991310,2cyclictest3185666-21cpuspeed_turbos10:45:150
296214799129,2cyclictest3282159-21needreboot12:15:213
296214799129,2cyclictest3045091-21fschecks_time08:30:153
296214799129,2cyclictest0-21swapper/307:42:293
296214799128,3cyclictest0-21swapper/310:35:013
296214799127,4cyclictest509-21rs:main3
2962147991210,1cyclictest0-21swapper/308:20:163
296214499129,2cyclictest3210799-21kworker/u8:2+events_unbound12:00:232
296214499129,2cyclictest3153095-21unixbench_singl10:10:252
296214499129,2cyclictest3111767-21kworker/u8:1+flush-259:010:00:212
296214499129,2cyclictest3101643-21kworker/u8:3+flush-259:009:45:232
296214499128,3cyclictest3283522-21kworker/u8:2+flush-259:012:39:572
296214499126,4cyclictest3007661-21ntpq07:50:232
296214299129,2cyclictest3023995-21kworker/u8:0+events_unbound08:30:181
296214299128,3cyclictest3283522-21kworker/u8:2+events_unbound12:33:201
296213799129,2cyclictest60350irq/132-enp0s29f1:rx-009:35:220
2962137991211,1cyclictest60350irq/132-enp0s29f1:rx-008:47:280
2962137991211,1cyclictest60350irq/132-enp0s29f1:rx-007:40:170
2962137991211,1cyclictest60350irq/132-enp0s29f1:rx-007:20:220
2962137991210,1cyclictest60350irq/132-enp0s29f1:rx-008:25:210
2962137991210,1cyclictest60350irq/132-enp0s29f1:rx-007:14:430
296214799119,1cyclictest0-21swapper/309:05:233
296214799118,2cyclictest3272778-21idleruntime-cro12:10:003
296214799118,2cyclictest3232034-21cpuspeed_turbos11:30:133
296214799118,2cyclictest3205422-21unixbench_singl11:00:263
296214799118,2cyclictest3195530-21cron10:55:013
296214799118,2cyclictest3112207-21cpuspeed_turbos09:35:123
296214799118,2cyclictest3029524-21cpuspeed_turbos08:15:153
296214799118,2cyclictest0-21swapper/311:20:193
296214499119,1cyclictest0-21swapper/209:20:242
296214499118,2cyclictest3216514-21cpuspeed_turbos11:15:142
296214499118,2cyclictest3023995-21kworker/u8:0+flush-259:008:34:382
296214499118,2cyclictest3016173-21kthreadcore08:00:202
296214499117,3cyclictest0-21swapper/211:15:002
296214499116,3cyclictest3111767-21kworker/u8:1+flush-259:010:20:252
296213799119,1cyclictest60350irq/132-enp0s29f1:rx-011:25:130
296214799107,2cyclictest3237201-21fschecks_count11:35:133
296214799107,2cyclictest3216514-21cpuspeed_turbos11:15:143
296214799107,2cyclictest3190439-21munin-plugin-st10:50:013
296214799107,2cyclictest3142378-21unixbench_singl10:00:273
296214499108,1cyclictest0-21swapper/207:45:272
296214499107,1cyclictest0-21swapper/211:45:232
296214499107,1cyclictest0-21swapper/210:15:232
296214499106,3cyclictest2967311-21kworker/u8:1+flush-259:007:41:362
29621449995,2cyclictest3059141-21ntpq08:40:202
29621379997,2cyclictest60350irq/132-enp0s29f1:rx-009:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional