You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 03:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 14, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
406877994943,4cyclictest703282-21cat23:55:002
406882994541,3cyclictest448616-21kworker/u8:1+events_unbound20:05:013
406882994237,3cyclictest651375-21apt-get23:05:113
406877994236,5cyclictest666651-21latency_hist23:20:012
406882994037,2cyclictest510675-21kworker/u8:3+flush-259:021:10:003
406873994035,4cyclictest651116-21latency_hist23:05:020
406882993933,4cyclictest335557-21systemd-journal20:46:203
406877993834,3cyclictest443731-21apt-get19:45:122
406873993835,2cyclictest464155-21kworker/u8:0+flush-259:021:15:000
406873993832,4cyclictest542088-21latency_hist21:20:010
406882993729,6cyclictest335557-21systemd-journal22:55:003
406876993633,2cyclictest718743-21kworker/u8:1+events_unbound00:10:241
406876993633,2cyclictest718743-21kworker/u8:1+events_unbound00:10:231
406876993631,3cyclictest412258-21kworker/u8:4+events_unbound19:25:141
406876993629,5cyclictest557699-21latency_hist21:35:001
406882993531,3cyclictest718743-21kworker/u8:1+flush-259:000:40:013
406882993528,5cyclictest335557-21systemd-journal20:40:003
406876993531,3cyclictest412258-21kworker/u8:4+flush-259:020:35:241
406876993430,3cyclictest547295-21kworker/u8:3+events_unbound21:35:171
406877993330,2cyclictest656949-21kworker/u8:1+events_unbound23:25:002
406873993329,3cyclictest542117-21kworker/u8:2+flush-259:021:20:150
406873993327,4cyclictest335557-21systemd-journal19:36:140
406873993327,4cyclictest335557-21systemd-journal19:36:140
406882993225,5cyclictest335557-21systemd-journal21:50:003
406877993229,2cyclictest516090-21kworker/u8:5+events_unbound20:55:212
406877993228,3cyclictest625065-21kworker/u8:2+flush-259:022:50:272
406877993228,3cyclictest552705-21kworker/u8:0+flush-259:022:15:242
406876993229,2cyclictest562873-21kworker/u8:2+flush-259:022:11:571
406873993228,3cyclictest464155-21kworker/u8:0+flush-259:020:09:590
406873993226,5cyclictest594313-21latency_hist22:10:010
406873993226,4cyclictest416322-21ntpq19:15:230
406877993129,1cyclictest562873-21kworker/u8:2+events_unbound22:05:282
406877993127,3cyclictest412044-21kworker/u8:2+events_unbound19:35:002
406876993129,2cyclictest412258-21kworker/u8:4+events_unbound20:15:281
406876993128,2cyclictest562873-21kworker/u8:2+flush-259:022:05:201
406876993128,2cyclictest464155-21kworker/u8:0+events_unbound20:50:201
406876993127,3cyclictest671845-21kworker/u8:3+flush-259:023:40:201
406873993126,4cyclictest505888-21diskstats20:45:150
406873993126,4cyclictest335557-21systemd-journal22:44:260
406873993125,4cyclictest478792-21ntpq20:15:230
406877993025,3cyclictest625507-21/usr/sbin/munin22:40:142
406876993027,2cyclictest412258-21kworker/u8:4+flush-259:019:20:151
406876993026,3cyclictest412258-21kworker/u8:4+flush-259:020:15:001
406882992925,3cyclictest542117-21kworker/u8:2+flush-259:021:20:263
406882992924,3cyclictest656949-21kworker/u8:1+events_unbound23:15:013
406877992924,4cyclictest464155-21kworker/u8:0+events_unbound21:09:222
406876992926,3cyclictest640618-21kworker/u8:0+events_unbound23:07:061
406876992926,2cyclictest412258-21kworker/u8:4+flush-259:020:40:211
406877992825,2cyclictest412258-21kworker/u8:4+flush-259:020:05:212
406877992825,2cyclictest412044-21kworker/u8:2+flush-259:019:55:112
406877992824,3cyclictest625065-21kworker/u8:2+events_unbound23:03:272
406877992823,3cyclictest335557-21systemd-journal20:21:202
406876992825,2cyclictest562873-21kworker/u8:2+flush-259:022:25:191
406873992824,3cyclictest625065-21kworker/u8:2+flush-259:022:50:160
406882992722,3cyclictest500546-21apt-get20:40:123
406877992723,3cyclictest739260-21kworker/u8:0+events_unbound00:37:572
406877992723,3cyclictest708221-21kworker/u8:0+flush-259:000:05:202
406877992723,3cyclictest702525-21kworker/u8:1+events_unbound23:52:262
406876992724,2cyclictest671845-21kworker/u8:3+events_unbound23:30:251
406876992724,2cyclictest412258-21kworker/u8:4+events_unbound19:16:581
406876992723,3cyclictest542117-21kworker/u8:2+events_unbound21:24:261
406876992722,4cyclictest583992-21latency_hist22:00:011
406873992723,3cyclictest516090-21kworker/u8:5+flush-259:021:00:010
406873992723,2cyclictest495370-21apt-get20:35:120
406882992622,3cyclictest671845-21kworker/u8:3+flush-259:023:35:243
406877992623,2cyclictest552705-21kworker/u8:0+flush-259:022:35:212
406876992622,4cyclictest671845-21kworker/u8:3+events_unbound23:52:471
406876992621,4cyclictest573898-21apt-get21:50:141
406876992621,4cyclictest573898-21apt-get21:50:141
406873992623,2cyclictest656949-21kworker/u8:1+events_unbound23:15:160
406873992622,3cyclictest464155-21kworker/u8:0+events_unbound20:30:210
406873992622,3cyclictest412258-21kworker/u8:4+events_unbound20:13:210
406873992619,5cyclictest682110-21latency_hist23:35:010
406882992523,1cyclictest625065-21kworker/u8:2+events_unbound22:45:153
406882992521,3cyclictest729090-21kworker/u8:2+flush-259:000:30:013
406882992521,3cyclictest640618-21kworker/u8:0+flush-259:023:30:253
406877992523,2cyclictest531807-21kworker/u8:1+flush-259:021:25:302
406877992522,2cyclictest412258-21kworker/u8:4+events_unbound19:25:222
406877992521,3cyclictest412258-21kworker/u8:4+events_unbound20:26:212
406876992522,2cyclictest656949-21kworker/u8:1+events_unbound23:16:261
406876992522,2cyclictest625065-21kworker/u8:2+events_unbound22:50:201
406873992522,2cyclictest547295-21kworker/u8:3+events_unbound21:37:260
406873992521,3cyclictest614783-21kworker/u8:1+flush-259:022:45:200
406882992419,3cyclictest703428-21/usr/sbin/munin23:55:173
406877992421,2cyclictest671845-21kworker/u8:3+flush-259:023:40:202
406877992421,2cyclictest640618-21kworker/u8:0+events_unbound23:38:262
406877992421,2cyclictest412044-21kworker/u8:2+events_unbound19:35:292
406877992421,2cyclictest412044-21kworker/u8:2+events_unbound19:35:282
406877992420,3cyclictest396200-21kworker/u8:1+events_unbound19:20:132
406876992422,2cyclictest718743-21kworker/u8:1+events_unbound00:28:281
406876992421,3cyclictest412044-21kworker/u8:2+events_unbound19:40:271
406876992421,2cyclictest531807-21kworker/u8:1+flush-259:021:25:251
406876992421,2cyclictest412258-21kworker/u8:4+flush-259:021:10:291
406876992421,2cyclictest412258-21kworker/u8:4+flush-259:020:00:251
406876992419,4cyclictest718734-21latency_hist00:10:001
406876992419,4cyclictest645087-21ntpq22:55:211
406873992421,2cyclictest640618-21kworker/u8:0+flush-259:023:25:110
406873992420,3cyclictest656949-21kworker/u8:1+events_unbound23:22:080
406873992417,5cyclictest526597-21latency_hist21:05:000
406882992320,2cyclictest464155-21kworker/u8:0+flush-259:021:15:253
406882992319,3cyclictest599702-21kworker/u8:3+events_unbound22:45:013
406882992319,3cyclictest552705-21kworker/u8:0+flush-259:022:20:173
406877992320,2cyclictest671845-21kworker/u8:3+events_unbound23:33:282
406877992319,3cyclictest640618-21kworker/u8:0+events_unbound23:29:282
406877992319,3cyclictest599702-21kworker/u8:3+events_unbound22:56:262
406877992319,3cyclictest521001-21apt-get21:00:012
406876992322,1cyclictest510675-21kworker/u8:3+events_unbound21:00:151
406876992321,2cyclictest599702-21kworker/u8:3+events_unbound22:42:351
406876992320,2cyclictest562873-21kworker/u8:2+events_unbound21:49:271
406876992320,2cyclictest448616-21kworker/u8:1+events_unbound19:50:141
406876992320,2cyclictest373954-21kworker/u8:3+events_unbound19:11:231
406876992319,3cyclictest464155-21kworker/u8:0+events_unbound20:22:091
406876992319,2cyclictest412258-21kworker/u8:4+flush-259:020:25:241
406873992320,2cyclictest531807-21kworker/u8:1+events_unbound21:26:510
406877992219,2cyclictest614783-21kworker/u8:1+flush-259:022:30:192
406877992219,2cyclictest547295-21kworker/u8:3+flush-259:022:00:242
406877992219,2cyclictest547295-21kworker/u8:3+events_unbound21:36:262
406877992219,2cyclictest464155-21kworker/u8:0+flush-259:020:50:232
406877992218,3cyclictest671845-21kworker/u8:3+events_unbound00:25:252
406877992218,3cyclictest552705-21kworker/u8:0+flush-259:021:50:162
406877992218,3cyclictest552705-21kworker/u8:0+flush-259:021:50:162
406877992218,3cyclictest412258-21kworker/u8:4+flush-259:020:40:182
406876992219,2cyclictest671845-21kworker/u8:3+events_unbound23:55:131
406876992218,3cyclictest640618-21kworker/u8:0+events_unbound23:25:141
406873992220,2cyclictest412044-21kworker/u8:2+events_unbound19:50:020
406873992220,2cyclictest412044-21kworker/u8:2+events_unbound19:41:230
406873992219,2cyclictest729090-21kworker/u8:2+events_unbound00:30:230
406873992218,3cyclictest640618-21kworker/u8:0+events_unbound23:05:200
406873992218,3cyclictest464155-21kworker/u8:0+events_unbound20:51:210
406873992217,4cyclictest563092-21/usr/sbin/munin21:40:200
406873992217,4cyclictest412028-21latency_hist19:15:000
406882992118,2cyclictest412258-21kworker/u8:4+events_unbound19:20:173
406882992117,3cyclictest531807-21kworker/u8:1+flush-259:021:35:183
406882992117,3cyclictest464155-21kworker/u8:0+flush-259:020:15:173
406877992119,2cyclictest412258-21kworker/u8:4+events_unbound20:00:142
406877992118,3cyclictest464155-21kworker/u8:0+events_unbound20:15:162
406877992118,2cyclictest562873-21kworker/u8:2+flush-259:021:45:252
406877992118,2cyclictest412258-21kworker/u8:4+flush-259:021:15:192
406876992119,2cyclictest562873-21kworker/u8:2+events_unbound21:40:141
406876992119,2cyclictest412258-21kworker/u8:4+flush-259:020:30:161
406876992118,2cyclictest625065-21kworker/u8:2+flush-259:023:00:211
406876992115,4cyclictest624398-21ntpq22:35:221
406873992118,3cyclictest718743-21kworker/u8:1+events_unbound00:25:180
406873992118,2cyclictest562873-21kworker/u8:2+events_unbound21:45:200
406873992117,3cyclictest556832-21ntpq21:30:240
406882992016,3cyclictest729090-21kworker/u8:2+flush-259:000:30:243
406882992016,3cyclictest547295-21kworker/u8:3+events_unbound21:55:173
406877992017,2cyclictest729090-21kworker/u8:2+events_unbound00:30:202
406877992017,2cyclictest718743-21kworker/u8:1+flush-259:000:20:202
406877992017,2cyclictest640618-21kworker/u8:0+flush-259:023:05:202
406877992017,2cyclictest599702-21kworker/u8:3+events_unbound23:10:142
406877992017,2cyclictest412044-21kworker/u8:2+events_unbound19:40:232
406877992014,4cyclictest411190-21ntpq19:10:222
406876992017,2cyclictest464155-21kworker/u8:0+flush-259:021:05:161
406876992017,2cyclictest412044-21kworker/u8:2+flush-259:019:30:161
406876992016,3cyclictest671845-21kworker/u8:3+events_unbound00:00:151
406876992016,3cyclictest412044-21kworker/u8:2+events_unbound19:55:121
406873992018,2cyclictest718743-21kworker/u8:1+events_unbound00:10:260
406873992018,2cyclictest718743-21kworker/u8:1+events_unbound00:10:250
406873992017,2cyclictest464155-21kworker/u8:0+events_unbound20:20:220
406873992016,3cyclictest423037-21kworker/u8:3+flush-259:019:31:270
406873992014,4cyclictest335557-21systemd-journal23:14:250
406882991916,2cyclictest464155-21kworker/u8:0+flush-259:020:50:243
406882991916,2cyclictest412258-21kworker/u8:4+flush-259:021:10:203
406882991915,3cyclictest625065-21kworker/u8:2+events_unbound23:00:143
406882991915,3cyclictest464155-21kworker/u8:0+events_unbound20:30:153
406882991915,2cyclictest0-21swapper/323:55:003
406877991916,2cyclictest640618-21kworker/u8:0+events_unbound23:45:222
406877991916,2cyclictest562873-21kworker/u8:2+events_unbound22:25:162
406877991916,2cyclictest547295-21kworker/u8:3+events_unbound21:32:222
406877991916,2cyclictest412258-21kworker/u8:4+events_unbound20:35:012
406876991917,1cyclictest0-21swapper/122:05:001
406876991916,2cyclictest729090-21kworker/u8:2+events_unbound00:30:191
406876991916,2cyclictest671845-21kworker/u8:3+events_unbound00:15:231
406876991916,2cyclictest614783-21kworker/u8:1+flush-259:022:45:251
406876991916,2cyclictest464155-21kworker/u8:0+flush-259:021:19:361
406876991915,3cyclictest516090-21kworker/u8:5+events_unbound20:59:201
406873991915,3cyclictest671845-21kworker/u8:3+events_unbound00:15:160
406873991915,3cyclictest562873-21kworker/u8:2+events_unbound22:04:250
406873991915,3cyclictest412258-21kworker/u8:4+events_unbound20:41:200
406882991815,2cyclictest640618-21kworker/u8:0+events_unbound23:45:183
406882991815,2cyclictest0-21swapper/300:24:593
406882991814,3cyclictest671845-21kworker/u8:3+events_unbound00:00:193
406882991814,3cyclictest562873-21kworker/u8:2+flush-259:021:40:163
406882991814,3cyclictest464155-21kworker/u8:0+events_unbound20:10:233
406876991816,2cyclictest739260-21kworker/u8:0+events_unbound00:38:331
406876991815,2cyclictest464155-21kworker/u8:0+flush-259:020:45:161
406876991813,4cyclictest697621-21latency_hist23:50:011
406873991816,2cyclictest671845-21kworker/u8:3+flush-259:023:55:230
406873991815,3cyclictest640618-21kworker/u8:0+flush-259:023:45:120
406873991815,2cyclictest671845-21kworker/u8:3+flush-259:023:35:200
406873991815,2cyclictest640618-21kworker/u8:0+flush-259:022:55:210
406873991815,2cyclictest444146-21irqcore19:45:160
406873991815,2cyclictest412258-21kworker/u8:4+events_unbound20:25:200
406873991814,3cyclictest702525-21kworker/u8:1+events_unbound00:04:300
406873991814,2cyclictest412258-21kworker/u8:4+flush-259:019:55:210
406873991812,5cyclictest422388-21latency_hist19:25:010
406882991714,2cyclictest464155-21kworker/u8:0+flush-259:020:20:163
406882991714,1cyclictest0-21swapper/322:30:193
406882991713,3cyclictest562873-21kworker/u8:2+flush-259:022:10:153
406877991714,2cyclictest671845-21kworker/u8:3+flush-259:000:15:222
406877991714,2cyclictest542117-21kworker/u8:2+events_unbound21:23:272
406877991714,2cyclictest412258-21kworker/u8:4+flush-259:021:10:242
406877991714,2cyclictest396200-21kworker/u8:1+events_unbound19:16:222
406877991712,4cyclictest604866-21/usr/sbin/munin22:20:202
406876991714,2cyclictest671845-21kworker/u8:3+events_unbound23:35:201
406873991714,3cyclictest739260-21kworker/u8:0+flush-259:000:35:200
406873991714,2cyclictest60350irq/132-enp0s29f1:rx-022:20:220
406873991714,2cyclictest547295-21kworker/u8:3+flush-259:021:55:150
406882991614,2cyclictest708221-21kworker/u8:0+flush-259:000:05:283
406882991613,2cyclictest531807-21kworker/u8:1+events_unbound21:30:173
406882991613,2cyclictest412044-21kworker/u8:2+flush-259:019:45:173
406882991612,3cyclictest552705-21kworker/u8:0+flush-259:022:05:153
406882991612,3cyclictest396200-21kworker/u8:1+events_unbound19:15:233
406882991611,3cyclictest335557-21systemd-journal20:29:203
406882991610,4cyclictest599709-21/usr/sbin/munin22:15:133
406877991614,2cyclictest708221-21kworker/u8:0+events_unbound00:02:102
406877991613,3cyclictest412258-21kworker/u8:4+flush-259:020:35:162
406876991613,2cyclictest412258-21kworker/u8:4+events_unbound20:05:071
406873991614,1cyclictest60350irq/132-enp0s29f1:rx-000:05:190
406873991613,2cyclictest60350irq/132-enp0s29f1:rx-022:25:180
406873991613,2cyclictest562873-21kworker/u8:2+events_unbound21:50:250
406873991613,2cyclictest562873-21kworker/u8:2+events_unbound21:50:250
406873991612,3cyclictest671845-21kworker/u8:3+events_unbound23:40:260
406873991612,3cyclictest614783-21kworker/u8:1+events_unbound22:31:260
406873991612,3cyclictest562873-21kworker/u8:2+events_unbound22:10:180
406873991612,3cyclictest412258-21kworker/u8:4+events_unbound20:00:180
406882991512,2cyclictest672203-21cpuspeed_turbos23:25:123
406882991512,2cyclictest448616-21kworker/u8:1+events_unbound19:50:123
406882991511,3cyclictest510675-21kworker/u8:3+flush-259:021:00:223
406882991510,4cyclictest656949-21kworker/u8:1+events_unbound23:20:183
406877991513,2cyclictest562873-21kworker/u8:2+events_unbound21:55:302
406877991512,2cyclictest718743-21kworker/u8:1+events_unbound00:10:222
406877991512,2cyclictest718743-21kworker/u8:1+events_unbound00:10:222
406877991512,2cyclictest614783-21kworker/u8:1+events_unbound22:45:192
406877991511,3cyclictest531807-21kworker/u8:1+events_unbound21:43:252
406876991513,2cyclictest412044-21kworker/u8:2+events_unbound19:35:131
406876991513,2cyclictest412044-21kworker/u8:2+events_unbound19:35:131
406876991512,2cyclictest640618-21kworker/u8:0+flush-259:023:10:171
406876991512,2cyclictest412044-21kworker/u8:2+events_unbound19:45:131
406876991511,3cyclictest552705-21kworker/u8:0+flush-259:022:30:291
406882991411,2cyclictest412258-21kworker/u8:4+flush-259:019:25:183
406877991411,2cyclictest505506-21kworker/u8:2+events_unbound20:46:482
406873991412,1cyclictest60350irq/132-enp0s29f1:rx-022:15:110
406873991412,1cyclictest60350irq/132-enp0s29f1:rx-000:20:160
406873991411,2cyclictest60350irq/132-enp0s29f1:rx-022:35:120
406873991410,3cyclictest60350irq/132-enp0s29f1:rx-019:25:170
40687699139,3cyclictest552705-21kworker/u8:0+events_unbound22:15:241
40687699136,5cyclictest733376-21ntpq00:20:221
40687399139,3cyclictest527090-21fschecks_time21:05:160
406873991311,2cyclictest60350irq/132-enp0s29f1:rx-023:52:010
40688299129,2cyclictest531807-21kworker/u8:1+flush-259:021:25:273
40688299128,3cyclictest516090-21kworker/u8:5+flush-259:020:55:183
40688299126,4cyclictest335557-21systemd-journal19:45:003
406882991210,1cyclictest0-21swapper/322:00:183
40688299119,1cyclictest2109693-21snmpd19:59:583
40688299118,2cyclictest666224-21unixbench_singl23:15:253
40688299118,2cyclictest0-21swapper/320:05:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional