You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 19:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Aug 12, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1927103994339,3cyclictest1942579-21kworker/u8:0+flush-259:008:40:250
1927114994238,3cyclictest2115183-21cat10:10:013
1927112994235,5cyclictest1979599-21latency_hist08:00:012
1927109994239,2cyclictest2083635-21kworker/u8:1+flush-259:009:55:241
1927114994137,3cyclictest2193993-21base6411:25:003
1927112993934,3cyclictest2157320-21base6410:50:022
1927112993933,4cyclictest2010627-21latency_hist08:30:022
1927112993734,2cyclictest2068197-21kworker/u8:2+events_unbound09:30:252
1927109993732,3cyclictest2094184-21apt-get09:50:111
1927103993731,4cyclictest2136089-21latency_hist10:30:000
1927109993431,2cyclictest1942579-21kworker/u8:0+flush-259:009:10:231
1927109993429,3cyclictest2178482-21/usr/sbin/munin11:10:211
1927112993330,2cyclictest2005313-21kworker/u8:4+events_unbound08:50:232
1927112993329,3cyclictest2068197-21kworker/u8:2+events_unbound10:15:132
1927109993329,3cyclictest2005313-21kworker/u8:4+flush-259:008:50:221
1927112993226,4cyclictest2214935-21latency_hist11:45:002
1927109993228,3cyclictest2151813-21apt-get10:45:111
1927103993226,4cyclictest2042167-21gpgv09:00:000
1927112993128,2cyclictest2005313-21kworker/u8:4+flush-259:008:45:202
1927112993125,4cyclictest335557-21systemd-journal07:11:392
1927109993128,2cyclictest2245702-21kworker/u8:3+events_unbound12:15:261
1927109993127,3cyclictest2062993-21latency_hist09:20:011
1927103993127,3cyclictest1958268-21kworker/u8:3+flush-259:007:55:000
1927114993027,2cyclictest2005313-21kworker/u8:4+flush-259:009:05:153
1927112993027,2cyclictest2209969-21kworker/u8:1+flush-259:011:52:282
1927109993026,3cyclictest1942581-21kworker/u8:4+flush-259:007:35:101
1927112992925,3cyclictest2094150-21kworker/u8:3+events_unbound11:30:462
1927109992926,2cyclictest2225043-21kworker/u8:2+flush-259:012:00:161
1927109992926,2cyclictest2083635-21kworker/u8:1+events_unbound10:00:221
1927109992926,2cyclictest1953115-21kworker/u8:1+events_unbound07:40:021
1927109992925,3cyclictest1969444-21kworker/u8:2+flush-259:008:00:191
1927112992825,2cyclictest1942581-21kworker/u8:4+flush-259:007:35:232
1927112992824,3cyclictest2178266-21kworker/u8:4+events_unbound11:19:462
1927109992825,2cyclictest2136134-21kworker/u8:0+events_unbound10:43:141
1927109992825,2cyclictest2068197-21kworker/u8:2+flush-259:010:40:011
1927114992724,2cyclictest1942579-21kworker/u8:0+flush-259:008:25:263
1927109992724,2cyclictest2230512-21kworker/u8:1+flush-259:012:35:191
1927103992721,4cyclictest2220074-21latency_hist11:50:010
1927103992721,4cyclictest1989932-21latency_hist08:10:010
1927114992620,4cyclictest2026129-21http08:45:023
1927112992623,2cyclictest1953115-21kworker/u8:1+flush-259:007:50:242
1927112992623,2cyclictest1942579-21kworker/u8:0+events_unbound08:40:132
1927109992623,2cyclictest2005313-21kworker/u8:4+flush-259:009:05:211
1927109992623,2cyclictest2005313-21kworker/u8:4+flush-259:008:47:541
1927109992622,3cyclictest2204605-21kworker/u8:0+flush-259:011:45:161
1927109992622,3cyclictest2010889-21apt-get08:30:121
1927109992622,3cyclictest1990188-21apt-get08:10:121
1927114992522,2cyclictest2167927-21kworker/u8:1+events_unbound11:00:193
1927114992521,3cyclictest335557-21systemd-journal09:16:443
1927114992521,3cyclictest2178266-21kworker/u8:4+flush-259:011:15:153
1927114992521,3cyclictest2151570-21kworker/u8:1+flush-259:010:50:003
1927112992522,2cyclictest2178266-21kworker/u8:4+events_unbound11:35:182
1927112992522,2cyclictest2178265-21kworker/u8:2+events_unbound11:23:252
1927112992522,2cyclictest2114465-21kworker/u8:0+events_unbound10:13:102
1927112992522,2cyclictest1942579-21kworker/u8:0+events_unbound09:10:112
1927112992521,3cyclictest2204605-21kworker/u8:0+flush-259:012:10:252
1927112992521,3cyclictest2094150-21kworker/u8:3+events_unbound10:20:302
1927112992521,3cyclictest1927081-21kworker/u8:2+events_unbound07:24:392
1927112992520,4cyclictest2261459-21latency_hist12:30:002
1927112992519,5cyclictest1968793-21apt-get07:50:012
1927109992522,2cyclictest2094150-21kworker/u8:3+events_unbound10:20:171
1927109992522,2cyclictest2005313-21kworker/u8:4+events_unbound09:35:191
1927109992521,3cyclictest2178265-21kworker/u8:2+events_unbound11:23:271
1927109992521,3cyclictest1942821-21apt-get07:25:121
1927103992520,3cyclictest2235959-21apt-get12:05:150
1927112992421,2cyclictest2178265-21kworker/u8:2+flush-259:011:25:192
1927112992421,2cyclictest2068197-21kworker/u8:2+flush-259:010:45:052
1927112992420,3cyclictest2083635-21kworker/u8:1+events_unbound09:55:142
1927109992421,2cyclictest2204605-21kworker/u8:0+flush-259:012:00:001
1927109992421,2cyclictest2167927-21kworker/u8:1+flush-259:011:00:201
1927114992320,2cyclictest1916853-21kworker/u8:3+flush-259:007:20:153
1927112992320,2cyclictest2041951-21cron08:59:592
1927112992319,3cyclictest2094150-21kworker/u8:3+events_unbound10:08:082
1927112992319,3cyclictest2068197-21kworker/u8:2+flush-259:010:38:142
1927112992319,3cyclictest2068197-21kworker/u8:2+events_unbound09:50:262
1927109992320,2cyclictest2136134-21kworker/u8:0+events_unbound11:05:281
1927109992319,3cyclictest1916853-21kworker/u8:3+events_unbound07:10:021
1927103992319,3cyclictest2136134-21kworker/u8:0+flush-259:011:05:240
1927114992217,3cyclictest1932648-21diskstats07:15:133
1927114992217,3cyclictest1932648-21diskstats07:15:133
1927112992219,2cyclictest2068197-21kworker/u8:2+flush-259:009:25:242
1927112992219,2cyclictest1958268-21kworker/u8:3+events_unbound07:45:002
1927112992219,2cyclictest1942579-21kworker/u8:0+events_unbound08:30:202
1927112992218,3cyclictest1969444-21kworker/u8:2+events_unbound08:08:442
1927109992219,2cyclictest2094150-21kworker/u8:3+events_unbound10:55:231
1927109992219,2cyclictest1942579-21kworker/u8:0+events_unbound08:05:241
1927109992217,4cyclictest2087866-21ntpq09:40:191
1927109992216,5cyclictest2161434-21ntpq10:50:231
1927103992219,2cyclictest2094150-21kworker/u8:3+events_unbound11:05:000
1927103992218,3cyclictest1916853-21kworker/u8:3+flush-259:007:20:220
1927103992216,4cyclictest2141667-21diskstats10:35:140
1927114992117,3cyclictest2162301-21apt-get10:55:023
1927114992117,3cyclictest1969454-21/usr/sbin/munin07:50:243
1927112992118,2cyclictest1984792-21runrttasks08:05:002
1927112992118,2cyclictest1942579-21kworker/u8:0+flush-259:007:25:192
1927112992118,2cyclictest1942579-21kworker/u8:0+events_unbound08:37:532
1927112992118,2cyclictest1916853-21kworker/u8:3+events_unbound07:15:022
1927112992118,2cyclictest1916853-21kworker/u8:3+events_unbound07:15:022
1927112992117,3cyclictest2225043-21kworker/u8:2+events_unbound12:17:472
1927112992117,3cyclictest2209969-21kworker/u8:1+events_unbound11:49:472
1927112992116,3cyclictest2088771-21cron09:45:002
1927109992118,2cyclictest2204605-21kworker/u8:0+flush-259:011:50:161
1927109992118,2cyclictest2068197-21kworker/u8:2+events_unbound10:34:451
1927109992118,2cyclictest1953115-21kworker/u8:1+events_unbound07:54:511
1927109992117,3cyclictest2251420-21apt-get12:20:121
1927109992117,3cyclictest2005313-21kworker/u8:4+events_unbound08:29:441
1927103992118,2cyclictest2210004-21apt-get11:40:120
1927103992118,2cyclictest2178266-21kworker/u8:4+events_unbound11:15:150
1927103992118,2cyclictest2094150-21kworker/u8:3+flush-259:011:10:150
1927103992115,5cyclictest2246235-21apt-get12:15:120
1927114992015,3cyclictest2068197-21kworker/u8:2+flush-259:010:30:163
1927114992014,4cyclictest335557-21systemd-journal12:15:003
1927112992016,3cyclictest2225530-21apt-get11:55:082
1927109992017,2cyclictest2245702-21kworker/u8:3+flush-259:012:30:201
1927109992017,2cyclictest2178266-21kworker/u8:4+events_unbound11:15:231
1927109992017,2cyclictest2094150-21kworker/u8:3+events_unbound11:30:181
1927109992017,2cyclictest2068197-21kworker/u8:2+flush-259:009:30:451
1927109992017,2cyclictest1958268-21kworker/u8:3+events_unbound08:20:071
1927109992017,2cyclictest1916853-21kworker/u8:3+events_unbound07:20:231
1927103992017,2cyclictest1942579-21kworker/u8:0+flush-259:008:10:240
1927103992016,3cyclictest2130779-21kworker/u8:1+flush-259:010:25:010
1927103992015,4cyclictest1963727-21cat07:45:010
1927114991915,3cyclictest2204605-21kworker/u8:0+events_unbound11:55:143
1927114991915,3cyclictest2068197-21kworker/u8:2+events_unbound10:35:233
1927114991914,4cyclictest335557-21systemd-journal08:05:423
1927112991917,2cyclictest1969444-21kworker/u8:2+events_unbound08:15:252
1927112991916,2cyclictest2230512-21kworker/u8:1+events_unbound12:35:272
1927112991915,3cyclictest2005313-21kworker/u8:4+flush-259:009:35:202
1927112991915,3cyclictest1942579-21kworker/u8:0+events_unbound08:12:552
1927109991916,2cyclictest2225043-21kworker/u8:2+flush-259:012:25:111
1927109991915,3cyclictest509-21rs:main1
1927109991915,2cyclictest2041966-21latency_hist09:00:001
1927103991916,2cyclictest2178265-21kworker/u8:2+events_unbound11:20:230
1927114991816,1cyclictest0-21swapper/310:55:003
1927114991815,2cyclictest1942579-21kworker/u8:0+flush-259:009:10:193
1927114991814,3cyclictest335557-21systemd-journal09:02:573
1927114991814,3cyclictest2245702-21kworker/u8:3+flush-259:012:25:233
1927114991814,3cyclictest2068436-21apt-get09:25:113
1927114991811,5cyclictest1963217-21apt-get07:45:013
1927112991815,2cyclictest2204605-21kworker/u8:0+flush-259:012:05:262
1927112991815,2cyclictest2167927-21kworker/u8:1+events_unbound11:00:252
1927112991815,2cyclictest2005313-21kworker/u8:4+events_unbound09:05:152
1927112991814,3cyclictest2094150-21kworker/u8:3+events_unbound10:02:472
1927112991814,3cyclictest2005313-21kworker/u8:4+events_unbound09:20:292
1927109991815,2cyclictest2094150-21kworker/u8:3+flush-259:010:25:211
1927109991815,2cyclictest2068197-21kworker/u8:2+flush-259:010:15:251
1927109991815,2cyclictest1969444-21kworker/u8:2+flush-259:008:15:021
1927109991815,2cyclictest1942579-21kworker/u8:0+flush-259:008:40:201
1927109991814,3cyclictest1963877-21/usr/sbin/munin07:45:231
1927103991815,2cyclictest2068197-21kworker/u8:2+events_unbound10:10:240
1927114991714,2cyclictest2068197-21kworker/u8:2+flush-259:009:30:173
1927114991713,3cyclictest2245702-21kworker/u8:3+events_unbound12:35:013
1927114991713,3cyclictest2094150-21kworker/u8:3+flush-259:010:25:343
1927114991713,3cyclictest1942579-21kworker/u8:0+flush-259:008:55:203
1927114991712,4cyclictest2068197-21kworker/u8:2+flush-259:010:15:203
1927114991711,4cyclictest2031684-21latency_hist08:50:003
1927112991714,2cyclictest2005313-21kworker/u8:4+flush-259:009:15:202
1927112991714,2cyclictest2005313-21kworker/u8:4+flush-259:009:00:152
1927112991714,2cyclictest1942579-21kworker/u8:0+events_unbound08:24:452
1927112991714,2cyclictest0-21swapper/210:45:012
1927112991713,3cyclictest2136134-21kworker/u8:0+flush-259:011:05:242
1927109991714,2cyclictest1942579-21kworker/u8:0+events_unbound07:59:461
1927109991713,3cyclictest2094150-21kworker/u8:3+events_unbound10:05:131
1927109991713,3cyclictest2089022-21/usr/sbin/munin09:45:151
1927103991715,1cyclictest0-21swapper/012:30:010
1927103991714,2cyclictest1942579-21kworker/u8:0+flush-259:008:50:000
1927103991713,3cyclictest2230512-21kworker/u8:1+events_unbound12:00:200
1927103991713,2cyclictest0-21swapper/009:55:000
1927103991712,3cyclictest2109710-21apt-get10:05:130
1927103991711,5cyclictest2136513-21diskstats10:30:120
1927114991612,3cyclictest2230512-21kworker/u8:1+events_unbound12:35:213
1927114991612,3cyclictest2204605-21kworker/u8:0+events_unbound12:09:473
1927114991612,3cyclictest2094150-21kworker/u8:3+flush-259:011:10:243
1927114991612,3cyclictest1969444-21kworker/u8:2+events_unbound08:15:203
1927114991612,3cyclictest1958268-21kworker/u8:3+flush-259:007:40:163
1927109991613,2cyclictest2230512-21kworker/u8:1+flush-259:012:05:461
1927109991613,2cyclictest2204605-21kworker/u8:0+events_unbound12:10:231
1927109991613,2cyclictest2068857-21irqcore09:25:151
192710399168,1cyclictest2225273-21turbostat11:54:590
1927103991614,1cyclictest60350irq/132-enp0s29f1:rx-012:35:200
1927103991614,1cyclictest60350irq/132-enp0s29f1:rx-011:25:190
1927103991614,1cyclictest60350irq/132-enp0s29f1:rx-008:20:160
1927103991613,2cyclictest60350irq/132-enp0s29f1:rx-012:20:140
1927103991613,2cyclictest2083635-21kworker/u8:1+flush-259:009:55:210
1927103991613,2cyclictest1942579-21kworker/u8:0+events_unbound08:25:230
1927103991612,3cyclictest2005313-21kworker/u8:4+events_unbound08:35:150
1927103991611,4cyclictest335557-21systemd-journal10:49:560
1927103991611,4cyclictest335557-21systemd-journal07:45:010
1927103991611,4cyclictest2265706-21ntpq12:30:220
1927103991611,3cyclictest1953589-21cut07:35:150
1927114991512,2cyclictest2114826-21latency_hist10:10:003
1927114991512,2cyclictest2094150-21kworker/u8:3+events_unbound11:30:193
1927114991512,2cyclictest2094150-21kworker/u8:3+events_unbound10:25:003
1927114991512,2cyclictest1942581-21kworker/u8:4+events_unbound07:30:213
1927114991512,2cyclictest0-21swapper/311:55:003
1927114991511,3cyclictest2225043-21kworker/u8:2+events_unbound12:20:243
1927114991511,3cyclictest2068197-21kworker/u8:2+flush-259:009:51:023
1927114991511,3cyclictest2068197-21kworker/u8:2+flush-259:009:45:173
1927114991511,3cyclictest1942579-21kworker/u8:0+flush-259:008:10:133
1927112991513,2cyclictest2094150-21kworker/u8:3+flush-259:011:10:212
1927112991512,2cyclictest2204605-21kworker/u8:0+events_unbound12:01:472
1927112991512,2cyclictest2094150-21kworker/u8:3+flush-259:010:55:172
1927112991511,3cyclictest2068197-21kworker/u8:2+flush-259:009:45:212
1927112991510,4cyclictest2131177-21/usr/sbin/munin10:25:162
1927109991513,2cyclictest2114465-21kworker/u8:0+events_unbound10:13:011
1927109991512,2cyclictest1942579-21kworker/u8:0+flush-259:008:35:251
1927103991513,2cyclictest60350irq/132-enp0s29f1:rx-010:50:180
1927103991513,1cyclictest60350irq/132-enp0s29f1:rx-009:32:260
1927103991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:250
1927103991513,1cyclictest60350irq/132-enp0s29f1:rx-007:30:130
1927103991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:120
1927103991513,1cyclictest2094150-21kworker/u8:3+flush-259:011:35:150
1927103991512,2cyclictest60350irq/132-enp0s29f1:rx-010:55:140
1927103991512,2cyclictest60350irq/132-enp0s29f1:rx-009:05:190
1927103991512,2cyclictest1969444-21kworker/u8:2+flush-259:007:55:230
192711499149,4cyclictest2225043-21kworker/u8:2+flush-259:012:18:233
1927114991411,2cyclictest2068197-21kworker/u8:2+events_unbound10:40:163
1927114991411,2cyclictest2005313-21kworker/u8:4-flush-259:009:40:013
192710999149,4cyclictest509-21rs:main1
1927109991410,3cyclictest1942579-21kworker/u8:0+events_unbound07:32:381
1927103991413,1cyclictest60350irq/132-enp0s29f1:rx-011:55:260
1927103991413,1cyclictest60350irq/132-enp0s29f1:rx-009:45:180
1927103991412,2cyclictest60350irq/132-enp0s29f1:rx-009:40:340
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-010:40:220
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-010:00:150
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-009:35:220
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-009:20:210
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-009:12:510
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-009:00:140
1927103991412,1cyclictest60350irq/132-enp0s29f1:rx-008:00:040
1927103991411,2cyclictest60350irq/132-enp0s29f1:rx-008:15:120
1927103991411,2cyclictest60350irq/132-enp0s29f1:rx-007:15:160
1927103991411,2cyclictest60350irq/132-enp0s29f1:rx-007:15:160
1927103991411,2cyclictest60350irq/132-enp0s29f1:rx-007:10:250
1927103991410,3cyclictest2005313-21kworker/u8:4+events_unbound09:15:220
192711499139,3cyclictest2230512-21kworker/u8:1+events_unbound12:00:243
192711499139,3cyclictest2178265-21kworker/u8:2+events_unbound11:25:143
192711499139,3cyclictest2020133-21ntp_offset08:35:213
1927114991310,2cyclictest2209328-21unixbench_singl11:35:273
1927114991310,1cyclictest0-21swapper/308:20:213
192711499130,11cyclictest1-21systemd07:35:383
1927112991311,1cyclictest0-21swapper/207:35:012
1927112991310,2cyclictest2245702-21kworker/u8:3+events_unbound12:31:192
192710999139,3cyclictest2057857-21kworker/u8:1+events_unbound09:21:541
1927109991310,2cyclictest2178266-21kworker/u8:4+flush-259:011:35:211
1927109991310,2cyclictest1916853-21kworker/u8:3+events_unbound07:16:121
1927109991310,2cyclictest1916853-21kworker/u8:3+events_unbound07:16:111
192710399138,4cyclictest2120825-21cat10:15:010
1927103991312,1cyclictest60350irq/132-enp0s29f1:rx-011:32:580
1927103991310,2cyclictest60350irq/132-enp0s29f1:rx-008:30:120
192711499129,2cyclictest1980059-21fschecks_count08:00:173
192711499128,3cyclictest4087864-21kworker/u8:1+flush-259:007:10:253
192711499128,3cyclictest1969444-21kworker/u8:2+flush-259:007:57:143
192711499127,4cyclictest1942579-21kworker/u8:0+events_unbound07:25:193
192711499119,1cyclictest2086186-21kthreadcore09:40:163
192711499118,2cyclictest2083635-21kworker/u8:1+flush-259:009:55:183
192711499117,3cyclictest335557-21systemd-journal10:01:453
192711499117,2cyclictest0-21swapper/311:40:203
192711299118,2cyclictest2225043-21kworker/u8:2+flush-259:012:20:302
192710399117,3cyclictest2241257-21grep12:10:150
192711499109,1cyclictest491ktimers/311:45:113
192711499107,2cyclictest2005313-21kworker/u8:4+events_unbound09:20:143
19271039996,2cyclictest60350irq/132-enp0s29f1:rx-009:25:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional