You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 10:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 06, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2016276994135,4cyclictest2115194-21latency_hist20:45:001
2016282993832,4cyclictest2307728-21latency_hist23:50:013
2016282993731,4cyclictest2260682-21latency_hist23:05:013
2016279993730,5cyclictest2094572-21latency_hist20:25:002
2016274993732,4cyclictest335557-21systemd-journal00:00:110
2016279993430,3cyclictest2156750-21kworker/u8:1+events_unbound21:30:122
2016279993427,4cyclictest2286738-21cp23:30:012
2016282993328,3cyclictest2240050-21kworker/u8:2+flush-259:000:10:003
2016279993326,5cyclictest2208555-21latency_hist22:15:012
2016276993329,3cyclictest1984043-21kworker/u8:1+flush-259:019:25:101
2016279993227,3cyclictest335557-21systemd-journal22:38:122
2016279993127,3cyclictest2052433-21kworker/u8:5+events_unbound21:15:152
2016276993027,2cyclictest2276261-21kworker/u8:1+flush-259:023:25:001
2016274993026,3cyclictest2297635-21kworker/u8:1+flush-259:000:30:000
2016274992925,3cyclictest2105157-21apt-get20:35:120
2016279992824,3cyclictest2011104-21kworker/u8:3+events_unbound21:25:122
2016274992824,3cyclictest2203639-21apt-get22:10:120
2016274992821,5cyclictest2229513-21cp22:35:000
2016279992621,4cyclictest2240050-21kworker/u8:2+flush-259:023:45:012
2016279992620,4cyclictest2047236-21latency_hist19:40:012
2016279992519,4cyclictest2021372-21latency_hist19:15:012
2016279992517,5cyclictest2057171-21ntpq19:45:202
2016276992520,4cyclictest2286630-21latency_hist23:30:011
2016282992419,4cyclictest2036913-21kworker/u8:2+flush-259:019:50:013
2016282992418,4cyclictest2089431-21latency_hist20:20:003
2016279992420,3cyclictest2265865-21kworker/u8:3+events_unbound23:15:212
2016274992420,3cyclictest2052516-21gpgv19:45:010
201627499240,23cyclictest1-21systemd22:19:120
2016279992319,3cyclictest2265865-21kworker/u8:3+events_unbound23:15:002
2016279992319,3cyclictest2011104-21kworker/u8:3+events_unbound20:47:142
2016279992316,5cyclictest2141036-21latency_hist21:10:002
2016279992316,5cyclictest2104889-21latency_hist20:35:002
2016274992318,4cyclictest2261107-21diskstats23:05:130
2016282992217,3cyclictest2125802-21apt-get20:55:113
2016282992217,3cyclictest2125802-21apt-get20:55:113
2016282992216,4cyclictest2177154-21latency_hist21:45:023
2016279992219,2cyclictest2177146-21idleruntime-cro21:45:002
2016279992218,3cyclictest2260908-21kworker/u8:1+flush-259:023:05:202
2016279992218,3cyclictest2182525-21kworker/u8:4+flush-259:021:55:152
2016279992218,3cyclictest2115422-21kworker/u8:2+events_unbound20:55:202
2016279992218,3cyclictest2115422-21kworker/u8:2+events_unbound20:55:202
2016279992217,3cyclictest2265865-21kworker/u8:3+events_unbound23:37:122
2016279992217,3cyclictest2240050-21kworker/u8:2+events_unbound23:52:282
2016276992218,3cyclictest2333750-21apt-get00:15:111
2016276992217,3cyclictest335557-21systemd-journal21:13:121
2016274992215,5cyclictest2171133-21ntpq21:35:210
2016279992118,2cyclictest2240050-21kworker/u8:2+events_unbound22:50:012
2016279992117,3cyclictest2281422-21kworker/u8:5+events_unbound00:10:172
2016279992116,3cyclictest2297635-21kworker/u8:1+events_unbound23:55:202
2016276992118,2cyclictest2224163-21kworker/u8:3+flush-259:022:35:171
2016276992118,2cyclictest2036913-21kworker/u8:2+flush-259:019:35:011
2016276992117,3cyclictest2011104-21kworker/u8:3+flush-259:020:00:011
2016274992117,3cyclictest2099995-21apt-get20:30:110
2016274992116,4cyclictest2245193-21latency_hist22:50:000
2016274992115,4cyclictest335557-21systemd-journal23:20:000
2016274992114,4cyclictest335557-21systemd-journal19:16:100
2016279992017,2cyclictest2281422-21kworker/u8:5+events_unbound00:00:212
2016279992016,3cyclictest2348990-21kworker/u8:3+events_unbound00:30:132
2016279992016,3cyclictest2218805-21kworker/u8:0+events_unbound22:40:212
2016279992016,3cyclictest1952844-21kworker/u8:0+events_unbound19:22:112
2016279992015,3cyclictest335557-21systemd-journal22:04:112
2016279992012,6cyclictest2145377-21ntpq21:10:212
2016276992015,4cyclictest2287184-21cp23:30:001
2016274992016,2cyclictest0-21swapper/020:15:000
2016274992014,4cyclictest2030870-21ntpq19:20:220
2016282991914,4cyclictest2192446-21kworker/u8:1+flush-259:022:05:223
2016279991916,2cyclictest2052433-21kworker/u8:5+flush-259:020:15:242
2016279991915,3cyclictest2265865-21kworker/u8:3+events_unbound23:20:122
2016279991915,3cyclictest2250830-21kworker/u8:5+events_unbound23:00:142
2016279991915,3cyclictest2218805-21kworker/u8:0+events_unbound22:25:282
2016279991915,3cyclictest2011104-21kworker/u8:3+events_unbound19:40:102
2016279991915,2cyclictest2151649-21apt-get21:20:122
2016279991915,2cyclictest0-21swapper/219:55:012
2016276991916,2cyclictest2052433-21kworker/u8:5+flush-259:020:45:171
2016276991915,3cyclictest2218805-21kworker/u8:0+events_unbound22:45:151
2016274991916,2cyclictest2250830-21kworker/u8:5+flush-259:023:00:010
2016274991916,2cyclictest2240050-21kworker/u8:2+flush-259:023:50:240
2016274991915,3cyclictest2052433-21kworker/u8:5+flush-259:020:45:170
2016274991914,4cyclictest2098816-21ntpq20:25:210
2016282991813,3cyclictest2281408-21latency_hist23:25:003
2016279991815,2cyclictest1984043-21kworker/u8:1+events_unbound19:30:232
2016279991814,3cyclictest2240050-21kworker/u8:2+events_unbound23:30:022
2016279991814,3cyclictest2052433-21kworker/u8:5+flush-259:020:10:252
2016279991813,3cyclictest1984043-21kworker/u8:1+flush-259:019:25:192
2016276991815,2cyclictest2042342-21apt-get19:35:131
2016276991814,3cyclictest2240050-21kworker/u8:2+events_unbound23:10:231
2016276991813,3cyclictest2218805-21kworker/u8:0+flush-259:022:40:161
2016274991815,2cyclictest2348990-21kworker/u8:3+events_unbound00:32:120
2016274991815,2cyclictest2297635-21kworker/u8:1+flush-259:000:15:160
2016274991815,2cyclictest2219647-21irqcore22:25:190
2016274991815,2cyclictest2192446-21kworker/u8:1+flush-259:022:05:190
2016274991814,3cyclictest2265865-21kworker/u8:3+flush-259:023:30:410
2016274991814,3cyclictest2182525-21kworker/u8:4+flush-259:021:50:200
2016274991813,4cyclictest2130701-21latency_hist21:00:010
2016274991811,5cyclictest2306844-21ntpq23:45:210
2016274991811,5cyclictest2259813-21ntpq23:00:210
2016282991715,1cyclictest2224127-21sh22:29:593
2016282991713,3cyclictest2177395-21/usr/sbin/munin21:45:143
2016282991713,2cyclictest0-21swapper/323:20:013
2016279991714,2cyclictest2011104-21kworker/u8:3+events_unbound19:20:002
2016279991713,3cyclictest2297635-21kworker/u8:1+events_unbound00:15:142
2016279991712,3cyclictest335557-21systemd-journal00:21:112
2016276991715,1cyclictest0-21swapper/120:30:001
2016276991714,2cyclictest2036913-21kworker/u8:2+flush-259:019:40:181
2016276991713,3cyclictest2187722-21apt-get21:55:111
2016276991713,3cyclictest2011104-21kworker/u8:3+flush-259:021:25:171
201627499179,6cyclictest2073566-21latency_hist20:05:010
2016274991714,2cyclictest60350irq/132-enp0s29f1:rx-000:20:030
2016274991714,2cyclictest2115192-21sh20:45:000
2016274991714,2cyclictest1984043-21kworker/u8:1+flush-259:019:55:010
2016274991713,3cyclictest2052433-21kworker/u8:5+events_unbound20:05:200
2016274991713,3cyclictest1984043-21kworker/u8:1+events_unbound19:25:230
2016282991612,3cyclictest2208819-21apt-get22:15:113
2016282991612,3cyclictest2052433-21kworker/u8:5+flush-259:021:20:003
2016282991612,3cyclictest1952844-21kworker/u8:0+flush-259:019:15:003
2016282991611,3cyclictest509-21rs:main3
2016282991611,3cyclictest509-21rs:main3
2016282991611,3cyclictest2245422-21kworker/u8:4+flush-259:022:50:253
2016279991613,2cyclictest2184866-21tr21:50:192
2016279991612,3cyclictest2281422-21kworker/u8:5+events_unbound23:45:132
2016279991612,3cyclictest2192446-21kworker/u8:1+events_unbound22:07:122
2016279991612,3cyclictest2156750-21kworker/u8:1+flush-259:021:45:262
2016279991612,3cyclictest2011104-21kworker/u8:3+flush-259:021:35:312
201627999160,4cyclictest2068386-21idleruntime-cro20:00:002
2016276991614,1cyclictest0-21swapper/123:45:011
2016276991613,2cyclictest2318770-21irqcore00:00:141
2016276991612,3cyclictest2218597-21apt-get22:21:121
2016276991612,2cyclictest0-21swapper/122:29:591
2016274991614,1cyclictest60350irq/132-enp0s29f1:rx-023:40:270
2016274991614,1cyclictest60350irq/132-enp0s29f1:rx-021:44:180
2016274991614,1cyclictest60350irq/132-enp0s29f1:rx-021:05:260
2016274991614,1cyclictest0-21swapper/020:25:000
2016274991613,2cyclictest60350irq/132-enp0s29f1:rx-023:11:400
2016274991613,2cyclictest60350irq/132-enp0s29f1:rx-019:11:220
2016274991613,2cyclictest2328376-21kworker/u8:0+flush-259:000:10:170
2016274991613,2cyclictest2240050-21kworker/u8:2+flush-259:023:20:270
2016274991613,2cyclictest2214435-21irqcore22:20:160
2016274991610,4cyclictest335557-21systemd-journal21:35:000
2016282991513,1cyclictest2136533-21irqcore21:05:173
2016282991511,3cyclictest2224163-21kworker/u8:3+flush-259:022:40:253
2016279991510,3cyclictest0-21swapper/200:10:002
2016276991511,3cyclictest2240050-21kworker/u8:2+flush-259:000:05:301
2016276991511,3cyclictest2202972-21gpgv22:10:001
2016276991510,4cyclictest509-21rs:main1
2016276991510,4cyclictest2182564-21apt-get21:50:121
201627499159,4cyclictest2156949-21diskstats21:25:130
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:160
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-022:54:230
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-022:35:120
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:160
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:560
2016274991513,1cyclictest60350irq/132-enp0s29f1:rx-019:30:190
2016274991512,2cyclictest60350irq/132-enp0s29f1:rx-020:19:390
2016274991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:100
2016274991512,2cyclictest2115422-21kworker/u8:2+flush-259:021:15:200
2016274991511,3cyclictest2240050-21kworker/u8:2+flush-259:000:05:210
2016274991511,2cyclictest0-21swapper/022:05:010
201628299149,4cyclictest2011104-21kworker/u8:3+flush-259:020:33:153
2016282991411,2cyclictest2312474-21unixbench_singl23:50:243
2016282991411,2cyclictest2098770-21cut20:25:203
201628299140,13cyclictest1-21systemd19:35:003
201627999148,4cyclictest2245421-21kworker/u8:1+events_unbound22:52:232
201627999147,5cyclictest2016188-21latency_hist19:10:012
2016279991411,2cyclictest2095856-21kthreadcore20:25:172
2016279991410,3cyclictest2348990-21kworker/u8:3+events_unbound00:35:142
2016279991410,3cyclictest2192830-21kworker/u8:3+flush-259:022:15:532
2016279991410,3cyclictest2192446-21kworker/u8:1+events_unbound22:31:402
201627699149,4cyclictest2026585-21latency_hist19:20:011
2016276991411,2cyclictest2115422-21kworker/u8:2+events_unbound20:50:211
2016276991411,2cyclictest0-21swapper/120:10:011
2016276991410,3cyclictest2011104-21kworker/u8:3+flush-259:020:35:171
2016276991410,2cyclictest2177387-21kworker/u8:0+flush-259:022:10:171
2016274991412,1cyclictest60350irq/132-enp0s29f1:rx-022:40:260
2016274991412,1cyclictest60350irq/132-enp0s29f1:rx-021:55:240
2016274991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:260
2016274991411,2cyclictest60350irq/132-enp0s29f1:rx-023:36:450
2016274991411,2cyclictest60350irq/132-enp0s29f1:rx-021:20:240
2016274991411,2cyclictest60350irq/132-enp0s29f1:rx-019:55:150
2016274991411,2cyclictest60350irq/132-enp0s29f1:rx-019:35:200
201628299139,3cyclictest2182525-21kworker/u8:4+flush-259:021:55:243
201628299139,2cyclictest0-21swapper/320:20:213
2016282991311,1cyclictest0-21swapper/319:25:003
2016282991310,1cyclictest0-21swapper/320:55:003
201627999139,3cyclictest2192446-21kworker/u8:1+events_unbound22:20:022
201627999139,3cyclictest2115422-21kworker/u8:2+events_unbound20:50:132
201627999138,4cyclictest2250830-21kworker/u8:5+events_unbound22:55:272
201627999138,4cyclictest2083887-21kworker/u8:0+flush-259:020:40:102
2016279991310,2cyclictest2073129-21unixbench_singl20:00:252
2016279991310,2cyclictest2052433-21kworker/u8:5+events_unbound21:04:112
2016279991310,2cyclictest2052433-21kworker/u8:5+events_unbound21:04:102
201627699138,3cyclictest2068620-21/usr/sbin/munin20:00:151
2016274991310,2cyclictest60350irq/132-enp0s29f1:rx-021:10:110
2016274991310,2cyclictest2052433-21kworker/u8:5+flush-259:021:00:240
2016274991310,2cyclictest2052433-21kworker/u8:5+flush-259:021:00:240
201628299128,3cyclictest2297635-21kworker/u8:1+flush-259:023:40:163
201628299128,3cyclictest2218805-21kworker/u8:0+flush-259:022:30:063
201628299128,3cyclictest2021768-21cpuspeed_turbos19:15:133
2016282991210,1cyclictest0-21swapper/320:40:003
201627999129,2cyclictest2105132-21/usr/sbin/munin20:35:172
201627699129,2cyclictest2192830-21kworker/u8:3+flush-259:022:00:161
201627699129,2cyclictest2135044-21nvmesmart_nvme021:00:231
201627699129,2cyclictest2135044-21nvmesmart_nvme021:00:231
201627699129,2cyclictest2084630-21cpuspeed_turbos20:15:121
201627699129,2cyclictest2011104-21kworker/u8:3+flush-259:019:20:151
201627699128,3cyclictest2245422-21kworker/u8:4+events_unbound22:50:181
2016276991210,1cyclictest0-21swapper/122:35:011
201627499129,2cyclictest60350irq/132-enp0s29f1:rx-021:45:190
2016274991210,1cyclictest60350irq/132-enp0s29f1:rx-023:55:240
201628299119,1cyclictest0-21swapper/321:50:133
201628299119,1cyclictest0-21swapper/320:40:123
201628299118,2cyclictest2047571-21cpuspeed_turbos19:40:153
201628299118,1cyclictest0-21swapper/300:15:123
201628299117,3cyclictest2348990-21kworker/u8:3+flush-259:000:30:253
201627999111,6cyclictest2078686-21cron20:10:012
201627699119,1cyclictest2182294-21idleruntime-cro21:50:001
201627699119,1cyclictest0-21swapper/122:20:011
201627699119,1cyclictest0-21swapper/121:20:151
201627699118,2cyclictest2261012-21cpuspeed_turbos23:05:121
201627699118,2cyclictest2036913-21kworker/u8:2+flush-259:019:45:151
201627699118,1cyclictest0-21swapper/100:00:011
201627699117,3cyclictest335557-21systemd-journal20:24:561
201627699110,10cyclictest2312894-21awk23:55:001
201628299108,1cyclictest0-21swapper/323:30:003
201628299105,4cyclictest2348990-21kworker/u8:3+flush-259:000:35:103
201628299104,5cyclictest2115783-21sort20:45:153
201627699107,2cyclictest2171543-21unixbench_multi21:35:261
201627699106,3cyclictest2062880-21sshd19:51:171
201627699104,4cyclictest2292486-21seq23:35:121
20162829997,1cyclictest2042410-21cpuspeed_turbos19:35:143
20162829997,1cyclictest0-21swapper/321:00:123
20162829997,1cyclictest0-21swapper/321:00:123
20162829996,2cyclictest2266204-21cpuspeed_turbos23:10:143
20162829994,3cyclictest2214517-21cut22:20:173
20162769997,1cyclictest2345582-21kthreadcore00:25:191
20162769997,1cyclictest0-21swapper/122:55:131
20162769995,3cyclictest2328376-21kworker/u8:0+events_unbound00:20:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional