You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 05:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Wed Sep 23, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205953799323716,3216cyclictest2097013-21kworker/2:2+events21:15:152
205953399315214,3132cyclictest2149889-21kworker/1:1+events23:50:141
20595379928570,2852cyclictest2124364-21kworker/2:2+events22:30:182
205953799281813,2800cyclictest2097013-21kworker/2:2+events21:10:202
205952899278514,2767cyclictest2142008-21kworker/0:0+events23:30:160
205953399278414,2768cyclictest2088674-21kworker/1:1+events20:45:201
205953999277312,2757cyclictest2143431-21kworker/3:1+events23:31:233
205952899264511,2630cyclictest2121294-21kworker/0:1+events22:25:240
205952899262813,2611cyclictest2157736-21kworker/0:0+events00:30:170
205952899257812,2563cyclictest2074371-21kworker/0:1+events20:50:420
205952899257812,2563cyclictest2074371-21kworker/0:1+events20:50:410
205952899254412,2528cyclictest2101884-21kworker/0:2+events21:19:210
205953799253912,2525cyclictest2097013-21kworker/2:2+events21:20:062
205953799253612,2520cyclictest2127299-21kworker/2:1+events22:38:412
205953999253010,2517cyclictest2145063-21kworker/3:0+events23:35:133
205952899253012,2514cyclictest2132009-21kworker/0:2+events22:53:550
205953799252812,2512cyclictest2121116-21kworker/2:1+events22:25:472
205953399251712,2501cyclictest2119387-21kworker/1:2+events22:16:451
205952899251511,2500cyclictest2123366-21kworker/0:2+events22:34:290
205952899250012,2485cyclictest2151628-21kworker/0:0+events23:58:020
205952899249812,2482cyclictest2064405-21kworker/0:2+events19:29:410
20595379924929,2480cyclictest2138749-21kworker/2:2+events23:16:572
205953799249112,2476cyclictest2144967-21kworker/2:1+events23:31:462
205952899249012,2475cyclictest2129135-21kworker/0:0+events22:55:480
205952899249011,2475cyclictest2086824-21kworker/0:2+events20:36:300
205952899248911,2474cyclictest2085106-21kworker/0:0+events20:30:480
205952899248811,2474cyclictest2101884-21kworker/0:2+events21:22:220
205953999248712,2471cyclictest2103466-21kworker/3:1+events21:32:403
205952899248612,2470cyclictest2114407-21kworker/0:2+events22:18:580
205952899248610,2473cyclictest2161237-21kworker/0:1+events00:35:330
205952899248610,2473cyclictest2161237-21kworker/0:1+events00:35:330
20595339924857,2473cyclictest2072401-21kworker/1:0+events19:55:151
205953999248412,2468cyclictest2093523-21kworker/3:0+events21:13:033
205953999248211,2469cyclictest2137028-21kworker/3:2+events23:15:033
205953799247911,2465cyclictest2078935-21kworker/2:2+events20:24:462
205953399247710,2464cyclictest2114528-21kworker/1:0+events22:00:211
205952899247312,2457cyclictest2151628-21kworker/0:0+events00:04:040
205953799247211,2458cyclictest2064465-21kworker/2:2+events19:32:212
205953999247112,2455cyclictest2149919-21kworker/3:1+events23:52:063
205953799245912,2443cyclictest2137126-21kworker/2:0+events23:26:522
205953999245810,2445cyclictest2085337-21kworker/3:2+events20:29:393
205953799245712,2441cyclictest2135234-21kworker/2:1+events23:08:172
205952899245612,2441cyclictest2114407-21kworker/0:2+events22:14:050
205953799245512,2439cyclictest2116033-21kworker/2:1+events22:02:382
205953799245311,2439cyclictest2127299-21kworker/2:1+events22:48:392
205953799245211,2439cyclictest2064465-21kworker/2:2+events19:25:092
205953799245012,2434cyclictest2146609-21kworker/2:0+events23:37:502
205953799245012,2434cyclictest2090242-21kworker/2:0+events20:43:262
205953999244912,2434cyclictest2067379-21kworker/3:1+events19:44:133
205953399244911,2434cyclictest2145251-21kworker/1:2+events23:37:051
205953999244812,2432cyclictest2072430-21kworker/3:0+events19:50:173
205953399244811,2433cyclictest2141979-21kworker/1:1+events23:34:261
205953799244712,2432cyclictest2109781-21kworker/2:2+events22:22:462
205953799244612,2430cyclictest2150105-21kworker/2:3+events00:32:112
205953799244612,2430cyclictest2121116-21kworker/2:1+events22:18:152
205953799244612,2430cyclictest2093794-21kworker/2:0+events21:09:372
20595379924449,2432cyclictest2093794-21kworker/2:0+events21:01:142
205953799244312,2428cyclictest2117631-21kworker/2:0+events22:08:422
205953799244312,2428cyclictest2098875-21kworker/2:1+events21:35:402
205953799244312,2427cyclictest2150009-21kworker/2:2+events23:54:432
20595379924429,2430cyclictest2072495-21kworker/2:1+events19:57:552
205953799244212,2427cyclictest2109781-21kworker/2:2+events22:14:522
205953799244212,2426cyclictest2132131-21kworker/2:2+events22:52:482
205953799244211,2427cyclictest2140472-21kworker/2:1+events23:21:332
205953799243712,2422cyclictest2098875-21kworker/2:1+events21:28:082
205953999243410,2421cyclictest2090511-21kworker/3:2+events20:52:323
205953999243410,2421cyclictest2090511-21kworker/3:2+events20:52:323
205953999243410,2417cyclictest2154841-21kworker/3:0+events00:09:013
205953399243212,2417cyclictest2145251-21kworker/1:2+events23:44:121
205952899243112,2415cyclictest2140318-21kworker/0:2+events23:23:300
205952899242212,2406cyclictest2078862-21kworker/0:0+events20:13:530
205953999242011,2405cyclictest2093523-21kworker/3:0+events21:03:303
205953799242012,2404cyclictest2090242-21kworker/2:0+events20:47:152
205953999241812,2403cyclictest2067379-21kworker/3:1+events19:31:573
205953399241812,2403cyclictest2151716-21kworker/1:2+events23:58:471
205952899241611,2401cyclictest2142008-21kworker/0:0+events23:47:150
205953399241511,2400cyclictest2106832-21kworker/1:1+events21:44:441
205953999241212,2397cyclictest2105084-21kworker/3:2+events22:13:413
205953399241212,2396cyclictest2134230-21kworker/1:2+events23:07:551
205953399241212,2396cyclictest2092524-21kworker/1:0+events21:02:461
205953399241112,2395cyclictest2062753-21kworker/1:2+events19:24:241
205953399241012,2394cyclictest2158062-21kworker/1:0+events00:16:131
205953399241011,2395cyclictest2072401-21kworker/1:0+events20:23:391
205953999240912,2394cyclictest2143431-21kworker/3:1+events23:28:243
205953399240810,2395cyclictest2086764-21kworker/1:2+events20:34:121
205953999240711,2393cyclictest2154841-21kworker/3:0+events00:17:433
205953399240712,2393cyclictest2126026-21kworker/1:2+events22:37:101
205953399240611,2392cyclictest2124425-21kworker/1:1+events22:50:531
205953399240511,2390cyclictest2086764-21kworker/1:2+events20:36:061
205953399240412,2389cyclictest2106832-21kworker/1:1+events21:36:041
205953999240312,2388cyclictest2158040-21kworker/3:1+events00:20:223
205953799240314,2386cyclictest2109781-21kworker/2:2+events21:51:362
205953999240212,2387cyclictest2105084-21kworker/3:2+events21:42:253
205953999240212,2387cyclictest2083755-21kworker/3:0+events20:35:203
205953999240211,2387cyclictest2095121-21kworker/3:1+events21:05:253
205953999240112,2386cyclictest2149919-21kworker/3:1+events00:01:043
205953799240112,2386cyclictest2127299-21kworker/2:1+events22:40:592
205953999240012,2384cyclictest2138629-21kworker/3:0+events23:21:583
205953799240011,2386cyclictest2083798-21kworker/2:1+events20:31:552
205953399240012,2385cyclictest2132335-21kworker/1:0+events22:57:191
205953399240011,2385cyclictest2124425-21kworker/1:1+events22:34:511
20595399923994,2392cyclictest2125908-21kworker/3:1+events22:48:173
205953999239911,2384cyclictest2067379-21kworker/3:1+events19:45:193
205953999239812,2382cyclictest2146667-21kworker/3:1+events23:41:333
205953999239812,2382cyclictest2111534-21kworker/3:0+events22:04:553
205952899239714,2380cyclictest2074371-21kworker/0:1+events20:43:490
205953999239612,2381cyclictest2130745-21kworker/3:0+events23:00:453
205953999239612,2381cyclictest2063108-21kworker/3:1+events19:23:153
205953999239611,2382cyclictest2151544-21kworker/3:0+events23:57:413
205953999239611,2382cyclictest2125908-21kworker/3:1+events22:41:223
205953999239512,2381cyclictest2109874-21kworker/3:1+events21:45:063
205953399239512,2379cyclictest2103564-21kworker/1:2+events21:27:011
205953999239412,2379cyclictest2090511-21kworker/3:2+events20:45:423
205953999239412,2378cyclictest2124260-21kworker/3:0+events22:28:273
205953999239211,2377cyclictest2106672-21kworker/3:0+events21:37:583
205952899239111,2378cyclictest2108630-21kworker/0:0+events21:56:310
205953399238912,2373cyclictest2097067-21kworker/1:1+events21:08:061
20595379923884,2380cyclictest2161176-21kworker/2:0+events00:25:192
205953999238612,2370cyclictest2130745-21kworker/3:0+events22:51:403
205953999238311,2369cyclictest2095121-21kworker/3:1+events20:59:183
205953999238110,2367cyclictest2083755-21kworker/3:0+events20:43:023
205953999235712,2342cyclictest2149919-21kworker/3:1+events23:49:073
205952899235112,2335cyclictest2140318-21kworker/0:2+events23:19:390
205953999235011,2335cyclictest2158040-21kworker/3:1+events00:31:253
205953799234910,2336cyclictest2064465-21kworker/2:2+events19:51:052
205952899234910,2336cyclictest2125773-21kworker/0:0+events22:35:140
205952899234410,2331cyclictest2074371-21kworker/0:1+events21:07:180
205953799233412,2319cyclictest2064465-21kworker/2:2+events19:41:112
205953799233111,2317cyclictest2103294-21kworker/2:0+events21:30:462
205952899233012,2315cyclictest2110823-21kworker/0:2+events21:49:190
205952899233012,2314cyclictest2127421-21kworker/0:1+events22:47:050
205953799232211,2307cyclictest2066153-21kworker/2:1+events19:39:372
205952899231012,2294cyclictest2074371-21kworker/0:1+events21:01:590
205952899230812,2293cyclictest2052744-21kworker/0:0+events19:16:230
205952899230611,2292cyclictest2133607-21kworker/0:1+events23:12:010
205952899230411,2289cyclictest2106770-21kworker/0:1+events21:40:130
205952899230312,2288cyclictest2157736-21kworker/0:0+events00:26:290
205953799229211,2277cyclictest2153357-21kworker/2:1+events00:04:492
205953799229112,2276cyclictest2072495-21kworker/2:1+events19:49:092
205952899229010,2277cyclictest2116123-21kworker/0:1+events22:04:330
205952899228612,2270cyclictest2074371-21kworker/0:1+events20:07:230
205953799228412,2269cyclictest2062814-21kworker/2:0+events19:23:372
205952899227111,2256cyclictest2153572-21kworker/0:1+events00:08:380
205952899227011,2256cyclictest2100258-21kworker/0:0+events21:33:020
205952899226910,2256cyclictest2159487-21kworker/0:2+events00:18:300
205952899226610,2252cyclictest2149949-21kworker/0:1+events23:53:370
205953799226111,2248cyclictest2128908-21kworker/2:0+events22:55:042
205952899226011,2245cyclictest2153572-21kworker/0:1+events00:14:420
20595379922578,2245cyclictest2135234-21kworker/2:1+events23:01:542
20595289922568,2245cyclictest2072733-21kworker/0:2+events19:54:310
205953399225311,2239cyclictest2088674-21kworker/1:1+events20:53:171
205953399225311,2239cyclictest2088674-21kworker/1:1+events20:53:171
205953799225011,2235cyclictest2078935-21kworker/2:2+events20:19:062
205953399225012,2235cyclictest2059057-21kworker/1:1+events19:28:091
205953799224711,2233cyclictest2165973-21kworker/2:0+events00:37:302
205953799224711,2233cyclictest2165973-21kworker/2:0+events00:37:302
20595379922459,2232cyclictest2108161-21kworker/2:0+events21:42:022
205953799224010,2226cyclictest2075730-21kworker/2:0+events20:09:182
20595379922389,2226cyclictest2075730-21kworker/2:0+events20:04:222
205953799223810,2225cyclictest2137126-21kworker/2:0+events23:12:252
205953799223611,2221cyclictest2093794-21kworker/2:0+events20:57:462
205952899223611,2221cyclictest2100258-21kworker/0:0+events21:14:330
205953799223510,2222cyclictest2148232-21kworker/2:1+events23:45:462
205953399223511,2220cyclictest2156190-21kworker/1:2+events00:28:211
205952899223510,2221cyclictest2114407-21kworker/0:2+events22:05:190
205953399223011,2216cyclictest2164286-21kworker/1:1+events00:35:561
205953399223011,2216cyclictest2164286-21kworker/1:1+events00:35:561
205953799222911,2215cyclictest2075730-21kworker/2:0+events20:10:252
205953799222911,2214cyclictest2146609-21kworker/2:0+events23:40:042
20595379922289,2216cyclictest2150105-21kworker/2:3+events00:18:532
20595339922289,2216cyclictest2080615-21kworker/1:2+events20:19:301
205953399222811,2213cyclictest2100319-21kworker/1:0+events21:24:181
205953799222610,2213cyclictest2078935-21kworker/2:2+events20:27:442
205953999222511,2212cyclictest2105084-21kworker/3:2+events21:50:063
205953799222410,2210cyclictest2092135-21kworker/2:1+events20:52:552
205953799222410,2210cyclictest2092135-21kworker/2:1+events20:52:542
205953999222312,2207cyclictest2075650-21kworker/3:2+events19:58:163
205953799222311,2208cyclictest2060798-21kworker/2:1+events19:14:292
205953799222310,2210cyclictest2054248-21kworker/2:2+events19:16:482
205953799222210,2209cyclictest2114346-21kworker/2:0+events21:57:412
205953399222211,2207cyclictest2119387-21kworker/1:2+events22:23:081
20595379922219,2208cyclictest2156160-21kworker/2:0+events00:06:442
205953799222111,2207cyclictest2150105-21kworker/2:3+events23:59:112
205953399222011,2206cyclictest2083830-21kworker/1:1+events20:26:371
20595379922199,2206cyclictest2150105-21kworker/2:3+events00:13:312
205953399221911,2204cyclictest2114528-21kworker/1:0+events22:14:291
205953999221610,2203cyclictest2100245-21kworker/3:1+events21:16:223
205953399221511,2201cyclictest2156190-21kworker/1:2+events00:33:371
20595339922149,2202cyclictest2097067-21kworker/1:1+events21:13:261
205953399221410,2201cyclictest2116150-21kworker/1:2+events22:06:041
205953399221310,2200cyclictest2092524-21kworker/1:0+events20:58:111
205953399221211,2198cyclictest2059057-21kworker/1:1+events19:31:351
205953399221111,2197cyclictest2059057-21kworker/1:1+events19:45:421
205953399220911,2195cyclictest2149889-21kworker/1:1+events00:00:401
205953399220911,2195cyclictest2106832-21kworker/1:1+events21:58:041
205953399220811,2194cyclictest2100319-21kworker/1:0+events21:34:111
205953399220711,2193cyclictest2132335-21kworker/1:0+events23:28:481
205953999220410,2190cyclictest2075650-21kworker/3:2+events20:19:523
205953399220410,2190cyclictest2072401-21kworker/1:0+events20:07:001
205953399220410,2190cyclictest2059057-21kworker/1:1+events19:17:101
20595399922039,2190cyclictest2111534-21kworker/3:0+events21:56:113
205953999220311,2189cyclictest2067379-21kworker/3:1+events19:38:273
205953999220311,2188cyclictest2117572-21kworker/3:1+events22:09:293
205953399220212,2187cyclictest2109633-21kworker/1:0+events21:45:521
205953999220111,2187cyclictest2138629-21kworker/3:0+events23:13:333
205953999220011,2186cyclictest2166000-21kworker/3:0+events00:37:533
205953999220011,2186cyclictest2166000-21kworker/3:0+events00:37:533
205953999219911,2185cyclictest2134063-21kworker/3:1+events23:08:413
205953999219911,2185cyclictest2103466-21kworker/3:1+events21:27:463
205953999219711,2183cyclictest2125908-21kworker/3:1+events22:36:233
20595399921969,2183cyclictest2105084-21kworker/3:2+events22:20:293
205953999219610,2183cyclictest2065069-21kworker/3:2+events19:28:533
205953999219511,2180cyclictest2075650-21kworker/3:2+events20:11:353
205953399219510,2182cyclictest2059057-21kworker/1:1+events19:36:541
205953399219210,2179cyclictest2130621-21kworker/1:2+events22:49:461
205953399219011,2176cyclictest2074098-21kworker/1:2+events20:02:051
20595339921899,2176cyclictest2149889-21kworker/1:1+events00:06:201
205953399218811,2173cyclictest2132335-21kworker/1:0+events23:00:221
205953399218810,2174cyclictest2074098-21kworker/1:2+events19:52:571
205953399218511,2171cyclictest2114528-21kworker/1:0+events22:29:331
205952899218511,2172cyclictest2123366-21kworker/0:2+events22:40:360
205952899218311,2169cyclictest2074371-21kworker/0:1+events20:20:580
20595339921819,2169cyclictest2059057-21kworker/1:1+events19:44:341
205953999217610,2163cyclictest2105084-21kworker/3:2+events22:17:273
205953999217511,2160cyclictest2057703-21kworker/3:2+events19:12:133
205953399217511,2161cyclictest2138660-21kworker/1:1+events23:15:461
205953999217210,2158cyclictest2105084-21kworker/3:2+events22:31:263
205953399216311,2149cyclictest2161086-21kworker/1:1+events00:24:321
205953999215910,2146cyclictest2083755-21kworker/3:0+events20:31:353
205953999215611,2142cyclictest2154841-21kworker/3:0+events00:10:333
205953399215210,2138cyclictest2141979-21kworker/1:1+events23:24:381
205953799215010,2137cyclictest2083798-21kworker/2:1+events20:37:162
20595399921286,2119cyclictest2078926-21kworker/3:1+events20:09:413
20595399921249,2111cyclictest2075650-21kworker/3:2+events20:22:303
205952899212311,2109cyclictest2070811-21kworker/0:0+events19:59:250
20595399921229,2110cyclictest2093523-21kworker/3:0+events21:20:283
20595289921109,2098cyclictest2140318-21kworker/0:2+events23:25:460
205952899211010,2097cyclictest2108630-21kworker/0:0+events21:53:320
205952899210910,2095cyclictest2069000-21kworker/0:1+events19:43:510
205952899210811,2093cyclictest2105167-21kworker/0:2+events21:37:110
205953399210611,2091cyclictest2127689-21kworker/1:0+events22:43:401
205952899210611,2091cyclictest2157736-21kworker/0:0+events00:24:560
205952899210611,2091cyclictest2093501-21kworker/0:2+events20:58:330
205952899210610,2092cyclictest2142008-21kworker/0:0+events23:42:430
205952899210510,2093cyclictest2074371-21kworker/0:1+events20:15:020
205952899210411,2090cyclictest2119356-21kworker/0:0+events22:24:380
205952899210411,2090cyclictest2074371-21kworker/0:1+events20:04:440
205952899210411,2089cyclictest2085106-21kworker/0:0+events20:26:580
205952899210211,2088cyclictest2135438-21kworker/0:2+events23:04:550
20595339921009,2088cyclictest2060741-21kworker/1:0+events19:13:421
20595289921009,2088cyclictest2062702-21kworker/0:1+events19:22:520
205952899209711,2082cyclictest2074371-21kworker/0:1+events20:46:050
205952899209611,2082cyclictest2066121-21kworker/0:0+events19:34:160
205952899209510,2082cyclictest2070811-21kworker/0:0+events19:49:550
205952899209410,2081cyclictest2135438-21kworker/0:2+events23:07:120
20595289920936,2084cyclictest2064405-21kworker/0:2+events19:36:050
20595339920929,2080cyclictest2132335-21kworker/1:0+events23:14:191
205952899208911,2075cyclictest2100258-21kworker/0:0+events21:29:370
205953399208610,2073cyclictest2106832-21kworker/1:1+events21:52:451
205953799208110,2068cyclictest2150105-21kworker/2:3+events00:24:102
20595339920627,2052cyclictest2097067-21kworker/1:1+events21:16:461
20595379920614,2053cyclictest2109781-21kworker/2:2+events21:49:422
20595339920618,2049cyclictest2088674-21kworker/1:1+events20:41:291
205953399205810,2045cyclictest2072401-21kworker/1:0+events20:14:381
205952899205610,2042cyclictest2142008-21kworker/0:0+events23:35:340
20595339920537,2043cyclictest2147662-21kworker/1:0+events23:47:591
205953999204312,2027cyclictest2158040-21kworker/3:1+events00:27:593
205953999203010,2017cyclictest2057703-21kworker/3:2+events19:19:283
20595289920287,2017cyclictest2052744-21kworker/0:0+events19:11:270
20595399919549,1943cyclictest2074039-21kworker/3:1+events20:00:113
20592482179145,30sleep20-21swapper/219:08:492
20591442144107,33sleep30-21swapper/319:07:293
20590142141101,25sleep00-21swapper/019:05:510
20593082140107,28sleep10-21swapper/119:09:361
205953399111108,2cyclictest2156190-21kworker/1:2+pm00:14:551
205953999161,11cyclictest2133967-21munin-run23:00:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional