You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 22:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Mon Mar 30, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202389199314515,3126cyclictest2033808-21kworker/0:1+events19:45:210
202390199299915,2980cyclictest2079192-21kworker/3:2+events22:00:003
20238979928897,2878cyclictest2082421-21kworker/2:1+events22:10:132
202390199276913,2752cyclictest2038545-21kworker/3:1+events19:55:123
202390199276812,2750cyclictest2088488-21kworker/3:0+events22:35:113
202389199275411,2738cyclictest2063229-21kworker/0:1+events21:10:470
202389199267113,2654cyclictest2069632-21kworker/0:0+events21:40:120
20238959926568,2644cyclictest2064657-21kworker/1:0+events21:20:211
202390199264513,2628cyclictest2069577-21kworker/3:0+events21:30:153
202390199263010,2615cyclictest2046820-21kworker/3:2+events20:20:153
202390199262513,2609cyclictest2025437-21kworker/3:2+events19:25:163
202389599259212,2574cyclictest2115955-21kworker/1:2+events00:05:151
202389599254213,2525cyclictest2064657-21kworker/1:0+events21:18:081
202390199253612,2520cyclictest2082545-21kworker/3:2+events22:16:163
202390199252510,2511cyclictest2128481-21kworker/3:2+events00:37:423
202390199252510,2511cyclictest2128481-21kworker/3:2+events00:37:423
20238919925089,2495cyclictest2053132-21kworker/0:1+events20:44:190
20239019925007,2489cyclictest2117903-21kworker/3:0+events00:03:003
202389799249712,2482cyclictest2075889-21kworker/2:1+events21:47:222
202389199249312,2477cyclictest2046850-21kworker/0:0+events20:21:250
202389599249111,2477cyclictest2046611-21kworker/1:0+events20:51:571
202389599249012,2474cyclictest2127056-21kworker/1:1+events00:31:361
202389599249012,2474cyclictest2127056-21kworker/1:1+events00:31:361
202390199248712,2473cyclictest2038545-21kworker/3:1+events20:05:063
202390199248712,2471cyclictest2056334-21kworker/3:0+events20:52:213
202389199248610,2473cyclictest2089084-21kworker/0:1+events22:40:520
202389199248312,2468cyclictest2122083-21kworker/0:0+events00:31:120
202389199248312,2468cyclictest2122083-21kworker/0:0+events00:31:110
202389199248010,2467cyclictest2097998-21kworker/0:0+events23:06:290
202389199246712,2451cyclictest2106463-21kworker/0:2+events23:30:170
202390199246011,2445cyclictest2077558-21kworker/3:0+events22:12:303
202390199245612,2442cyclictest2040494-21kworker/3:0+events20:01:183
202390199245612,2440cyclictest2117903-21kworker/3:0+events00:17:503
20238919924556,2445cyclictest2115688-21kworker/0:1+events00:09:440
202389799245411,2440cyclictest2109501-21kworker/2:0+events23:43:332
202390199245312,2438cyclictest2059607-21kworker/3:1+events21:02:223
202390199245312,2437cyclictest2091842-21kworker/3:1+events22:42:473
202390199245310,2439cyclictest2061301-21kworker/3:0+events21:16:353
202390199245112,2436cyclictest2028741-21kworker/3:1+events19:22:583
202390199245112,2435cyclictest2103255-21kworker/3:2+events23:17:103
202390199245112,2435cyclictest2095130-21kworker/3:1+events23:35:353
202390199245011,2436cyclictest2093495-21kworker/3:2+events22:52:223
202390199244912,2434cyclictest2079192-21kworker/3:2+events22:02:383
202390199244711,2432cyclictest2120662-21kworker/3:1+events00:09:223
202390199244610,2433cyclictest2074353-21kworker/3:2+events21:50:493
202390199244211,2427cyclictest2099990-21kworker/3:2+events23:07:153
202390199243912,2424cyclictest2051624-21kworker/3:0+events20:36:383
202389199243710,2424cyclictest2117377-21kworker/0:0+events00:04:530
202389199243512,2419cyclictest2068032-21kworker/0:2+events21:25:200
202389799242712,2412cyclictest2002823-21kworker/2:1+events19:20:192
202389799242612,2411cyclictest2104558-21kworker/2:2+events23:16:482
202389199242212,2407cyclictest2089084-21kworker/0:1+events22:33:190
202389199242210,2409cyclictest2115688-21kworker/0:1+events00:11:380
202389599242012,2405cyclictest2046611-21kworker/1:0+events20:39:401
202389199242011,2405cyclictest2066048-21kworker/0:0+events21:20:430
202389199241912,2404cyclictest2054850-21kworker/0:2+events20:58:300
202389199241912,2403cyclictest2063229-21kworker/0:1+events21:19:160
202389199241812,2402cyclictest2103167-21kworker/0:2+events23:15:150
202389199241211,2399cyclictest2108342-21kworker/0:0+events23:40:100
202389799240812,2393cyclictest2104558-21kworker/2:2+events23:22:352
202389599240211,2388cyclictest2117559-21kworker/1:1+events00:03:461
202389199239811,2383cyclictest2095073-21kworker/0:1+events22:57:010
202389199239212,2377cyclictest2122083-21kworker/0:0+events00:17:270
20239019923889,2375cyclictest2025437-21kworker/3:2+events19:46:283
202390199238410,2370cyclictest2063196-21kworker/3:1+events21:42:053
202390199238312,2368cyclictest2048533-21kworker/3:1+events20:30:123
202389199238111,2368cyclictest2095073-21kworker/0:1+events22:50:060
202389199237610,2363cyclictest2077646-21kworker/0:1+events22:06:280
202390199237211,2357cyclictest2046820-21kworker/3:2+events20:25:133
202389599237111,2357cyclictest2053431-21kworker/1:1+events20:41:131
202389199236512,2350cyclictest2108342-21kworker/0:0+events23:39:260
20238959923638,2351cyclictest2082302-21kworker/1:0+events22:09:491
202389599236312,2348cyclictest2059454-21kworker/1:2+events21:00:271
202389799235711,2343cyclictest2041986-21kworker/2:2+events20:13:272
202389199235111,2337cyclictest2115688-21kworker/0:1+events23:52:180
202389599235012,2334cyclictest2046611-21kworker/1:0+events20:24:271
202389799234912,2333cyclictest2056577-21kworker/2:1+events21:12:222
202389799234910,2334cyclictest2069782-21kworker/2:0+events21:38:392
202389799234812,2333cyclictest2085657-21kworker/2:1+events22:21:362
20238959923459,2333cyclictest2122113-21kworker/1:0+events00:23:331
202389599234412,2329cyclictest2043376-21kworker/1:0+events20:10:511
202389799234312,2328cyclictest2109501-21kworker/2:0+events23:34:262
202389799233510,2322cyclictest2116284-21kworker/2:2+events00:12:232
202389799233012,2315cyclictest2084047-21kworker/2:0+events22:34:282
202389799233012,2314cyclictest2106222-21kworker/2:1+events23:27:112
202389799232912,2313cyclictest2091718-21kworker/2:1+events22:49:192
202389599232911,2314cyclictest2106160-21kworker/1:1+events23:47:411
202389799232812,2313cyclictest2125441-21kworker/2:0+events00:28:542
202389799232812,2313cyclictest2123784-21kworker/2:1+events00:22:002
202389799232811,2313cyclictest2056577-21kworker/2:1+events21:24:132
202390199232711,2312cyclictest2120662-21kworker/3:1+events00:12:473
202389799232710,2314cyclictest2091718-21kworker/2:1+events23:00:272
202389799232512,2310cyclictest2109501-21kworker/2:0+events23:38:382
202389799232512,2310cyclictest2051563-21kworker/2:1+events20:32:072
202389599232512,2309cyclictest2117559-21kworker/1:1+events00:12:011
202389799232412,2309cyclictest2098454-21kworker/2:2+events23:08:002
202389199232312,2308cyclictest2058091-21kworker/0:1+events20:54:150
202390199232210,2308cyclictest2088488-21kworker/3:0+events22:31:473
202389599232112,2306cyclictest2106160-21kworker/1:1+events23:23:461
202389799232011,2306cyclictest2080789-21kworker/2:2+events22:05:182
202390199231211,2298cyclictest2111075-21kworker/3:0+events23:40:533
202389599230111,2286cyclictest2061120-21kworker/1:1+events21:06:561
202390199229911,2285cyclictest2063196-21kworker/3:1+events21:21:063
202389799229712,2281cyclictest2101869-21kworker/2:0+events23:12:342
202389799229611,2282cyclictest2128361-21kworker/2:2+events00:32:432
202389799229611,2282cyclictest2128361-21kworker/2:2+events00:32:432
202389199229611,2282cyclictest2122083-21kworker/0:0+events00:20:290
202389199229410,2281cyclictest2077646-21kworker/0:1+events21:56:310
202389799229012,2274cyclictest2084047-21kworker/2:0+events22:43:092
202390199228510,2271cyclictest2086753-21kworker/3:1+events22:25:463
202390199227910,2266cyclictest2109348-21kworker/3:2+events23:49:143
202389799227812,2262cyclictest2056577-21kworker/2:1+events21:02:452
202389199227412,2259cyclictest2099843-21kworker/0:2+events23:01:340
202389199227111,2256cyclictest2074442-21kworker/0:2+events21:48:330
202390199226411,2250cyclictest2033867-21kworker/3:1+events19:42:193
202390199226410,2251cyclictest2040494-21kworker/3:0+events20:19:283
202389799226411,2250cyclictest2091718-21kworker/2:1+events22:58:312
20239019922637,2253cyclictest2109348-21kworker/3:2+events23:31:473
202389799226211,2248cyclictest2048117-21kworker/2:0+events20:24:042
202389599226111,2247cyclictest2037062-21kworker/1:2+events19:54:501
202389599225810,2245cyclictest2076104-21kworker/1:0+events21:55:001
202389199225811,2245cyclictest2083810-21kworker/0:2+events22:20:510
202389199224511,2231cyclictest2085446-21kworker/0:1+events22:19:440
202390199224212,2227cyclictest2080821-21kworker/3:1+events22:08:443
20239019922389,2225cyclictest2063196-21kworker/3:1+events21:11:113
20239019922339,2220cyclictest2109348-21kworker/3:2+events23:51:343
202389599223210,2218cyclictest2117559-21kworker/1:1+events00:16:391
202390199223111,2217cyclictest2093495-21kworker/3:2+events22:47:263
202390199223011,2216cyclictest2028741-21kworker/3:1+events19:30:353
202389199223010,2217cyclictest2046850-21kworker/0:0+events20:35:520
202390199222910,2215cyclictest2036825-21kworker/3:0+events19:51:273
202390199222810,2214cyclictest2101648-21kworker/3:0+events23:11:033
20238919922287,2218cyclictest2046850-21kworker/0:0+events20:30:340
202390199222711,2213cyclictest2061301-21kworker/3:0+events21:09:373
202390199222711,2212cyclictest2045191-21kworker/3:1+events20:14:553
202389199222710,2214cyclictest2108342-21kworker/0:0+events23:50:000
202390199222610,2214cyclictest2123889-21kworker/3:2+events00:20:063
202390199222610,2213cyclictest2120662-21kworker/3:1+events00:28:303
20239019922259,2212cyclictest2106495-21kworker/3:0+events23:26:033
202390199222510,2211cyclictest2099990-21kworker/3:2+events23:03:493
202390199222510,2211cyclictest2056334-21kworker/3:0+events20:49:403
20238919922256,2216cyclictest2068032-21kworker/0:2+events21:33:420
202389199222511,2211cyclictest2038370-21kworker/0:0+events20:02:260
202390199222311,2209cyclictest2025437-21kworker/3:2+events19:39:163
202390199222310,2210cyclictest2096998-21kworker/3:0+events22:57:213
202390199222211,2208cyclictest2063196-21kworker/3:1+events21:26:513
202390199222210,2208cyclictest2115986-21kworker/3:1+events23:56:083
202390199222110,2207cyclictest2120662-21kworker/3:1+events00:32:213
202390199222110,2207cyclictest2120662-21kworker/3:1+events00:32:213
202389199222010,2206cyclictest2093462-21kworker/0:2+events22:48:560
20238919922189,2206cyclictest2069632-21kworker/0:0+events21:36:430
202389199221811,2204cyclictest2043470-21kworker/0:2+events20:11:580
20238919922179,2205cyclictest2028654-21kworker/0:1+events19:23:210
202389199221610,2203cyclictest2030549-21kworker/0:0+events19:29:500
202390199221311,2199cyclictest2074353-21kworker/3:2+events21:45:283
202390199221210,2198cyclictest2058003-21kworker/3:2+events20:57:413
202390199220410,2191cyclictest2069577-21kworker/3:0+events21:35:583
202389799220410,2191cyclictest2111132-21kworker/2:1+events23:45:492
202389599220411,2189cyclictest2037062-21kworker/1:2+events20:05:491
202389599220311,2189cyclictest2055060-21kworker/1:2+events20:45:481
202389199220311,2189cyclictest2030549-21kworker/0:0+events19:42:410
202389199220210,2189cyclictest2043470-21kworker/0:2+events20:19:520
20238919922014,2194cyclictest2038370-21kworker/0:0+events20:06:120
202389199220011,2186cyclictest2129995-21kworker/0:2+events00:39:360
202389199220011,2186cyclictest2129995-21kworker/0:2+events00:39:360
202389199219911,2184cyclictest2054850-21kworker/0:2+events21:00:500
202389599219810,2184cyclictest2091900-21kworker/1:0+events22:42:251
202389199219710,2184cyclictest2028654-21kworker/0:1+events19:30:580
202389199219511,2181cyclictest2074442-21kworker/0:2+events21:51:360
20238919921948,2183cyclictest2054850-21kworker/0:2+events20:48:080
202389199219411,2180cyclictest2048725-21kworker/0:1+events20:29:230
202389599219111,2176cyclictest2082302-21kworker/1:0+events22:13:161
202389199218911,2175cyclictest2082209-21kworker/0:0+events22:11:460
20238919921878,2176cyclictest2115688-21kworker/0:1+events23:59:340
202389199218610,2172cyclictest2097998-21kworker/0:0+events23:14:510
202389199218510,2172cyclictest2089084-21kworker/0:1+events22:37:280
202389199218410,2170cyclictest2122083-21kworker/0:0+events00:29:380
202389199218310,2170cyclictest2104757-21kworker/0:1+events23:24:310
202389199218210,2169cyclictest2035432-21kworker/0:2+events19:52:560
202389799217910,2165cyclictest2035372-21kworker/2:1+events19:46:052
202389599217811,2163cyclictest2085724-21kworker/1:1+events22:22:001
202390199217510,2161cyclictest2086753-21kworker/3:1+events22:22:443
202390199216910,2155cyclictest2095130-21kworker/3:1+events23:24:533
202389599216810,2155cyclictest2083930-21kworker/1:2+events22:26:061
20238979921678,2156cyclictest2074231-21kworker/2:2+events21:50:292
202389799215211,2138cyclictest2084047-21kworker/2:0+events22:17:492
202389799215210,2139cyclictest2038634-21kworker/2:0+events20:06:362
202389599215111,2137cyclictest2046611-21kworker/1:0+events20:55:461
202389599215010,2137cyclictest2032123-21kworker/1:2+events19:41:551
202389599214612,2131cyclictest2068155-21kworker/1:2+events21:33:191
20239019921436,2134cyclictest2020342-21kworker/3:0+events19:16:313
202389799214311,2129cyclictest2069782-21kworker/2:0+events21:40:332
202389799214210,2129cyclictest2116284-21kworker/2:2+events00:06:212
202389599214211,2128cyclictest2088519-21kworker/1:0+events22:30:401
202389799214011,2126cyclictest2027614-21kworker/2:0+events19:27:552
202389799214011,2125cyclictest2048117-21kworker/2:0+events20:25:372
202389799214011,2125cyclictest2027614-21kworker/2:0+events19:44:582
202389799213911,2125cyclictest2084047-21kworker/2:0+events22:27:172
202389799213911,2125cyclictest2075889-21kworker/2:1+events22:01:532
20238959921399,2127cyclictest2093587-21kworker/1:2+events22:48:331
202389799213810,2125cyclictest2091718-21kworker/2:1+events22:38:352
202389799213711,2123cyclictest2116284-21kworker/2:2+events00:00:412
202389799213611,2122cyclictest2075889-21kworker/2:1+events21:59:392
202389799213610,2124cyclictest2122142-21kworker/2:0+events00:15:072
202389199213610,2123cyclictest2079392-21kworker/0:2+events22:04:340
20238979921326,2123cyclictest2041986-21kworker/2:2+events20:15:192
202389599213211,2118cyclictest2061120-21kworker/1:1+events21:45:531
202389799213110,2118cyclictest2056577-21kworker/2:1+events21:08:292
202389799213110,2118cyclictest2053317-21kworker/2:2+events20:41:362
202389799212911,2114cyclictest2027614-21kworker/2:0+events19:37:252
20238959921286,2119cyclictest2100019-21kworker/1:2+events23:27:351
202389599212812,2114cyclictest2096161-21kworker/1:0+events23:00:051
202389599212711,2113cyclictest2109471-21kworker/1:0+events23:37:311
202389599212711,2113cyclictest2101620-21kworker/1:0+events23:17:351
202389599212711,2112cyclictest2038664-21kworker/1:0+events19:57:051
202389799212511,2111cyclictest2128361-21kworker/2:2+events00:35:482
202389799212511,2111cyclictest2128361-21kworker/2:2+events00:35:472
202389799212511,2111cyclictest2048117-21kworker/2:0+events20:46:362
202389599212511,2111cyclictest2076104-21kworker/1:0+events21:59:151
202389799212411,2110cyclictest2111132-21kworker/2:1+events23:53:062
202389599212411,2110cyclictest2062987-21kworker/1:2+events21:10:241
202389599212310,2110cyclictest2101620-21kworker/1:0+events23:09:311
202389599212210,2109cyclictest2090300-21kworker/1:1+events22:38:571
202389799211910,2105cyclictest2038634-21kworker/2:0+events20:03:102
20238979921188,2107cyclictest2048117-21kworker/2:0+events20:51:102
202389599211811,2104cyclictest2080636-21kworker/1:2+events22:04:101
20238959921179,2105cyclictest2115955-21kworker/1:2+events23:59:561
202389599211711,2103cyclictest2106160-21kworker/1:1+events23:32:331
202389599211711,2103cyclictest2074502-21kworker/1:2+events21:44:441
202389599211711,2103cyclictest2030488-21kworker/1:1+events19:39:371
202389599211611,2102cyclictest2096161-21kworker/1:0+events22:55:041
202389599211611,2102cyclictest2068155-21kworker/1:2+events21:27:581
202389599211610,2103cyclictest2114231-21kworker/1:0+events23:54:351
202389599211511,2100cyclictest2037062-21kworker/1:2+events20:19:061
202389599211510,2103cyclictest2123814-21kworker/1:2+events00:25:061
202389599211110,2098cyclictest2013609-21kworker/1:2+events19:16:081
202389599210711,2093cyclictest2030488-21kworker/1:1+events19:49:311
20238979921069,2094cyclictest2068186-21kworker/2:2+events21:31:492
202389799210511,2091cyclictest2111132-21kworker/2:1+events23:59:122
202389799210511,2091cyclictest2062954-21kworker/2:2+events21:16:102
202389199210311,2088cyclictest2104757-21kworker/0:1+events23:28:420
202389799210011,2086cyclictest2058309-21kworker/2:2+events20:57:182
202389799210010,2087cyclictest2038634-21kworker/2:0+events19:57:272
202389599210010,2086cyclictest2101620-21kworker/1:0+events23:12:111
202389599209811,2084cyclictest2040540-21kworker/1:1+events20:00:541
20238959920896,2079cyclictest2122113-21kworker/1:0+events00:38:491
20238959920896,2079cyclictest2122113-21kworker/1:0+events00:38:481
202389599208811,2074cyclictest2090300-21kworker/1:1+events22:50:281
202389799208311,2069cyclictest2035372-21kworker/2:1+events19:50:412
20238979920797,2069cyclictest2025276-21kworker/2:2+events19:16:542
20239019920767,2066cyclictest2020342-21kworker/3:0+events19:12:403
20238919920709,2058cyclictest2038370-21kworker/0:0+events19:56:410
20238919920659,2053cyclictest2016950-21kworker/0:0+events19:18:240
20238919920629,2050cyclictest2087158-21kworker/0:0+events22:28:250
202389199206210,2049cyclictest2030549-21kworker/0:0+events19:38:300
20238959920515,2043cyclictest2046611-21kworker/1:0+events20:27:291
202389799204910,2036cyclictest2068186-21kworker/2:2+events21:29:292
202389599204711,2033cyclictest2027021-21kworker/1:0+events19:31:231
202389799203011,2015cyclictest2048117-21kworker/2:0+events20:38:112
20238959920065,1997cyclictest2046611-21kworker/1:0+events20:34:451
20238959920015,1993cyclictest2111103-21kworker/1:2+events23:42:471
202389799199010,1977cyclictest2094924-21kworker/2:2+events22:51:122
20238919919839,1971cyclictest2061359-21kworker/0:0+events21:09:140
20238979919746,1965cyclictest2027614-21kworker/2:0+events19:31:442
20238959919737,1963cyclictest2027021-21kworker/1:0+events19:26:281
20238979919728,1960cyclictest2018922-21kworker/2:0+events19:12:182
202389599195210,1939cyclictest2071333-21kworker/1:0+events21:35:361
20238919919458,1934cyclictest2022112-21kworker/0:2+events19:14:370
20238959918966,1887cyclictest2082302-21kworker/1:0+events22:15:541
20238959918956,1886cyclictest2023752-21kworker/1:3+events19:13:521
20238959918946,1885cyclictest2013609-21kworker/1:2+events19:20:421
20234332150102,42sleep10-21swapper/119:06:421
20234722146116,25sleep00-21swapper/019:07:130
20234852141112,24sleep30-21swapper/319:07:233
20233792141109,27sleep20-21swapper/219:06:022
2023901991311,1cyclictest2053976-21/usr/sbin/munin20:40:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional