You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 05:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Dec 06, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
226028499334915,3329cyclictest2326176-21kworker/1:0+events22:45:191
226028499282116,2800cyclictest2319343-21kworker/1:1+events22:15:141
226028199280014,2783cyclictest2287648-21kworker/0:2+events20:40:200
226028199280014,2783cyclictest2287648-21kworker/0:2+events20:40:190
226028499276713,2750cyclictest2313401-21kworker/1:1+events22:05:171
226028199274112,2725cyclictest2292143-21kworker/0:0+events21:05:150
226028499272912,2713cyclictest2345989-21kworker/1:0+events23:35:201
226029299265613,2640cyclictest2285862-21kworker/3:0+events20:30:243
226028199262513,2609cyclictest2276242-21kworker/0:2+events20:05:150
226029299254812,2533cyclictest2317994-21kworker/3:0+events22:10:163
226029299254412,2527cyclictest2294065-21kworker/3:0+events21:00:193
226028199253612,2521cyclictest2317961-21kworker/0:0+events22:16:430
226028499253010,2517cyclictest2298710-21kworker/1:0+events21:30:161
226028199251610,2503cyclictest2366430-21kworker/0:0+events00:36:390
226029299249913,2482cyclictest2361561-21kworker/3:2+events00:20:173
226029299248812,2473cyclictest2312993-21kworker/3:1+events21:55:313
226028199248712,2471cyclictest2276242-21kworker/0:2+events20:12:360
226029299248612,2471cyclictest2351201-21kworker/3:2+events00:09:343
226028199248610,2473cyclictest2292143-21kworker/0:0+events20:51:130
226028199248512,2469cyclictest2332881-21kworker/0:2+events22:53:120
226029299248111,2467cyclictest2341274-21kworker/3:2+events23:25:493
22602899924638,2451cyclictest2279469-21kworker/2:2+events20:45:112
226028199246312,2447cyclictest2352776-21kworker/0:1+events23:57:520
226028199246312,2447cyclictest2276242-21kworker/0:2+events20:00:160
226028499244612,2431cyclictest2273014-21kworker/1:1+events19:53:211
226028499244411,2430cyclictest2349187-21kworker/1:0+events23:47:081
226028499244312,2427cyclictest2336072-21kworker/1:2+events23:25:281
226028499244112,2426cyclictest2311563-21kworker/1:2+events22:34:151
226029299243510,2421cyclictest2352904-21kworker/3:0+events00:12:143
226028499242811,2414cyclictest2336072-21kworker/1:2+events23:20:301
226028199234010,2327cyclictest2322879-21kworker/0:1+events22:22:520
226028999233212,2316cyclictest2306707-21kworker/2:1+events21:35:132
226028999231912,2305cyclictest2349246-21kworker/2:0+events23:50:112
226029299231810,2305cyclictest2278047-21kworker/3:1+events20:20:303
226028999231712,2302cyclictest2284296-21kworker/2:0+events20:23:112
226028999231612,2300cyclictest2310022-21kworker/2:1+events21:58:102
226028999231412,2299cyclictest2336253-21kworker/2:1+events23:14:482
226028999231012,2296cyclictest2332820-21kworker/2:2+events23:05:012
226029299229411,2280cyclictest2281666-21kworker/3:0+events20:16:253
226029299228111,2267cyclictest2278047-21kworker/3:1+events20:07:583
226029299227410,2260cyclictest2290810-21kworker/3:1+events20:47:063
226029299227311,2259cyclictest2316391-21kworker/3:1+events22:26:173
226028999227211,2258cyclictest2308337-21kworker/2:0+events21:43:142
226028199227210,2259cyclictest2327731-21kworker/0:0+events22:49:470
226029299227111,2256cyclictest2364835-21kworker/3:0+events00:34:003
226029299227011,2256cyclictest2259915-21kworker/3:0+events19:18:443
226029299226811,2254cyclictest2324575-21kworker/3:2+events22:51:183
226029299226811,2254cyclictest2294065-21kworker/3:0+events21:45:293
226029299226810,2254cyclictest2344490-21kworker/3:1+events23:38:233
226029299226710,2254cyclictest2314686-21kworker/3:2+events22:03:473
226028199226712,2252cyclictest2300579-21kworker/0:2+events21:34:300
226029299226611,2252cyclictest2347711-21kworker/3:0+events23:41:043
226028999226612,2251cyclictest2289098-21kworker/2:0+events20:44:022
226028999226612,2251cyclictest2289098-21kworker/2:0+events20:44:022
226029299226311,2249cyclictest2294065-21kworker/3:0+events21:37:283
22602929922627,2252cyclictest2327601-21kworker/3:1+events22:41:293
226029299226210,2249cyclictest2341274-21kworker/3:2+events23:18:123
22602929922619,2249cyclictest2276275-21kworker/3:2+events19:59:523
226029299226110,2248cyclictest2294065-21kworker/3:0+events21:43:563
22602819922619,2249cyclictest2317961-21kworker/0:0+events22:09:280
226028199225910,2247cyclictest2311748-21kworker/0:0+events22:00:030
22602929922578,2245cyclictest2294065-21kworker/3:0+events21:54:223
226028199225611,2242cyclictest2272922-21kworker/0:0+events19:58:420
226029299225510,2242cyclictest2331139-21kworker/3:1+events22:56:393
226028199225311,2239cyclictest2311748-21kworker/0:0+events21:54:010
22602929922519,2239cyclictest2342905-21kworker/3:0+events23:23:323
22602849922519,2238cyclictest2309935-21kworker/1:0+events21:52:271
226028199224811,2234cyclictest2364773-21kworker/0:1+events00:31:460
226028499224611,2233cyclictest2326176-21kworker/1:0+events22:50:101
226028499224411,2230cyclictest2281130-21kworker/1:1+events20:13:431
226029299224211,2228cyclictest2314686-21kworker/3:2+events22:07:583
226028499224210,2229cyclictest2276353-21kworker/1:2+events20:04:521
226028499224010,2226cyclictest2326176-21kworker/1:0+events22:37:421
22602819922408,2229cyclictest2359820-21kworker/0:1+events00:15:160
226028199223710,2224cyclictest2344540-21kworker/0:2+events23:42:590
22602819922359,2222cyclictest2332881-21kworker/0:2+events22:57:010
226028199223410,2221cyclictest2344540-21kworker/0:2+events23:45:130
226028199223410,2221cyclictest2344540-21kworker/0:2+events23:36:050
226028499223210,2219cyclictest2277982-21kworker/1:0+events20:05:371
226028199223211,2217cyclictest2306856-21kworker/0:1+events22:12:340
226028199223210,2219cyclictest2336500-21kworker/0:2+events23:11:280
226029299223110,2218cyclictest2278047-21kworker/3:1+events20:29:373
226028199223110,2218cyclictest2364773-21kworker/0:1+events00:28:430
22602819922306,2221cyclictest2300579-21kworker/0:2+events21:36:450
226028199222910,2216cyclictest2265379-21kworker/0:2+events19:37:260
226028199222811,2214cyclictest2292143-21kworker/0:0+events21:14:020
226028199222810,2215cyclictest2263618-21kworker/0:1+events19:22:570
226029299222711,2213cyclictest2352904-21kworker/3:0+events23:56:433
226028499222710,2214cyclictest2293741-21kworker/1:0+events20:56:521
226028199222711,2213cyclictest2361747-21kworker/0:0+events00:22:100
226028199222711,2213cyclictest2263618-21kworker/0:1+events19:29:230
226028499222511,2211cyclictest2366398-21kworker/1:0+events00:33:381
226028499222510,2212cyclictest2361533-21kworker/1:0+events00:21:251
226028499222510,2212cyclictest2266697-21kworker/1:1+events19:33:361
22602819922247,2214cyclictest2341336-21kworker/0:1+events23:26:130
22602929922239,2211cyclictest2342905-21kworker/3:0+events23:31:563
226028499222311,2209cyclictest2356256-21kworker/1:0+events00:09:591
226028199222311,2209cyclictest2265379-21kworker/0:2+events19:42:460
226028499222211,2208cyclictest2336072-21kworker/1:2+events23:34:101
226028499222111,2206cyclictest2311563-21kworker/1:2+events22:20:561
226028999222011,2206cyclictest2269694-21kworker/2:2+events19:39:202
226028499222011,2205cyclictest2338056-21kworker/1:0+events23:14:041
226028199222011,2207cyclictest2272922-21kworker/0:0+events19:53:000
226029299221910,2206cyclictest2273046-21kworker/3:0+events19:51:543
226028499221911,2205cyclictest2351046-21kworker/1:2+events00:02:471
226028499221911,2205cyclictest2250228-21kworker/1:0+events19:18:221
226028499221910,2206cyclictest2311563-21kworker/1:2+events22:12:571
226028499221711,2203cyclictest2281130-21kworker/1:1+events20:22:481
226028499221510,2202cyclictest2311563-21kworker/1:2+events22:26:411
22602849922148,2203cyclictest2336072-21kworker/1:2+events23:09:331
226028499221411,2200cyclictest2334361-21kworker/1:0+events22:57:451
226028499221311,2199cyclictest2327805-21kworker/1:1+events22:42:161
22602929922119,2199cyclictest2324575-21kworker/3:2+events22:31:363
226028499220610,2193cyclictest2336072-21kworker/1:2+events23:41:261
226028499220610,2193cyclictest2282762-21kworker/1:0+events20:18:591
226028199220310,2190cyclictest2352776-21kworker/0:1+events23:54:480
226028999220212,2187cyclictest2351331-21kworker/2:2+events00:01:412
226028199220210,2189cyclictest2344540-21kworker/0:2+events23:32:160
22602849921989,2186cyclictest2306118-21kworker/1:1+events21:45:511
226028499219510,2182cyclictest2339680-21kworker/1:1+events23:18:351
226028499219410,2181cyclictest2298710-21kworker/1:0+events21:19:161
22602899921924,2185cyclictest2341185-21kworker/2:2+events23:16:392
226028499218912,2174cyclictest2336072-21kworker/1:2+events23:03:531
226028199218110,2168cyclictest2285954-21kworker/0:0+events20:33:510
226028499217310,2160cyclictest2352742-21kworker/1:1+events23:59:231
226028199216910,2155cyclictest2303927-21kworker/0:0+events21:29:530
22602819921687,2158cyclictest2278086-21kworker/0:1+events20:22:030
22602849921559,2143cyclictest2250228-21kworker/1:0+events19:27:531
226029299215411,2140cyclictest2263601-21kworker/3:2+events19:33:593
226029299215110,2137cyclictest2269663-21kworker/3:1+events19:43:333
226028499214511,2131cyclictest2306118-21kworker/1:1+events21:39:241
226028199214511,2131cyclictest2354407-21kworker/0:0+events00:10:210
226029299214411,2130cyclictest2303796-21kworker/3:2+events21:25:193
226028499214410,2130cyclictest2311563-21kworker/1:2+events22:04:101
226028199213310,2121cyclictest2310108-21kworker/0:2+events21:45:060
226029299213110,2118cyclictest2271293-21kworker/3:2+events19:49:393
22602929921299,2117cyclictest2337821-21kworker/3:0+events23:14:263
226028499212911,2115cyclictest2356378-21kworker/1:3+events00:28:191
22602819921216,2112cyclictest2289603-21kworker/0:1+events20:48:140
22602819921213,2115cyclictest2317961-21kworker/0:0+events22:33:050
226028999212011,2105cyclictest2286101-21kworker/2:1+events20:31:102
226028999212010,2107cyclictest2332820-21kworker/2:2+events22:52:512
226028999212010,2107cyclictest2324454-21kworker/2:1+events22:35:462
226029299211910,2106cyclictest2278047-21kworker/3:1+events20:36:513
226028999211910,2106cyclictest2322820-21kworker/2:0+events22:30:272
226029299211810,2105cyclictest2273046-21kworker/3:0+events20:03:443
226028999211711,2103cyclictest2310022-21kworker/2:1+events22:09:532
226028999211711,2103cyclictest2303650-21kworker/2:2+events21:24:552
22602929921168,2105cyclictest2294065-21kworker/3:0+events21:31:483
226028999211610,2104cyclictest2318056-21kworker/2:2+events22:25:082
22602929921148,2103cyclictest2290810-21kworker/3:1+events20:44:263
22602929921148,2103cyclictest2290810-21kworker/3:1+events20:44:263
226029299211410,2101cyclictest2302147-21kworker/3:1+events21:22:213
226029299211310,2100cyclictest2351201-21kworker/3:2+events23:49:253
226028199211310,2100cyclictest2292143-21kworker/0:0+events21:15:310
226029299211210,2100cyclictest2266843-21kworker/3:0+events19:35:313
226029299211210,2099cyclictest2331139-21kworker/3:1+events23:00:243
226029299211210,2099cyclictest2300489-21kworker/3:2+events21:14:243
226029299211210,2099cyclictest2278047-21kworker/3:1+events20:12:593
226029299211210,2099cyclictest2265215-21kworker/3:1+events19:28:393
226029299211110,2098cyclictest2292441-21kworker/3:2+events20:52:223
226029299210910,2096cyclictest2364835-21kworker/3:0+events00:29:063
22602899921079,2095cyclictest2310022-21kworker/2:1+events22:04:332
226028199210710,2094cyclictest2341336-21kworker/0:1+events23:23:120
226029299210610,2092cyclictest2351201-21kworker/3:2+events23:51:183
226028499210610,2092cyclictest2284412-21kworker/1:2+events20:39:101
22602819921067,2095cyclictest2311748-21kworker/0:0+events21:57:040
22602929921059,2093cyclictest2327601-21kworker/3:1+events22:39:123
22602929921059,2093cyclictest2322968-21kworker/3:0+events22:24:213
22602929921054,2098cyclictest2316391-21kworker/3:1+events22:15:573
226028999210510,2092cyclictest2272984-21kworker/2:2+events19:50:462
22602819921059,2093cyclictest2334572-21kworker/0:0+events23:03:300
226028199210410,2091cyclictest2302205-21kworker/0:1+events21:21:570
226029299210310,2091cyclictest2265215-21kworker/3:1+events19:24:303
226029299210310,2090cyclictest2351201-21kworker/3:2+events00:02:273
226028999210311,2089cyclictest2334602-21kworker/2:0+events23:01:332
226028499210310,2090cyclictest2250228-21kworker/1:0+events19:39:441
226029299210210,2089cyclictest2294065-21kworker/3:0+events21:18:553
226029299210210,2088cyclictest2337821-21kworker/3:0+events23:07:383
226029299210110,2088cyclictest2298470-21kworker/3:1+events21:06:233
22602849921015,2093cyclictest2297081-21kworker/1:1+events21:04:281
22602929921006,2090cyclictest2364835-21kworker/3:0+events00:39:443
226028999209810,2085cyclictest2289098-21kworker/2:0+events20:54:382
226028199209710,2084cyclictest2292143-21kworker/0:0+events20:56:310
22602819920959,2083cyclictest2265379-21kworker/0:2+events19:46:350
22602849920909,2078cyclictest2295399-21kworker/1:2+events21:08:411
22602849920909,2078cyclictest2287707-21kworker/1:1+events20:47:521
22602849920887,2078cyclictest2269994-21kworker/1:2+events19:47:451
226028999208710,2073cyclictest2266969-21kworker/2:1+events19:56:042
22602849920819,2068cyclictest2366398-21kworker/1:0+events00:36:161
22602849920807,2070cyclictest2302175-21kworker/1:1+events21:21:331
22602849920803,2073cyclictest2273014-21kworker/1:1+events19:59:281
226028499208010,2066cyclictest2269994-21kworker/1:2+events19:42:231
22602819920808,2069cyclictest2324544-21kworker/0:2+events22:29:420
22602849920799,2067cyclictest2303887-21kworker/1:2+events21:29:051
226029299207710,2064cyclictest2261599-21kworker/3:1+events19:14:333
22602849920769,2064cyclictest2289312-21kworker/1:0+events20:44:481
22602849920769,2064cyclictest2289312-21kworker/1:0+events20:44:471
22602929920756,2066cyclictest2329221-21kworker/3:0+events22:46:263
22602849920737,2063cyclictest2295399-21kworker/1:2+events21:10:361
22602849920728,2061cyclictest2359675-21kworker/1:1+events00:15:411
226028199207210,2059cyclictest2295369-21kworker/0:1+events21:01:040
226028199207110,2058cyclictest2326144-21kworker/0:1+events22:38:030
22602819920709,2058cyclictest2329400-21kworker/0:1+events23:09:100
22602819920697,2059cyclictest2306856-21kworker/0:1+events21:44:190
22602849920687,2058cyclictest2250228-21kworker/1:0+events19:22:111
226028999206710,2054cyclictest2338355-21kworker/2:0+events23:21:152
226028499206710,2054cyclictest2286012-21kworker/1:0+events20:28:521
22602899920649,2052cyclictest2327774-21kworker/2:0+events22:49:252
226028199206410,2051cyclictest2285954-21kworker/0:0+events20:38:470
226028499206210,2049cyclictest2313401-21kworker/1:1+events21:56:161
226028499206210,2049cyclictest2287707-21kworker/1:1+events20:52:421
22602849920607,2050cyclictest2356378-21kworker/1:3+events00:11:071
22602819920609,2048cyclictest2278086-21kworker/0:1+events20:16:480
22602819920608,2049cyclictest2344540-21kworker/0:2+events00:07:190
226028499205910,2046cyclictest2284412-21kworker/1:2+events20:31:331
22602849920498,2038cyclictest2250228-21kworker/1:0+events19:11:521
226028999204811,2034cyclictest2351331-21kworker/2:2+events23:57:302
226028999204810,2035cyclictest2366552-21kworker/2:0+events00:35:532
226028499204510,2031cyclictest2309935-21kworker/1:0+events21:43:351
226029299204410,2032cyclictest2290810-21kworker/3:1+events20:58:503
22602819920407,2030cyclictest2327731-21kworker/0:0+events22:44:550
226028999203510,2022cyclictest2281366-21kworker/2:1+events20:17:312
22602819920358,2024cyclictest2336500-21kworker/0:2+events23:15:310
22602929920339,2021cyclictest2361561-21kworker/3:2+events00:17:593
22602819920319,2020cyclictest2265379-21kworker/0:2+events19:30:340
22602899920305,2022cyclictest2360165-21kworker/2:1+events00:24:072
22602849920129,2000cyclictest2349187-21kworker/1:0+events23:51:421
22602899920114,2003cyclictest2299038-21kworker/2:1+events21:15:542
22602899920097,1999cyclictest2261422-21kworker/2:2+events19:17:352
22602819920054,1998cyclictest2255093-21kworker/0:2+events19:14:100
22602819919999,1987cyclictest2278086-21kworker/0:1+events20:27:220
226028999199110,1978cyclictest2261422-21kworker/2:2+events19:22:332
226028999198910,1976cyclictest2342813-21kworker/2:1+events23:32:392
226028999198411,1970cyclictest2310022-21kworker/2:1+events22:14:522
22602899919814,1974cyclictest2289098-21kworker/2:0+events21:03:202
22602899919747,1964cyclictest2349246-21kworker/2:0+events23:46:432
226028999196910,1956cyclictest2289098-21kworker/2:0+events20:38:002
22602899919627,1952cyclictest2351331-21kworker/2:2+events00:19:532
22602899919624,1955cyclictest2332820-21kworker/2:2+events22:59:182
22602899919619,1949cyclictest2360165-21kworker/2:1+events00:29:272
22602899919614,1954cyclictest2364955-21kworker/2:2+events00:32:072
22602899919607,1950cyclictest2306707-21kworker/2:1+events21:32:122
226028999195910,1946cyclictest2318056-21kworker/2:2+events22:15:362
226028999195910,1946cyclictest2289098-21kworker/2:0+events20:56:082
22602899919587,1948cyclictest2310022-21kworker/2:1+events21:53:142
22602899919587,1948cyclictest2284296-21kworker/2:0+events20:25:502
22602899919499,1937cyclictest2318056-21kworker/2:2+events22:21:412
22602899919489,1936cyclictest2324454-21kworker/2:1+events22:44:092
22602899919488,1937cyclictest2261422-21kworker/2:2+events19:27:302
226028999194810,1935cyclictest2272984-21kworker/2:2+events19:49:162
226028999194710,1934cyclictest2301907-21kworker/2:0+events21:27:122
22602899919468,1935cyclictest2271352-21kworker/2:0+events19:44:182
226028999194310,1930cyclictest2295641-21kworker/2:2+events21:11:232
226028999193210,1919cyclictest2248685-21kworker/2:1+events19:11:282
22602819919278,1916cyclictest2261392-21kworker/0:0+events19:19:070
22602899919207,1910cyclictest2263495-21kworker/2:0+events19:30:112
22602899918969,1884cyclictest2351331-21kworker/2:2+events00:07:412
22602899918953,1889cyclictest2266969-21kworker/2:1+events20:04:282
22602899918928,1881cyclictest2279469-21kworker/2:2+events20:14:302
22602899918767,1866cyclictest2342813-21kworker/2:1+events23:42:342
22602899918068,1795cyclictest2357964-21kworker/2:0+events00:11:532
22602899918057,1795cyclictest2276036-21kworker/2:0+events20:08:462
22597712152107,26sleep10-21swapper/119:06:261
22599782141109,27sleep30-21swapper/319:09:043
22599012140111,25sleep00-21swapper/019:08:050
22596872139110,24sleep20-21swapper/219:05:232
226028999166,6cyclictest2347881-21systemctl23:40:002
226028199166,7cyclictest2356340-21apt-get00:05:000
2260289991512,2cyclictest2298848-21dump-pmu-power21:10:002
226028999150,7cyclictest2343792-21meminfo23:25:192
2260289991410,2cyclictest2310455-21apt-get21:45:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional