You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 12:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sun Mar 22, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244839499311714,3099cyclictest2540980-21kworker/0:0+events00:16:550
244840499304315,3024cyclictest2469173-21kworker/3:1+events20:15:153
244840299286613,2849cyclictest2534840-21kworker/2:2+events23:40:012
244839499277013,2754cyclictest2470721-21kworker/0:1+events20:20:120
244840499270713,2692cyclictest2449672-21kworker/3:2+events19:35:173
244839499265013,2634cyclictest2453399-21kworker/0:1+events19:40:130
24484049926089,2595cyclictest2517696-21kworker/3:0+events22:50:183
244839499255312,2539cyclictest2508328-21kworker/0:2+events22:21:010
244839499254311,2528cyclictest2451778-21kworker/0:0+events19:34:320
244839499251110,2497cyclictest2479252-21kworker/0:1+events20:52:330
244840299250012,2485cyclictest2453342-21kworker/2:0+events19:25:502
24483979924986,2488cyclictest2456370-21kworker/1:0+events19:46:251
244839799249612,2481cyclictest2461230-21kworker/1:1+events19:54:461
244839799249512,2480cyclictest2454678-21kworker/1:2+events19:27:441
244840299249412,2478cyclictest2477058-21kworker/2:2+events21:00:252
244839499249312,2478cyclictest2496581-21kworker/0:1+events21:51:020
244839499249211,2478cyclictest2491866-21kworker/0:2+events21:32:250
244839499249112,2476cyclictest2479252-21kworker/0:1+events21:07:400
244839499248712,2471cyclictest2511616-21kworker/0:1+events22:29:420
244839499248612,2471cyclictest2467337-21kworker/0:1+events20:10:410
244839499248612,2470cyclictest2496581-21kworker/0:1+events21:38:080
244839499248512,2469cyclictest2524638-21kworker/0:2+events23:05:340
244839499248510,2473cyclictest2451778-21kworker/0:0+events19:25:040
244839499248510,2472cyclictest2505014-21kworker/0:0+events22:14:550
244839499248312,2469cyclictest2483634-21kworker/0:2+events21:00:020
244839499248312,2467cyclictest2513248-21kworker/0:0+events22:38:520
244839499248211,2468cyclictest2524638-21kworker/0:2+events23:25:520
244839499247510,2461cyclictest2542568-21kworker/0:1+events23:58:540
244839799247412,2459cyclictest2477207-21kworker/1:0+events20:43:461
24483949924749,2462cyclictest2477383-21kworker/0:2+events20:40:420
244839499246011,2445cyclictest2479252-21kworker/0:1+events20:45:420
244839499245912,2443cyclictest2524638-21kworker/0:2+events23:17:000
244839499245910,2446cyclictest2532880-21kworker/0:1+events23:41:320
244839499245712,2443cyclictest2470721-21kworker/0:1+events20:25:100
244839499245512,2440cyclictest2521087-21kworker/0:1+events22:55:420
244839499245312,2438cyclictest2496581-21kworker/0:1+events21:47:580
244839499245110,2437cyclictest2462748-21kworker/0:2+events19:58:360
244839499245110,2437cyclictest2462748-21kworker/0:2+events19:58:360
244840499244812,2432cyclictest2532787-21kworker/3:2+events23:38:083
244840499244712,2432cyclictest2456216-21kworker/3:0+events19:45:153
244839499244712,2431cyclictest2479252-21kworker/0:1+events20:58:550
244840499242712,2411cyclictest2488139-21kworker/3:1+events21:33:543
244839499241312,2397cyclictest2540980-21kworker/0:0+events00:15:010
244840299241112,2397cyclictest2517967-21kworker/2:1+events22:57:152
244839799241012,2395cyclictest2509750-21kworker/1:1+events22:17:101
244839799239711,2378cyclictest2496911-21kworker/1:2+events21:43:031
244839799239510,2381cyclictest2498772-21kworker/1:1+events22:01:351
244840499238912,2373cyclictest2511467-21kworker/3:0+events22:25:553
244839799238911,2374cyclictest2513131-21kworker/1:1+events22:34:161
244840299238112,2365cyclictest2524487-21kworker/2:0+events23:24:422
244839499237510,2362cyclictest2514906-21kworker/0:2+events22:46:510
244839499236810,2354cyclictest2505014-21kworker/0:0+events22:18:190
244840499236012,2344cyclictest2514739-21kworker/3:2+events22:36:333
244840499235912,2345cyclictest2500141-21kworker/3:2+events22:00:023
244840299235711,2344cyclictest2477058-21kworker/2:2+events20:46:302
244839499235610,2343cyclictest2489951-21kworker/0:1+events21:25:340
244840299235512,2339cyclictest2485198-21kworker/2:0+events21:10:232
24484049923519,2338cyclictest2481916-21kworker/3:0+events20:54:243
244840299235112,2336cyclictest2488375-21kworker/2:2+events21:20:152
244840299235011,2336cyclictest2511496-21kworker/2:2+events22:48:012
24484049923499,2337cyclictest2546181-21kworker/3:0+events00:36:503
244840299234811,2334cyclictest2446801-21kworker/2:3+events19:18:352
244840299234810,2334cyclictest2501321-21kworker/2:1+events21:57:242
244840299234810,2334cyclictest2494954-21kworker/2:2+events21:37:232
244840299234810,2334cyclictest2470533-21kworker/2:2+events20:23:412
244839499234810,2335cyclictest2517725-21kworker/0:1+events22:43:260
244840499234711,2332cyclictest2498474-21kworker/3:0+events21:49:083
244840499234312,2329cyclictest2539609-21kworker/3:1+events00:05:023
244839499234211,2327cyclictest2554181-21kworker/0:2+events00:37:150
24484049923417,2330cyclictest2536343-21kworker/3:1+events23:41:573
244840299234112,2326cyclictest2524487-21kworker/2:0+events23:31:142
244840499234012,2324cyclictest2481916-21kworker/3:0+events21:01:333
244839799234011,2326cyclictest2493381-21kworker/1:1+events21:29:201
244839499234011,2325cyclictest2547728-21kworker/0:1+events00:23:030
244840499233812,2323cyclictest2457803-21kworker/3:1+events19:50:343
244840499233712,2321cyclictest2519324-21kworker/3:1+events22:47:143
244840299233711,2323cyclictest2545937-21kworker/2:0+events00:17:192
244840299233711,2323cyclictest2477058-21kworker/2:2+events20:52:562
244840499233611,2322cyclictest2537977-21kworker/3:0+events23:56:413
244839799233612,2322cyclictest2521173-21kworker/1:2+events22:56:061
244840499233312,2317cyclictest2532787-21kworker/3:2+events23:29:193
244840499233212,2316cyclictest2470779-21kworker/3:0+events20:34:413
244839799233212,2317cyclictest2553973-21kworker/1:1+events00:33:251
244840499233112,2315cyclictest2488139-21kworker/3:1+events21:37:463
244840499233012,2315cyclictest2470779-21kworker/3:0+events20:43:003
244840499233012,2314cyclictest2526375-21kworker/3:2+events23:12:243
244840499233011,2316cyclictest2503151-21kworker/3:0+events21:58:323
244840299233012,2316cyclictest2524487-21kworker/2:0+events23:07:502
244840299233012,2315cyclictest2520904-21kworker/2:0+events22:53:012
244840299233011,2315cyclictest2464474-21kworker/2:1+events20:04:202
244840499232912,2314cyclictest2539609-21kworker/3:1+events00:02:443
244840499232912,2314cyclictest2467544-21kworker/3:2+events20:12:133
244840499232912,2313cyclictest2514739-21kworker/3:2+events22:40:463
244840299232912,2314cyclictest2501321-21kworker/2:1+events21:53:172
244840499232812,2312cyclictest2503151-21kworker/3:0+events22:08:513
244840499232711,2313cyclictest2496853-21kworker/3:2+events21:40:233
244840499232711,2313cyclictest2485313-21kworker/3:2+events21:06:533
244840299232712,2313cyclictest2490143-21kworker/2:1+events21:27:262
244840299232612,2310cyclictest2511496-21kworker/2:2+events22:33:552
244840499232512,2309cyclictest2534749-21kworker/3:0+events23:33:543
244840499232511,2311cyclictest2493318-21kworker/3:2+events21:29:433
244839799232512,2311cyclictest2466063-21kworker/1:2+events20:05:051
244840499232412,2309cyclictest2552332-21kworker/3:2+events00:33:023
244840299232412,2310cyclictest2505046-21kworker/2:0+events22:05:042
24483979923248,2313cyclictest2553973-21kworker/1:1+events00:35:211
244839799232412,2309cyclictest2517934-21kworker/1:1+events22:50:431
244839799232411,2310cyclictest2509750-21kworker/1:1+events22:20:141
244840499232311,2309cyclictest2524518-21kworker/3:0+events23:06:403
24484029923227,2312cyclictest2536472-21kworker/2:0+events23:47:582
244840299232211,2308cyclictest2541088-21kworker/2:2+events23:54:232
244839499232112,2305cyclictest2483634-21kworker/0:2+events21:13:020
24483979923209,2308cyclictest2519542-21kworker/1:0+events22:49:561
244840299231912,2304cyclictest2470533-21kworker/2:2+events20:25:342
244839799231812,2303cyclictest2503361-21kworker/1:0+events22:10:421
244839799231812,2302cyclictest2462864-21kworker/1:0+events19:55:541
244839799231812,2302cyclictest2462864-21kworker/1:0+events19:55:541
244839499231812,2303cyclictest2540980-21kworker/0:0+events00:04:380
24484029923147,2304cyclictest2522803-21kworker/2:2+events23:03:182
24483979923149,2302cyclictest2547636-21kworker/1:2+events00:13:071
244839799231212,2297cyclictest2486742-21kworker/1:1+events21:14:331
244839799231112,2297cyclictest2466063-21kworker/1:2+events20:17:551
244839799231110,2298cyclictest2482197-21kworker/1:0+events21:02:421
244840499230811,2294cyclictest2488139-21kworker/3:1+events21:13:253
244839799230613,2291cyclictest2488436-21kworker/1:0+events21:21:441
244839799230512,2290cyclictest2536267-21kworker/1:2+events23:45:201
244839799230512,2290cyclictest2496911-21kworker/1:2+events21:47:121
244839799230511,2291cyclictest2493381-21kworker/1:1+events21:34:171
244840299230412,2288cyclictest2552546-21kworker/2:2+events00:30:422
244839799229812,2283cyclictest2466063-21kworker/1:2+events20:28:591
244840499229411,2279cyclictest2509838-21kworker/3:1+events22:19:523
244840299228511,2270cyclictest2526462-21kworker/2:1+events23:12:002
244839799228011,2266cyclictest2447955-21kworker/1:1+events19:39:281
244839499227812,2263cyclictest2498236-21kworker/0:0+events21:56:420
244839799227710,2264cyclictest2478890-21kworker/1:2+events20:50:401
24484029922740,2271cyclictest2536472-21kworker/2:0+events23:55:092
244839799227410,2260cyclictest2480503-21kworker/1:1+events20:55:331
244840499227212,2256cyclictest2470779-21kworker/3:0+events20:24:023
244839499227010,2257cyclictest2547728-21kworker/0:1+events00:25:180
244840299226812,2253cyclictest2459657-21kworker/2:2+events19:51:432
244839499226611,2252cyclictest2524638-21kworker/0:2+events23:10:510
244839499226510,2251cyclictest2532880-21kworker/0:1+events23:32:010
24483949922638,2251cyclictest2451778-21kworker/0:0+events19:22:000
244839499226311,2250cyclictest2529634-21kworker/0:1+events23:20:070
24483949922629,2249cyclictest2511616-21kworker/0:1+events22:32:480
24483949922626,2252cyclictest2453399-21kworker/0:1+events19:46:480
244839499226211,2248cyclictest2464351-21kworker/0:0+events20:00:540
244839499226211,2248cyclictest2462748-21kworker/0:2+events19:54:030
24483949922619,2249cyclictest2503327-21kworker/0:2+events22:02:430
244839499226011,2245cyclictest2532880-21kworker/0:1+events23:46:490
24483949922579,2244cyclictest2449702-21kworker/0:1+events19:17:490
24483949922569,2244cyclictest2486951-21kworker/0:0+events21:18:430
244839499225610,2243cyclictest2489951-21kworker/0:1+events21:22:290
244839799224811,2234cyclictest2475572-21kworker/1:1+events20:32:461
244839499224710,2234cyclictest2475484-21kworker/0:0+events20:39:570
244839499223410,2220cyclictest2496581-21kworker/0:1+events22:06:120
244839499223110,2219cyclictest2534902-21kworker/0:2+events23:35:050
244839499222911,2215cyclictest2467337-21kworker/0:1+events20:08:020
244840499222812,2212cyclictest2488139-21kworker/3:1+events21:51:463
24483949922287,2218cyclictest2475484-21kworker/0:0+events20:33:100
24483949922268,2215cyclictest2540980-21kworker/0:0+events00:06:110
244839499222610,2212cyclictest2469053-21kworker/0:0+events20:19:050
244839499222510,2212cyclictest2539396-21kworker/0:2+events23:51:450
244839499222310,2209cyclictest2521087-21kworker/0:1+events22:54:330
244839499222211,2208cyclictest2453399-21kworker/0:1+events19:36:030
24483979922209,2208cyclictest2517934-21kworker/1:1+events22:44:361
244840299221711,2203cyclictest2485198-21kworker/2:0+events21:17:572
244840499220811,2194cyclictest2513100-21kworker/3:1+events22:31:143
244840299219911,2186cyclictest2473976-21kworker/2:0+events20:35:022
244840499218812,2173cyclictest2508238-21kworker/3:2+events22:12:143
244840499218811,2174cyclictest2528011-21kworker/3:1+events23:17:473
244840499218310,2169cyclictest2546181-21kworker/3:0+events00:20:233
244839799218211,2167cyclictest2545997-21kworker/1:0+events00:08:281
244840299218111,2167cyclictest2511496-21kworker/2:2+events22:44:132
244839799217510,2162cyclictest2552299-21kworker/1:2+events00:27:131
24483979921739,2161cyclictest2486742-21kworker/1:1+events21:16:261
244839799217110,2157cyclictest2547636-21kworker/1:2+events00:15:251
244839799216610,2153cyclictest2498772-21kworker/1:1+events21:52:311
244840299216212,2148cyclictest2459657-21kworker/2:2+events19:55:072
244840299216212,2148cyclictest2459657-21kworker/2:2+events19:55:072
244840499215811,2143cyclictest2456216-21kworker/3:0+events19:58:123
244840499215811,2143cyclictest2456216-21kworker/3:0+events19:58:113
244839799215810,2144cyclictest2536267-21kworker/1:2+events23:59:181
244840499214911,2135cyclictest2529954-21kworker/3:0+events23:22:003
244840499214211,2127cyclictest2489829-21kworker/3:0+events21:21:213
244840299214110,2128cyclictest2498502-21kworker/2:2+events21:48:452
24484029921392,2134cyclictest2509810-21kworker/2:0+events22:17:572
244840499213811,2124cyclictest2449672-21kworker/3:2+events19:33:003
244840499213811,2124cyclictest2449672-21kworker/3:2+events19:28:293
244840299213711,2124cyclictest2545937-21kworker/2:0+events00:10:012
244840499213611,2122cyclictest2520966-21kworker/3:2+events23:02:323
244840499213611,2122cyclictest2511467-21kworker/3:0+events22:23:153
244840499213311,2119cyclictest2474048-21kworker/3:2+events20:35:253
244840499213311,2118cyclictest2488139-21kworker/3:1+events21:17:113
244839799213211,2118cyclictest2534629-21kworker/1:0+events23:39:151
244840299213111,2117cyclictest2501321-21kworker/2:1+events22:01:112
244840299213111,2117cyclictest2458031-21kworker/2:0+events19:44:042
244840499213011,2116cyclictest2532787-21kworker/3:2+events23:48:203
244840499213010,2117cyclictest2546181-21kworker/3:0+events00:28:473
244840499213010,2117cyclictest2483545-21kworker/3:1+events20:58:333
244840299213011,2116cyclictest2485198-21kworker/2:0+events21:08:262
24484029921299,2117cyclictest2446801-21kworker/2:3+events19:22:232
24484029921298,2118cyclictest2506954-21kworker/2:2+events22:11:062
244840299212911,2115cyclictest2511496-21kworker/2:2+events22:40:002
244840299212911,2115cyclictest2458031-21kworker/2:0+events20:11:012
244840299212911,2114cyclictest2541088-21kworker/2:2+events00:05:472
244840499212711,2113cyclictest2546181-21kworker/3:0+events00:18:293
244840499212711,2113cyclictest2480319-21kworker/3:2+events20:48:483
244840499212711,2113cyclictest2469173-21kworker/3:1+events20:26:433
244839799212710,2114cyclictest2513131-21kworker/1:1+events22:36:571
244840499212611,2112cyclictest2456216-21kworker/3:0+events19:43:413
24484029921266,2117cyclictest2549213-21kworker/2:1+events00:38:462
244840299212611,2112cyclictest2455030-21kworker/2:1+events19:31:522
244840499212511,2111cyclictest2464320-21kworker/3:1+events20:02:033
244840299212511,2111cyclictest2458031-21kworker/2:0+events20:07:392
244839799211811,2103cyclictest2536267-21kworker/1:2+events23:53:381
244839799211810,2105cyclictest2495014-21kworker/1:0+events21:36:361
244840299211710,2104cyclictest2478800-21kworker/2:0+events20:44:332
244839799211710,2103cyclictest2447955-21kworker/1:1+events19:32:381
244840299211611,2102cyclictest2483590-21kworker/2:1+events20:59:162
244840299211610,2103cyclictest2458031-21kworker/2:0+events20:16:462
244839799211611,2101cyclictest2498772-21kworker/1:1+events21:58:101
24484029921158,2104cyclictest2472165-21kworker/2:1+events20:34:172
244839799211511,2101cyclictest2461230-21kworker/1:1+events20:11:261
24484029921149,2102cyclictest2531299-21kworker/2:2+events23:25:292
244839799211411,2100cyclictest2511528-21kworker/1:0+events22:25:321
24483949921138,2102cyclictest2496581-21kworker/0:1+events21:41:320
24484029921128,2101cyclictest2501321-21kworker/2:1+events22:27:032
244839799210911,2095cyclictest2519542-21kworker/1:0+events23:14:201
244839799210910,2096cyclictest2456370-21kworker/1:0+events19:41:461
24483979921088,2097cyclictest2470630-21kworker/1:0+events20:22:311
244839799210711,2093cyclictest2503361-21kworker/1:0+events22:06:341
244839799210711,2092cyclictest2536267-21kworker/1:2+events23:41:091
244839799210610,2092cyclictest2475572-21kworker/1:1+events20:37:411
24483979921058,2094cyclictest2534629-21kworker/1:0+events23:34:431
244839799210511,2091cyclictest2453071-21kworker/1:0+events19:22:461
244839799210511,2090cyclictest2530786-21kworker/1:1+events23:21:361
244839799210411,2090cyclictest2482197-21kworker/1:0+events21:07:171
244839799210410,2091cyclictest2530786-21kworker/1:1+events23:26:151
244839799210311,2089cyclictest2549426-21kworker/1:0+events00:21:061
24483979921027,2092cyclictest2527981-21kworker/1:2+events23:16:371
244839799210211,2088cyclictest2519542-21kworker/1:0+events23:08:341
244839799210211,2088cyclictest2477207-21kworker/1:0+events20:46:071
24483949921018,2090cyclictest2521087-21kworker/0:1+events23:02:540
24483979920989,2086cyclictest2461230-21kworker/1:1+events20:02:241
244839799209510,2082cyclictest2446351-21kworker/1:2+events19:17:261
244840499209211,2078cyclictest2449672-21kworker/3:2+events19:16:403
24483949920788,2067cyclictest2446318-21kworker/0:2+events19:13:370
24484029920759,2062cyclictest2458031-21kworker/2:0+events19:47:552
24484029920689,2056cyclictest2496884-21kworker/2:1+events21:43:512
244840299206311,2048cyclictest2455030-21kworker/2:1+events19:38:432
244840299203710,2024cyclictest2501321-21kworker/2:1+events22:22:302
244839799203711,2023cyclictest2542747-21kworker/1:1+events00:00:491
244840299203210,2019cyclictest2543958-21kworker/2:1+events00:01:362
24483949920155,2007cyclictest2551126-21kworker/0:0+events00:34:570
24484049920124,2005cyclictest2520966-21kworker/3:2+events22:57:373
244840299201010,1996cyclictest2552546-21kworker/2:2+events00:29:552
24484029919903,1983cyclictest2490143-21kworker/2:1+events21:32:022
24484049919844,1977cyclictest2539609-21kworker/3:1+events23:50:583
24484049919828,1971cyclictest2456216-21kworker/3:0+events20:08:493
24484049919748,1962cyclictest2546181-21kworker/3:0+events00:11:563
24484029919749,1962cyclictest2446801-21kworker/2:3+events19:11:212
24484049919718,1961cyclictest2449672-21kworker/3:2+events19:14:003
24484049919668,1954cyclictest2443504-21kworker/3:0+events19:21:153
24484029919646,1955cyclictest2536472-21kworker/2:0+events23:40:452
24483979919539,1940cyclictest2446351-21kworker/1:2+events19:14:241
244839799195310,1939cyclictest2519542-21kworker/1:0+events23:02:091
24484029919068,1895cyclictest2526462-21kworker/2:1+events23:17:252
24481372170141,24sleep00-21swapper/019:09:410
24478592162114,25sleep10-21swapper/119:06:101
24480722141112,25sleep20-21swapper/219:08:512
24479682141104,32sleep30-21swapper/319:07:313
244840299231,7cyclictest2551065-21munin-plugin-st00:25:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional