You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 20:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Mon Apr 13, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26947999342214,3403cyclictest341121-21kworker/1:2+events22:55:121
26947599293814,2920cyclictest347176-21kworker/0:0+events23:15:200
2694799928556,2844cyclictest308597-21kworker/1:2+events21:15:171
26947999282413,2807cyclictest320122-21kworker/1:0+events22:15:121
26948299280313,2786cyclictest316826-21kworker/2:1+events21:37:432
26947999275014,2729cyclictest364847-21kworker/1:1+events00:05:011
26947999274913,2734cyclictest350198-21kworker/1:1+events23:20:171
26947999274913,2734cyclictest350198-21kworker/1:1+events23:20:171
26948599270313,2686cyclictest334630-21kworker/3:1+events22:32:183
26947599268913,2673cyclictest334567-21kworker/0:1+events22:30:010
26947599266613,2648cyclictest340832-21kworker/0:1+events22:50:140
26948599264813,2631cyclictest339345-21kworker/3:1+events22:45:183
26948599262913,2612cyclictest320153-21kworker/3:2+events22:00:173
26948299262110,2607cyclictest316826-21kworker/2:1+events21:49:342
26948599259712,2582cyclictest320153-21kworker/3:2+events21:50:203
26948299259512,2579cyclictest276186-21kworker/2:1+events19:45:182
26948599257412,2559cyclictest337573-21kworker/3:2+events22:41:053
26948599257312,2558cyclictest359942-21kworker/3:0+events23:51:023
26947999256513,2549cyclictest291247-21kworker/1:0+events20:19:161
26947599256412,2549cyclictest363093-21kworker/0:0+events00:34:470
26947599255412,2539cyclictest364879-21kworker/0:1+events00:04:400
26947599255312,2537cyclictest281140-21kworker/0:0+events19:51:040
26947599255112,2536cyclictest311798-21kworker/0:2+events21:22:080
26947599254812,2533cyclictest353954-21kworker/0:1+events23:34:190
26947599254412,2528cyclictest296173-21kworker/0:2+events20:40:200
26947599252312,2508cyclictest350427-21kworker/0:2+events23:24:240
26947599252312,2508cyclictest350427-21kworker/0:2+events23:24:240
26948299251511,2499cyclictest276186-21kworker/2:1+events19:50:162
26947599251010,2496cyclictest328411-21kworker/0:1+events22:19:000
26947599250311,2490cyclictest282746-21kworker/0:1+events20:00:160
26947599250112,2485cyclictest274374-21kworker/0:2+events19:26:550
26948599249812,2483cyclictest322290-21kworker/3:0+events21:57:373
26947599249812,2482cyclictest369775-21kworker/0:1+events00:24:090
26948599249712,2481cyclictest332967-21kworker/3:0+events22:53:163
26947599249712,2482cyclictest317810-21kworker/0:1+events21:49:570
26948299249612,2481cyclictest315198-21kworker/2:2+events21:42:182
26947599249612,2480cyclictest310097-21kworker/0:1+events21:27:290
26947599249512,2479cyclictest331163-21kworker/0:0+events22:34:380
26948299249412,2479cyclictest328038-21kworker/2:1+events22:14:022
26948299249412,2478cyclictest323655-21kworker/2:0+events22:05:592
26948599249312,2478cyclictest345454-21kworker/3:2+events23:14:123
26948299249312,2477cyclictest329677-21kworker/2:2+events22:20:292
26948599249212,2477cyclictest363177-21kworker/3:2+events00:00:313
26948599249212,2477cyclictest359942-21kworker/3:0+events23:59:243
26948599249212,2476cyclictest342711-21kworker/3:1+events23:04:433
26948299249212,2477cyclictest315198-21kworker/2:2+events21:30:282
26948299249212,2477cyclictest315198-21kworker/2:2+events21:30:282
26948299249212,2476cyclictest360240-21kworker/2:1+events23:54:072
26947599249212,2476cyclictest360537-21kworker/0:2+events00:08:290
26947599249211,2477cyclictest302315-21kworker/0:2+events21:09:570
26948599249012,2475cyclictest308674-21kworker/3:0+events21:16:513
26947599249012,2475cyclictest363093-21kworker/0:0+events00:37:460
26947599248912,2474cyclictest343945-21kworker/0:2+events22:59:000
26947599248912,2473cyclictest336753-21kworker/0:2+events22:46:040
26947599248911,2475cyclictest347176-21kworker/0:0+events23:09:170
26948599248812,2473cyclictest292440-21kworker/3:2+events20:28:063
26948299248811,2474cyclictest305511-21kworker/2:0+events21:13:462
26947599248712,2471cyclictest303951-21kworker/0:1+events20:55:340
26947599248512,2470cyclictest363093-21kworker/0:0+events00:11:080
26947599248312,2467cyclictest343945-21kworker/0:2+events23:02:050
26947599248311,2468cyclictest360537-21kworker/0:2+events23:52:360
26947999248210,2468cyclictest357080-21kworker/1:0+events23:43:271
26948299248112,2466cyclictest340772-21kworker/2:2+events22:50:362
26947999247912,2463cyclictest278434-21kworker/1:0+events19:59:541
26947999247812,2462cyclictest334599-21kworker/1:2+events22:39:121
26947599247810,2464cyclictest363093-21kworker/0:0+events00:16:310
26947599247712,2461cyclictest302315-21kworker/0:2+events20:49:250
26947999247612,2460cyclictest302191-21kworker/1:1+events20:49:481
26947999247512,2460cyclictest289383-21kworker/1:2+events20:24:171
26948599247412,2458cyclictest278167-21kworker/3:1+events19:48:493
26948599247410,2461cyclictest295979-21kworker/3:0+events20:45:583
26947999247312,2457cyclictest307011-21kworker/1:0+events21:06:081
2694859924699,2457cyclictest369931-21kworker/3:2+events00:26:513
26947599246812,2452cyclictest281140-21kworker/0:0+events19:44:330
26947999246512,2450cyclictest331318-21kworker/1:1+events22:30:451
26947999246312,2447cyclictest320122-21kworker/1:0+events22:04:501
26947599246312,2447cyclictest317810-21kworker/0:1+events21:36:360
26947999245711,2442cyclictest357080-21kworker/1:0+events00:19:361
26947599245411,2440cyclictest307517-21kworker/0:0+events21:11:040
26947599245112,2436cyclictest363093-21kworker/0:0+events00:25:410
26948599245012,2435cyclictest282712-21kworker/3:2+events19:53:223
26948599244812,2432cyclictest374825-21kworker/3:1+events00:38:083
26948599244310,2430cyclictest368317-21kworker/3:1+events00:13:273
26948599243812,2421cyclictest303768-21kworker/3:2+events21:10:203
26947999243013,2413cyclictest357080-21kworker/1:0+events00:22:401
26947999242610,2412cyclictest371347-21kworker/1:1+events00:32:311
26948299242212,2406cyclictest345609-21kworker/2:2+events23:19:322
26948299242112,2405cyclictest348658-21kworker/2:1+events23:14:562
26947999241512,2400cyclictest350198-21kworker/1:1+events23:33:571
26947599241511,2401cyclictest356779-21kworker/0:0+events23:49:060
26947999241111,2397cyclictest308597-21kworker/1:2+events21:24:251
26947999241012,2395cyclictest318499-21kworker/1:2+events21:48:031
26948299240911,2394cyclictest354826-21kworker/2:2+events23:55:172
26947999240812,2392cyclictest366950-21kworker/1:3+events00:11:311
26947999240411,2391cyclictest305392-21kworker/1:2+events21:00:061
26948599240212,2386cyclictest355533-21kworker/3:2+events23:41:573
2694799923989,2385cyclictest357080-21kworker/1:0+events00:26:041
26947999239711,2382cyclictest344158-21kworker/1:0+events23:00:331
26947999239212,2377cyclictest297971-21kworker/1:0+events20:53:391
26948299239110,2377cyclictest350473-21kworker/2:0+events23:43:062
26947999239112,2376cyclictest320122-21kworker/1:0+events22:11:011
26947999239111,2376cyclictest310191-21kworker/1:0+events21:27:531
26947999239012,2375cyclictest331318-21kworker/1:1+events22:21:371
26947999239012,2375cyclictest305392-21kworker/1:2+events20:57:251
26947999239012,2375cyclictest284487-21kworker/1:2+events19:52:141
2694799923899,2378cyclictest357080-21kworker/1:0+events23:51:261
26947999238911,2375cyclictest270654-21kworker/1:2+events19:41:301
2694829923884,2381cyclictest303709-21kworker/2:2+events20:53:162
26947999238812,2373cyclictest278434-21kworker/1:0+events20:05:141
26947999238811,2375cyclictest345872-21kworker/1:2+events23:10:471
26947999238712,2372cyclictest358966-21kworker/1:2+events23:47:381
26947999238710,2373cyclictest294479-21kworker/1:1+events20:33:041
26947999238612,2370cyclictest363206-21kworker/1:2+events23:59:461
26947999238611,2371cyclictest336209-21kworker/1:0+events22:49:051
26948299238511,2371cyclictest366805-21kworker/2:2+events00:37:222
26947999238512,2370cyclictest355443-21kworker/1:2+events23:37:221
26947999238512,2370cyclictest345872-21kworker/1:2+events23:17:391
26947599238510,2373cyclictest292699-21kworker/0:2+events20:20:030
26947999238412,2368cyclictest287780-21kworker/1:1+events20:04:291
26947999238211,2368cyclictest350198-21kworker/1:1+events23:28:121
26947999237812,2363cyclictest270654-21kworker/1:2+events19:19:581
2694799923758,2363cyclictest315261-21kworker/1:1+events21:32:261
2694799923758,2363cyclictest315261-21kworker/1:1+events21:32:261
2694759923759,2363cyclictest352059-21kworker/0:0+events23:27:490
26947999236912,2354cyclictest294479-21kworker/1:1+events20:39:561
26948599236811,2353cyclictest295979-21kworker/3:0+events20:31:113
26948599236511,2351cyclictest326464-21kworker/3:1+events22:12:533
26947999236312,2348cyclictest320122-21kworker/1:0+events21:54:341
26948599236011,2345cyclictest303768-21kworker/3:2+events21:01:103
26947599235910,2346cyclictest258421-21kworker/0:1+events19:24:580
26947599235411,2339cyclictest286626-21kworker/0:2+events20:07:310
26948299235112,2336cyclictest352289-21kworker/2:1+events23:27:262
2694829923415,2333cyclictest299250-21kworker/2:1+events20:45:352
26947599233612,2321cyclictest347176-21kworker/0:0+events23:13:480
26947999233212,2317cyclictest272719-21kworker/1:1+events19:20:441
26947999233012,2315cyclictest302191-21kworker/1:1+events21:11:281
26948599232912,2314cyclictest289594-21kworker/3:1+events20:13:583
26948599232812,2314cyclictest353838-21kworker/3:0+events23:35:053
26948299232712,2313cyclictest354826-21kworker/2:2+events00:00:092
26948299232512,2310cyclictest299250-21kworker/2:1+events20:40:422
26948599231712,2301cyclictest353838-21kworker/3:0+events23:29:213
26948299231612,2300cyclictest321728-21kworker/2:2+events21:51:522
26948599231311,2298cyclictest332967-21kworker/3:0+events22:24:183
26948299231012,2294cyclictest284427-21kworker/2:0+events20:02:122
26947999231012,2295cyclictest320122-21kworker/1:0+events21:57:581
26948299230912,2294cyclictest374501-21kworker/2:0+events00:31:472
26948299230812,2292cyclictest303709-21kworker/2:2+events20:58:102
26948599230611,2291cyclictest332967-21kworker/3:0+events22:29:153
26948299229912,2283cyclictest305511-21kworker/2:0+events21:24:012
26948299229312,2278cyclictest331349-21kworker/2:0+events22:18:392
26947999229012,2274cyclictest341121-21kworker/1:2+events22:50:571
26947599228511,2271cyclictest323387-21kworker/0:2+events22:14:490
26948599228212,2266cyclictest332967-21kworker/3:0+events22:58:133
26948299227511,2260cyclictest350473-21kworker/2:0+events23:21:502
26948299227511,2260cyclictest350473-21kworker/2:0+events23:21:502
26948299227411,2260cyclictest307219-21kworker/2:1+events21:05:442
26947599227211,2258cyclictest310097-21kworker/0:1+events21:17:360
26947599227211,2258cyclictest281140-21kworker/0:0+events19:56:040
26947599227110,2257cyclictest323387-21kworker/0:2+events21:58:220
2694759922699,2256cyclictest311798-21kworker/0:2+events21:31:150
2694759922699,2256cyclictest311798-21kworker/0:2+events21:31:140
2694759922679,2254cyclictest350427-21kworker/0:2+events23:35:510
2694759922678,2256cyclictest339165-21kworker/0:0+events22:42:130
26947599226711,2253cyclictest323387-21kworker/0:2+events22:07:310
26947599226710,2254cyclictest332937-21kworker/0:2+events22:23:560
26948299226612,2250cyclictest326434-21kworker/2:2+events22:02:332
2694759922659,2253cyclictest363093-21kworker/0:0+events23:56:250
26947599226511,2252cyclictest289176-21kworker/0:0+events20:25:020
26947599226511,2251cyclictest296173-21kworker/0:2+events20:32:420
26947599226510,2251cyclictest276247-21kworker/0:0+events19:33:260
26947599226311,2249cyclictest258421-21kworker/0:1+events19:36:290
26947599226211,2249cyclictest334567-21kworker/0:1+events22:35:240
26947599226210,2249cyclictest321487-21kworker/0:0+events21:54:570
26948599226110,2248cyclictest282712-21kworker/3:2+events20:09:263
26948599226110,2248cyclictest269140-21kworker/3:1+events19:19:133
26947599226110,2248cyclictest299027-21kworker/0:1+events20:37:410
2694759922578,2246cyclictest325049-21kworker/0:1+events22:03:190
2694759922547,2244cyclictest289176-21kworker/0:0+events20:16:590
26947599225210,2238cyclictest270961-21kworker/0:0+events19:18:020
2694859922509,2238cyclictest320153-21kworker/3:2+events21:47:413
26947999224912,2234cyclictest278434-21kworker/1:0+events19:37:161
26947999224811,2234cyclictest291247-21kworker/1:0+events20:14:441
26947999224011,2225cyclictest318499-21kworker/1:2+events21:42:421
26948599223910,2226cyclictest316924-21kworker/3:0+events21:34:433
26948599223910,2226cyclictest316924-21kworker/3:0+events21:34:433
26948299223111,2217cyclictest345609-21kworker/2:2+events23:03:362
26948299223011,2216cyclictest366805-21kworker/2:2+events00:15:452
26948299222510,2212cyclictest329677-21kworker/2:2+events22:31:322
26947999222310,2210cyclictest363206-21kworker/1:2+events00:01:381
26947599222011,2206cyclictest278108-21kworker/0:2+events19:45:430
26948299221811,2204cyclictest292668-21kworker/2:0+events20:22:222
26948299221411,2199cyclictest337603-21kworker/2:1+events22:38:272
2694859922109,2197cyclictest342711-21kworker/3:1+events23:15:433
2694859922099,2197cyclictest326464-21kworker/3:1+events22:06:453
2694799922058,2193cyclictest336209-21kworker/1:0+events22:42:361
26948299220311,2188cyclictest274285-21kworker/2:0+events19:26:302
26947999219611,2182cyclictest294479-21kworker/1:1+events20:29:151
26948599219311,2180cyclictest311885-21kworker/3:2+events21:26:183
26948299219211,2177cyclictest274285-21kworker/2:0+events19:23:032
26947999219210,2179cyclictest282621-21kworker/1:1+events19:49:111
2694799921880,2185cyclictest297971-21kworker/1:0+events20:41:271
26947999218710,2174cyclictest332998-21kworker/1:0+events22:28:061
26947999218510,2172cyclictest270654-21kworker/1:2+events19:31:071
26947999218510,2171cyclictest315261-21kworker/1:1+events21:36:111
2694799921819,2169cyclictest371347-21kworker/1:1+events00:35:531
26947999217911,2165cyclictest339406-21kworker/1:1+events23:05:291
26947999217810,2165cyclictest274381-21kworker/1:0+events19:27:401
26947599217710,2163cyclictest302315-21kworker/0:2+events21:00:280
26948299217410,2161cyclictest354826-21kworker/2:2+events23:32:492
2694829921409,2129cyclictest342582-21kworker/2:0+events23:05:062
26948599213310,2120cyclictest292440-21kworker/3:2+events20:23:083
2694859921328,2121cyclictest351920-21kworker/3:1+events23:33:123
26947599212511,2110cyclictest317810-21kworker/0:1+events21:40:270
26948599212111,2107cyclictest318528-21kworker/3:1+events21:44:373
2694859921179,2105cyclictest371553-21kworker/3:0+events00:33:403
2694859921178,2107cyclictest284638-21kworker/3:0+events19:55:163
26948599211511,2101cyclictest364818-21kworker/3:1+events00:06:343
26948299211411,2100cyclictest271047-21kworker/2:3+events19:32:402
26947599211310,2100cyclictest356779-21kworker/0:0+events23:44:350
2694859921129,2099cyclictest316924-21kworker/3:0+events21:36:593
2694829921107,2099cyclictest278140-21kworker/2:0+events19:41:092
2694759921109,2098cyclictest300682-21kworker/0:0+events20:52:280
26948599210910,2095cyclictest308674-21kworker/3:0+events21:09:123
2694859921088,2096cyclictest366716-21kworker/3:0+events00:16:543
2694859921075,2099cyclictest371553-21kworker/3:0+events00:24:543
26948299210711,2093cyclictest256697-21kworker/2:2+events19:13:542
26948299210711,2092cyclictest271047-21kworker/2:3+events19:18:502
26948299210710,2094cyclictest333116-21kworker/2:1+events22:27:422
26948599210611,2091cyclictest326464-21kworker/3:1+events22:17:083
26948599210610,2093cyclictest351920-21kworker/3:1+events23:23:403
26948599210610,2093cyclictest351920-21kworker/3:1+events23:23:403
26948599210610,2093cyclictest286307-21kworker/3:1+events20:01:043
26948299210511,2091cyclictest364940-21kworker/2:1+events00:05:252
26947599210510,2092cyclictest286626-21kworker/0:2+events20:10:330
26948299210411,2090cyclictest354826-21kworker/2:2+events23:49:312
26948299210411,2090cyclictest337603-21kworker/2:1+events22:57:502
26948299210411,2090cyclictest316826-21kworker/2:1+events21:55:422
26947599210410,2091cyclictest269226-21kworker/0:2+events19:14:190
26948299210213,2086cyclictest291037-21kworker/2:1+events20:16:362
26948299210211,2088cyclictest361950-21kworker/2:0+events00:11:552
26948299210211,2088cyclictest305511-21kworker/2:0+events21:27:062
26948299210211,2088cyclictest303709-21kworker/2:2+events21:02:412
26948599210011,2086cyclictest297576-21kworker/3:1+events20:38:033
26948299210011,2085cyclictest278140-21kworker/2:0+events19:35:192
2694859920998,2087cyclictest292440-21kworker/3:2+events20:16:133
26948599209811,2084cyclictest278167-21kworker/3:1+events19:43:033
26948299209811,2084cyclictest350473-21kworker/2:0+events23:39:172
2694859920978,2086cyclictest337573-21kworker/3:2+events22:37:183
26948599209611,2082cyclictest345454-21kworker/3:2+events23:09:403
26948599209611,2082cyclictest273212-21kworker/3:2+events19:21:313
26948599209510,2082cyclictest261022-21kworker/3:2+events19:12:443
26948599209411,2080cyclictest270885-21kworker/3:0+events19:28:273
26948299209311,2079cyclictest284427-21kworker/2:0+events20:07:082
26948599208910,2076cyclictest359942-21kworker/3:0+events23:47:153
2694859920879,2075cyclictest308674-21kworker/3:0+events21:20:593
26948299206710,2054cyclictest287724-21kworker/2:2+events20:10:542
26948599204810,2035cyclictest278167-21kworker/3:1+events19:37:403
2694859920469,2034cyclictest295979-21kworker/3:0+events20:51:423
2694799920383,2032cyclictest326492-21kworker/1:1+events22:05:131
26948599201011,1996cyclictest295979-21kworker/3:0+events20:56:213
26948299199810,1985cyclictest292668-21kworker/2:0+events20:35:442
2694799919874,1980cyclictest270654-21kworker/1:2+events19:13:321
2694859919527,1942cyclictest270885-21kworker/3:0+events19:30:203
2694829919482,1943cyclictest337603-21kworker/2:1+events22:46:502
2694829919479,1935cyclictest284427-21kworker/2:0+events19:56:502
2694829919416,1932cyclictest295918-21kworker/2:1+events20:28:292
26948299194010,1927cyclictest292668-21kworker/2:0+events20:34:372
2691432143112,26sleep10-21swapper/119:08:281
2690572143112,26sleep00-21swapper/019:07:230
2690812142108,29sleep30-21swapper/319:07:413
2692212140108,27sleep20-21swapper/219:09:282
26948299196,2cyclictest191rcu_preempt00:20:212
26948599180,16cyclictest300801-21runrttasks20:43:553
26948299176,2cyclictest191rcu_preempt00:25:212
26948299158,2cyclictest191rcu_preempt21:15:182
26948299156,2cyclictest191rcu_preempt22:40:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional