You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 18:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Sep 24, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253230999370516,3683cyclictest2580462-21kworker/0:0+events21:50:000
25323129929613,2953cyclictest2607512-21kworker/1:0+events23:10:171
253230999281013,2794cyclictest2544930-21kworker/0:0+events19:55:010
253230999279312,2777cyclictest2569535-21kworker/0:2+events21:15:220
25323189927912,2785cyclictest2537074-21kworker/3:1+events19:30:003
253231499277112,2755cyclictest2538615-21kworker/2:1+events19:30:232
253231299276413,2747cyclictest2630299-21kworker/1:2+events00:25:141
253231299276413,2747cyclictest2615859-21kworker/1:2+events23:35:181
253231899273814,2721cyclictest2619103-21kworker/3:0+events23:40:153
253230999267413,2659cyclictest2580462-21kworker/0:0+events22:25:190
253231899265713,2640cyclictest2599535-21kworker/3:0+events22:40:133
253231499265313,2637cyclictest2548542-21kworker/2:0+events20:00:012
253230999265010,2635cyclictest2544930-21kworker/0:0+events20:01:570
253231499257212,2556cyclictest2558343-21kworker/2:0+events20:35:142
253231299252811,2514cyclictest2596512-21kworker/1:1+events22:30:131
253230999252612,2511cyclictest2604306-21kworker/0:0+events22:54:420
253231499251210,2498cyclictest2554970-21kworker/2:1+events20:22:182
253231299250312,2487cyclictest2563157-21kworker/1:2+events21:11:401
25323099924954,2488cyclictest2623731-21kworker/0:2+events23:56:230
253231299248012,2466cyclictest2615859-21kworker/1:2+events23:50:121
253231299247112,2455cyclictest2530488-21kworker/1:2+events19:31:081
253231299246311,2448cyclictest2599727-21kworker/1:2+events23:06:061
253231499245512,2439cyclictest2629918-21kworker/2:0+events00:20:582
253231499245211,2437cyclictest2580252-21kworker/2:0+events21:48:502
253231499245112,2434cyclictest2558343-21kworker/2:0+events20:32:542
253231499244912,2433cyclictest2543510-21kworker/2:1+events19:44:052
253231299244812,2434cyclictest2569209-21kworker/1:0+events21:05:171
253231899244612,2431cyclictest2548513-21kworker/3:0+events20:10:123
253231499244612,2431cyclictest2553297-21kworker/2:0+events20:14:222
253231499244611,2431cyclictest2585348-21kworker/2:1+events22:21:062
253231499244512,2431cyclictest2562815-21kworker/2:1+events20:45:022
253231499244512,2430cyclictest2580252-21kworker/2:0+events21:52:432
253231499244512,2430cyclictest2575656-21kworker/2:2+events21:35:332
253231499244412,2428cyclictest2550544-21kworker/2:1+events20:08:172
253231499244410,2430cyclictest2620433-21kworker/2:0+events23:45:392
253231299244311,2427cyclictest2628320-21kworker/1:0+events00:10:261
253231499244012,2425cyclictest2533647-21kworker/2:2+events19:23:482
253231499244012,2424cyclictest2634750-21kworker/2:2+events00:27:512
253231499244011,2426cyclictest2601344-21kworker/2:1+events22:46:172
253231499244011,2426cyclictest2564490-21kworker/2:0+events20:50:462
253231299243912,2423cyclictest2546681-21kworker/1:2+events20:34:511
253231899243812,2422cyclictest2540428-21kworker/3:0+events19:35:153
253231499243511,2420cyclictest2617557-21kworker/2:2+events23:54:522
253231299243112,2416cyclictest2574086-21kworker/1:1+events21:26:231
253231899242612,2410cyclictest2587332-21kworker/3:0+events22:02:373
253230999242612,2410cyclictest2605943-21kworker/0:1+events22:56:580
253231899242511,2411cyclictest2628674-21kworker/3:1+events00:14:573
253231899242411,2409cyclictest2570838-21kworker/3:2+events21:25:163
253231299242414,2407cyclictest2538643-21kworker/1:0+events19:36:461
253231299242411,2409cyclictest2548569-21kworker/1:1+events20:02:171
253231299242212,2406cyclictest2546681-21kworker/1:2+events20:06:031
253231499242110,2408cyclictest2607735-21kworker/2:2+events23:15:142
253231299242012,2405cyclictest2607512-21kworker/1:0+events23:04:121
253231299242012,2404cyclictest2546681-21kworker/1:2+events20:18:101
253231299242010,2406cyclictest2585729-21kworker/1:0+events21:58:031
253231899241912,2403cyclictest2602828-21kworker/3:2+events22:52:233
25323129924199,2407cyclictest2574086-21kworker/1:1+events21:44:161
253231299241911,2404cyclictest2630299-21kworker/1:2+events00:38:011
253231299241911,2404cyclictest2538643-21kworker/1:0+events19:27:171
253231299241811,2403cyclictest2574086-21kworker/1:1+events21:51:341
253231299241712,2401cyclictest2587796-21kworker/1:2+events22:06:001
253231299241612,2401cyclictest2591693-21kworker/1:0+events22:22:391
253231299241112,2396cyclictest2629947-21kworker/1:1+events00:16:061
253231299241112,2396cyclictest2601423-21kworker/1:1+events22:48:561
253231299241012,2394cyclictest2561398-21kworker/1:0+events20:46:331
253231299240911,2395cyclictest2563157-21kworker/1:2+events21:20:161
253231299240812,2392cyclictest2554928-21kworker/1:0+events20:21:091
253231499240711,2392cyclictest2604688-21kworker/2:0+events22:59:362
253231299240512,2390cyclictest2535150-21kworker/1:0+events19:16:141
253231299240512,2389cyclictest2633089-21kworker/1:0+events00:24:041
253231299240412,2390cyclictest2574086-21kworker/1:1+events21:30:351
253231299240412,2389cyclictest2552945-21kworker/1:1+events20:11:431
25323099924000,2397cyclictest2596570-21kworker/0:2+events22:35:110
253230999239611,2382cyclictest2631756-21kworker/0:0+events00:33:540
253231299239512,2380cyclictest2558128-21kworker/1:1+events20:36:221
253231499238012,2364cyclictest2590386-21kworker/2:2+events22:14:182
253231299238011,2366cyclictest2585729-21kworker/1:0+events22:00:421
253231899237812,2364cyclictest2615925-21kworker/3:1+events23:30:443
253231499236911,2354cyclictest2607735-21kworker/2:2+events23:02:152
253231899236711,2352cyclictest2554578-21kworker/3:1+events20:28:463
253231899236011,2346cyclictest2570838-21kworker/3:2+events21:12:473
253231899235912,2344cyclictest2572520-21kworker/3:0+events21:15:433
253231899235911,2344cyclictest2570838-21kworker/3:2+events21:32:293
25323149923599,2347cyclictest2588752-21kworker/2:0+events22:05:352
253230999235811,2343cyclictest2585646-21kworker/0:1+events22:09:280
253231899235412,2338cyclictest2590206-21kworker/3:1+events22:20:193
253231499235112,2335cyclictest2595209-21kworker/2:2+events22:35:572
253231899234810,2336cyclictest2559797-21kworker/3:0+events20:40:093
253231299234612,2330cyclictest2593273-21kworker/1:2+events22:19:561
253231899234112,2325cyclictest2623578-21kworker/3:2+events23:53:193
253231899234111,2326cyclictest2634719-21kworker/3:1+events00:31:113
253231899233912,2323cyclictest2578463-21kworker/3:1+events21:36:413
253231899233812,2323cyclictest2548513-21kworker/3:0+events20:17:253
253231899233812,2322cyclictest2625214-21kworker/3:0+events00:02:033
253230999233812,2322cyclictest2561340-21kworker/0:2+events20:43:110
253230999233712,2322cyclictest2567878-21kworker/0:1+events21:03:450
253231899233610,2322cyclictest2556502-21kworker/3:2+events20:34:273
253231899233512,2319cyclictest2585511-21kworker/3:2+events21:56:103
253231899233510,2322cyclictest2563100-21kworker/3:1+events21:08:173
253231899233012,2315cyclictest2564698-21kworker/3:0+events20:53:263
253231899233011,2316cyclictest2590206-21kworker/3:1+events22:12:073
253230999233012,2314cyclictest2585646-21kworker/0:1+events21:56:310
253231899232912,2314cyclictest2625214-21kworker/3:0+events00:22:543
253231899232912,2314cyclictest2563100-21kworker/3:1+events20:56:253
253231899232912,2313cyclictest2580345-21kworker/3:0+events21:41:163
253231899232912,2313cyclictest2534397-21kworker/3:2+events19:20:003
253231899232812,2312cyclictest2599535-21kworker/3:0+events22:36:203
253231899232612,2310cyclictest2583612-21kworker/3:0+events21:52:193
253231899232611,2312cyclictest2581985-21kworker/3:2+events21:45:453
253231899232611,2312cyclictest2546621-21kworker/3:2+events19:54:383
253231299232512,2310cyclictest2546681-21kworker/1:2+events19:55:481
253231499231710,2303cyclictest2553297-21kworker/2:0+events20:16:392
253230999231612,2301cyclictest2622127-21kworker/0:1+events23:50:360
253231499231411,2300cyclictest2636553-21kworker/2:1+events00:39:552
253230999231311,2299cyclictest2607825-21kworker/0:2+events23:05:220
253230999231212,2297cyclictest2544930-21kworker/0:0+events20:08:420
253230999231112,2295cyclictest2531674-21kworker/0:0+events19:16:360
253230999231110,2298cyclictest2544930-21kworker/0:0+events20:11:200
253230999231110,2297cyclictest2596570-21kworker/0:2+events22:47:270
253230999231012,2295cyclictest2620400-21kworker/0:2+events23:41:260
253230999231012,2295cyclictest2544930-21kworker/0:0+events19:47:030
25323099923098,2297cyclictest2561340-21kworker/0:2+events20:50:230
253230999230911,2296cyclictest2555180-21kworker/0:2+events20:20:010
253230999230910,2297cyclictest2538829-21kworker/0:0+events19:31:320
253231899230711,2293cyclictest2619103-21kworker/3:0+events23:49:283
253230999230610,2292cyclictest2540457-21kworker/0:2+events19:38:190
253230999230312,2288cyclictest2540457-21kworker/0:2+events19:42:060
253230999230212,2287cyclictest2580462-21kworker/0:0+events22:01:060
25323099922940,2290cyclictest2596570-21kworker/0:2+events22:42:510
25323189922879,2275cyclictest2593404-21kworker/3:2+events22:26:283
253231899228211,2267cyclictest2634719-21kworker/3:1+events00:28:153
253231499227910,2266cyclictest2556626-21kworker/2:2+events20:40:312
25323099922780,2275cyclictest2630153-21kworker/0:1+events00:23:180
253231299227411,2259cyclictest2582161-21kworker/1:0+events21:48:261
253231899227310,2260cyclictest2543388-21kworker/3:1+events19:42:313
253230999227311,2258cyclictest2561340-21kworker/0:2+events20:55:190
253231899226512,2250cyclictest2540428-21kworker/3:0+events19:47:243
25323099922659,2252cyclictest2625335-21kworker/0:1+events00:04:230
253231499226111,2247cyclictest2611108-21kworker/2:1+events23:27:192
253231299225610,2242cyclictest2538643-21kworker/1:0+events19:42:531
253230999225410,2241cyclictest2577254-21kworker/0:0+events21:31:440
253231499224710,2234cyclictest2556626-21kworker/2:2+events21:14:152
25323149922411,2236cyclictest2573966-21kworker/2:0+events21:17:582
253231499223810,2225cyclictest2601344-21kworker/2:1+events22:51:132
253231499223810,2225cyclictest2541705-21kworker/2:2+events19:37:572
253231499223710,2225cyclictest2543510-21kworker/2:1+events19:45:132
253231899223611,2222cyclictest2559797-21kworker/3:0+events20:37:303
253231499223610,2222cyclictest2620433-21kworker/2:0+events23:42:582
253231499223311,2219cyclictest2575656-21kworker/2:2+events21:29:482
253231499223310,2220cyclictest2585348-21kworker/2:1+events22:04:072
253231299223310,2220cyclictest2615859-21kworker/1:2+events23:33:471
25323149922329,2220cyclictest2577432-21kworker/2:1+events21:34:222
253231499223210,2218cyclictest2543510-21kworker/2:1+events19:51:182
25323149922318,2220cyclictest2614270-21kworker/2:0+events23:33:012
253231499223110,2218cyclictest2595209-21kworker/2:2+events22:30:342
253231499223010,2216cyclictest2629918-21kworker/2:0+events00:30:282
25323129922309,2217cyclictest2598138-21kworker/1:0+events22:40:361
253230999223010,2217cyclictest2553560-21kworker/0:1+events20:17:460
253231899222911,2214cyclictest2623578-21kworker/3:2+events23:58:393
25323129922294,2221cyclictest2596512-21kworker/1:1+events22:28:201
25323149922281,2224cyclictest2585348-21kworker/2:1+events21:57:412
25323129922289,2216cyclictest2630299-21kworker/1:2+events00:31:581
253231299222811,2214cyclictest2625562-21kworker/1:3+events00:09:191
253230999222812,2212cyclictest2605943-21kworker/0:1+events23:26:120
253231499222710,2213cyclictest2623621-21kworker/2:0+events23:57:552
253231899222611,2211cyclictest2554578-21kworker/3:1+events20:23:053
253231499222610,2213cyclictest2571175-21kworker/2:1+events21:21:022
253231299222611,2212cyclictest2536965-21kworker/1:1+events19:21:311
253231299222611,2211cyclictest2528614-21kworker/1:1+events19:14:221
253231299222411,2211cyclictest2599727-21kworker/1:2+events22:55:061
253231299222411,2210cyclictest2610928-21kworker/1:1+events23:21:151
253231299222411,2210cyclictest2569209-21kworker/1:0+events21:03:231
253231299222311,2209cyclictest2543481-21kworker/1:2+events19:45:561
253231299222310,2210cyclictest2563157-21kworker/1:2+events21:17:361
25323149922229,2211cyclictest2627009-21kworker/2:2+events00:05:092
253231499222210,2209cyclictest2595209-21kworker/2:2+events22:43:152
253231299222111,2207cyclictest2620753-21kworker/1:0+events23:55:591
253231899221910,2206cyclictest2608124-21kworker/3:3+events23:12:353
253231499221910,2206cyclictest2623621-21kworker/2:0+events00:00:552
253231899221810,2204cyclictest2606032-21kworker/3:0+events23:04:353
253231299221711,2203cyclictest2538643-21kworker/1:0+events19:50:311
25323149922139,2201cyclictest2609475-21kworker/2:0+events23:09:542
253231299221112,2197cyclictest2599727-21kworker/1:2+events22:50:031
253231299221011,2195cyclictest2558128-21kworker/1:1+events20:27:131
253230999221011,2195cyclictest2569535-21kworker/0:2+events21:10:540
253231299220711,2193cyclictest2590087-21kworker/1:1+events22:11:221
253231499220311,2189cyclictest2627009-21kworker/2:2+events00:10:492
253231299220310,2191cyclictest2612530-21kworker/1:0+events23:25:061
253231299219811,2183cyclictest2610928-21kworker/1:1+events23:16:231
253231899219211,2178cyclictest2630518-21kworker/3:2+events00:16:293
253230999219112,2176cyclictest2596570-21kworker/0:2+events22:31:450
253231499218810,2175cyclictest2545317-21kworker/2:2+events19:58:512
253231299218710,2173cyclictest2563157-21kworker/1:2+events20:53:481
25323099921869,2173cyclictest2605943-21kworker/0:1+events23:21:390
253231299218511,2170cyclictest2575716-21kworker/1:0+events21:37:251
253231899218411,2169cyclictest2574209-21kworker/3:1+events21:22:353
25323149921757,2164cyclictest2607735-21kworker/2:2+events23:13:212
25323129921639,2150cyclictest2625127-21kworker/1:1+events00:00:321
253230999216010,2147cyclictest2580462-21kworker/0:0+events22:11:450
253230999215912,2144cyclictest2631756-21kworker/0:0+events00:19:510
253231499214511,2132cyclictest2580252-21kworker/2:0+events21:40:292
253231899214211,2128cyclictest2630518-21kworker/3:2+events00:38:473
253231899214011,2126cyclictest2625214-21kworker/3:0+events00:07:053
25323189921398,2128cyclictest2546621-21kworker/3:2+events20:05:423
253230999213911,2125cyclictest2569535-21kworker/0:2+events21:09:010
253231899213811,2123cyclictest2599535-21kworker/3:0+events22:49:403
253231899213510,2122cyclictest2612618-21kworker/3:1+events23:22:013
253230999213512,2120cyclictest2623731-21kworker/0:2+events00:06:410
253231499213411,2120cyclictest2569268-21kworker/2:0+events21:05:402
253231899213111,2117cyclictest2590206-21kworker/3:1+events22:18:033
25323149921319,2118cyclictest2536984-21kworker/2:0+events19:26:302
25323189921309,2118cyclictest2593404-21kworker/3:2+events22:33:153
253231899213011,2115cyclictest2523420-21kworker/3:0+events19:21:553
25323189921279,2115cyclictest2563100-21kworker/3:1+events21:03:013
253231899212711,2112cyclictest2546621-21kworker/3:2+events19:58:293
253231899212511,2111cyclictest2563100-21kworker/3:1+events20:48:503
253231499212410,2110cyclictest2593313-21kworker/2:0+events22:27:362
253230999211811,2104cyclictest2580462-21kworker/0:0+events21:55:000
253230999211711,2102cyclictest2593344-21kworker/0:1+events22:18:250
253230999211710,2104cyclictest2605943-21kworker/0:1+events23:01:520
253230999211710,2104cyclictest2556833-21kworker/0:0+events20:32:100
253230999211411,2100cyclictest2617578-21kworker/0:1+events23:35:430
253231899211310,2100cyclictest2538737-21kworker/3:2+events19:30:463
253231899210810,2095cyclictest2548513-21kworker/3:0+events20:00:253
253230999210711,2094cyclictest2633544-21kworker/0:2+events00:37:380
253230999210711,2092cyclictest2553560-21kworker/0:1+events20:27:580
253230999210710,2094cyclictest2569535-21kworker/0:2+events21:27:330
253230999210611,2092cyclictest2535447-21kworker/0:1+events19:24:340
253230999210610,2092cyclictest2575623-21kworker/0:1+events21:23:210
253230999210511,2091cyclictest2553560-21kworker/0:1+events20:49:110
253230999210511,2090cyclictest2569535-21kworker/0:2+events21:37:030
253231899210411,2090cyclictest2612618-21kworker/3:1+events23:19:013
253230999210411,2090cyclictest2611077-21kworker/0:2+events23:16:000
253230999210411,2090cyclictest2605943-21kworker/0:1+events23:12:570
253231899210311,2088cyclictest2615925-21kworker/3:1+events23:37:583
253230999210311,2089cyclictest2633544-21kworker/0:2+events00:29:430
253230999210311,2088cyclictest2537132-21kworker/0:2+events19:27:400
253230999210211,2088cyclictest2615987-21kworker/0:0+events23:49:500
253231499210110,2088cyclictest2611108-21kworker/2:1+events23:23:112
253230999210111,2087cyclictest2593344-21kworker/0:1+events22:23:500
25323129920886,2079cyclictest2599727-21kworker/1:2+events22:39:491
253230999208811,2074cyclictest2623731-21kworker/0:2+events00:13:490
253230999208811,2073cyclictest2615987-21kworker/0:0+events23:34:570
25323149920827,2072cyclictest2523413-21kworker/2:1+events19:18:292
25323149920825,2074cyclictest2556626-21kworker/2:2+events21:01:292
25323149920776,2067cyclictest2556626-21kworker/2:2+events20:29:072
25323099920769,2065cyclictest2544930-21kworker/0:0+events19:50:080
25323149920759,2063cyclictest2566094-21kworker/2:1+events20:55:412
25323129920757,2065cyclictest2615859-21kworker/1:2+events23:45:181
25323129920595,2051cyclictest2564785-21kworker/1:1+events20:56:501
253231499205510,2042cyclictest2611108-21kworker/2:1+events23:37:352
253230999205411,2040cyclictest2578859-21kworker/0:1+events21:42:450
253231499204010,2027cyclictest2585348-21kworker/2:1+events22:16:562
25323189920375,2028cyclictest2608035-21kworker/3:2+events23:06:283
25323129920379,2024cyclictest2619054-21kworker/1:1+events23:42:121
25323099920356,2026cyclictest2561340-21kworker/0:2+events20:39:470
25323149920298,2017cyclictest2523413-21kworker/2:1+events19:11:192
25323189919859,1973cyclictest2606032-21kworker/3:0+events22:58:293
253231899196510,1952cyclictest2587332-21kworker/3:0+events22:07:333
253231899196010,1947cyclictest2531734-21kworker/3:1+events19:14:433
253231899194710,1933cyclictest2608124-21kworker/3:3+events23:29:113
25323099918929,1880cyclictest2530025-21kworker/0:2+events19:11:410
25315472149104,26sleep10-21swapper/119:06:331
25316972144114,25sleep30-21swapper/319:08:263
25316532142112,25sleep20-21swapper/219:07:532
25315932142111,26sleep00-21swapper/019:07:080
253231499151,10cyclictest2631869-21munin-run00:20:002
253231299156,6cyclictest2562847-21apt-get20:40:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional