You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 13:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Mon Aug 10, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
218677899308214,3063cyclictest2200927-21kworker/0:0+events19:55:150
218678599292214,2904cyclictest2249769-21kworker/2:0+events22:25:142
218678399283313,2815cyclictest2235301-21kworker/1:0+events21:50:161
218677899283212,2815cyclictest2280691-21kworker/0:2+events00:10:210
218678599283113,2814cyclictest2187906-21kworker/2:2+events19:20:162
218678599280213,2785cyclictest2209422-21kworker/2:2+events20:42:402
218678599280113,2784cyclictest2232089-21kworker/2:1+events21:51:022
21867859927889,2775cyclictest2226312-21kworker/2:0+events21:15:172
218678599278713,2770cyclictest2256163-21kworker/2:1+events22:50:202
218678599278413,2767cyclictest2222554-21kworker/2:1+events21:02:452
218678599278013,2763cyclictest2264224-21kworker/2:0+events23:11:252
218678599278013,2763cyclictest2264224-21kworker/2:0+events23:11:242
218678399276412,2749cyclictest2259223-21kworker/1:2+events23:17:341
218678599276113,2743cyclictest2285483-21kworker/2:1+events00:20:122
218677899276112,2745cyclictest2214101-21kworker/0:1+events20:39:410
218678399275913,2743cyclictest2287002-21kworker/1:1+events00:19:501
218678399275713,2740cyclictest2238643-21kworker/1:1+events21:58:181
218678399275513,2738cyclictest2272373-21kworker/1:1+events23:33:091
218678399275211,2737cyclictest2249680-21kworker/1:1+events22:24:061
218678399273913,2723cyclictest2225719-21kworker/1:1+events21:06:341
218678399272913,2714cyclictest2254335-21kworker/1:2+events22:45:441
218678399272711,2712cyclictest2205961-21kworker/1:1+events20:31:421
218678599272213,2705cyclictest2226312-21kworker/2:0+events21:13:012
218678399270613,2689cyclictest2287002-21kworker/1:1+events00:24:001
218678599269112,2675cyclictest2271058-21kworker/2:1+events23:33:552
218678399268713,2671cyclictest2222618-21kworker/1:0+events21:19:251
218678599268112,2665cyclictest2275626-21kworker/2:1+events23:45:172
218678999267513,2657cyclictest2227629-21kworker/3:2+events21:35:293
218678999267413,2657cyclictest2214192-21kworker/3:1+events20:34:463
218678599267411,2660cyclictest2232089-21kworker/2:1+events22:07:452
218678599267313,2656cyclictest2258004-21kworker/2:0+events22:55:202
218677899266013,2644cyclictest2196479-21kworker/0:2+events19:46:350
218678599265713,2640cyclictest2219321-21kworker/2:0+events20:57:012
218678399265610,2642cyclictest2248058-21kworker/1:2+events22:19:061
218678999265413,2637cyclictest2277587-21kworker/3:0+events00:01:143
218678999265213,2635cyclictest2270843-21kworker/3:0+events23:37:413
218678999265012,2634cyclictest2227629-21kworker/3:2+events21:25:563
218678999264413,2627cyclictest2208792-21kworker/3:0+events20:19:333
218677899264213,2625cyclictest2202761-21kworker/0:2+events20:14:390
218677899264111,2626cyclictest2277046-21kworker/0:2+events23:50:160
218678999264013,2624cyclictest2244914-21kworker/3:1+events22:18:443
218678399263912,2625cyclictest2267196-21kworker/1:1+events23:25:101
218678999263813,2621cyclictest2217447-21kworker/3:0+events21:06:113
218678999263813,2621cyclictest2217447-21kworker/3:0+events20:46:043
218678999263713,2620cyclictest2227629-21kworker/3:2+events21:56:013
218678599263613,2620cyclictest2202583-21kworker/2:0+events20:00:592
218678999263413,2615cyclictest2277587-21kworker/3:0+events23:57:473
218677899262912,2614cyclictest2265714-21kworker/0:0+events23:15:160
218677899262812,2612cyclictest2255916-21kworker/0:2+events22:42:230
21867789926269,2614cyclictest2270921-21kworker/0:1+events23:40:210
218677899262013,2603cyclictest2217342-21kworker/0:0+events20:52:280
218678399261413,2597cyclictest2259223-21kworker/1:2+events23:49:521
218678999261013,2593cyclictest2260667-21kworker/3:2+events23:00:163
21867899926096,2600cyclictest2277587-21kworker/3:0+events00:06:553
21867839926099,2597cyclictest2235301-21kworker/1:0+events21:37:451
218678999260613,2591cyclictest2197973-21kworker/3:0+events19:55:373
218677899260413,2587cyclictest2251136-21kworker/0:0+events22:36:410
218678399260212,2586cyclictest2259223-21kworker/1:2+events23:41:271
218677899259812,2582cyclictest2240171-21kworker/0:1+events21:54:520
218677899259610,2582cyclictest2228977-21kworker/0:1+events21:19:030
218678999259512,2579cyclictest2197973-21kworker/3:0+events19:46:583
218678399258913,2572cyclictest2259223-21kworker/1:2+events23:52:551
21867789925830,2579cyclictest2196479-21kworker/0:2+events19:40:490
218677899258112,2565cyclictest2259036-21kworker/0:1+events23:10:390
218677899258112,2565cyclictest2259036-21kworker/0:1+events23:10:380
218677899257912,2563cyclictest2222685-21kworker/0:2+events21:08:530
218677899257812,2562cyclictest2251136-21kworker/0:0+events22:33:120
218677899257812,2562cyclictest2189792-21kworker/0:0+events19:23:410
21867839925778,2566cyclictest2199622-21kworker/1:1+events19:59:491
21867789925776,2568cyclictest2237222-21kworker/0:0+events21:49:310
218677899257712,2562cyclictest2288506-21kworker/0:0+events00:32:040
218677899257712,2561cyclictest2288506-21kworker/0:0+events00:27:540
218678599257313,2556cyclictest2197268-21kworker/2:1+events19:57:112
218678599256911,2554cyclictest2244881-21kworker/2:2+events22:37:272
218677899256912,2553cyclictest2259036-21kworker/0:1+events23:06:010
21867789925678,2555cyclictest2278774-21kworker/0:1+events00:03:290
218678399256611,2551cyclictest2229155-21kworker/1:1+events21:22:291
218678399256611,2551cyclictest2229155-21kworker/1:1+events21:22:281
218678599256310,2549cyclictest2244881-21kworker/2:2+events22:20:162
218678999255212,2537cyclictest2251503-21kworker/3:2+events22:30:563
218678599254812,2532cyclictest2264224-21kworker/2:0+events23:24:472
218678599254610,2532cyclictest2226312-21kworker/2:0+events21:33:122
218678399254611,2531cyclictest2259223-21kworker/1:2+events23:10:161
218678399254611,2531cyclictest2259223-21kworker/1:2+events23:10:161
218678599254512,2529cyclictest2262478-21kworker/2:2+events23:02:332
218678599254512,2529cyclictest2199353-21kworker/2:0+events19:47:192
218678599254511,2530cyclictest2219321-21kworker/2:0+events20:53:372
218677899254512,2529cyclictest2244758-21kworker/0:1+events22:10:220
218678599254212,2526cyclictest2287381-21kworker/2:0+events00:25:342
218678599254212,2526cyclictest2212292-21kworker/2:1+events20:26:462
218678599254112,2525cyclictest2209422-21kworker/2:2+events20:24:082
218678599254111,2526cyclictest2215750-21kworker/2:0+events20:39:182
218678399254112,2525cyclictest2275685-21kworker/1:0+events00:11:031
21867839925409,2527cyclictest2230812-21kworker/1:2+events21:28:371
218678599253912,2523cyclictest2244881-21kworker/2:2+events22:48:012
218678599253912,2523cyclictest2232089-21kworker/2:1+events22:00:302
218678399253912,2523cyclictest2197986-21kworker/1:0+events19:45:001
21867859925389,2525cyclictest2246466-21kworker/2:0+events22:17:392
21867859925387,2527cyclictest2275626-21kworker/2:1+events23:55:352
218678599253712,2521cyclictest2226312-21kworker/2:0+events21:20:342
218678599253712,2521cyclictest2226312-21kworker/2:0+events21:20:332
218678599253711,2524cyclictest2232089-21kworker/2:1+events21:56:242
218678399253610,2522cyclictest2238643-21kworker/1:1+events21:49:541
218678399253512,2519cyclictest2222618-21kworker/1:0+events21:13:461
218678999253412,2519cyclictest2224148-21kworker/3:1+events21:20:543
218678999253412,2519cyclictest2224148-21kworker/3:1+events21:20:543
218678599253312,2518cyclictest2197268-21kworker/2:1+events20:11:362
21867839925334,2525cyclictest2205961-21kworker/1:1+events20:10:081
218678399253310,2519cyclictest2246362-21kworker/1:0+events22:12:171
21867839925327,2521cyclictest2259223-21kworker/1:2+events23:01:461
218678399253212,2517cyclictest2257617-21kworker/1:1+events23:06:231
218678399253212,2516cyclictest2283730-21kworker/1:2+events00:08:041
218678599253112,2515cyclictest2190026-21kworker/2:0+events19:26:202
218678399253111,2516cyclictest2217521-21kworker/1:2+events20:47:121
21867859925309,2517cyclictest2232089-21kworker/2:1+events21:28:582
218678399253012,2514cyclictest2207561-21kworker/1:0+events20:16:121
218678399252912,2514cyclictest2259223-21kworker/1:2+events22:54:581
218678599252512,2509cyclictest2289719-21kworker/2:2+events00:30:562
218678399252512,2509cyclictest2275685-21kworker/1:0+events23:58:581
218678399252512,2509cyclictest2182944-21kworker/1:0+events19:36:401
218678399252511,2510cyclictest2197986-21kworker/1:0+events19:49:371
218678599251812,2503cyclictest2209422-21kworker/2:2+events20:30:332
218677899251812,2503cyclictest2278774-21kworker/0:1+events23:59:190
218678599251512,2499cyclictest2235285-21kworker/2:2+events21:41:132
218678599251410,2502cyclictest2244881-21kworker/2:2+events22:32:052
218678399251312,2497cyclictest2217521-21kworker/1:2+events20:44:341
218677899251012,2496cyclictest2207236-21kworker/0:1+events20:19:560
218678599250912,2493cyclictest2264224-21kworker/2:0+events23:19:062
218677899250112,2485cyclictest2202761-21kworker/0:2+events20:02:300
21867789924996,2490cyclictest2186340-21kworker/0:1+events19:51:070
21867789924995,2490cyclictest2217342-21kworker/0:0+events20:41:530
218678599249811,2483cyclictest2238553-21kworker/2:2+events21:48:232
218677899249712,2482cyclictest2275394-21kworker/0:0+events23:46:240
218677899249712,2481cyclictest2186340-21kworker/0:1+events19:34:020
218678399249612,2480cyclictest2278889-21kworker/1:1+events00:05:001
218677899249612,2481cyclictest2186340-21kworker/0:1+events19:27:300
218677899249612,2480cyclictest2264071-21kworker/0:2+events23:36:540
218677899249612,2480cyclictest2186340-21kworker/0:1+events19:18:220
218677899249512,2479cyclictest2227322-21kworker/0:0+events21:14:100
218677899249412,2480cyclictest2286820-21kworker/0:1+events00:20:350
218677899249412,2478cyclictest2209133-21kworker/0:0+events20:25:380
218677899249212,2477cyclictest2235508-21kworker/0:2+events21:55:380
218677899249212,2477cyclictest2214101-21kworker/0:1+events20:32:500
218677899249212,2476cyclictest2259036-21kworker/0:1+events22:58:210
218677899249112,2476cyclictest2233876-21kworker/0:1+events21:39:410
218678399249012,2475cyclictest2202553-21kworker/1:2+events20:02:511
218677899249011,2475cyclictest2255916-21kworker/0:2+events22:46:080
218678599248811,2474cyclictest2224176-21kworker/2:2+events21:07:212
218678599248712,2472cyclictest2289719-21kworker/2:2+events00:36:342
218677899248712,2471cyclictest2249499-21kworker/0:1+events22:22:110
218678599248612,2470cyclictest2280397-21kworker/2:2+events00:17:312
218678599248612,2470cyclictest2269141-21kworker/2:2+events23:27:482
218678599248512,2469cyclictest2209422-21kworker/2:2+events20:47:342
218677899248512,2470cyclictest2251136-21kworker/0:0+events22:28:380
218677899248512,2469cyclictest2217342-21kworker/0:0+events20:48:420
218678399248312,2468cyclictest2222618-21kworker/1:0+events21:03:541
218678599248211,2467cyclictest2232089-21kworker/2:1+events22:11:082
218678599248210,2468cyclictest2193374-21kworker/2:2+events19:32:532
218678599248110,2467cyclictest2269141-21kworker/2:2+events23:38:042
218678399248112,2465cyclictest2249680-21kworker/1:1+events22:40:521
21867859924788,2466cyclictest2235285-21kworker/2:2+events21:37:232
218678399247211,2458cyclictest2259223-21kworker/1:2+events23:35:461
218678399247111,2457cyclictest2192998-21kworker/1:1+events19:27:081
218678399246412,2448cyclictest2259223-21kworker/1:2+events22:57:101
21867859924639,2449cyclictest2190026-21kworker/2:0+events19:19:542
218678599245712,2441cyclictest2193374-21kworker/2:2+events19:43:072
218678599245511,2440cyclictest2275626-21kworker/2:1+events23:44:312
218678599245312,2438cyclictest2280397-21kworker/2:2+events00:08:492
218678599245312,2437cyclictest2197268-21kworker/2:1+events20:08:572
218678399244912,2433cyclictest2235301-21kworker/1:0+events21:42:451
218678999244812,2432cyclictest2277587-21kworker/3:0+events23:52:073
218678599244812,2433cyclictest2200983-21kworker/2:2+events19:52:362
218678399244812,2433cyclictest2205961-21kworker/1:1+events20:25:151
21867899924469,2433cyclictest2207027-21kworker/3:2+events20:27:313
218678599244612,2431cyclictest2197268-21kworker/2:1+events20:18:472
218678599244611,2432cyclictest2190026-21kworker/2:0+events19:39:422
218678399244611,2431cyclictest2217521-21kworker/1:2+events20:57:251
218678399244610,2433cyclictest2252622-21kworker/1:0+events22:31:181
218678399244610,2432cyclictest2291657-21kworker/1:2+events00:33:351
218678399244511,2431cyclictest2212414-21kworker/1:0+events20:38:341
218678399244510,2431cyclictest2197986-21kworker/1:0+events19:53:001
218678599244412,2430cyclictest2283851-21kworker/2:0+events00:11:272
218678399244412,2428cyclictest2241892-21kworker/1:2+events22:08:051
218678399244312,2427cyclictest2288624-21kworker/1:0+events00:39:101
218678399243912,2423cyclictest2205961-21kworker/1:1+events20:21:511
218678999243612,2420cyclictest2194726-21kworker/3:2+events19:38:103
218678399243612,2421cyclictest2182944-21kworker/1:0+events19:32:291
218678399243511,2420cyclictest2249680-21kworker/1:1+events22:38:361
218678399243212,2418cyclictest2235301-21kworker/1:0+events22:00:091
218678999242912,2414cyclictest2240079-21kworker/3:0+events22:02:243
21867789924298,2418cyclictest2235508-21kworker/0:2+events22:15:430
218678999242712,2412cyclictest2233662-21kworker/3:1+events21:34:453
218678399242711,2412cyclictest2267196-21kworker/1:1+events23:22:061
218678399242611,2412cyclictest2202553-21kworker/1:2+events20:09:441
218678999242412,2408cyclictest2222522-21kworker/3:2+events21:01:593
218678999242312,2407cyclictest2235268-21kworker/3:0+events21:44:143
218678999242212,2407cyclictest2274042-21kworker/3:1+events23:44:543
218678999242211,2408cyclictest2285294-21kworker/3:1+events00:29:053
218678999241711,2402cyclictest2262551-21kworker/3:0+events23:07:103
218678999241612,2401cyclictest2207027-21kworker/3:2+events20:13:313
218677899241612,2401cyclictest2264071-21kworker/0:2+events23:25:560
218678999241412,2399cyclictest2215814-21kworker/3:2+events20:41:093
218678999241212,2397cyclictest2217447-21kworker/3:0+events21:13:263
218678999241112,2395cyclictest2291780-21kworker/3:0+events00:38:053
218678999241112,2395cyclictest2277587-21kworker/3:0+events00:16:463
218678999241112,2395cyclictest2244914-21kworker/3:1+events22:11:553
218678999241112,2395cyclictest2227629-21kworker/3:2+events21:17:533
218678999241010,2397cyclictest2197973-21kworker/3:0+events20:02:073
218677899241012,2394cyclictest2202761-21kworker/0:2+events20:06:410
218678999240812,2393cyclictest2257466-21kworker/3:0+events22:47:383
218678999240812,2392cyclictest2240079-21kworker/3:0+events21:52:563
218678999240810,2394cyclictest2210677-21kworker/3:1+events20:23:233
218677899240412,2389cyclictest2264071-21kworker/0:2+events23:23:180
218677899239912,2383cyclictest2207236-21kworker/0:1+events20:22:120
218678999239611,2381cyclictest2277587-21kworker/3:0+events00:13:443
218678399239311,2378cyclictest2248058-21kworker/1:2+events22:27:281
218677899239311,2379cyclictest2221039-21kworker/0:1+events20:58:580
218677899239311,2378cyclictest2270921-21kworker/0:1+events23:32:000
218677899239112,2376cyclictest2235508-21kworker/0:2+events22:01:370
218677899239112,2375cyclictest2259036-21kworker/0:1+events22:53:230
218678599239012,2374cyclictest2275626-21kworker/2:1+events00:04:142
218677899239012,2374cyclictest2288506-21kworker/0:0+events00:38:480
218678999238612,2370cyclictest2257466-21kworker/3:0+events22:54:103
218678999238510,2371cyclictest2199581-21kworker/3:2+events19:52:133
218677899238511,2371cyclictest2232241-21kworker/0:2+events21:29:440
218678999237912,2363cyclictest2268978-21kworker/3:1+events23:31:143
218678999237612,2360cyclictest2215814-21kworker/3:2+events20:52:513
218678999237412,2359cyclictest2187847-21kworker/3:1+events19:20:383
218678999236712,2351cyclictest2196332-21kworker/3:1+events19:41:353
218677899236212,2346cyclictest2235508-21kworker/0:2+events22:06:130
218678999235411,2340cyclictest2267310-21kworker/3:0+events23:18:423
218678999235312,2338cyclictest2246573-21kworker/3:0+events22:24:493
218678999235312,2337cyclictest2260667-21kworker/3:2+events23:21:463
218678999233310,2320cyclictest2204382-21kworker/3:1+events20:08:123
218678999233011,2315cyclictest2220917-21kworker/3:1+events20:58:123
218678999232912,2313cyclictest2189875-21kworker/3:0+events19:19:303
218678999232812,2314cyclictest2288566-21kworker/3:0+events00:23:363
218677899232811,2314cyclictest2233876-21kworker/0:1+events21:44:370
218678999232711,2313cyclictest2265663-21kworker/3:1+events23:13:433
218678999232711,2313cyclictest2265663-21kworker/3:1+events23:13:433
218678999232711,2312cyclictest2251503-21kworker/3:2+events22:43:493
218678599232712,2312cyclictest2275626-21kworker/2:1+events23:51:222
218678999232612,2312cyclictest2243277-21kworker/3:2+events22:05:053
218678999232612,2310cyclictest2285294-21kworker/3:1+events00:33:143
218678999232512,2310cyclictest2275740-21kworker/3:2+events23:48:453
218678999232512,2310cyclictest2251503-21kworker/3:2+events22:38:153
218678999232212,2307cyclictest2214192-21kworker/3:1+events20:38:543
218677899232212,2306cyclictest2217342-21kworker/0:0+events21:04:170
218678999232111,2307cyclictest2187847-21kworker/3:1+events19:29:263
218678999231412,2299cyclictest2193125-21kworker/3:0+events19:33:163
218677899231312,2298cyclictest2230662-21kworker/0:0+events21:30:530
218677899231210,2299cyclictest2186340-21kworker/0:1+events19:37:040
218678399230311,2289cyclictest2230812-21kworker/1:2+events21:32:481
218678399229510,2282cyclictest2212414-21kworker/1:0+events20:54:001
218677899227410,2261cyclictest2280691-21kworker/0:2+events00:19:020
218678999226011,2245cyclictest2246573-21kworker/3:0+events22:29:253
218678599225911,2244cyclictest2187906-21kworker/2:2+events19:13:562
218678399224012,2225cyclictest2188297-21kworker/1:3+events19:19:071
218678399223910,2225cyclictest2176633-21kworker/1:1+events19:13:091
218678399223510,2221cyclictest2287002-21kworker/1:1+events00:28:421
21867859922279,2214cyclictest2244881-21kworker/2:2+events22:44:592
218678599222111,2207cyclictest2256163-21kworker/2:1+events23:07:552
218678399218411,2169cyclictest2182944-21kworker/1:0+events19:24:251
218678999212611,2112cyclictest2183301-21kworker/3:2+events19:13:343
218678999211610,2102cyclictest2268978-21kworker/3:1+events23:28:353
218677899210611,2092cyclictest2280691-21kworker/0:2+events00:05:470
218677899210311,2089cyclictest2228977-21kworker/0:1+events21:21:190
218677899210311,2089cyclictest2228977-21kworker/0:1+events21:21:180
218677899209511,2080cyclictest2173453-21kworker/0:2+events19:12:480
218678999200810,1995cyclictest2259076-21kworker/3:1+events22:59:073
21861862148101,28sleep10-21swapper/119:06:081
21863392145110,29sleep30-21swapper/319:08:053
21861272145112,28sleep20-21swapper/219:05:242
21863162143112,26sleep00-21swapper/019:07:460
218678999241,9cyclictest2238765-21awk21:50:013
218677899179,4cyclictest2261699-21hddtemp_smartct23:00:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional