You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 08:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Wed Sep 16, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293125399335316,3332cyclictest2988258-21kworker/3:1+events22:10:183
293125399310714,3088cyclictest2971913-21kworker/3:0+events21:15:173
293124399303014,3012cyclictest2963628-21kworker/0:0+events20:50:000
29312439929045,2894cyclictest3002936-21kworker/0:2+events23:00:150
293125399285714,2838cyclictest2945778-21kworker/3:0+events19:55:193
293124399285214,2834cyclictest2994707-21kworker/0:2+events22:30:130
293125199282213,2806cyclictest2958577-21kworker/2:2+events20:45:012
293124399281114,2793cyclictest3035401-21kworker/0:2+events00:30:150
293125199278713,2770cyclictest3004394-21kworker/2:2+events22:55:202
293124399275610,2741cyclictest2963628-21kworker/0:0+events21:25:130
293124699274613,2731cyclictest3033975-21kworker/1:2+events00:25:151
293124699273513,2718cyclictest2934455-21kworker/1:0+events19:30:201
293124699271611,2701cyclictest2994270-21kworker/1:2+events22:43:321
293125199271510,2701cyclictest2989855-21kworker/2:2+events22:20:142
293125399271113,2694cyclictest2994567-21kworker/3:1+events22:25:113
293124699271113,2694cyclictest3012539-21kworker/1:1+events23:27:521
293124699271113,2694cyclictest2947672-21kworker/1:2+events20:11:401
293124399271113,2696cyclictest2963628-21kworker/0:0+events20:55:010
293124399269213,2676cyclictest2949055-21kworker/0:2+events20:25:190
293125399268213,2665cyclictest3019256-21kworker/3:1+events23:55:133
293125199267613,2659cyclictest2949083-21kworker/2:2+events20:20:202
293125199267611,2661cyclictest3001139-21kworker/2:0+events22:45:482
293124399266213,2645cyclictest3006486-21kworker/0:1+events23:26:430
293124399265313,2636cyclictest3017307-21kworker/0:0+events23:33:330
293124399264713,2631cyclictest2983012-21kworker/0:0+events21:57:450
293125199262813,2611cyclictest2989855-21kworker/2:2+events22:15:162
293125199262213,2607cyclictest3012766-21kworker/2:1+events23:25:162
293125199261911,2604cyclictest3022273-21kworker/2:2+events23:57:062
293124699260312,2589cyclictest2970548-21kworker/1:2+events21:20:151
29312519925790,2575cyclictest2971840-21kworker/2:1+events21:34:042
293125199257712,2562cyclictest3007665-21kworker/2:1+events23:11:142
293125199257712,2561cyclictest2995857-21kworker/2:1+events22:32:292
293125199257612,2562cyclictest2963652-21kworker/2:1+events21:05:022
293125199257612,2561cyclictest3012766-21kworker/2:1+events23:37:182
293125199257412,2559cyclictest2976737-21kworker/2:0+events21:27:322
293125199257012,2554cyclictest2970206-21kworker/2:2+events21:10:242
293124699256711,2553cyclictest2959938-21kworker/1:1+events20:49:371
293125199256612,2550cyclictest3001139-21kworker/2:0+events22:44:402
293125199255412,2538cyclictest2970206-21kworker/2:2+events21:16:042
293125199255212,2536cyclictest2949083-21kworker/2:2+events20:19:132
293125199255011,2536cyclictest3022273-21kworker/2:2+events00:01:592
293125199253912,2524cyclictest3020682-21kworker/2:0+events23:46:072
293124699253912,2525cyclictest2975062-21kworker/1:0+events21:35:141
293125399253013,2514cyclictest2956823-21kworker/3:0+events20:35:373
293125199252412,2508cyclictest3012766-21kworker/2:1+events23:41:332
293124399252112,2506cyclictest3017307-21kworker/0:0+events23:40:470
293124699251512,2500cyclictest2986096-21kworker/1:0+events21:56:371
293125199251012,2495cyclictest2949083-21kworker/2:2+events20:14:402
293124699250411,2490cyclictest2991429-21kworker/1:1+events22:20:381
29312519925000,2496cyclictest3012766-21kworker/2:1+events23:19:372
293125199249912,2484cyclictest2939686-21kworker/2:0+events19:44:222
293124699249412,2479cyclictest3032199-21kworker/1:1+events00:21:251
293124699249411,2479cyclictest2952083-21kworker/1:0+events20:32:361
293125199248610,2472cyclictest2944230-21kworker/2:2+events19:51:132
293125199248512,2469cyclictest2984794-21kworker/2:1+events21:58:072
293125199248511,2470cyclictest3030473-21kworker/2:1+events00:16:072
293124699248511,2470cyclictest3038445-21kworker/1:1+events00:39:121
293125399248411,2469cyclictest2960144-21kworker/3:2+events20:41:153
293125199248312,2468cyclictest2944230-21kworker/2:2+events19:56:522
29312469924829,2469cyclictest2988137-21kworker/1:2+events22:08:471
293125199248113,2464cyclictest3025889-21kworker/2:3+events00:05:262
293125199248112,2465cyclictest2955357-21kworker/2:0+events20:26:062
293125199248012,2465cyclictest2939686-21kworker/2:0+events19:37:112
293124699248012,2465cyclictest2991429-21kworker/1:1+events22:17:581
293124699248012,2464cyclictest2994270-21kworker/1:2+events22:25:571
293124699248010,2466cyclictest2994270-21kworker/1:2+events22:37:061
293125199247911,2465cyclictest2986382-21kworker/2:0+events22:04:192
293125199247812,2463cyclictest2958577-21kworker/2:2+events20:54:372
293125199247812,2462cyclictest2975088-21kworker/2:2+events21:23:202
293125199247512,2459cyclictest2988246-21kworker/2:1+events22:07:392
293124399247413,2457cyclictest2925971-21kworker/0:3+events19:25:450
293124399247112,2456cyclictest2963628-21kworker/0:0+events21:08:080
293125399247012,2455cyclictest2961796-21kworker/3:0+events20:48:503
293124699247012,2454cyclictest2978327-21kworker/1:2+events21:41:211
293124699246610,2452cyclictest2973419-21kworker/1:1+events21:30:391
293124699246512,2449cyclictest2918201-21kworker/1:2+events19:16:141
293124399246510,2452cyclictest2939227-21kworker/0:0+events19:40:130
293125199246312,2448cyclictest2936241-21kworker/2:0+events19:27:392
293125399245912,2445cyclictest3025531-21kworker/3:2+events00:05:043
29312439924598,2448cyclictest3020671-21kworker/0:1+events23:46:300
293124699245210,2439cyclictest2984171-21kworker/1:2+events21:51:381
293124399245212,2437cyclictest2939227-21kworker/0:0+events19:36:480
293124699245112,2436cyclictest2965311-21kworker/1:2+events20:53:061
293124399245112,2436cyclictest3001276-21kworker/0:1+events22:53:280
293124399245111,2438cyclictest2978577-21kworker/0:2+events21:40:110
293124399244912,2433cyclictest2945807-21kworker/0:0+events20:08:110
293124399244711,2432cyclictest2983012-21kworker/0:0+events22:03:550
293124399244410,2431cyclictest2983012-21kworker/0:0+events22:18:430
293125399244011,2426cyclictest2986367-21kworker/3:0+events22:00:023
293124699243711,2422cyclictest2947672-21kworker/1:2+events20:05:301
293124399243510,2422cyclictest3033705-21kworker/0:1+events00:21:470
293124399243412,2418cyclictest2973511-21kworker/0:1+events21:22:100
293124399243212,2416cyclictest2958418-21kworker/0:1+events20:32:570
293124399243212,2416cyclictest2949055-21kworker/0:2+events21:01:110
293124399243211,2418cyclictest3025441-21kworker/0:2+events23:59:420
293124699242712,2411cyclictest3010481-21kworker/1:2+events23:13:091
293124399242612,2410cyclictest2963628-21kworker/0:0+events21:19:530
293124399242612,2410cyclictest2947434-21kworker/0:1+events19:58:450
293125399242512,2409cyclictest3030502-21kworker/3:0+events00:12:203
293125399242412,2408cyclictest3006196-21kworker/3:0+events23:03:143
293125399242411,2409cyclictest2981528-21kworker/3:2+events21:51:153
293125399242312,2409cyclictest3014500-21kworker/3:0+events23:32:253
293125399242212,2407cyclictest2981528-21kworker/3:2+events21:46:203
29312469924219,2408cyclictest2979935-21kworker/1:1+events21:47:041
293125399242012,2405cyclictest3012603-21kworker/3:1+events23:26:213
293125399241712,2401cyclictest2970308-21kworker/3:2+events21:07:213
293124399241512,2399cyclictest3025441-21kworker/0:2+events00:06:130
293124699241411,2399cyclictest3006077-21kworker/1:0+events23:21:301
293125199241012,2394cyclictest2989855-21kworker/2:2+events22:35:112
293125399240811,2394cyclictest2947404-21kworker/3:2+events20:02:323
29312539924079,2394cyclictest2973647-21kworker/3:2+events21:28:183
29312519924068,2395cyclictest2958577-21kworker/2:2+events20:39:462
29312469924067,2395cyclictest2961589-21kworker/1:2+events20:43:561
293124699240612,2390cyclictest2934455-21kworker/1:0+events19:36:251
293124699240512,2390cyclictest3024081-21kworker/1:2+events23:55:581
293124699240412,2389cyclictest3015822-21kworker/1:0+events23:35:261
293124699240412,2388cyclictest2934455-21kworker/1:0+events19:57:141
293124699240312,2388cyclictest2994270-21kworker/1:2+events22:46:361
293124699240212,2386cyclictest3036829-21kworker/1:0+events00:32:071
293124699240210,2388cyclictest2970548-21kworker/1:2+events21:13:261
293124699240112,2387cyclictest2952083-21kworker/1:0+events20:36:011
293124699240112,2386cyclictest2988137-21kworker/1:2+events22:12:131
293124699240112,2385cyclictest2975062-21kworker/1:0+events21:29:531
293124399240112,2386cyclictest2999593-21kworker/0:0+events22:44:180
293125399240012,2385cyclictest3017365-21kworker/3:2+events23:36:333
293124699240012,2384cyclictest3007753-21kworker/1:1+events23:06:181
293124699240011,2385cyclictest3002997-21kworker/1:1+events22:52:421
293124699239912,2383cyclictest3020880-21kworker/1:1+events23:52:341
293124699239912,2383cyclictest2965311-21kworker/1:2+events20:57:191
293124699239812,2383cyclictest3024081-21kworker/1:2+events00:13:041
293124699239812,2383cyclictest2952083-21kworker/1:0+events20:23:471
293124699239612,2381cyclictest2994270-21kworker/1:2+events22:34:011
293124399239612,2380cyclictest3029021-21kworker/0:0+events00:38:030
293124699239512,2381cyclictest2994270-21kworker/1:2+events22:58:211
293124699239512,2380cyclictest2947672-21kworker/1:2+events20:16:341
293124699239312,2378cyclictest3030594-21kworker/1:0+events00:17:161
293124399239311,2378cyclictest2983012-21kworker/0:0+events21:50:530
293125199239211,2377cyclictest2929305-21kworker/2:0+events19:12:472
293125199239112,2376cyclictest2947476-21kworker/2:0+events20:03:372
293125199239112,2375cyclictest2960160-21kworker/2:1+events20:43:332
293125399238912,2374cyclictest2965219-21kworker/3:1+events20:59:403
293124399238312,2368cyclictest2963628-21kworker/0:0+events21:32:550
293125399238012,2364cyclictest3007816-21kworker/3:2+events23:14:163
293125399237812,2363cyclictest2981528-21kworker/3:2+events21:59:163
293124399237812,2362cyclictest2983012-21kworker/0:0+events21:48:340
29312439923778,2365cyclictest2945807-21kworker/0:0+events20:03:160
29312439923748,2362cyclictest2994707-21kworker/0:2+events22:26:210
293124399237311,2358cyclictest2949055-21kworker/0:2+events20:14:190
293125399237212,2356cyclictest2973647-21kworker/3:2+events21:32:093
293125399236312,2349cyclictest2952177-21kworker/3:2+events20:15:023
293124699236311,2349cyclictest3006077-21kworker/1:0+events23:04:221
29312439923639,2351cyclictest2971791-21kworker/0:2+events21:13:490
293124399236312,2348cyclictest3009031-21kworker/0:0+events23:07:050
293124699236212,2347cyclictest2970548-21kworker/1:2+events21:18:211
293124399236212,2346cyclictest3006486-21kworker/0:1+events23:17:430
293124399236112,2345cyclictest3006486-21kworker/0:1+events23:21:530
293124399236111,2347cyclictest2999593-21kworker/0:0+events22:39:220
293124399235912,2343cyclictest3020671-21kworker/0:1+events23:54:500
293124699235710,2345cyclictest2968852-21kworker/1:1+events21:05:461
293125199235512,2339cyclictest2939686-21kworker/2:0+events19:48:112
293124699235511,2341cyclictest2934455-21kworker/1:0+events19:54:561
293125399235412,2340cyclictest2926118-21kworker/3:1+events19:20:273
293124399235311,2339cyclictest3029021-21kworker/0:0+events00:10:260
293125399235012,2334cyclictest2999562-21kworker/3:2+events22:54:133
293125199234711,2333cyclictest2983195-21kworker/2:0+events21:49:202
293124399234712,2332cyclictest2950716-21kworker/0:1+events20:15:480
293124399234612,2332cyclictest2978577-21kworker/0:2+events21:36:460
293125199234211,2327cyclictest3007665-21kworker/2:1+events23:08:132
293124399234211,2328cyclictest2958418-21kworker/0:1+events20:43:100
293125399234112,2326cyclictest2999562-21kworker/3:2+events22:43:543
293124399234112,2326cyclictest2949055-21kworker/0:2+events20:51:550
293125399234011,2326cyclictest2960144-21kworker/3:2+events21:00:263
293124399234012,2325cyclictest3017307-21kworker/0:0+events00:00:260
293124399234012,2325cyclictest2989821-21kworker/0:1+events22:24:480
293124399234012,2324cyclictest3004597-21kworker/0:0+events22:56:070
293125399233912,2324cyclictest2952177-21kworker/3:2+events20:21:063
293124399233912,2324cyclictest2932590-21kworker/0:1+events19:16:380
293124399233911,2324cyclictest3001276-21kworker/0:1+events22:46:110
293124399233812,2322cyclictest3029021-21kworker/0:0+events00:27:330
293125399233712,2321cyclictest3019256-21kworker/3:1+events00:03:083
293125199233710,2323cyclictest2989855-21kworker/2:2+events22:11:272
293125399233612,2321cyclictest2965219-21kworker/3:1+events20:53:283
293124399233610,2324cyclictest2934608-21kworker/0:0+events19:20:060
293124399233311,2318cyclictest2941542-21kworker/0:1+events19:48:340
293125399233112,2315cyclictest3032163-21kworker/3:1+events00:38:493
293124399233111,2317cyclictest2954000-21kworker/0:0+events20:24:320
293124699233011,2315cyclictest2952083-21kworker/1:0+events20:26:541
29312539923298,2318cyclictest3006196-21kworker/3:0+events23:15:483
293125399232912,2314cyclictest3019256-21kworker/3:1+events23:51:033
293125199232912,2315cyclictest2947476-21kworker/2:0+events20:05:062
29312539923288,2316cyclictest2939932-21kworker/3:0+events19:42:053
293125199232812,2312cyclictest2995857-21kworker/2:1+events22:26:442
293125399232712,2312cyclictest3014500-21kworker/3:0+events23:43:043
293125399232712,2311cyclictest2997699-21kworker/3:0+events22:31:223
293124399232712,2312cyclictest2943820-21kworker/0:2+events19:52:190
293125399232612,2310cyclictest3032163-21kworker/3:1+events00:19:303
293125399232611,2313cyclictest3001216-21kworker/3:0+events22:45:033
293125399232511,2311cyclictest2999562-21kworker/3:2+events22:55:443
293125399232511,2311cyclictest2975420-21kworker/3:1+events21:42:523
293124399232512,2310cyclictest3006486-21kworker/0:1+events23:12:230
293125199232412,2309cyclictest3012766-21kworker/2:1+events23:23:252
293125199232412,2308cyclictest3037049-21kworker/2:2+events00:37:172
29312539923238,2312cyclictest2926118-21kworker/3:1+events19:17:473
293125399232312,2309cyclictest2937742-21kworker/3:1+events19:35:143
293125399232311,2308cyclictest3006196-21kworker/3:0+events23:09:213
293125199232312,2308cyclictest2937844-21kworker/2:2+events19:30:432
293125199232212,2306cyclictest2978333-21kworker/2:2+events21:37:332
293125199232212,2306cyclictest2958577-21kworker/2:2+events20:59:162
293125399232112,2306cyclictest3032163-21kworker/3:1+events00:34:003
293125199231811,2303cyclictest2978333-21kworker/2:2+events21:54:192
293125199231711,2303cyclictest3005988-21kworker/2:0+events23:00:382
293125199231710,2303cyclictest3023873-21kworker/2:1+events23:52:132
293125199231612,2302cyclictest3027938-21kworker/2:0+events00:10:022
293125399231512,2299cyclictest2970308-21kworker/3:2+events21:11:093
293124699231412,2299cyclictest2934455-21kworker/1:0+events19:23:271
293125399230911,2294cyclictest3033824-21kworker/3:2+events00:23:183
293124399230910,2296cyclictest2983012-21kworker/0:0+events22:09:310
293125199230812,2293cyclictest2967375-21kworker/2:0+events21:02:222
293124399230410,2291cyclictest2949055-21kworker/0:2+events20:38:160
293124699229712,2282cyclictest3024081-21kworker/1:2+events00:04:411
29312539922936,2284cyclictest2945778-21kworker/3:0+events20:06:393
293125399229011,2275cyclictest2979752-21kworker/3:0+events21:39:013
293124699228610,2273cyclictest3020880-21kworker/1:1+events23:48:451
293124399228510,2272cyclictest2939227-21kworker/0:0+events19:34:510
293125399228111,2267cyclictest2944178-21kworker/3:1+events19:51:573
293125399228110,2267cyclictest3032163-21kworker/3:1+events00:29:063
293125399226311,2249cyclictest2994567-21kworker/3:1+events22:35:573
293125199225710,2242cyclictest2934641-21kworker/2:2+events19:21:342
293125399224510,2231cyclictest2992825-21kworker/3:0+events22:24:253
293125199224511,2231cyclictest3035424-21kworker/2:0+events00:32:312
293124399223411,2220cyclictest3030923-21kworker/0:2+events00:18:020
293125399222511,2211cyclictest3020968-21kworker/3:2+events23:48:013
293124699222110,2208cyclictest2934455-21kworker/1:0+events19:26:301
293124699221110,2198cyclictest2965311-21kworker/1:2+events21:00:491
293125399220310,2190cyclictest2937742-21kworker/3:1+events19:29:363
293124699220210,2189cyclictest3012539-21kworker/1:1+events23:31:181
29312469922019,2188cyclictest2934455-21kworker/1:0+events20:02:101
29312469922009,2188cyclictest2942663-21kworker/1:1+events19:44:451
293124699219911,2185cyclictest2934455-21kworker/1:0+events19:48:581
293124699219810,2185cyclictest2932413-21kworker/1:1+events19:13:111
293124699219611,2181cyclictest2979935-21kworker/1:1+events22:03:081
293124699219410,2181cyclictest3018352-21kworker/1:2+events23:43:291
29312519921778,2166cyclictest2979963-21kworker/2:0+events21:43:152
293125199214510,2133cyclictest3001139-21kworker/2:0+events22:50:252
293124399214011,2126cyclictest3017307-21kworker/0:0+events23:36:570
293125399213712,2121cyclictest2944178-21kworker/3:1+events19:49:213
293125399213711,2122cyclictest2952177-21kworker/3:2+events20:26:293
293124399213611,2122cyclictest2983012-21kworker/0:0+events22:13:210
293125399212710,2113cyclictest2950504-21kworker/3:1+events20:10:533
293125399212710,2113cyclictest2935963-21kworker/3:2+events19:31:543
293125399212610,2113cyclictest3007816-21kworker/3:2+events23:21:083
293124699212611,2112cyclictest3006077-21kworker/1:0+events23:16:351
293125199211711,2104cyclictest2929305-21kworker/2:0+events19:15:072
293125199211210,2100cyclictest3014465-21kworker/2:2+events23:30:072
293125399210911,2094cyclictest2990125-21kworker/3:2+events22:17:343
29312519921065,2098cyclictest3033796-21kworker/2:2+events00:24:052
29312539921059,2093cyclictest2952177-21kworker/3:2+events20:31:053
29312539921039,2091cyclictest2926118-21kworker/3:1+events19:12:263
29312519920998,2088cyclictest2956969-21kworker/2:1+events20:31:522
293125199209210,2079cyclictest3035424-21kworker/2:0+events00:29:302
293124399206210,2049cyclictest2932590-21kworker/0:1+events19:14:440
29309412161120,24sleep30-21swapper/319:08:543
29307492154113,24sleep10-21swapper/119:06:281
29309792143108,30sleep00-21swapper/019:09:230
29308552139102,32sleep20-21swapper/219:07:492
2931253991811,5cyclictest2989891-21awk22:10:013
2931246991615,1cyclictest24650irq/134-xhci_hcd00:09:391
2931253991514,1cyclictest26450irq/143-i91521:22:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional