You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 16:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sat Jun 27, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
234234299520820,5181cyclictest2409581-21kworker/3:1+events22:40:193
234234299407617,4053cyclictest2390397-21kworker/3:1+events21:40:183
234233899403819,4008cyclictest2417660-21kworker/2:2+events23:15:172
234234299402020,3994cyclictest2438021-21kworker/3:0+events00:10:113
234234299369715,3677cyclictest2364562-21kworker/3:0+events20:30:163
234234299368318,3660cyclictest2348587-21kworker/3:0+events19:50:173
234234299363518,3611cyclictest2439890-21kworker/3:1+events00:15:123
234234299362616,3606cyclictest2420481-21kworker/3:1+events23:20:103
234234299362319,3599cyclictest2376093-21kworker/3:1+events20:55:193
234234299358715,3568cyclictest2427061-21kworker/3:2+events23:45:003
234234299341414,3394cyclictest2376093-21kworker/3:1+events21:00:133
234233899339915,3378cyclictest2358008-21kworker/2:1+events20:00:182
234234299338616,3364cyclictest2409581-21kworker/3:1+events23:00:183
234234299328115,3264cyclictest2404506-21kworker/3:0+events22:35:193
234233099321413,3197cyclictest2414392-21kworker/0:1+events22:55:200
234234299311915,3100cyclictest2374497-21kworker/3:0+events20:50:453
234233499306615,3046cyclictest2409490-21kworker/1:2+events22:41:291
234233899304214,3023cyclictest2404569-21kworker/2:1+events23:03:022
234233099303713,3020cyclictest2388109-21kworker/0:0+events21:47:090
234233499302413,3007cyclictest2416139-21kworker/1:3+events23:17:101
234233499302215,3005cyclictest2398505-21kworker/1:2+events22:25:231
234234299301115,2991cyclictest2432161-21kworker/3:0+events23:51:283
234234299297814,2959cyclictest2401265-21kworker/3:2+events22:21:593
234233899297110,2957cyclictest2397525-21kworker/2:1+events22:08:092
234233899296515,2948cyclictest2421645-21kworker/2:1+events23:20:332
234233499295814,2939cyclictest2374381-21kworker/1:0+events21:17:441
234233499294913,2932cyclictest2385496-21kworker/1:2+events21:24:171
234234299294014,2922cyclictest2348587-21kworker/3:0+events19:55:183
23423389929359,2922cyclictest2353561-21kworker/2:2+events20:23:062
23423309929240,2920cyclictest2404539-21kworker/0:2+events23:20:560
234233899292214,2904cyclictest2391990-21kworker/2:1+events21:44:292
234233899291914,2903cyclictest2382501-21kworker/2:0+events21:30:032
234233899291910,2905cyclictest2366504-21kworker/2:1+events20:42:462
234233899291814,2900cyclictest2359639-21kworker/2:0+events20:05:582
234233899291813,2901cyclictest2431743-21kworker/2:2+events23:55:182
234233899291714,2899cyclictest2397525-21kworker/2:1+events22:12:222
234233899291614,2896cyclictest2393617-21kworker/2:0+events21:54:442
234233899291514,2897cyclictest2395220-21kworker/2:2+events22:02:222
234233899291511,2900cyclictest2431743-21kworker/2:2+events23:49:562
234233099291413,2897cyclictest2350370-21kworker/0:2+events19:35:110
234233899290712,2890cyclictest2362960-21kworker/2:0+events20:29:072
234234299290614,2888cyclictest2379368-21kworker/3:2+events21:26:383
234233899290314,2887cyclictest2341770-21kworker/2:0+events19:25:452
234233899290213,2885cyclictest2382501-21kworker/2:0+events21:14:422
234234299289614,2878cyclictest2348587-21kworker/3:0+events19:37:513
234234299289014,2872cyclictest2443206-21kworker/3:1+events00:37:193
234234299289014,2872cyclictest2443206-21kworker/3:1+events00:37:193
234233899288713,2870cyclictest2358008-21kworker/2:1+events19:56:502
234233499288612,2870cyclictest2441589-21kworker/1:1+events00:22:061
234233899288213,2865cyclictest2385764-21kworker/2:2+events21:45:142
234234299288114,2866cyclictest2427061-21kworker/3:2+events23:48:493
234234299288114,2863cyclictest2390397-21kworker/3:1+events22:16:133
234234299287814,2860cyclictest2438021-21kworker/3:0+events00:34:173
234233499287811,2862cyclictest2343423-21kworker/1:2+events19:15:121
234234299287713,2860cyclictest2387193-21kworker/3:0+events21:38:473
234233499287714,2858cyclictest2419001-21kworker/1:0+events23:33:081
234233899287513,2858cyclictest2393617-21kworker/2:0+events21:57:052
234234299287314,2857cyclictest2379488-21kworker/3:3+events21:10:063
234233499287314,2856cyclictest2361544-21kworker/1:0+events20:27:141
234233499287314,2855cyclictest2359873-21kworker/1:1+events20:05:141
234234299287114,2853cyclictest2362838-21kworker/3:1+events20:23:513
234233899287114,2855cyclictest2414361-21kworker/2:0+events23:10:242
234233899287114,2855cyclictest2414361-21kworker/2:0+events23:10:232
234234299286714,2849cyclictest2415916-21kworker/3:2+events23:09:383
234234299286712,2851cyclictest2401265-21kworker/3:2+events22:27:423
234233499286714,2848cyclictest2395190-21kworker/1:0+events22:04:431
234234299286514,2847cyclictest2379488-21kworker/3:3+events21:06:383
234233499286514,2847cyclictest2443307-21kworker/1:2+events00:34:401
234233499286514,2847cyclictest2364321-21kworker/1:1+events20:17:041
234233499286514,2846cyclictest2347137-21kworker/1:0+events19:25:221
234233899286413,2847cyclictest2353561-21kworker/2:2+events19:51:502
234233499286411,2848cyclictest2427202-21kworker/1:3+events23:44:141
234233499286314,2845cyclictest2388736-21kworker/1:0+events21:33:471
234233499286214,2844cyclictest2423858-21kworker/1:1+events23:28:141
234233099286113,2844cyclictest2401235-21kworker/0:0+events22:14:170
234234299285713,2840cyclictest2417568-21kworker/3:0+events23:10:463
234234299285713,2840cyclictest2417568-21kworker/3:0+events23:10:453
23423429928557,2844cyclictest2361236-21kworker/3:0+events20:10:333
234233099285313,2836cyclictest2388109-21kworker/0:0+events21:51:150
234233099285214,2834cyclictest2379336-21kworker/0:1+events21:27:220
234233899284813,2831cyclictest2438232-21kworker/2:1+events00:28:372
234233099284314,2825cyclictest2428799-21kworker/0:0+events23:59:330
234233099284113,2824cyclictest2382293-21kworker/0:0+events21:12:000
234233499284014,2822cyclictest2374381-21kworker/1:0+events21:25:501
234233099284014,2822cyclictest2435010-21kworker/0:1+events00:02:340
234233099284014,2822cyclictest2359785-21kworker/0:2+events20:04:520
234233099283813,2821cyclictest2426944-21kworker/0:1+events23:33:320
234233099283614,2820cyclictest2379336-21kworker/0:1+events21:30:260
234233099283614,2818cyclictest2404539-21kworker/0:2+events22:47:170
234233099283412,2818cyclictest2404539-21kworker/0:2+events22:43:030
234234299283313,2815cyclictest2422138-21kworker/3:2+events23:19:273
234233099283113,2814cyclictest2441463-21kworker/0:1+events00:20:100
234233899282913,2812cyclictest2423642-21kworker/2:0+events23:31:392
234233099281611,2800cyclictest2376008-21kworker/0:2+events20:53:260
234233899281313,2796cyclictest2348500-21kworker/2:2+events19:32:322
234233099281213,2795cyclictest2363058-21kworker/0:2+events20:23:290
234234299281114,2793cyclictest2390397-21kworker/3:1+events21:55:313
234233099280915,2790cyclictest2361472-21kworker/0:0+events20:14:210
234233499280511,2790cyclictest2390334-21kworker/1:1+events21:39:101
234233499280414,2788cyclictest2364321-21kworker/1:1+events20:20:051
23423429928026,2792cyclictest2432161-21kworker/3:0+events23:58:013
234233099280113,2784cyclictest2354834-21kworker/0:1+events19:46:320
23423309928009,2787cyclictest2388109-21kworker/0:0+events21:58:340
234233099280012,2785cyclictest2404539-21kworker/0:2+events23:35:050
234233099279913,2782cyclictest2388109-21kworker/0:0+events21:44:090
234233099279813,2782cyclictest2404539-21kworker/0:2+events23:27:050
234234299279712,2780cyclictest2387193-21kworker/3:0+events21:31:373
234233899279712,2781cyclictest2351941-21kworker/2:0+events19:43:322
234233899279513,2777cyclictest2438232-21kworker/2:1+events00:19:492
234233099279413,2777cyclictest2404539-21kworker/0:2+events23:40:260
234233499279313,2776cyclictest2416139-21kworker/1:3+events23:13:491
234233499279313,2776cyclictest2416139-21kworker/1:3+events23:13:491
234233899278213,2765cyclictest2414361-21kworker/2:0+events22:57:362
234233099278213,2765cyclictest2406170-21kworker/0:0+events22:29:110
234233499277811,2763cyclictest2427202-21kworker/1:3+events23:46:331
234233499277113,2756cyclictest2369714-21kworker/1:3+events20:45:051
234233899277013,2753cyclictest2438232-21kworker/2:1+events00:14:492
234233499277014,2754cyclictest2379162-21kworker/1:1+events21:05:061
234233899276910,2755cyclictest2404569-21kworker/2:1+events22:45:212
234233099276714,2749cyclictest2416028-21kworker/0:0+events23:03:270
234233499276511,2750cyclictest2405087-21kworker/1:0+events22:34:331
234233099276514,2747cyclictest2404539-21kworker/0:2+events23:13:020
234233099276514,2747cyclictest2404539-21kworker/0:2+events23:13:020
234233899276313,2746cyclictest2429990-21kworker/2:0+events23:44:372
234233899276213,2745cyclictest2404569-21kworker/2:1+events22:51:332
234233899276113,2744cyclictest2374526-21kworker/2:0+events20:49:132
234233899276112,2745cyclictest2444727-21kworker/2:0+events00:38:522
234233899276112,2745cyclictest2444727-21kworker/2:0+events00:38:512
234233499276114,2743cyclictest2396793-21kworker/1:1+events22:08:551
234233899276013,2744cyclictest2401361-21kworker/2:2+events22:22:452
234233899276013,2743cyclictest2423642-21kworker/2:0+events23:29:012
234233899276013,2743cyclictest2401361-21kworker/2:2+events22:17:232
234233899276013,2743cyclictest2388681-21kworker/2:1+events21:36:312
234233899275913,2743cyclictest2404569-21kworker/2:1+events22:29:342
234233899275913,2742cyclictest2438232-21kworker/2:1+events00:30:302
234233899275913,2742cyclictest2406286-21kworker/2:0+events22:36:292
234233899275913,2742cyclictest2380775-21kworker/2:1+events21:19:412
234233899275913,2742cyclictest2370916-21kworker/2:2+events21:01:192
234234299275812,2742cyclictest2443206-21kworker/3:1+events00:25:573
234233899275813,2741cyclictest2411151-21kworker/2:2+events22:43:502
234233899275812,2743cyclictest2406286-21kworker/2:0+events22:34:562
234233899275713,2742cyclictest2382501-21kworker/2:0+events21:25:042
234233899275713,2740cyclictest2370916-21kworker/2:2+events20:51:092
234233899275712,2741cyclictest2353561-21kworker/2:2+events20:19:422
234233099275712,2741cyclictest2376008-21kworker/0:2+events21:05:520
234233899275613,2739cyclictest2433522-21kworker/2:0+events00:09:022
234233899275513,2739cyclictest2438232-21kworker/2:1+events00:22:302
234233899275513,2738cyclictest2350220-21kworker/2:1+events19:47:182
234233099275414,2736cyclictest2441463-21kworker/0:1+events00:38:290
234233099275414,2736cyclictest2441463-21kworker/0:1+events00:38:280
234233899275313,2738cyclictest2341770-21kworker/2:0+events19:20:292
234233899275313,2736cyclictest2428034-21kworker/2:1+events23:50:432
234234299275213,2735cyclictest2398088-21kworker/3:2+events22:04:203
234233899275110,2737cyclictest2350220-21kworker/2:1+events19:39:212
234233899275013,2733cyclictest2428034-21kworker/2:1+events23:37:222
234233499274913,2732cyclictest2395190-21kworker/1:0+events21:59:421
234234299274814,2730cyclictest2434707-21kworker/3:2+events00:02:593
234233899274813,2731cyclictest2382501-21kworker/2:0+events21:23:102
234233499274714,2729cyclictest2391961-21kworker/1:2+events21:52:251
234234299274211,2727cyclictest2401265-21kworker/3:2+events22:13:533
234233099273714,2719cyclictest2404539-21kworker/0:2+events22:53:490
23423429927349,2721cyclictest2409581-21kworker/3:1+events22:57:593
234233499273313,2715cyclictest2443307-21kworker/1:2+events00:28:141
234233499273013,2711cyclictest2348718-21kworker/1:1+events19:30:151
234233899272913,2712cyclictest2370916-21kworker/2:2+events21:07:012
234233099272713,2710cyclictest2350370-21kworker/0:2+events19:41:140
234234299272512,2709cyclictest2399677-21kworker/3:0+events22:07:453
234233899272313,2706cyclictest2431743-21kworker/2:2+events00:00:192
234234299272113,2704cyclictest2425401-21kworker/3:1+events23:28:373
234234299271912,2703cyclictest2423796-21kworker/3:0+events23:38:333
234234299271813,2701cyclictest2409581-21kworker/3:1+events22:45:453
234234299271613,2699cyclictest2364562-21kworker/3:0+events20:25:253
234234299271514,2697cyclictest2383892-21kworker/3:0+events21:18:083
234233899271413,2697cyclictest2366504-21kworker/2:1+events20:31:032
234234299271213,2697cyclictest2390397-21kworker/3:1+events21:50:093
234233499271212,2697cyclictest2407885-21kworker/1:1+events22:39:581
23423429927118,2699cyclictest2345580-21kworker/3:2+events19:20:513
234234299271113,2694cyclictest2353444-21kworker/3:1+events19:47:413
234234299271113,2694cyclictest2350190-21kworker/3:2+events19:33:193
234234299271113,2693cyclictest2414332-21kworker/3:0+events22:54:573
23423349927116,2701cyclictest2361544-21kworker/1:0+events20:12:271
234233899271013,2695cyclictest2414361-21kworker/2:0+events23:05:012
234233499271013,2693cyclictest2354084-21kworker/1:2+events19:46:091
234234299270913,2692cyclictest2356676-21kworker/3:1+events20:01:503
234234299270912,2693cyclictest2353444-21kworker/3:1+events19:43:543
23423349927097,2696cyclictest2433311-21kworker/1:1+events00:01:281
234233499270913,2692cyclictest2433311-21kworker/1:1+events00:10:361
234233499270912,2693cyclictest2416139-21kworker/1:3+events23:06:581
23423429927088,2697cyclictest2404506-21kworker/3:0+events22:32:593
234234299270813,2691cyclictest2364562-21kworker/3:0+events20:35:133
234233499270812,2692cyclictest2361544-21kworker/1:0+events20:32:111
234233499270811,2693cyclictest2416010-21kworker/1:1+events23:01:061
234234299270713,2690cyclictest2374497-21kworker/3:0+events20:48:503
234234299270713,2690cyclictest2358282-21kworker/3:2+events20:09:233
234234299270713,2690cyclictest2343570-21kworker/3:1+events19:29:523
234234299270712,2691cyclictest2362838-21kworker/3:1+events20:43:313
234233899270713,2690cyclictest2370916-21kworker/2:2+events20:55:422
234233499270713,2690cyclictest2354084-21kworker/1:2+events19:56:271
234234299270613,2689cyclictest2392079-21kworker/3:2+events21:48:133
234234299270513,2688cyclictest2441494-21kworker/3:2+events00:20:583
234234299270513,2687cyclictest2438021-21kworker/3:0+events00:08:183
23423349927055,2697cyclictest2443307-21kworker/1:2+events00:38:061
23423349927055,2697cyclictest2443307-21kworker/1:2+events00:38:061
234233499270511,2690cyclictest2374381-21kworker/1:0+events20:54:561
234233499270411,2689cyclictest2407885-21kworker/1:1+events22:52:421
234233499270013,2683cyclictest2433311-21kworker/1:1+events23:57:361
234234299269913,2682cyclictest2362838-21kworker/3:1+events20:18:553
234233499269913,2682cyclictest2441589-21kworker/1:1+events00:19:031
234233499269913,2682cyclictest2427202-21kworker/1:3+events23:53:001
234233499269813,2681cyclictest2388736-21kworker/1:0+events21:43:211
234233499269713,2680cyclictest2380835-21kworker/1:2+events21:12:471
234233499269712,2681cyclictest2398505-21kworker/1:2+events22:11:351
234233499269613,2679cyclictest2393586-21kworker/1:1+events21:49:471
234233499269612,2681cyclictest2414422-21kworker/1:0+events22:55:421
234233499269513,2678cyclictest2347137-21kworker/1:0+events19:37:291
234233499269313,2676cyclictest2412758-21kworker/1:2+events22:48:501
234233099269313,2676cyclictest2428799-21kworker/0:0+events23:54:090
234233099268513,2668cyclictest2398421-21kworker/0:2+events22:06:580
234233099268513,2668cyclictest2367983-21kworker/0:1+events20:38:160
234233499268412,2668cyclictest2369439-21kworker/1:1+events20:35:341
234233099268413,2667cyclictest2404539-21kworker/0:2+events23:07:210
234233099268412,2668cyclictest2377661-21kworker/0:0+events21:02:480
234233099268313,2666cyclictest2404539-21kworker/0:2+events22:23:320
234233099268213,2665cyclictest2401235-21kworker/0:0+events22:16:370
234233099268113,2664cyclictest2435010-21kworker/0:1+events00:06:020
234233099268113,2664cyclictest2373935-21kworker/0:1+events20:56:490
234233099268113,2664cyclictest2340258-21kworker/0:0+events19:18:140
234233499268013,2663cyclictest2379162-21kworker/1:1+events21:02:261
234233099268013,2663cyclictest2428799-21kworker/0:0+events23:47:400
234233099268013,2663cyclictest2373935-21kworker/0:1+events20:48:290
234233099267913,2662cyclictest2358132-21kworker/0:1+events19:59:110
234233099267813,2661cyclictest2345373-21kworker/0:1+events19:22:190
234233099267713,2660cyclictest2358132-21kworker/0:1+events20:09:470
234233899267611,2661cyclictest2343454-21kworker/2:2+events19:13:202
234233099267613,2659cyclictest2363058-21kworker/0:2+events20:16:170
234233099267513,2658cyclictest2367983-21kworker/0:1+events20:31:480
234233499267413,2657cyclictest2427202-21kworker/1:3+events23:37:011
234233099267113,2654cyclictest2371472-21kworker/0:2+events20:44:420
234233099267112,2655cyclictest2347050-21kworker/0:2+events19:26:070
234233499267013,2653cyclictest2345493-21kworker/1:1+events19:21:351
234234299266711,2652cyclictest2379368-21kworker/3:2+events21:22:463
234234299266512,2649cyclictest2343570-21kworker/3:1+events19:15:573
234234299266412,2648cyclictest2427061-21kworker/3:2+events23:34:433
234233099266412,2648cyclictest2441463-21kworker/0:1+events00:33:550
234233499265813,2641cyclictest2354084-21kworker/1:2+events19:53:001
234233099265812,2642cyclictest2428799-21kworker/0:0+events00:16:440
234234299265613,2639cyclictest2338582-21kworker/3:0+events19:13:413
234233499265513,2638cyclictest2398505-21kworker/1:2+events22:21:361
23423349926537,2643cyclictest2398505-21kworker/1:2+events22:18:581
234233499265313,2637cyclictest2354084-21kworker/1:2+events20:04:291
234233499265113,2634cyclictest2416139-21kworker/1:3+events23:21:431
234233099265013,2633cyclictest2390186-21kworker/0:2+events21:36:540
23423349926499,2637cyclictest2369714-21kworker/1:3+events20:40:521
234233499264913,2632cyclictest2438052-21kworker/1:2+events00:09:481
23423309926459,2632cyclictest2382293-21kworker/0:0+events21:15:490
234233099264213,2625cyclictest2408033-21kworker/0:1+events22:37:170
234233099263813,2622cyclictest2396705-21kworker/0:1+events22:00:040
234233099263811,2623cyclictest2379336-21kworker/0:1+events21:20:270
234233099263411,2620cyclictest2404539-21kworker/0:2+events22:33:240
234233499261412,2598cyclictest2376239-21kworker/1:2+events20:57:341
23423389924879,2475cyclictest2370916-21kworker/2:2+events20:39:212
234233899248511,2470cyclictest2353561-21kworker/2:2+events20:13:372
234233099248211,2467cyclictest2363058-21kworker/0:2+events20:28:440
23423389924809,2468cyclictest2343454-21kworker/2:2+events19:15:362
234233499242612,2410cyclictest2351911-21kworker/1:1+events19:41:381
234233499242512,2409cyclictest2330874-21kworker/1:0+events19:14:261
234233099241812,2402cyclictest2350370-21kworker/0:2+events19:51:260
234233099238112,2365cyclictest2428799-21kworker/0:0+events00:11:210
234233099237511,2360cyclictest2348761-21kworker/0:0+events19:34:270
23423309919938,1982cyclictest2326027-21kworker/0:2+events19:11:000
23407032147111,31sleep00-21swapper/019:05:080
23418282145110,30sleep20-21swapper/219:07:262
23418292141107,27sleep30-21swapper/319:07:273
23417642141110,26sleep10-21swapper/119:06:371
2342330992712,11cyclictest2422439-21awk23:20:010
234233099209,7cyclictest2443186-21kworker/u16:0-events_unbound00:29:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional