You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 06:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Aug 20, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
274806999310615,3086cyclictest2804446-21kworker/3:0+events22:10:143
274806499309815,3079cyclictest2775691-21kworker/1:1+events20:35:011
274806999302612,3010cyclictest2784286-21kworker/3:0+events21:04:133
274806699301815,2998cyclictest2812335-21kworker/2:0+events22:30:182
27480669929159,2901cyclictest2846215-21kworker/2:1+events00:15:142
274806499291314,2893cyclictest2828046-21kworker/1:2+events23:25:131
274805999286313,2845cyclictest2786797-21kworker/0:0+events21:10:190
274806999286114,2843cyclictest2759272-21kworker/3:2+events19:45:163
274806999283812,2822cyclictest2831439-21kworker/3:1+events23:30:093
274806499280813,2792cyclictest2833315-21kworker/1:0+events23:50:121
274805999280013,2783cyclictest2828229-21kworker/0:0+events00:02:460
274806999279713,2780cyclictest2760932-21kworker/3:0+events20:06:053
274806499277213,2755cyclictest2780590-21kworker/1:3+events21:05:221
274806499275513,2737cyclictest2823532-21kworker/1:2+events23:05:141
274806499274413,2727cyclictest2807497-21kworker/1:2+events22:25:211
274806499274413,2727cyclictest2807497-21kworker/1:2+events22:25:201
274806699273014,2711cyclictest2751576-21kworker/2:2+events19:20:122
274806699272615,2707cyclictest2756112-21kworker/2:2+events19:40:442
274806499271013,2693cyclictest2761528-21kworker/1:1+events20:00:201
274806499270313,2686cyclictest2833315-21kworker/1:0+events23:49:481
274806499269913,2682cyclictest2793242-21kworker/1:2+events21:29:371
274805999269213,2675cyclictest2842957-21kworker/0:2+events00:10:000
274806699268913,2673cyclictest2790022-21kworker/2:2+events21:35:142
274806499268812,2672cyclictest2849299-21kworker/1:1+events00:25:551
274806499268411,2669cyclictest2843072-21kworker/1:2+events00:16:441
274806499267712,2661cyclictest2818107-21kworker/1:2+events22:53:531
274806699267413,2657cyclictest2782794-21kworker/2:1+events21:42:242
274806999266711,2652cyclictest2833111-21kworker/3:2+events23:40:343
274806699266613,2649cyclictest2815698-21kworker/2:3+events22:51:382
274806999266511,2650cyclictest2812184-21kworker/3:1+events22:42:053
274806999266413,2649cyclictest2802731-21kworker/3:1+events22:05:173
274806499266312,2647cyclictest2765750-21kworker/1:2+events20:13:411
274806499265814,2641cyclictest2820283-21kworker/1:0+events23:02:171
274806699264913,2632cyclictest2820108-21kworker/2:0+events23:04:082
274806699264113,2624cyclictest2754388-21kworker/2:1+events19:33:112
274806999264013,2623cyclictest2780187-21kworker/3:0+events20:52:463
274806699264013,2623cyclictest2756112-21kworker/2:2+events19:38:282
274806699263713,2620cyclictest2784957-21kworker/2:0+events21:01:362
274805999263713,2620cyclictest2846240-21kworker/0:0+events00:26:400
274805999263613,2621cyclictest2793188-21kworker/0:0+events21:30:210
274805999262912,2615cyclictest2852466-21kworker/0:1+events00:35:450
274806999261912,2603cyclictest2812184-21kworker/3:1+events22:26:513
274806999261912,2603cyclictest2812184-21kworker/3:1+events22:26:513
274806499261313,2596cyclictest2841294-21kworker/1:0+events00:03:541
274806699261112,2596cyclictest2767379-21kworker/2:1+events20:24:232
274806699258312,2567cyclictest2846215-21kworker/2:1+events00:24:052
274806499257912,2563cyclictest2805837-21kworker/1:1+events22:07:111
274806499256813,2551cyclictest2749409-21kworker/1:0+events19:15:161
274806699255713,2540cyclictest2812335-21kworker/2:0+events22:35:142
274805999255712,2540cyclictest2772601-21kworker/0:0+events20:31:340
274806999255512,2539cyclictest2744584-21kworker/3:2+events19:20:593
274806999255413,2537cyclictest2824865-21kworker/3:0+events23:07:073
274806699255412,2538cyclictest2810616-21kworker/2:1+events22:24:582
274806499253712,2523cyclictest2843072-21kworker/1:2+events00:10:221
274806999253510,2521cyclictest2799438-21kworker/3:1+events21:47:473
274806699253213,2515cyclictest2836691-21kworker/2:0+events23:58:092
274805999253013,2514cyclictest2794817-21kworker/0:2+events21:40:520
274806999252211,2507cyclictest2807673-21kworker/3:2+events22:15:273
27480699925175,2508cyclictest2752786-21kworker/3:0+events19:41:073
274806999251112,2495cyclictest2789784-21kworker/3:2+events21:52:423
274806699250611,2492cyclictest2826681-21kworker/2:0+events23:22:352
274806699250112,2486cyclictest2847822-21kworker/2:2+events00:36:292
274806699249912,2484cyclictest2833046-21kworker/2:0+events23:32:242
274806999249812,2482cyclictest2833111-21kworker/3:2+events23:39:033
274806699249812,2482cyclictest2767379-21kworker/2:1+events20:25:532
274806499249512,2479cyclictest2829671-21kworker/1:1+events23:38:171
274806499249212,2476cyclictest2809154-21kworker/1:0+events22:20:451
274806699249112,2475cyclictest2799468-21kworker/2:2+events21:47:012
274805999249012,2476cyclictest2817271-21kworker/0:0+events22:55:040
274806499248712,2471cyclictest2772489-21kworker/1:1+events20:27:241
274805999248511,2470cyclictest2759281-21kworker/0:0+events19:58:040
274806499248312,2469cyclictest2807497-21kworker/1:2+events22:15:051
274806999248212,2466cyclictest2765952-21kworker/3:2+events20:15:153
274806999248212,2466cyclictest2765952-21kworker/3:2+events20:15:153
274806499248211,2467cyclictest2786851-21kworker/1:1+events21:12:551
274806999248013,2463cyclictest2744584-21kworker/3:2+events19:25:353
274805999248010,2466cyclictest2824974-21kworker/0:1+events23:19:120
274806699247712,2461cyclictest2799848-21kworker/2:3+events21:55:232
274806499247712,2462cyclictest2747703-21kworker/1:2+events19:25:571
274806499247712,2461cyclictest2761528-21kworker/1:1+events20:06:501
274806999247613,2459cyclictest2838406-21kworker/3:2+events00:06:333
274806499247612,2460cyclictest2854408-21kworker/1:0+events00:39:541
274806999247512,2459cyclictest2813847-21kworker/3:2+events22:36:243
274806499247412,2459cyclictest2789664-21kworker/1:2+events21:16:211
274806499247412,2459cyclictest2761528-21kworker/1:1+events19:53:371
274806499247411,2460cyclictest2820283-21kworker/1:0+events23:11:151
27480699924739,2460cyclictest2802731-21kworker/3:1+events21:59:353
274806499247212,2457cyclictest2791582-21kworker/1:0+events21:23:571
274806499247212,2456cyclictest2847633-21kworker/1:0+events00:23:421
274806499247212,2456cyclictest2812397-21kworker/1:0+events22:43:351
274806499247211,2457cyclictest2780220-21kworker/1:2+events20:51:371
274806499247112,2455cyclictest2786851-21kworker/1:1+events21:37:081
274805999247111,2456cyclictest2772601-21kworker/0:0+events20:39:570
274806499247012,2456cyclictest2829671-21kworker/1:1+events23:40:131
274806499247012,2454cyclictest2799682-21kworker/1:2+events22:02:351
274806499247012,2454cyclictest2780590-21kworker/1:3+events20:57:211
274806499247011,2455cyclictest2786851-21kworker/1:1+events21:53:051
274806999246912,2453cyclictest2817198-21kworker/3:2+events23:13:093
274806499246912,2453cyclictest2849299-21kworker/1:1+events00:33:541
274806499246814,2450cyclictest2812397-21kworker/1:0+events22:39:451
274806999246111,2447cyclictest2775754-21kworker/3:2+events20:47:063
274806699246112,2445cyclictest2815698-21kworker/2:3+events23:07:522
274805999246012,2444cyclictest2747752-21kworker/0:0+events19:19:270
274806999245813,2441cyclictest2774031-21kworker/3:0+events20:34:373
274806999245612,2440cyclictest2759272-21kworker/3:2+events19:54:013
274806999245212,2437cyclictest2789784-21kworker/3:2+events21:39:443
274806999245110,2437cyclictest2775754-21kworker/3:2+events20:40:203
274806499245112,2435cyclictest2799682-21kworker/1:2+events21:58:471
274806499244911,2434cyclictest2752816-21kworker/1:1+events19:40:211
274806699244812,2432cyclictest2841630-21kworker/2:4+events00:06:102
274806699244412,2429cyclictest2765689-21kworker/2:2+events20:05:412
274806999244311,2428cyclictest2781933-21kworker/3:1+events20:58:303
274806499244312,2429cyclictest2793242-21kworker/1:2+events21:40:071
274806999243912,2423cyclictest2788126-21kworker/3:1+events21:14:273
274806999243810,2424cyclictest2838406-21kworker/3:2+events23:52:283
274806999243712,2421cyclictest2841385-21kworker/3:1+events00:12:163
274806999243712,2421cyclictest2786527-21kworker/3:2+events21:07:173
274806699243713,2420cyclictest2780541-21kworker/2:2+events20:59:382
274806699243612,2420cyclictest2777090-21kworker/2:0+events20:37:392
274806999243512,2419cyclictest2772402-21kworker/3:2+events20:25:293
27480669924358,2423cyclictest2759333-21kworker/2:1+events19:48:412
274806999243212,2416cyclictest2817198-21kworker/3:2+events22:48:113
274806999243210,2419cyclictest2825175-21kworker/3:3+events23:20:183
274806699243212,2416cyclictest2797477-21kworker/2:0+events22:18:072
274806499243211,2417cyclictest2805837-21kworker/1:1+events22:13:121
274806999242811,2413cyclictest2804446-21kworker/3:0+events22:04:313
274806999242712,2411cyclictest2789784-21kworker/3:2+events21:43:333
274806999242511,2410cyclictest2846096-21kworker/3:0+events00:19:293
274806999242412,2408cyclictest2841385-21kworker/3:1+events00:03:083
274806999242410,2411cyclictest2847695-21kworker/3:2+events00:20:153
274806999242312,2407cyclictest2752786-21kworker/3:0+events19:37:203
274806999242211,2407cyclictest2821647-21kworker/3:0+events23:00:493
27480669924229,2410cyclictest2828287-21kworker/2:2+events23:38:392
274806699242212,2407cyclictest2760993-21kworker/2:2+events19:54:222
27480649924203,2414cyclictest2828046-21kworker/1:2+events23:22:121
274806999241912,2403cyclictest2772402-21kworker/3:2+events20:24:003
274806499241812,2403cyclictest2752816-21kworker/1:1+events19:32:261
27480649924180,2415cyclictest2772489-21kworker/1:1+events20:24:451
274805999241712,2401cyclictest2829892-21kworker/0:2+events23:29:460
274806999241512,2399cyclictest2841385-21kworker/3:1+events23:59:413
274805999241410,2400cyclictest2785191-21kworker/0:2+events21:09:310
274806999241311,2399cyclictest2752786-21kworker/3:0+events19:32:033
274806699241312,2399cyclictest2778911-21kworker/2:1+events20:47:272
274806699241312,2398cyclictest2850775-21kworker/2:0+events00:28:572
274806699241312,2397cyclictest2826681-21kworker/2:0+events23:18:032
274806699241312,2397cyclictest2810616-21kworker/2:1+events22:28:232
274806699241312,2397cyclictest2810616-21kworker/2:1+events22:28:232
274806999241212,2398cyclictest2825175-21kworker/3:3+events23:15:023
274806699241212,2396cyclictest2852408-21kworker/2:1+events00:34:162
274806699241210,2398cyclictest2790022-21kworker/2:2+events21:24:202
274805999241212,2397cyclictest2774470-21kworker/0:2+events20:41:280
274805999241212,2396cyclictest2809070-21kworker/0:1+events22:23:510
27480669924109,2398cyclictest2757712-21kworker/2:0+events20:13:202
27480669924103,2403cyclictest2782794-21kworker/2:1+events21:11:492
274806699241012,2394cyclictest2834777-21kworker/2:1+events23:44:232
274806699240912,2393cyclictest2767379-21kworker/2:1+events20:16:232
274806699240912,2393cyclictest2767379-21kworker/2:1+events20:16:232
274806699240910,2397cyclictest2815571-21kworker/2:1+events22:40:082
274806999240812,2393cyclictest2788126-21kworker/3:1+events21:19:243
274805999240812,2392cyclictest2812361-21kworker/0:0+events22:37:530
27480669924065,2397cyclictest2841628-21kworker/2:3+events00:01:132
274805999240512,2391cyclictest2805800-21kworker/0:1+events22:06:010
274805999240410,2390cyclictest2810694-21kworker/0:2+events22:29:310
274805999240410,2390cyclictest2810694-21kworker/0:2+events22:29:310
274805999240410,2390cyclictest2774470-21kworker/0:2+events20:56:370
274805999240312,2388cyclictest2813991-21kworker/0:1+events22:47:490
274805999240310,2390cyclictest2768979-21kworker/0:1+events20:21:200
274806999240211,2388cyclictest2812184-21kworker/3:1+events22:52:213
27480599924009,2387cyclictest2759281-21kworker/0:0+events20:08:210
274805999239912,2383cyclictest2760871-21kworker/0:2+events19:49:280
274806499239710,2382cyclictest2761528-21kworker/1:1+events19:56:121
274805999239712,2381cyclictest2794817-21kworker/0:2+events21:38:150
274805999239612,2381cyclictest2768979-21kworker/0:1+events20:28:100
274806699239412,2379cyclictest2782794-21kworker/2:1+events21:34:062
27480649923908,2379cyclictest2775691-21kworker/1:1+events20:37:161
274806499239011,2376cyclictest2815602-21kworker/1:1+events22:45:311
274806499239010,2376cyclictest2820283-21kworker/1:0+events22:55:481
274806499238912,2374cyclictest2783477-21kworker/1:0+events21:04:581
274806499238911,2375cyclictest2775691-21kworker/1:1+events20:45:591
274806499238910,2375cyclictest2828046-21kworker/1:2+events23:19:351
274806499238812,2373cyclictest2765750-21kworker/1:2+events20:15:371
274806499238812,2373cyclictest2765750-21kworker/1:2+events20:15:371
274806499238811,2374cyclictest2798043-21kworker/1:0+events21:47:251
274806699238712,2371cyclictest2741191-21kworker/2:0+events19:26:202
274806699238711,2373cyclictest2799848-21kworker/2:3+events22:04:542
274806499238412,2368cyclictest2747703-21kworker/1:2+events19:21:221
274806499238411,2371cyclictest2752816-21kworker/1:1+events19:35:021
274806499238411,2370cyclictest2812397-21kworker/1:0+events22:32:351
274806499238312,2368cyclictest2839664-21kworker/1:2+events23:56:141
274806699238112,2365cyclictest2782794-21kworker/2:1+events21:08:452
274806999237811,2363cyclictest2812184-21kworker/3:1+events22:34:533
274806999237611,2361cyclictest2774031-21kworker/3:0+events20:39:333
274805999237611,2362cyclictest2846240-21kworker/0:0+events00:30:490
274806699237211,2357cyclictest2765689-21kworker/2:2+events20:03:012
274806699236611,2351cyclictest2790022-21kworker/2:2+events21:25:512
274806999235910,2346cyclictest2849547-21kworker/3:1+events00:39:313
274806699235812,2343cyclictest2841630-21kworker/2:4+events00:10:462
274806499235610,2343cyclictest2843072-21kworker/1:2+events00:07:441
27480599923558,2344cyclictest2828229-21kworker/0:0+events23:41:210
274806999235311,2338cyclictest2849547-21kworker/3:1+events00:27:463
274805999235312,2337cyclictest2788688-21kworker/0:1+events21:17:530
27480599923519,2338cyclictest2821657-21kworker/0:1+events23:01:100
274806999235012,2335cyclictest2791671-21kworker/3:0+events21:24:453
274806999235010,2336cyclictest2760932-21kworker/3:0+events20:04:083
274806699235012,2334cyclictest2824953-21kworker/2:1+events23:12:462
274805999235012,2335cyclictest2759281-21kworker/0:0+events20:04:320
274806999234912,2335cyclictest2760932-21kworker/3:0+events19:55:073
274806699234912,2335cyclictest2836691-21kworker/2:0+events23:45:092
274806699234912,2334cyclictest2780541-21kworker/2:2+events20:51:142
274806699234910,2336cyclictest2839577-21kworker/2:2+events23:54:452
274806999234812,2332cyclictest2810572-21kworker/3:0+events22:22:183
274805999234812,2332cyclictest2819803-21kworker/0:2+events22:51:140
274805999234812,2332cyclictest2803902-21kworker/0:2+events22:11:430
274806999234712,2332cyclictest2852347-21kworker/3:2+events00:34:593
274806699234711,2333cyclictest2797477-21kworker/2:0+events22:05:392
274806699234710,2334cyclictest2797477-21kworker/2:0+events21:50:492
274806999234311,2329cyclictest2829317-21kworker/3:0+events23:26:203
274805999234312,2328cyclictest2838059-21kworker/0:2+events23:48:160
274806999234111,2327cyclictest2744584-21kworker/3:2+events19:14:083
274806999234111,2326cyclictest2744584-21kworker/3:2+events19:16:253
274806699234112,2325cyclictest2815571-21kworker/2:1+events22:48:582
274806999233912,2323cyclictest2793301-21kworker/3:1+events21:31:053
274806999233911,2325cyclictest2789784-21kworker/3:2+events21:29:593
274806999233911,2324cyclictest2817198-21kworker/3:2+events22:59:183
27480669923388,2326cyclictest2777090-21kworker/2:0+events20:44:272
274805999233812,2323cyclictest2780278-21kworker/0:0+events21:02:440
274805999233712,2322cyclictest2770893-21kworker/0:2+events20:19:030
274805999233712,2322cyclictest2770893-21kworker/0:2+events20:19:030
274805999233712,2321cyclictest2846240-21kworker/0:0+events00:17:070
274805999233612,2321cyclictest2810694-21kworker/0:2+events22:33:210
27480599923349,2321cyclictest2755959-21kworker/0:1+events19:34:390
274805999232812,2313cyclictest2828229-21kworker/0:0+events23:20:420
274806699232712,2311cyclictest2741191-21kworker/2:0+events19:14:302
274806699232512,2309cyclictest2828287-21kworker/2:2+events23:25:342
274805999232312,2305cyclictest2757582-21kworker/0:2+events19:39:130
274805999232311,2308cyclictest2841234-21kworker/0:1+events23:59:190
274806699232212,2306cyclictest2767379-21kworker/2:1+events20:33:282
274806499232111,2307cyclictest2757682-21kworker/1:0+events19:45:401
274805999232112,2306cyclictest2755959-21kworker/0:1+events19:44:090
274806699232011,2306cyclictest2747798-21kworker/2:1+events19:18:432
274806499231911,2305cyclictest2778624-21kworker/1:0+events20:41:491
274805999231912,2303cyclictest2847970-21kworker/0:1+events00:24:480
274805999231812,2303cyclictest2788688-21kworker/0:1+events21:28:530
274805999231812,2302cyclictest2796441-21kworker/0:1+events21:46:380
274805999231512,2301cyclictest2819803-21kworker/0:2+events23:05:390
274806699231411,2299cyclictest2757712-21kworker/2:0+events19:55:292
27480599922759,2263cyclictest2838059-21kworker/0:2+events23:52:500
274806499225511,2241cyclictest2786851-21kworker/1:1+events21:30:421
274805999224911,2234cyclictest2759281-21kworker/0:0+events19:53:140
274806999223211,2218cyclictest2768834-21kworker/3:1+events20:12:563
274805999220610,2193cyclictest2780278-21kworker/0:0+events20:47:500
274806699219311,2180cyclictest2820108-21kworker/2:0+events22:55:262
27480599921789,2166cyclictest2752366-21kworker/0:1+events19:22:090
274806499217010,2156cyclictest2828046-21kworker/1:2+events23:32:031
274805999213011,2115cyclictest2815584-21kworker/0:2+events22:44:230
274806999212711,2113cyclictest2836635-21kworker/3:1+events23:46:203
274805999211910,2106cyclictest2844554-21kworker/0:1+events00:11:300
274805999211711,2102cyclictest2749488-21kworker/0:2+events19:27:510
274805999211411,2100cyclictest2828229-21kworker/0:0+events23:33:120
274806699210910,2095cyclictest2788419-21kworker/2:0+events21:19:012
27480649920966,2087cyclictest2747703-21kworker/1:2+events19:13:451
27480599919636,1954cyclictest2747752-21kworker/0:0+events19:11:490
27476842181148,27sleep20-21swapper/219:07:542
27477652163135,25sleep30-21swapper/319:08:553
27465382146118,23sleep10-21swapper/119:05:171
27475472143109,29sleep00-21swapper/019:06:080
274805999305,11cyclictest2834120-10ld23:35:180
274805999265,18cyclictest616-21gdbus23:10:210
2748059992520,3cyclictest2802979-21sendmail22:00:000
274805999241,21cyclictest0-21swapper/021:20:020
274805999241,20cyclictest2809314-21perf22:20:000
2748059992317,4cyclictest740-21snmpd20:10:520
274805999220,2cyclictest2800318-21/usr/sbin/munin21:50:150
274805999211,17cyclictest2804577-21perf22:05:000
274805999211,17cyclictest2782141-21munin-run20:55:000
274806699191,2cyclictest2807732-21awk22:15:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional