You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 11:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Fri Jun 19, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273451099410722,4079cyclictest2819578-21kworker/2:2+events23:35:002
273450599370418,3680cyclictest2787501-21kworker/0:1+events21:55:010
273451399337816,3357cyclictest2774020-21kworker/3:0+events21:15:033
273451099325915,3242cyclictest2800538-21kworker/2:3+events22:45:142
273451099322116,3201cyclictest2835456-21kworker/2:2+events00:25:132
273451399311816,3097cyclictest2736093-21kworker/3:3+events19:20:113
273451099303511,3018cyclictest2774350-21kworker/2:0+events21:25:132
273450799298811,2973cyclictest2811548-21kworker/1:0+events23:36:101
273450799298114,2961cyclictest2825985-21kworker/1:0+events00:15:221
273451099294214,2924cyclictest2756807-21kworker/2:0+events20:21:082
273450799291114,2893cyclictest2776128-21kworker/1:2+events21:20:181
273450799290813,2890cyclictest2797243-21kworker/1:0+events22:35:181
273451399290514,2887cyclictest2822663-21kworker/3:2+events23:50:183
273450799290114,2882cyclictest2760099-21kworker/1:0+events20:45:151
273450799289614,2879cyclictest2760099-21kworker/1:0+events20:35:181
273450799284814,2827cyclictest2769585-21kworker/1:0+events21:05:131
273451099283913,2822cyclictest2808184-21kworker/2:0+events23:02:182
27345109928219,2809cyclictest2746644-21kworker/2:0+events20:06:152
273451099281813,2801cyclictest2774350-21kworker/2:0+events21:21:012
273451099281813,2801cyclictest2753633-21kworker/2:1+events20:18:052
273451099281414,2795cyclictest2741064-21kworker/2:1+events19:44:172
273451099281113,2794cyclictest2798591-21kworker/2:2+events22:38:222
27345109928078,2795cyclictest2771031-21kworker/2:2+events21:14:412
273451099280413,2787cyclictest2821190-21kworker/2:0+events23:49:562
273451099280313,2786cyclictest2813187-21kworker/2:2+events23:25:522
273451099280113,2784cyclictest2819578-21kworker/2:2+events23:38:312
273451099280013,2783cyclictest2761640-21kworker/2:2+events20:44:512
273451099279913,2782cyclictest2826140-21kworker/2:1+events00:07:462
273451399279111,2775cyclictest2809739-21kworker/3:2+events23:10:153
273451099279013,2773cyclictest2750406-21kworker/2:2+events20:03:382
273451099278313,2766cyclictest2789127-21kworker/2:2+events22:03:302
273451099278311,2768cyclictest2824474-21kworker/2:2+events23:50:422
273451099277813,2761cyclictest2781056-21kworker/2:1+events21:42:172
273451099277513,2758cyclictest2737704-21kworker/2:0+events19:27:052
273451099277313,2755cyclictest2794415-21kworker/2:1+events22:26:022
273451099276813,2751cyclictest2806549-21kworker/2:1+events22:56:172
273451099276711,2752cyclictest2800538-21kworker/2:3+events23:07:402
273451099276413,2747cyclictest2782658-21kworker/2:0+events21:56:342
273451099275812,2742cyclictest2748744-21kworker/2:1+events19:54:502
273451099275812,2742cyclictest2748744-21kworker/2:1+events19:54:502
273451099275013,2733cyclictest2764885-21kworker/2:1+events20:52:592
273450599274713,2730cyclictest2763379-21kworker/0:0+events20:56:470
273450599274112,2726cyclictest2797202-21kworker/0:0+events22:27:590
273450599272213,2705cyclictest2806788-21kworker/0:2+events22:55:320
273450799272113,2704cyclictest2769585-21kworker/1:0+events21:03:181
273450599271813,2701cyclictest2833853-21kworker/0:2+events00:20:150
273450799271713,2700cyclictest2804979-21kworker/1:0+events22:55:541
273451399271513,2700cyclictest2809739-21kworker/3:2+events23:30:043
273451099271212,2697cyclictest2771031-21kworker/2:2+events21:08:182
273450799270613,2691cyclictest2821129-21kworker/1:2+events23:40:491
273450599270613,2689cyclictest2777538-21kworker/0:1+events21:22:340
273450799270311,2688cyclictest2756714-21kworker/1:2+events20:29:361
273450599269713,2680cyclictest2779137-21kworker/0:0+events21:30:270
273450799269513,2677cyclictest2749012-21kworker/1:0+events20:12:021
273450799269113,2669cyclictest2806611-21kworker/1:2+events23:09:541
273450799268713,2670cyclictest2781204-21kworker/1:2+events21:49:181
273450599268613,2670cyclictest2775323-21kworker/0:0+events21:16:110
273450799268013,2663cyclictest2792340-21kworker/1:0+events22:13:271
273450599267913,2662cyclictest2767923-21kworker/0:2+events21:04:290
273451399267813,2661cyclictest2782808-21kworker/3:1+events21:41:073
273450599267813,2661cyclictest2744127-21kworker/0:1+events19:40:240
273450799267713,2660cyclictest2765155-21kworker/1:2+events20:59:271
273450799267713,2660cyclictest2765155-21kworker/1:2+events20:53:451
273450599267713,2662cyclictest2763379-21kworker/0:0+events20:41:210
273450599267713,2662cyclictest2755089-21kworker/0:2+events20:15:040
273450599267713,2660cyclictest2822905-21kworker/0:1+events00:00:340
273450599267713,2660cyclictest2782627-21kworker/0:0+events21:46:320
273450599267713,2660cyclictest2739624-21kworker/0:0+events20:06:370
273450799267613,2659cyclictest2779342-21kworker/1:1+events21:33:481
273450599267613,2659cyclictest2733792-21kworker/0:0+events19:17:340
27345139926759,2662cyclictest2798684-21kworker/3:0+events22:29:093
273450799267513,2658cyclictest2804979-21kworker/1:0+events22:48:181
273450599267513,2659cyclictest2756683-21kworker/0:0+events20:22:150
273450599267413,2657cyclictest2739624-21kworker/0:0+events19:31:130
273450799267313,2656cyclictest2745662-21kworker/1:2+events19:58:191
273451099267213,2655cyclictest2739374-21kworker/2:2+events19:36:102
273450599267213,2656cyclictest2767923-21kworker/0:2+events21:06:440
273450799267113,2654cyclictest2795635-21kworker/1:1+events22:19:341
273451399266813,2651cyclictest2760222-21kworker/3:2+events20:40:143
273450599266513,2648cyclictest2822905-21kworker/0:1+events23:47:390
273450599266511,2650cyclictest2816311-21kworker/0:1+events23:28:560
273451399266413,2647cyclictest2750587-21kworker/3:1+events20:04:213
273450799266412,2648cyclictest2838638-21kworker/1:0+events00:38:351
273450799266313,2646cyclictest2763290-21kworker/1:1+events20:40:361
273450599266313,2648cyclictest2838696-21kworker/0:1+events00:35:570
273450599266313,2646cyclictest2835490-21kworker/0:0+events00:29:240
273451399266213,2645cyclictest2767707-21kworker/3:2+events21:10:333
27345059926628,2650cyclictest2766132-21kworker/0:1+events20:47:550
273450599266213,2645cyclictest2793911-21kworker/0:2+events22:13:480
273450599265912,2643cyclictest2801808-21kworker/0:0+events22:37:590
273451399265413,2637cyclictest2805132-21kworker/3:0+events23:08:243
273450799264715,2628cyclictest2787809-21kworker/1:1+events22:07:021
273450799264510,2632cyclictest2795635-21kworker/1:1+events22:23:461
273450799264312,2627cyclictest2787809-21kworker/1:1+events22:01:341
273450599264113,2625cyclictest2833853-21kworker/0:2+events00:18:210
273450599264113,2624cyclictest2828749-21kworker/0:0+events00:14:130
273451399263813,2621cyclictest2809739-21kworker/3:2+events23:26:153
273451399263713,2620cyclictest2792543-21kworker/3:2+events22:40:383
273451399263713,2620cyclictest2790910-21kworker/3:0+events22:04:413
273451399263612,2620cyclictest2757463-21kworker/3:1+events20:22:383
273451399263313,2616cyclictest2782808-21kworker/3:1+events22:08:083
273450599263313,2616cyclictest2822905-21kworker/0:1+events23:55:360
273451399263212,2616cyclictest2739313-21kworker/3:1+events19:36:563
273450799263212,2618cyclictest2769585-21kworker/1:0+events21:25:351
273451399263113,2615cyclictest2769342-21kworker/3:1+events20:57:343
273451399263013,2614cyclictest2824326-21kworker/3:1+events23:55:153
273451399263012,2614cyclictest2775975-21kworker/3:1+events21:23:193
273451399262913,2613cyclictest2739313-21kworker/3:1+events19:31:593
273451099262812,2612cyclictest2816281-21kworker/2:1+events23:22:032
273451399262713,2610cyclictest2814637-21kworker/3:1+events23:20:573
273451399262513,2608cyclictest2769342-21kworker/3:1+events21:09:013
273450599262312,2607cyclictest2814363-21kworker/0:0+events23:31:560
273451399262212,2606cyclictest2792543-21kworker/3:2+events22:19:583
273451099262213,2605cyclictest2789127-21kworker/2:2+events22:15:212
273450599262212,2606cyclictest2800169-21kworker/0:2+events22:47:350
273450799261712,2602cyclictest2787809-21kworker/1:1+events21:57:441
273450799261113,2594cyclictest2829322-21kworker/1:2+events00:09:191
273450799261012,2594cyclictest2745662-21kworker/1:2+events19:45:461
273451099260710,2593cyclictest2824474-21kworker/2:2+events23:57:572
273450599260413,2587cyclictest2805188-21kworker/0:1+events22:52:500
273451399259612,2580cyclictest2747204-21kworker/3:1+events19:48:263
273451099259312,2577cyclictest2789127-21kworker/2:2+events22:08:542
273451099259212,2576cyclictest2833822-21kworker/2:1+events00:19:282
273451399259111,2577cyclictest2786903-21kworker/3:0+events21:51:143
273451399259012,2575cyclictest2740974-21kworker/3:2+events20:07:023
273450799259013,2573cyclictest2811548-21kworker/1:0+events23:32:191
273450799258413,2567cyclictest2811548-21kworker/1:0+events23:27:021
273451099258213,2566cyclictest2761640-21kworker/2:2+events20:39:282
273451099257713,2560cyclictest2789127-21kworker/2:2+events22:12:202
273451399257612,2560cyclictest2762989-21kworker/3:0+events20:50:383
273451099257012,2554cyclictest2813187-21kworker/2:2+events23:19:262
273451099256612,2550cyclictest2819578-21kworker/2:2+events23:42:452
273451399256313,2547cyclictest2794144-21kworker/3:1+events22:24:103
273451399256311,2548cyclictest2748804-21kworker/3:0+events19:52:343
273451399256311,2548cyclictest2748804-21kworker/3:0+events19:52:333
273451399256213,2546cyclictest2779311-21kworker/3:2+events21:34:113
27345109925599,2546cyclictest2798591-21kworker/2:2+events22:31:262
273451099255713,2541cyclictest2760040-21kworker/2:1+events20:34:072
27345109925523,2546cyclictest2764885-21kworker/2:1+events20:55:162
273450599254912,2535cyclictest2739624-21kworker/0:0+events20:00:580
273451099254811,2534cyclictest2764885-21kworker/2:1+events20:47:332
273451099254810,2535cyclictest2782658-21kworker/2:0+events21:53:312
273450599254811,2533cyclictest2759950-21kworker/0:2+events20:29:580
273451099254712,2531cyclictest2750406-21kworker/2:2+events20:13:572
273451099254711,2532cyclictest2739374-21kworker/2:2+events19:32:212
273451099254710,2533cyclictest2781056-21kworker/2:1+events21:38:012
27345109925458,2533cyclictest2769405-21kworker/2:0+events21:00:372
273451099254511,2532cyclictest2826140-21kworker/2:1+events00:10:032
273451099254412,2528cyclictest2800538-21kworker/2:3+events22:42:092
273451099254411,2530cyclictest2771031-21kworker/2:2+events21:19:122
273451099254312,2529cyclictest2837312-21kworker/2:3+events00:31:212
273450599254311,2528cyclictest2785869-21kworker/0:2+events21:58:050
273451099254212,2526cyclictest2737704-21kworker/2:0+events19:24:022
273450599254212,2527cyclictest2837092-21kworker/0:2+events00:33:160
273451099254011,2525cyclictest2837123-21kworker/2:0+events00:38:142
273450599253912,2523cyclictest2790668-21kworker/0:0+events22:06:150
273451099253812,2522cyclictest2756807-21kworker/2:0+events20:26:072
273451099253712,2522cyclictest2750406-21kworker/2:2+events19:57:552
27345139925357,2524cyclictest2792543-21kworker/3:2+events22:34:543
273451099253512,2519cyclictest2800538-21kworker/2:3+events23:14:272
273451099253510,2521cyclictest2835456-21kworker/2:2+events00:24:272
273451099253310,2520cyclictest2794415-21kworker/2:1+events22:22:162
273451099253212,2517cyclictest2784406-21kworker/2:2+events21:45:452
273451099253212,2516cyclictest2827783-21kworker/2:3+events00:01:212
273450599253212,2516cyclictest2737874-21kworker/0:2+events19:20:340
273450599252912,2515cyclictest2809677-21kworker/0:0+events23:05:010
273451099250612,2490cyclictest2800538-21kworker/2:3+events22:51:422
273451399249612,2480cyclictest2805132-21kworker/3:0+events23:17:073
273451399249612,2480cyclictest2744304-21kworker/3:0+events19:44:403
273451399249612,2479cyclictest2740974-21kworker/3:2+events19:59:283
273451399249611,2482cyclictest2736093-21kworker/3:3+events19:15:383
273451399249412,2479cyclictest2792543-21kworker/3:2+events22:12:423
273451099249212,2476cyclictest2746644-21kworker/2:0+events19:46:112
273450799249213,2475cyclictest2781204-21kworker/1:2+events21:43:481
273451399249112,2476cyclictest2764645-21kworker/3:1+events20:46:223
273450799248712,2472cyclictest2806611-21kworker/1:2+events23:11:461
273451399248510,2471cyclictest2784500-21kworker/3:2+events21:49:403
27345079924775,2469cyclictest2756714-21kworker/1:2+events20:30:451
273450799247412,2458cyclictest2835328-21kworker/1:1+events00:32:301
273450799247210,2458cyclictest2745662-21kworker/1:2+events20:01:211
273450599247112,2455cyclictest2814363-21kworker/0:0+events23:24:200
273450599247112,2455cyclictest2782627-21kworker/0:0+events21:43:030
27345059924709,2457cyclictest2806788-21kworker/0:2+events23:19:490
273450599246912,2453cyclictest2795545-21kworker/0:1+events22:23:250
273451399246713,2450cyclictest2820027-21kworker/3:0+events23:46:093
273450799246712,2451cyclictest2769585-21kworker/1:0+events21:36:291
273450799246612,2452cyclictest2769585-21kworker/1:0+events21:16:321
273450799246412,2448cyclictest2729296-21kworker/1:1+events19:15:151
273450799246312,2447cyclictest2797243-21kworker/1:0+events22:29:311
273450799246310,2449cyclictest2798865-21kworker/1:2+events22:34:311
273451099245512,2440cyclictest2779167-21kworker/2:2+events21:32:412
27345109924539,2441cyclictest2737704-21kworker/2:0+events19:19:502
273450599245012,2434cyclictest2744127-21kworker/0:1+events19:38:310
273450799244811,2433cyclictest2803374-21kworker/1:1+events22:42:331
273450799244711,2432cyclictest2827590-21kworker/1:1+events00:01:441
273450599244710,2433cyclictest2747442-21kworker/0:1+events19:53:210
273450599244710,2433cyclictest2747442-21kworker/0:1+events19:53:210
273450599244612,2431cyclictest2795545-21kworker/0:1+events22:34:080
273450599244612,2430cyclictest2779137-21kworker/0:0+events21:27:270
273450599244412,2428cyclictest2781024-21kworker/0:2+events21:37:370
273450599244312,2428cyclictest2800169-21kworker/0:2+events22:40:140
273450799244112,2425cyclictest2821129-21kworker/1:2+events23:45:461
273450799244010,2426cyclictest2731920-21kworker/1:2+events19:13:421
27345059924408,2428cyclictest2790668-21kworker/0:0+events22:04:180
273450799243912,2423cyclictest2745662-21kworker/1:2+events19:52:581
273450799243912,2423cyclictest2745662-21kworker/1:2+events19:52:571
27345059924388,2427cyclictest2739624-21kworker/0:0+events19:56:250
273450799243712,2422cyclictest2811548-21kworker/1:0+events23:20:341
273450799243711,2422cyclictest2835328-21kworker/1:1+events00:29:011
273450799243612,2420cyclictest2741037-21kworker/1:1+events19:41:571
273450799243611,2422cyclictest2821129-21kworker/1:2+events23:54:081
273450599243612,2420cyclictest2814363-21kworker/0:0+events23:52:140
273450799243512,2420cyclictest2825985-21kworker/1:0+events00:20:381
273450799243512,2419cyclictest2821129-21kworker/1:2+events23:58:441
273450799243510,2421cyclictest2739404-21kworker/1:2+events19:28:351
273451399243412,2418cyclictest2732381-21kworker/3:0+events19:26:433
273450599243410,2420cyclictest2819484-21kworker/0:2+events23:38:070
273450799243312,2417cyclictest2830973-21kworker/1:1+events00:12:201
273450799243312,2417cyclictest2749012-21kworker/1:0+events20:21:301
273450799243310,2419cyclictest2806611-21kworker/1:2+events23:00:231
273450599243212,2416cyclictest2767923-21kworker/0:2+events21:11:170
273450599243212,2416cyclictest2761610-21kworker/0:1+events20:38:190
273450599243112,2416cyclictest2809677-21kworker/0:0+events23:02:420
273450599243012,2414cyclictest2737874-21kworker/0:2+events19:25:560
273450599242510,2411cyclictest2811344-21kworker/0:1+events23:11:020
273451399242411,2409cyclictest2781173-21kworker/3:0+events21:39:573
273451399242112,2406cyclictest2805132-21kworker/3:0+events23:01:553
27345079924149,2401cyclictest2749012-21kworker/1:0+events20:05:271
273451399241311,2398cyclictest2805132-21kworker/3:0+events22:50:583
273451399241111,2396cyclictest2803314-21kworker/3:1+events22:59:383
273451399241012,2394cyclictest2760222-21kworker/3:2+events20:33:233
27345079924069,2393cyclictest2806611-21kworker/1:2+events23:15:561
27345079924059,2393cyclictest2765155-21kworker/1:2+events21:10:101
273451399239911,2384cyclictest2820027-21kworker/3:0+events23:41:583
273451399239711,2382cyclictest2826312-21kworker/3:0+events00:04:013
27345139923967,2385cyclictest2798684-21kworker/3:0+events22:36:053
273451399239612,2380cyclictest2775975-21kworker/3:1+events21:28:543
273451399239610,2382cyclictest2829263-21kworker/3:2+events00:10:493
273451399239212,2376cyclictest2803314-21kworker/3:1+events22:48:433
273451399238912,2373cyclictest2838785-21kworker/3:0+events00:37:063
273450599238811,2375cyclictest2763379-21kworker/0:0+events20:53:210
273450599238212,2367cyclictest2745754-21kworker/0:2+events19:47:400
273450599238212,2366cyclictest2751911-21kworker/0:1+events20:11:190
273450599238211,2367cyclictest2759950-21kworker/0:2+events20:33:450
273450799237312,2357cyclictest2741037-21kworker/1:1+events19:38:531
273450599236512,2350cyclictest2819484-21kworker/0:2+events23:41:360
273451399236211,2347cyclictest2832491-21kworker/3:1+events00:23:183
273450599236112,2345cyclictest2793911-21kworker/0:2+events22:17:380
273450599235612,2341cyclictest2828749-21kworker/0:0+events00:06:370
273450799235412,2339cyclictest2739404-21kworker/1:2+events19:32:451
273450799235412,2338cyclictest2803374-21kworker/1:1+events22:50:351
273450799235210,2339cyclictest2753029-21kworker/1:1+events20:15:271
273450799234812,2334cyclictest2736651-21kworker/1:0+events19:22:521
273451399232611,2312cyclictest2829263-21kworker/3:2+events00:06:153
273451399232611,2312cyclictest2818153-21kworker/3:1+events23:35:233
273450599232611,2311cyclictest2733792-21kworker/0:0+events19:12:580
273451399232411,2309cyclictest2740974-21kworker/3:2+events20:10:563
273451399231212,2296cyclictest2826312-21kworker/3:0+events00:16:093
273451399230812,2294cyclictest2760222-21kworker/3:2+events20:36:033
27345139923059,2292cyclictest2782808-21kworker/3:1+events21:58:293
27345109922709,2258cyclictest2717777-21kworker/2:2+events19:14:052
273451399225810,2245cyclictest2835547-21kworker/3:2+events00:34:233
27345139920303,2024cyclictest2727512-21kworker/3:2+events19:11:463
27340642188155,30sleep00-21swapper/019:09:510
27340162145110,30sleep20-21swapper/219:09:122
27337162142115,22sleep30-21swapper/319:05:253
27338422139101,33sleep10-21swapper/119:06:591
2734507992218,3cyclictest2787580-21latency_hist21:55:011
2734513992019,1cyclictest26450irq/143-i91520:18:043
2734513992012,6cyclictest2771266-21awk21:05:003
2734513991913,2cyclictest191rcu_preempt00:25:163
2734513991716,1cyclictest26450irq/143-i91520:25:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional