You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 01:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun May 24, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
299996799422521,4199cyclictest3067608-21kworker/2:1+events23:00:192
299997099343718,3411cyclictest3017313-21kworker/3:2+events20:10:193
299996099338816,3366cyclictest3083814-21kworker/0:2+events23:40:140
299996799321414,3195cyclictest3046917-21kworker/2:0+events21:55:182
299996799309516,3074cyclictest3018118-21kworker/2:2+events20:15:142
299997099308515,3065cyclictest3064518-21kworker/3:1+events22:40:113
299996099304914,3029cyclictest3090662-21kworker/0:2+events23:50:130
299997099302314,3003cyclictest3101550-21kworker/3:0+events00:35:133
299996099300914,2991cyclictest3077348-21kworker/0:1+events23:10:180
299996799299914,2981cyclictest3012642-21kworker/2:0+events20:05:202
299996799299914,2981cyclictest3012642-21kworker/2:0+events20:05:202
299997099293013,2914cyclictest3024161-21kworker/3:2+events20:35:163
299996599290715,2889cyclictest3067729-21kworker/1:2+events22:45:141
299997099290313,2886cyclictest3015655-21kworker/3:0+events20:00:203
299997099287714,2859cyclictest3033642-21kworker/3:1+events21:00:113
299997099280613,2790cyclictest2999495-21kworker/3:1+events19:19:393
29999709928045,2795cyclictest3087603-21kworker/3:2+events23:43:183
299997099280413,2787cyclictest3087603-21kworker/3:2+events23:49:043
299997099280313,2786cyclictest3031944-21kworker/3:2+events20:59:003
299997099280313,2786cyclictest3020906-21kworker/3:1+events20:19:273
299996599280213,2785cyclictest3014118-21kworker/1:2+events19:52:001
299996599280112,2785cyclictest3030217-21kworker/1:0+events20:42:501
299996599279911,2784cyclictest3066064-21kworker/1:1+events22:41:221
299996099278812,2772cyclictest2998060-21kworker/0:2+events19:20:000
299996599278713,2770cyclictest3030217-21kworker/1:0+events20:57:081
299996599278014,2762cyclictest3064396-21kworker/1:2+events22:30:171
299997099277913,2762cyclictest3045044-21kworker/3:1+events21:28:183
299996099277813,2761cyclictest3092286-21kworker/0:0+events00:07:370
299996599277114,2755cyclictest3001316-21kworker/1:1+events19:35:211
299996099277113,2753cyclictest3043620-21kworker/0:0+events21:45:210
299997099276113,2744cyclictest3024161-21kworker/3:2+events20:26:143
299997099275512,2739cyclictest3025768-21kworker/3:1+events20:42:063
299996099272313,2706cyclictest3007902-21kworker/0:2+events19:33:240
299996099271612,2700cyclictest3017521-21kworker/0:1+events20:06:300
299996099271612,2700cyclictest3017521-21kworker/0:1+events20:06:290
299996099271213,2695cyclictest3085447-21kworker/0:0+events23:35:180
299996799271013,2693cyclictest3060097-21kworker/2:2+events22:19:362
299996099270913,2692cyclictest3017521-21kworker/0:1+events20:16:240
299996799270813,2692cyclictest3020754-21kworker/2:1+events20:20:582
299996599270712,2691cyclictest3067729-21kworker/1:2+events22:52:271
299996099270713,2690cyclictest3032098-21kworker/0:1+events20:57:310
299996799270512,2689cyclictest3084081-21kworker/2:0+events23:30:262
299996099270513,2688cyclictest3032098-21kworker/0:1+events21:23:180
29999679927049,2691cyclictest3078960-21kworker/2:2+events23:14:312
299996099270213,2685cyclictest3011132-21kworker/0:2+events20:03:230
299996099269612,2680cyclictest3025619-21kworker/0:1+events20:35:410
299996799268613,2669cyclictest3101731-21kworker/2:1+events00:29:062
299996799268012,2664cyclictest3092137-21kworker/2:0+events23:54:232
299996799267813,2660cyclictest3044006-21kworker/2:1+events21:44:132
299996099267813,2661cyclictest3036550-21kworker/0:2+events21:01:440
299996799267512,2659cyclictest3051388-21kworker/2:2+events21:51:082
299996799267113,2654cyclictest3012642-21kworker/2:0+events19:58:252
299997099267013,2654cyclictest3070634-21kworker/3:0+events23:30:473
299997099266810,2654cyclictest3049935-21kworker/3:0+events21:52:413
29999709926649,2651cyclictest2999495-21kworker/3:1+events19:25:193
299996799266413,2647cyclictest3067608-21kworker/2:1+events22:41:452
299996799266413,2647cyclictest3020754-21kworker/2:1+events20:30:452
299996799266313,2646cyclictest3040193-21kworker/2:2+events21:22:102
299996799265911,2644cyclictest3003834-21kworker/2:0+events19:24:552
299996799265613,2639cyclictest3082219-21kworker/2:2+events23:59:392
299997099265313,2636cyclictest3087603-21kworker/3:2+events00:05:183
299996099264712,2631cyclictest3007902-21kworker/0:2+events19:36:060
299997099264211,2627cyclictest3057752-21kworker/3:1+events22:12:183
299996099264212,2626cyclictest3043620-21kworker/0:0+events21:43:500
299996099264013,2624cyclictest3011132-21kworker/0:2+events19:53:300
299997099263913,2622cyclictest3095299-21kworker/3:0+events00:11:523
299997099263713,2621cyclictest3061290-21kworker/3:0+events22:23:263
299997099263411,2620cyclictest3101550-21kworker/3:0+events00:25:193
299996599263012,2614cyclictest3009471-21kworker/1:0+events19:45:141
299996599262713,2610cyclictest3031856-21kworker/1:1+events20:49:021
299996599262213,2605cyclictest3003455-21kworker/1:2+events19:21:531
299996599262013,2603cyclictest3073950-21kworker/1:1+events23:04:091
299997099261912,2604cyclictest3072323-21kworker/3:1+events23:20:133
299996599261811,2603cyclictest3038424-21kworker/1:0+events21:10:261
299996099260313,2585cyclictest3051961-21kworker/0:2+events21:53:460
29999659925967,2585cyclictest3036728-21kworker/1:1+events21:09:221
299996099259512,2579cyclictest3040073-21kworker/0:0+events21:13:080
299996599258212,2566cyclictest3059269-21kworker/1:0+events22:35:571
299996799258112,2565cyclictest3040193-21kworker/2:2+events21:25:142
299997099258012,2565cyclictest3006469-21kworker/3:2+events19:53:063
299997099258012,2564cyclictest3024161-21kworker/3:2+events20:34:313
299996599258012,2564cyclictest3045011-21kworker/1:0+events21:31:181
299997099257912,2563cyclictest3009325-21kworker/3:1+events19:38:203
299997099257912,2563cyclictest2999495-21kworker/3:1+events19:21:333
299996599257912,2562cyclictest3087273-21kworker/1:2+events23:50:361
299996599257910,2565cyclictest3015986-21kworker/1:0+events20:08:241
299996599257910,2565cyclictest3015986-21kworker/1:0+events20:08:231
299996799257811,2563cyclictest3030458-21kworker/2:0+events20:50:332
299996599257812,2564cyclictest3014118-21kworker/1:2+events20:12:121
299996599257812,2562cyclictest3014118-21kworker/1:2+events20:20:111
299997099257712,2562cyclictest3070634-21kworker/3:0+events23:38:443
299996599257712,2561cyclictest3062797-21kworker/1:1+events22:26:281
299997099257612,2560cyclictest3045044-21kworker/3:1+events21:34:223
299997099257612,2560cyclictest3011099-21kworker/3:0+events19:47:533
299996599257612,2560cyclictest3092200-21kworker/1:1+events00:19:341
299996599257612,2560cyclictest3050051-21kworker/1:1+events21:54:101
299996599257512,2560cyclictest3093801-21kworker/1:0+events00:00:471
299997099257412,2558cyclictest3068019-21kworker/3:2+events22:51:183
299997099257412,2558cyclictest3064518-21kworker/3:1+events22:38:393
299996599257312,2558cyclictest3088960-21kworker/1:0+events23:48:421
299997099257212,2556cyclictest3070634-21kworker/3:0+events23:28:563
299997099257212,2556cyclictest3070634-21kworker/3:0+events23:06:253
299997099257212,2556cyclictest3036878-21kworker/3:0+events21:08:133
29999659925728,2560cyclictest3033493-21kworker/1:2+events21:02:511
299997099257111,2556cyclictest3062901-21kworker/3:2+events22:25:173
299996599257112,2556cyclictest3001316-21kworker/1:1+events19:32:151
299996599257112,2555cyclictest3075604-21kworker/1:2+events23:06:041
299996599257110,2557cyclictest3053243-21kworker/1:2+events22:07:231
299997099257012,2554cyclictest3038478-21kworker/3:1+events21:17:383
299997099257010,2557cyclictest3093620-21kworker/3:1+events00:00:243
299996599257012,2554cyclictest3055699-21kworker/1:1+events22:04:431
299996599257012,2554cyclictest3055699-21kworker/1:1+events22:04:431
29999659925699,2556cyclictest3007866-21kworker/1:2+events19:41:241
299997099256412,2549cyclictest3097057-21kworker/3:1+events00:16:073
299997099256312,2547cyclictest3036878-21kworker/3:0+events21:14:153
299997099256212,2546cyclictest3068019-21kworker/3:2+events22:46:213
299996099255510,2541cyclictest3011132-21kworker/0:2+events19:48:150
299996599255412,2538cyclictest3030217-21kworker/1:0+events20:52:061
299996799255112,2534cyclictest3046917-21kworker/2:0+events22:10:262
299997099255012,2534cyclictest3062901-21kworker/3:2+events22:33:183
299996099255011,2535cyclictest3087335-21kworker/0:1+events23:49:280
299997099254810,2535cyclictest3012729-21kworker/3:1+events19:55:443
299996599254810,2534cyclictest3015986-21kworker/1:0+events20:00:431
299996799254510,2531cyclictest3024242-21kworker/2:3+events20:27:222
299996599254212,2527cyclictest3055699-21kworker/1:1+events22:11:111
299996099254212,2526cyclictest3061074-21kworker/0:0+events22:47:300
29999659925359,2522cyclictest3020783-21kworker/1:1+events20:17:101
299996599253510,2521cyclictest3048377-21kworker/1:2+events21:40:511
299996099253412,2519cyclictest3051961-21kworker/0:2+events21:56:030
299996799253312,2517cyclictest3069445-21kworker/2:2+events22:51:392
299996099253212,2516cyclictest3040073-21kworker/0:0+events21:16:290
299996099253012,2514cyclictest3099942-21kworker/0:0+events00:23:010
299996099252912,2513cyclictest3045254-21kworker/0:2+events21:31:410
299997099252812,2513cyclictest3022545-21kworker/3:0+events20:21:193
299996099252312,2507cyclictest3061074-21kworker/0:0+events22:39:020
299996599252112,2505cyclictest3080413-21kworker/1:1+events23:31:341
299996599251912,2504cyclictest3082277-21kworker/1:2+events23:28:331
299996599251912,2503cyclictest3101578-21kworker/1:0+events00:39:021
299996599251013,2495cyclictest3038424-21kworker/1:0+events21:15:231
299996599250412,2488cyclictest3024041-21kworker/1:0+events20:33:471
29999609925029,2489cyclictest3096725-21kworker/0:2+events00:16:320
299996599250012,2484cyclictest3099880-21kworker/1:2+events00:21:511
299996599249812,2482cyclictest3048377-21kworker/1:2+events21:48:041
299997099249412,2479cyclictest3101550-21kworker/3:0+events00:32:333
299997099249311,2478cyclictest3072323-21kworker/3:1+events23:04:333
299996599249312,2477cyclictest3014118-21kworker/1:2+events19:59:581
299996599249212,2477cyclictest3097327-21kworker/1:0+events00:12:391
299996099249111,2474cyclictest3054504-21kworker/0:1+events22:18:030
299997099249012,2475cyclictest3046707-21kworker/3:2+events21:41:153
299996599248812,2472cyclictest3103210-21kworker/1:1+events00:32:101
29999709924867,2475cyclictest3017313-21kworker/3:2+events20:07:403
29999709924867,2475cyclictest3017313-21kworker/3:2+events20:07:403
299997099248511,2470cyclictest3031944-21kworker/3:2+events20:54:003
299996599248512,2470cyclictest3095479-21kworker/1:2+events00:09:331
299996599248512,2470cyclictest3059269-21kworker/1:0+events22:16:541
299996599248510,2472cyclictest3045011-21kworker/1:0+events21:38:351
299996599248412,2468cyclictest3073950-21kworker/1:1+events22:59:111
299996099248412,2468cyclictest3002983-21kworker/0:0+events19:28:250
299996799248312,2468cyclictest3020754-21kworker/2:1+events20:39:242
299996599248312,2468cyclictest3092200-21kworker/1:1+events23:59:161
299997099248212,2467cyclictest3070634-21kworker/3:0+events22:56:363
299997099248212,2466cyclictest3057752-21kworker/3:1+events22:08:083
299996599248210,2468cyclictest3087273-21kworker/1:2+events23:38:211
299996099248212,2468cyclictest3032098-21kworker/0:1+events20:50:110
299997099248012,2465cyclictest3036878-21kworker/3:0+events21:20:393
299996599248012,2464cyclictest2993082-21kworker/1:2+events19:13:361
299997099247912,2464cyclictest3025768-21kworker/3:1+events20:46:443
299997099247912,2463cyclictest3070634-21kworker/3:0+events23:19:293
299996599247911,2465cyclictest3059269-21kworker/1:0+events22:24:111
299996099247811,2464cyclictest3043620-21kworker/0:0+events21:37:490
299996099247810,2464cyclictest3083814-21kworker/0:2+events23:33:480
29999609924779,2465cyclictest3087335-21kworker/0:1+events00:01:080
299997099247612,2460cyclictest3072323-21kworker/3:1+events23:13:453
29999609924768,2464cyclictest3064430-21kworker/0:1+events22:28:450
299996599247512,2459cyclictest3087273-21kworker/1:2+events23:40:371
299996099247512,2459cyclictest3099942-21kworker/0:0+events00:34:030
299996099247511,2460cyclictest3061074-21kworker/0:0+events22:50:330
299997099247412,2459cyclictest3056150-21kworker/3:0+events22:02:233
299997099247412,2459cyclictest3056150-21kworker/3:0+events22:02:223
299996599247412,2459cyclictest3053243-21kworker/1:2+events21:56:481
299996099247412,2459cyclictest3062736-21kworker/0:2+events22:23:490
299996099247412,2458cyclictest3056121-21kworker/0:0+events22:02:000
299996099247412,2458cyclictest3056121-21kworker/0:0+events22:02:000
299996099247314,2455cyclictest3032098-21kworker/0:1+events21:06:410
299996099247311,2458cyclictest3057813-21kworker/0:2+events22:08:550
299996099247212,2457cyclictest3079019-21kworker/0:0+events23:17:110
299996099247012,2455cyclictest3022299-21kworker/0:0+events20:28:090
299996599246812,2452cyclictest3077504-21kworker/1:0+events23:16:491
299996099246712,2451cyclictest3098363-21kworker/0:1+events00:12:160
299996099246211,2447cyclictest3011132-21kworker/0:2+events19:44:510
299996799246111,2446cyclictest3067608-21kworker/2:1+events23:05:192
299996799246012,2444cyclictest3056091-21kworker/2:2+events22:04:202
299996799246012,2444cyclictest3056091-21kworker/2:2+events22:04:192
299996099245813,2441cyclictest3061074-21kworker/0:0+events22:32:080
299996799245513,2438cyclictest3082219-21kworker/2:2+events00:17:162
299996799245510,2441cyclictest3038242-21kworker/2:1+events21:17:142
299996799245412,2439cyclictest3011035-21kworker/2:1+events19:46:232
299996799245212,2436cyclictest3020754-21kworker/2:1+events20:13:192
29999679924508,2438cyclictest3067608-21kworker/2:1+events22:56:142
299996799244812,2432cyclictest3088871-21kworker/2:0+events23:43:412
299996799243812,2422cyclictest3046917-21kworker/2:0+events21:35:532
299996799243812,2422cyclictest3001390-21kworker/2:3+events19:25:422
29999679924369,2423cyclictest3009383-21kworker/2:2+events19:51:352
299996799243612,2420cyclictest3062676-21kworker/2:0+events22:31:002
299996799243611,2421cyclictest2981444-21kworker/2:2+events19:18:322
299996799243610,2423cyclictest3082219-21kworker/2:2+events00:10:422
299996799243512,2419cyclictest3062676-21kworker/2:0+events22:38:162
299996799243512,2419cyclictest3051388-21kworker/2:2+events21:47:162
299996799243512,2419cyclictest3030458-21kworker/2:0+events21:01:212
299996799243511,2421cyclictest3020754-21kworker/2:1+events20:40:552
299996799243510,2421cyclictest3082219-21kworker/2:2+events23:25:312
299996799243212,2418cyclictest3062676-21kworker/2:0+events22:26:052
299996799243212,2416cyclictest3024242-21kworker/2:3+events20:45:572
299996799243211,2419cyclictest3040193-21kworker/2:2+events21:30:102
299996799243210,2418cyclictest3077332-21kworker/2:0+events23:17:342
299996099243212,2416cyclictest3027289-21kworker/0:2+events20:48:370
299996099243111,2416cyclictest3022299-21kworker/0:0+events20:30:250
29999679924309,2418cyclictest3082219-21kworker/2:2+events23:36:272
299996099243012,2414cyclictest3081951-21kworker/0:1+events23:23:590
299996099243012,2414cyclictest3072502-21kworker/0:1+events22:55:290
299996099243012,2414cyclictest3019425-21kworker/0:2+events20:14:310
299996099242912,2415cyclictest3054504-21kworker/0:1+events22:10:030
299996799242711,2413cyclictest3093830-21kworker/2:1+events00:04:332
299996599242712,2411cyclictest3025710-21kworker/1:2+events20:37:101
299996099242512,2410cyclictest3023980-21kworker/0:2+events20:23:330
299996099242412,2408cyclictest3103362-21kworker/0:2+events00:37:540
299996599242212,2407cyclictest3045011-21kworker/1:0+events21:26:461
299996599241512,2399cyclictest3099880-21kworker/1:2+events00:25:411
299996599241412,2398cyclictest3041983-21kworker/1:3+events21:22:341
29999609924139,2400cyclictest3075453-21kworker/0:0+events23:03:460
299996099241312,2398cyclictest3099942-21kworker/0:0+events00:29:280
299996099241311,2399cyclictest3067668-21kworker/0:2+events23:07:570
299996799241011,2396cyclictest3011035-21kworker/2:1+events19:44:072
299996599240910,2396cyclictest3077504-21kworker/1:0+events23:21:221
299997099240812,2392cyclictest3101550-21kworker/3:0+events00:23:233
299996799240711,2392cyclictest3101731-21kworker/2:1+events00:31:232
299996099239911,2385cyclictest3006255-21kworker/0:1+events19:56:080
299996099239511,2380cyclictest3061074-21kworker/0:0+events22:44:060
299996099239211,2377cyclictest3028892-21kworker/0:0+events20:44:470
299996099239112,2376cyclictest3092286-21kworker/0:0+events23:56:150
299997099239011,2376cyclictest3006469-21kworker/3:2+events19:30:183
299997099238912,2374cyclictest3090474-21kworker/3:0+events23:51:433
299996099238911,2375cyclictest3032098-21kworker/0:1+events21:27:300
299996099238810,2374cyclictest3083814-21kworker/0:2+events23:28:100
299996799238611,2371cyclictest3080596-21kworker/2:1+events23:22:322
299996099238512,2369cyclictest2998060-21kworker/0:2+events19:13:120
299996099238412,2369cyclictest2998060-21kworker/0:2+events19:24:330
299997099237812,2362cyclictest3049935-21kworker/3:0+events21:48:263
299997099237112,2355cyclictest3011099-21kworker/3:0+events19:43:433
299996799236512,2350cyclictest3082219-21kworker/2:2+events00:23:472
299996799236512,2349cyclictest3082219-21kworker/2:2+events00:08:012
299996799235412,2338cyclictest3007793-21kworker/2:0+events19:36:282
29999659923548,2343cyclictest3024041-21kworker/1:0+events20:29:181
299996799235212,2336cyclictest3030458-21kworker/2:0+events21:07:062
299996799235212,2336cyclictest3030458-21kworker/2:0+events20:58:372
29999679923519,2339cyclictest3082219-21kworker/2:2+events23:47:322
299996799235112,2335cyclictest3030458-21kworker/2:0+events21:11:142
299996799235112,2335cyclictest3006163-21kworker/2:1+events19:31:502
299996799234710,2334cyclictest3062676-21kworker/2:0+events22:24:322
299997099233312,2317cyclictest3053330-21kworker/3:2+events21:58:393
299996599232412,2309cyclictest3077504-21kworker/1:0+events23:11:051
299997099231811,2303cyclictest3045044-21kworker/3:1+events21:37:253
299997099231712,2302cyclictest3093620-21kworker/3:1+events23:58:313
299997099231412,2299cyclictest3057752-21kworker/3:1+events22:18:263
299997099225611,2242cyclictest2997863-21kworker/3:0+events19:12:483
299996599225411,2240cyclictest2989570-21kworker/1:0+events19:17:241
299996599222711,2213cyclictest3001316-21kworker/1:1+events19:26:281
299996799217911,2164cyclictest3067608-21kworker/2:1+events22:49:462
299996799215310,2140cyclictest2981444-21kworker/2:2+events19:12:052
299996799214110,2127cyclictest3101731-21kworker/2:1+events00:36:432
29995362163119,26sleep10-21swapper/119:08:021
29994112142112,25sleep00-21swapper/019:06:290
29993992142111,26sleep30-21swapper/319:06:193
29995012140113,22sleep20-21swapper/219:07:342
2999967992521,2cyclictest3017789-21base6420:05:012
2999967991412,1cyclictest3057130-21/usr/sbin/munin22:05:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional