You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 21:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Aug 03, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
315139799372917,3703cyclictest3152784-21kworker/2:2+events19:15:162
315139999331515,3296cyclictest3158529-21kworker/3:0+events19:35:153
31513939932539,3239cyclictest3219105-21kworker/1:2+events22:50:121
315139399319013,3171cyclictest3209288-21kworker/1:0+events22:40:121
315138999308715,3068cyclictest3238178-21kworker/0:2+events00:00:130
315139799303515,3017cyclictest3180419-21kworker/2:0+events20:50:132
315139799303415,3014cyclictest3212405-21kworker/2:2+events22:25:202
315139399299514,2977cyclictest3179043-21kworker/1:1+events20:45:141
315139399298214,2964cyclictest3156763-21kworker/1:2+events20:05:171
315139399296114,2943cyclictest3156763-21kworker/1:2+events19:29:141
315139399296012,2943cyclictest3243305-21kworker/1:0+events23:55:211
315139999292513,2908cyclictest3201527-21kworker/3:2+events21:45:193
315139799291214,2893cyclictest3206316-21kworker/2:0+events22:00:122
315139799291113,2894cyclictest3231622-21kworker/2:0+events23:25:172
315139799290314,2885cyclictest3162768-21kworker/2:2+events19:50:132
315139399285113,2833cyclictest3236407-21kworker/1:0+events23:32:321
315138999284510,2831cyclictest3214093-21kworker/0:0+events22:30:170
315138999283912,2822cyclictest3241703-21kworker/0:1+events23:50:220
315139399282613,2810cyclictest3156763-21kworker/1:2+events19:40:591
315139399281013,2793cyclictest3233590-21kworker/1:1+events23:41:581
315139399281013,2793cyclictest3233590-21kworker/1:1+events23:41:581
315139399280613,2789cyclictest3190409-21kworker/1:2+events21:18:031
315139799280513,2789cyclictest3164436-21kworker/2:1+events20:02:412
315139799280413,2789cyclictest3228428-21kworker/2:1+events23:10:472
315139799280213,2785cyclictest3194881-21kworker/2:0+events21:21:532
315139799280213,2785cyclictest3187035-21kworker/2:0+events20:58:562
315139799280013,2783cyclictest3194881-21kworker/2:0+events21:30:372
315139799279913,2782cyclictest3155062-21kworker/2:0+events19:35:402
315139399279613,2779cyclictest3201404-21kworker/1:0+events21:46:031
315138999279413,2778cyclictest3236566-21kworker/0:1+events23:42:460
315138999279413,2778cyclictest3236566-21kworker/0:1+events23:42:460
315139799278513,2768cyclictest3203044-21kworker/2:2+events22:09:232
315139799277313,2756cyclictest3149475-21kworker/2:1+events19:23:332
315139399277113,2755cyclictest3209288-21kworker/1:0+events22:22:181
315139399276713,2751cyclictest3219105-21kworker/1:2+events22:46:221
315139399276513,2748cyclictest3201404-21kworker/1:0+events21:44:121
315139999276012,2744cyclictest3174026-21kworker/3:2+events20:40:143
315139999275512,2739cyclictest3203398-21kworker/3:1+events21:54:023
315139399275511,2740cyclictest3185399-21kworker/1:2+events21:01:361
315138999275411,2739cyclictest3249486-21kworker/0:2+events00:14:570
315139999275212,2736cyclictest3203398-21kworker/3:1+events21:57:083
315139399275112,2735cyclictest3231858-21kworker/1:2+events23:26:051
315139999274713,2730cyclictest3210897-21kworker/3:0+events22:22:393
315139999274613,2729cyclictest3249629-21kworker/3:2+events00:15:183
315139399274612,2730cyclictest3209288-21kworker/1:0+events22:08:121
315139999274113,2724cyclictest3161097-21kworker/3:2+events19:49:493
315139399273913,2722cyclictest3247820-21kworker/1:0+events00:14:331
315139399273813,2723cyclictest3156763-21kworker/1:2+events19:37:331
31513939927379,2724cyclictest3204812-21kworker/1:2+events21:57:321
315139799273512,2720cyclictest3185433-21kworker/2:2+events21:06:572
315139999273113,2714cyclictest3155032-21kworker/3:1+events19:40:123
31513939927265,2717cyclictest3179043-21kworker/1:1+events20:54:251
315139399272513,2708cyclictest3244900-21kworker/1:2+events00:08:301
315139999272313,2706cyclictest3210897-21kworker/3:0+events22:16:183
315139999271613,2699cyclictest3169611-21kworker/3:1+events20:13:593
315139999271612,2698cyclictest3152619-21kworker/3:0+events19:23:563
315139999271012,2694cyclictest3256635-21kworker/3:3+events00:36:423
315139999270912,2693cyclictest3251506-21kworker/3:0+events00:34:243
315139999270912,2693cyclictest3222161-21kworker/3:0+events22:57:263
315139999270713,2690cyclictest3246396-21kworker/3:0+events00:06:373
315139999270613,2691cyclictest3190562-21kworker/3:0+events21:15:453
315139999270413,2687cyclictest3207563-21kworker/3:0+events22:04:233
315139999270313,2687cyclictest3174026-21kworker/3:2+events20:16:413
315139999270312,2688cyclictest3180574-21kworker/3:0+events20:48:433
315139999270211,2687cyclictest3234897-21kworker/3:0+events23:34:253
315138999270013,2685cyclictest3208803-21kworker/0:0+events22:10:090
315139999269813,2681cyclictest3233199-21kworker/3:1+events23:49:393
315139999269812,2682cyclictest3155032-21kworker/3:1+events19:30:223
31513939926917,2681cyclictest3204812-21kworker/1:2+events22:00:581
315139399268813,2671cyclictest3226979-21kworker/1:1+events23:03:091
315139399268511,2670cyclictest3253144-21kworker/1:1+events00:29:041
31513999926839,2670cyclictest3227009-21kworker/3:2+events23:06:113
315139999268112,2665cyclictest3222161-21kworker/3:0+events23:01:123
31513899926808,2668cyclictest3256290-21kworker/0:0+events00:31:430
315139799267812,2662cyclictest3231622-21kworker/2:0+events23:20:192
315139399267811,2663cyclictest3201404-21kworker/1:0+events21:51:451
315138999267812,2662cyclictest3167726-21kworker/0:2+events19:57:210
315139399267316,2653cyclictest3169495-21kworker/1:0+events20:36:261
315139799266813,2651cyclictest3174429-21kworker/2:1+events20:30:202
315139999266312,2647cyclictest3215758-21kworker/3:0+events22:36:463
315139399266013,2644cyclictest3156763-21kworker/1:2+events20:00:441
315139999265413,2637cyclictest3199876-21kworker/3:1+events21:41:123
31513939926520,2648cyclictest3226979-21kworker/1:1+events23:07:211
315138999265213,2635cyclictest3156533-21kworker/0:0+events19:27:460
315139999264412,2628cyclictest3222161-21kworker/3:0+events22:52:273
31513939926421,2637cyclictest3209288-21kworker/1:0+events22:16:411
315138999264113,2624cyclictest3253389-21kworker/0:1+events00:38:590
315138999264013,2623cyclictest3188601-21kworker/0:2+events21:08:060
315138999263912,2625cyclictest3240066-21kworker/0:0+events23:45:030
315138999263813,2621cyclictest3192316-21kworker/0:0+events21:28:440
315139799263513,2619cyclictest3241699-21kworker/2:1+events00:09:172
315138999263513,2618cyclictest3164677-21kworker/0:0+events20:08:190
315138999263213,2615cyclictest3225247-21kworker/0:2+events23:03:560
315138999263213,2615cyclictest3174062-21kworker/0:1+events20:17:260
315139999263110,2617cyclictest3187125-21kworker/3:1+events20:58:343
315138999263111,2616cyclictest3253389-21kworker/0:1+events00:26:010
315138999263013,2615cyclictest3210743-21kworker/0:1+events22:15:100
315138999263013,2613cyclictest3164677-21kworker/0:0+events19:51:440
315138999262913,2612cyclictest3206386-21kworker/0:2+events22:05:300
315138999262813,2611cyclictest3214093-21kworker/0:0+events22:24:110
315139999262513,2608cyclictest3169611-21kworker/3:1+events20:08:433
315139799262413,2609cyclictest3252945-21kworker/2:0+events00:30:132
315138999262313,2606cyclictest3228735-21kworker/0:0+events23:14:580
31513899926209,2607cyclictest3195045-21kworker/0:2+events21:23:250
315139799261713,2600cyclictest3188647-21kworker/2:1+events21:04:172
31513979926167,2605cyclictest3155062-21kworker/2:0+events19:31:532
315139799261312,2598cyclictest3172769-21kworker/2:0+events20:20:282
315139799261312,2597cyclictest3198137-21kworker/2:1+events21:37:462
315139999260713,2591cyclictest3222161-21kworker/3:0+events22:48:193
315139799260313,2588cyclictest3155062-21kworker/2:0+events19:25:022
315138999259913,2582cyclictest3185774-21kworker/0:0+events20:56:190
315139399259613,2579cyclictest3240037-21kworker/1:0+events23:48:081
315139399259313,2578cyclictest3251314-21kworker/1:2+events00:21:481
315139799259012,2574cyclictest3201415-21kworker/2:0+events21:49:512
315139399258712,2572cyclictest3162900-21kworker/1:1+events19:45:111
315139799258615,2567cyclictest3206316-21kworker/2:0+events22:11:402
315139399258611,2571cyclictest3190409-21kworker/1:2+events21:14:591
315139999258110,2568cyclictest3193290-21kworker/3:1+events21:31:193
315139999257812,2562cyclictest3238238-21kworker/3:2+events23:42:223
315139999257812,2562cyclictest3238238-21kworker/3:2+events23:42:223
315139799257812,2563cyclictest3217271-21kworker/2:1+events22:38:182
315139799257812,2563cyclictest3204658-21kworker/2:1+events21:56:452
315139799257612,2560cyclictest3223943-21kworker/2:0+events22:59:172
315139799257512,2558cyclictest3220469-21kworker/2:0+events22:45:372
315139999257412,2559cyclictest3156646-21kworker/3:2+events19:25:493
315139799257410,2560cyclictest3252945-21kworker/2:0+events00:37:262
315139799257112,2555cyclictest3164436-21kworker/2:1+events20:05:402
315139399257112,2555cyclictest3209288-21kworker/1:0+events22:37:101
315139799257012,2555cyclictest3155062-21kworker/2:0+events19:46:442
315139399257011,2555cyclictest3177350-21kworker/1:2+events20:29:351
315138999256912,2553cyclictest3190324-21kworker/0:1+events21:19:120
315139799256811,2554cyclictest3241699-21kworker/2:1+events23:58:192
315139799256811,2553cyclictest3241699-21kworker/2:1+events00:01:432
315139799256712,2551cyclictest3236487-21kworker/2:1+events23:40:292
315139799256712,2551cyclictest3236487-21kworker/2:1+events23:40:282
315139799256712,2551cyclictest3228428-21kworker/2:1+events23:17:172
315139799256711,2552cyclictest3222332-21kworker/2:2+events22:54:222
315139799256612,2552cyclictest3212405-21kworker/2:2+events22:20:032
315139799256512,2549cyclictest3236487-21kworker/2:1+events23:37:462
315139799256312,2547cyclictest3241699-21kworker/2:1+events00:16:282
315139799256312,2547cyclictest3176215-21kworker/2:2+events20:44:292
315139799256211,2549cyclictest3231622-21kworker/2:0+events23:47:452
315139799256112,2545cyclictest3201415-21kworker/2:0+events21:53:152
31513899925609,2548cyclictest3178980-21kworker/0:1+events20:34:550
315139799255912,2543cyclictest3166285-21kworker/2:0+events19:55:522
315139799255812,2542cyclictest3180419-21kworker/2:0+events20:39:292
315139799254911,2534cyclictest3174429-21kworker/2:1+events20:26:582
315139399254913,2532cyclictest3169495-21kworker/1:0+events20:14:451
315139799254310,2530cyclictest3185433-21kworker/2:2+events21:14:362
315138999254011,2525cyclictest3161157-21kworker/0:0+events19:40:350
315139999253813,2522cyclictest3210897-21kworker/3:0+events22:14:473
315139399253712,2521cyclictest3198124-21kworker/1:2+events21:37:231
315139999253513,2519cyclictest3215758-21kworker/3:0+events22:34:523
315139399253012,2512cyclictest3226979-21kworker/1:1+events23:13:051
315139999252913,2513cyclictest3188868-21kworker/3:2+events21:10:213
315139399252712,2511cyclictest3172750-21kworker/1:2+events20:15:321
31513979925258,2513cyclictest3240069-21kworker/2:2+events23:50:462
315138999252510,2511cyclictest3249486-21kworker/0:2+events00:19:540
315139399252412,2508cyclictest3158309-21kworker/1:3+events19:32:151
315139399252411,2510cyclictest3204812-21kworker/1:2+events22:12:271
315139999252311,2508cyclictest3190562-21kworker/3:0+events21:20:223
315139999252212,2507cyclictest3233199-21kworker/3:1+events23:24:553
315139399252211,2508cyclictest3230192-21kworker/1:0+events23:19:111
315139399252112,2505cyclictest3204812-21kworker/1:2+events22:26:521
315139999251813,2502cyclictest3209193-21kworker/3:1+events22:07:043
315139399251712,2501cyclictest3236407-21kworker/1:0+events23:36:191
315138999251611,2501cyclictest3171066-21kworker/0:2+events20:11:230
315139399251312,2497cyclictest3230192-21kworker/1:0+events23:22:591
315139399251312,2497cyclictest3187064-21kworker/1:0+events20:58:121
31513939925130,2509cyclictest3190409-21kworker/1:2+events21:09:591
31513899925139,2500cyclictest3217332-21kworker/0:1+events22:37:340
315139799251212,2497cyclictest3155062-21kworker/2:0+events19:42:522
315139399251211,2497cyclictest3196526-21kworker/1:1+events21:28:201
315139999251110,2497cyclictest3222161-21kworker/3:0+events23:11:563
315139399251112,2495cyclictest3166214-21kworker/1:0+events19:56:581
31513939925099,2497cyclictest3253144-21kworker/1:1+events00:30:371
315139399250712,2491cyclictest3175710-21kworker/1:1+events20:23:521
315139999250612,2491cyclictest3167986-21kworker/3:2+events20:00:213
315138999250612,2490cyclictest3171066-21kworker/0:2+events20:22:190
315139399250312,2488cyclictest3169495-21kworker/1:0+events20:34:091
315139999250211,2487cyclictest3251506-21kworker/3:0+events00:27:553
315139799250212,2486cyclictest3196510-21kworker/2:2+events21:27:132
31513899925025,2493cyclictest3161157-21kworker/0:0+events19:38:420
315139999250012,2484cyclictest3174026-21kworker/3:2+events20:38:223
315138999249812,2482cyclictest3227100-21kworker/0:1+events23:05:490
315138999249811,2483cyclictest3220382-21kworker/0:2+events22:47:080
315138999249712,2482cyclictest3178980-21kworker/0:1+events20:47:570
315139999249511,2481cyclictest3182619-21kworker/3:3+events20:54:483
315139399249412,2478cyclictest3256673-21kworker/1:2+events00:35:331
315139999249312,2478cyclictest3233199-21kworker/3:1+events23:57:553
315139999249212,2476cyclictest3193290-21kworker/3:1+events21:29:063
315139799249112,2477cyclictest3196510-21kworker/2:2+events21:40:042
315138999249112,2475cyclictest3199846-21kworker/0:1+events21:42:390
315139999249010,2476cyclictest3161097-21kworker/3:2+events19:51:213
315139999248912,2473cyclictest3196555-21kworker/3:0+events21:38:553
315139399248712,2471cyclictest3209288-21kworker/1:0+events22:58:551
315139799248512,2470cyclictest3180419-21kworker/2:0+events20:46:012
315139399248512,2469cyclictest3196526-21kworker/1:1+events21:30:151
315139999248312,2467cyclictest3233199-21kworker/3:1+events23:29:053
315139799248111,2467cyclictest3241699-21kworker/2:1+events00:20:382
315139999247912,2463cyclictest3233199-21kworker/3:1+events23:38:563
315139399247610,2463cyclictest3251314-21kworker/1:2+events00:18:011
315139799247512,2460cyclictest3217271-21kworker/2:1+events22:40:582
315139999247412,2458cyclictest3187125-21kworker/3:1+events21:06:103
315138999247312,2457cyclictest3178980-21kworker/0:1+events20:50:340
315139799247211,2457cyclictest3191834-21kworker/2:1+events21:17:182
31513999924695,2461cyclictest3209193-21kworker/3:1+events22:27:163
315139999246912,2454cyclictest3246396-21kworker/3:0+events00:11:113
315139999246812,2453cyclictest3217390-21kworker/3:2+events22:41:213
315138999246712,2451cyclictest3233229-21kworker/0:1+events23:22:140
315138999246610,2452cyclictest3178980-21kworker/0:1+events20:42:120
315139399246310,2449cyclictest3156763-21kworker/1:2+events19:52:051
315138999246112,2445cyclictest3236566-21kworker/0:1+events23:38:080
315139799245812,2443cyclictest3214059-21kworker/2:0+events22:33:202
315139799245310,2440cyclictest3210761-21kworker/2:1+events22:17:262
315139399243612,2420cyclictest3154970-21kworker/1:1+events19:22:061
315139999243411,2419cyclictest3230307-21kworker/3:2+events23:15:223
31513899924321,2427cyclictest3192316-21kworker/0:0+events21:59:260
315139999243112,2415cyclictest3174026-21kworker/3:2+events20:22:433
315139399243112,2415cyclictest3180689-21kworker/1:2+events20:43:431
315139999242911,2415cyclictest3180574-21kworker/3:0+events21:00:523
315139799242812,2413cyclictest3144565-21kworker/2:0+events19:11:022
315138999242711,2413cyclictest3251534-21kworker/0:0+events00:22:550
315139999242512,2410cyclictest3175653-21kworker/3:0+events20:26:123
315139399242312,2408cyclictest3244900-21kworker/1:2+events00:00:341
315138999242311,2410cyclictest3175743-21kworker/0:0+events20:25:010
315139399242210,2409cyclictest3192044-21kworker/1:0+events21:21:081
315139399242110,2407cyclictest3241671-21kworker/1:1+events23:54:371
315139399242012,2405cyclictest3149285-21kworker/1:0+events19:18:401
31513999924189,2406cyclictest3175653-21kworker/3:0+events20:31:063
315139999241812,2402cyclictest3233199-21kworker/3:1+events23:54:583
31513899924139,2401cyclictest3192316-21kworker/0:0+events21:49:080
315138999240311,2388cyclictest3217332-21kworker/0:1+events22:42:310
315139999240012,2385cyclictest3166363-21kworker/3:1+events19:58:503
315138999240012,2384cyclictest3185774-21kworker/0:0+events21:01:150
315138999239912,2383cyclictest3206386-21kworker/0:2+events22:03:160
315138999239812,2382cyclictest3247362-21kworker/0:1+events00:07:460
31513899923978,2385cyclictest3164677-21kworker/0:0+events20:02:180
315138999239712,2382cyclictest3223645-21kworker/0:0+events22:55:540
315138999239711,2382cyclictest3230337-21kworker/0:2+events23:16:080
315138999239311,2378cyclictest3234832-21kworker/0:2+events23:28:210
315139999239212,2376cyclictest3249629-21kworker/3:2+events00:24:063
315138999239110,2377cyclictest3238178-21kworker/0:2+events23:56:030
31513999923898,2377cyclictest3152619-21kworker/3:0+events19:19:283
315139999238912,2374cyclictest3134964-21kworker/3:2+events19:13:443
315138999237511,2361cyclictest3210743-21kworker/0:1+events22:26:280
315138999237112,2355cyclictest3217332-21kworker/0:1+events22:50:340
315138999237011,2355cyclictest3203072-21kworker/0:1+events21:50:590
315138999236611,2351cyclictest3195045-21kworker/0:2+events21:34:210
315138999235911,2344cyclictest3236566-21kworker/0:1+events23:33:190
315138999235712,2342cyclictest3154880-21kworker/0:1+events19:21:420
315138999232812,2312cyclictest3158336-21kworker/0:1+events19:34:550
31513899923259,2312cyclictest3192316-21kworker/0:0+events21:38:320
31513979923249,2312cyclictest3171145-21kworker/2:2+events20:10:382
315138999231611,2302cyclictest3154880-21kworker/0:1+events19:18:180
315138999231412,2299cyclictest3175743-21kworker/0:0+events20:37:120
315139799227411,2259cyclictest3222332-21kworker/2:2+events23:08:072
315139799226810,2255cyclictest3231622-21kworker/2:0+events23:34:032
315139399222612,2210cyclictest3149285-21kworker/1:0+events19:11:491
315139399222211,2208cyclictest3215788-21kworker/1:1+events22:32:131
31513899922208,2209cyclictest3146272-21kworker/0:0+events19:14:060
31513999921669,2153cyclictest3243335-21kworker/3:2+events00:03:113
31509162148104,16sleep10-21swapper/119:06:391
31510072144108,31sleep30-21swapper/319:07:503
31509302142110,27sleep00-21swapper/019:06:510
31508962142107,30sleep20-21swapper/219:06:242
3151397993629,5cyclictest3242021-21kworker/u16:4+events_unbound00:25:022
3151397992313,3cyclictest191rcu_preempt00:14:592
3151389992010,7cyclictest593-21dbus-daemon19:50:010
3151389992010,1cyclictest191rcu_preempt21:11:530
315139799191,8cyclictest3227217-21munin-run23:04:592
315139799174,3cyclictest191rcu_preempt20:20:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional