You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 09:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Mon Jun 29, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
329269299517118,5146cyclictest3338878-21kworker/2:0+events21:40:132
329269299452017,4497cyclictest3305530-21kworker/2:2+events20:00:202
329269599399519,3970cyclictest3313172-21kworker/3:2+events20:15:143
329268999367916,3652cyclictest3330949-21kworker/1:2+events21:20:131
329269299342514,3407cyclictest3331232-21kworker/2:2+events21:15:192
329269299315716,3137cyclictest3377762-21kworker/2:2+events23:45:192
329269299305714,3041cyclictest3311752-21kworker/2:1+events20:20:162
329269299304615,3026cyclictest3345366-21kworker/2:2+events22:00:202
329269299304314,3026cyclictest3390264-21kworker/2:2+events00:30:082
329268999303815,3018cyclictest3385363-21kworker/1:1+events00:10:181
32926929930296,3019cyclictest3319797-21kworker/2:1+events20:36:372
329268499301015,2991cyclictest3341864-21kworker/0:0+events21:43:190
329269599300514,2987cyclictest3331042-21kworker/3:2+events21:11:583
329269599300414,2985cyclictest3380685-21kworker/3:0+events23:44:113
329268999300412,2987cyclictest3313358-21kworker/1:2+events20:27:091
329268999300113,2983cyclictest3329344-21kworker/1:0+events21:03:341
329268499299414,2978cyclictest3335857-21kworker/0:2+events21:30:430
329268499297015,2951cyclictest3321514-21kworker/0:1+events20:49:580
329269599296412,2948cyclictest3329377-21kworker/3:1+events21:08:543
32926959929537,2942cyclictest3364458-21kworker/3:1+events22:53:583
329268499294314,2925cyclictest3313234-21kworker/0:2+events20:26:460
329268499294214,2923cyclictest3379036-21kworker/0:1+events23:36:590
329268499293414,2915cyclictest3324798-21kworker/0:2+events20:59:000
329268499293313,2916cyclictest3351687-21kworker/0:0+events22:20:230
329268999293014,2912cyclictest3330949-21kworker/1:2+events21:25:271
329268499292914,2911cyclictest3391747-21kworker/0:0+events00:17:090
329269599292713,2910cyclictest3364458-21kworker/3:1+events23:00:473
329268499292514,2906cyclictest3353771-21kworker/0:2+events22:25:220
329268499292114,2903cyclictest3313234-21kworker/0:2+events20:30:580
329269599292013,2903cyclictest3342043-21kworker/3:0+events21:47:543
329268499291613,2901cyclictest3329289-21kworker/0:0+events21:07:230
329268499291414,2896cyclictest3339090-21kworker/0:3+events21:37:330
329268499291414,2896cyclictest3314940-21kworker/0:0+events20:22:580
329269599291312,2898cyclictest3322898-21kworker/3:0+events20:46:313
329268499291314,2897cyclictest3324798-21kworker/0:2+events21:00:310
329268499290814,2890cyclictest3329289-21kworker/0:0+events21:22:490
329269599290613,2889cyclictest3359597-21kworker/3:2+events22:40:553
329269299289814,2880cyclictest3343584-21kworker/2:1+events21:52:022
329268999289813,2881cyclictest3316626-21kworker/1:0+events20:40:251
32926929928886,2878cyclictest3310154-21kworker/2:0+events20:10:372
32926929928886,2878cyclictest3310154-21kworker/2:0+events20:10:372
329269599287814,2859cyclictest3324525-21kworker/3:1+events20:56:003
32926929928714,2862cyclictest3319797-21kworker/2:1+events20:54:542
329268999286913,2851cyclictest3351765-21kworker/1:0+events22:16:591
329269599285614,2838cyclictest3351453-21kworker/3:1+events22:23:043
32926959928560,2852cyclictest3349793-21kworker/3:2+events22:15:493
32926849928567,2845cyclictest3313234-21kworker/0:2+events20:13:200
32926849928567,2845cyclictest3313234-21kworker/0:2+events20:13:200
329269599285415,2835cyclictest3310572-21kworker/3:1+events20:21:483
329269599285413,2837cyclictest3393379-21kworker/3:2+events00:26:423
329268999285213,2834cyclictest3286136-21kworker/1:0+events19:33:091
329269299285113,2834cyclictest3305530-21kworker/2:2+events19:56:522
329268999285113,2834cyclictest3311603-21kworker/1:0+events20:13:441
329268999285113,2834cyclictest3311603-21kworker/1:0+events20:13:431
329269599285013,2833cyclictest3376183-21kworker/3:1+events23:50:593
329269599285013,2833cyclictest3305344-21kworker/3:0+events19:48:053
329269299284913,2832cyclictest3332967-21kworker/2:0+events21:23:122
329268999284913,2832cyclictest3377165-21kworker/1:2+events23:33:131
329268999284913,2832cyclictest3342461-21kworker/1:2+events21:57:201
329268999284913,2832cyclictest3302082-21kworker/1:1+events19:50:461
329269599284813,2831cyclictest3382294-21kworker/3:2+events23:48:423
329269599284813,2831cyclictest3338758-21kworker/3:1+events21:38:433
329269599284813,2831cyclictest3329377-21kworker/3:1+events21:19:513
32926899928480,2844cyclictest3345185-21kworker/1:1+events21:53:351
329269599284713,2830cyclictest3327755-21kworker/3:0+events21:02:473
329269599284513,2828cyclictest3374261-21kworker/3:2+events23:24:463
329268999284413,2826cyclictest3385363-21kworker/1:1+events23:58:331
329268999284411,2829cyclictest3367533-21kworker/1:2+events23:05:151
329269599284313,2826cyclictest3337128-21kworker/3:2+events21:28:493
329268999284313,2826cyclictest3316626-21kworker/1:0+events20:31:211
329268999284313,2826cyclictest3313358-21kworker/1:2+events20:16:021
329268999284313,2825cyclictest3316626-21kworker/1:0+events20:52:371
329269299284214,2823cyclictest3351424-21kworker/2:1+events22:28:022
329268999284013,2823cyclictest3305313-21kworker/1:0+events19:56:311
329269299283914,2823cyclictest3364338-21kworker/2:2+events23:00:012
329268999283813,2820cyclictest3362674-21kworker/1:0+events22:48:131
329268499283813,2821cyclictest3348461-21kworker/0:2+events22:04:530
329268999283713,2820cyclictest3330949-21kworker/1:2+events21:12:421
329269599283613,2819cyclictest3367765-21kworker/3:2+events23:10:503
329269599283513,2818cyclictest3370865-21kworker/3:1+events23:18:003
329268999283514,2817cyclictest3364279-21kworker/1:1+events22:52:011
329268999283513,2820cyclictest3286136-21kworker/1:0+events19:36:131
329269599283313,2816cyclictest3292065-21kworker/3:1+events19:44:173
329268999283313,2816cyclictest3320141-21kworker/1:1+events20:37:001
329269599283213,2814cyclictest3307046-21kworker/3:1+events19:56:093
32926899928328,2820cyclictest3362674-21kworker/1:0+events22:59:391
329268999283013,2813cyclictest3326072-21kworker/1:1+events21:19:281
329268999283013,2812cyclictest3335798-21kworker/1:0+events21:49:451
329269599282813,2811cyclictest3356432-21kworker/3:0+events22:39:023
329269599282813,2810cyclictest3324525-21kworker/3:1+events20:52:143
329268499282613,2811cyclictest3341864-21kworker/0:0+events21:45:360
329269599282513,2808cyclictest3385777-21kworker/3:3+events00:01:343
329268999282510,2811cyclictest3369154-21kworker/1:0+events23:18:471
329269599282416,2804cyclictest3342043-21kworker/3:0+events21:53:113
329269599282413,2807cyclictest3308673-21kworker/3:2+events20:04:133
329269599282412,2808cyclictest3382294-21kworker/3:2+events23:56:193
329269299282414,2806cyclictest3351424-21kworker/2:1+events22:13:572
329269599282313,2806cyclictest3305344-21kworker/3:0+events20:05:213
329269599282313,2806cyclictest3297631-21kworker/3:0+events19:31:143
329269299282314,2805cyclictest3345366-21kworker/2:2+events21:55:522
329268999282211,2807cyclictest3335798-21kworker/1:0+events21:40:581
329268999282210,2808cyclictest3385363-21kworker/1:1+events00:06:321
329269599282114,2803cyclictest3332696-21kworker/3:0+events21:21:203
329269599281813,2801cyclictest3372610-21kworker/3:0+events23:33:593
329269599281613,2799cyclictest3349793-21kworker/3:2+events22:06:483
329268999281613,2799cyclictest3292197-21kworker/1:1+events19:15:591
329268999281513,2798cyclictest3354584-21kworker/1:2+events22:23:511
329269599281413,2799cyclictest3320062-21kworker/3:1+events20:40:023
329268999281213,2795cyclictest3308646-21kworker/1:1+events20:01:521
329269599281113,2794cyclictest3292065-21kworker/3:1+events19:28:113
329268999281113,2794cyclictest3364279-21kworker/1:1+events23:04:081
329268999281113,2794cyclictest3302082-21kworker/1:1+events19:49:141
32926899928108,2798cyclictest3326072-21kworker/1:1+events21:05:291
329269599280913,2792cyclictest3342043-21kworker/3:0+events22:02:133
329269599280911,2794cyclictest3367765-21kworker/3:2+events23:05:573
329269599280813,2791cyclictest3398132-21kworker/3:2+events00:38:293
329269599280513,2790cyclictest3316535-21kworker/3:2+events20:35:073
329269599280513,2788cyclictest3292065-21kworker/3:1+events19:14:263
329268999280513,2788cyclictest3354584-21kworker/1:2+events22:33:181
329268999280513,2788cyclictest3308646-21kworker/1:1+events20:09:051
329269599280413,2787cyclictest3349793-21kworker/3:2+events22:13:343
329269599280413,2787cyclictest3305344-21kworker/3:0+events19:53:533
329269299280413,2787cyclictest3292264-21kworker/2:0+events19:29:182
329268999280413,2789cyclictest3316626-21kworker/1:0+events20:55:381
329268999280413,2787cyclictest3354584-21kworker/1:2+events22:37:311
329268999280413,2787cyclictest3292197-21kworker/1:1+events19:24:001
329269599280313,2786cyclictest3388549-21kworker/3:0+events00:13:433
329269599280313,2786cyclictest3374261-21kworker/3:2+events23:27:493
329269599280313,2785cyclictest3382294-21kworker/3:2+events00:08:043
329268999280313,2786cyclictest3377165-21kworker/1:2+events23:41:541
329269299280213,2785cyclictest3362707-21kworker/2:0+events22:56:352
329268499280213,2785cyclictest3369009-21kworker/0:2+events23:11:340
329269599280113,2784cyclictest3342043-21kworker/3:0+events21:43:423
329269599280113,2784cyclictest3310572-21kworker/3:1+events20:14:063
329269599280113,2784cyclictest3310572-21kworker/3:1+events20:14:053
329269599280013,2783cyclictest3356432-21kworker/3:0+events22:47:503
329268999279913,2782cyclictest3354584-21kworker/1:2+events22:41:201
329269599279810,2784cyclictest3376183-21kworker/3:1+events23:37:223
329268999279813,2781cyclictest3396770-21kworker/1:1+events00:35:281
329268999279813,2781cyclictest3345185-21kworker/1:1+events22:07:541
329268499279813,2781cyclictest3361347-21kworker/0:1+events22:57:450
329269599279712,2781cyclictest3342043-21kworker/3:0+events21:56:153
329268999279712,2781cyclictest3298906-21kworker/1:2+events19:27:261
329269599279613,2779cyclictest3292065-21kworker/3:1+events19:24:463
329268999279613,2779cyclictest3322330-21kworker/1:2+events20:49:131
329269599279513,2778cyclictest3393379-21kworker/3:2+events00:22:573
329268999279410,2780cyclictest3382340-21kworker/1:0+events23:49:051
329268999279313,2776cyclictest3385363-21kworker/1:1+events00:03:271
329269299279213,2775cyclictest3377762-21kworker/2:2+events23:54:232
329268999279113,2775cyclictest3391902-21kworker/1:1+events00:23:191
329268999279013,2774cyclictest3382340-21kworker/1:0+events23:51:451
329268999279012,2774cyclictest3351765-21kworker/1:0+events22:26:311
329269599278813,2771cyclictest3292065-21kworker/3:1+events19:17:303
329268999278714,2769cyclictest3313358-21kworker/1:2+events20:24:541
329268999278613,2771cyclictest3395108-21kworker/1:2+events00:31:171
329268499278414,2766cyclictest3310215-21kworker/0:1+events20:04:350
329268499278413,2766cyclictest3361347-21kworker/0:1+events22:49:450
329268999278010,2766cyclictest3335798-21kworker/1:0+events21:35:421
329268999277813,2761cyclictest3369154-21kworker/1:0+events23:12:431
329268999277513,2758cyclictest3303709-21kworker/1:2+events19:42:431
329268999277113,2754cyclictest3345185-21kworker/1:1+events22:02:361
329269299277012,2754cyclictest3329409-21kworker/2:1+events21:10:282
329268499276813,2751cyclictest3382247-21kworker/0:1+events23:58:110
329268499276813,2751cyclictest3335857-21kworker/0:2+events21:28:270
329268499276810,2754cyclictest3372643-21kworker/0:1+events23:19:070
32926929927664,2758cyclictest3296008-21kworker/2:1+events19:23:382
329268499276613,2749cyclictest3351687-21kworker/0:0+events22:31:470
329268499276612,2750cyclictest3358023-21kworker/0:1+events22:36:230
329268499276611,2751cyclictest3319736-21kworker/0:0+events20:43:280
329268999276513,2748cyclictest3390296-21kworker/1:2+events00:19:511
329268499276513,2748cyclictest3361347-21kworker/0:1+events23:01:080
329268499276413,2747cyclictest3345153-21kworker/0:0+events21:57:440
329268999276310,2749cyclictest3393520-21kworker/1:0+events00:28:351
329268499276313,2746cyclictest3294188-21kworker/0:0+events19:24:230
329268499276213,2745cyclictest3321514-21kworker/0:1+events20:53:460
32926849927619,2748cyclictest3329289-21kworker/0:0+events21:12:210
329268499276113,2744cyclictest3294188-21kworker/0:0+events19:19:030
329268499276013,2743cyclictest3310215-21kworker/0:1+events20:16:260
329268499276013,2743cyclictest3299284-21kworker/0:1+events19:36:360
329268499276012,2744cyclictest3380655-21kworker/0:2+events23:49:290
329268499275913,2742cyclictest3374318-21kworker/0:2+events23:26:180
329268499275913,2742cyclictest3303833-21kworker/0:2+events19:44:390
329268499275813,2743cyclictest3351687-21kworker/0:0+events22:40:350
329268499275813,2741cyclictest3348461-21kworker/0:2+events22:07:320
329268499275713,2742cyclictest3382247-21kworker/0:1+events00:00:250
329268499275713,2738cyclictest3361347-21kworker/0:1+events22:51:140
329269599275613,2739cyclictest3362855-21kworker/3:2+events22:56:133
329268499275613,2741cyclictest3299284-21kworker/0:1+events19:45:240
329269599275513,2738cyclictest3316535-21kworker/3:2+events20:27:343
329268499275513,2738cyclictest3310215-21kworker/0:1+events20:07:120
329268499275411,2741cyclictest3350093-21kworker/0:1+events22:15:050
329268499275013,2733cyclictest3382247-21kworker/0:1+events23:54:010
329268499274813,2733cyclictest3374318-21kworker/0:2+events23:30:070
329268499274813,2731cyclictest3319736-21kworker/0:0+events20:38:330
329269299274713,2730cyclictest3390264-21kworker/2:2+events00:19:282
329268499274713,2730cyclictest3395013-21kworker/0:2+events00:33:330
32926849927424,2734cyclictest3361347-21kworker/0:1+events23:05:370
329269299273911,2724cyclictest3377762-21kworker/2:2+events23:40:002
329269599273412,2718cyclictest3338758-21kworker/3:1+events21:32:383
329268499272413,2707cyclictest3294194-21kworker/0:3+events19:33:540
329268499272412,2708cyclictest3395013-21kworker/0:2+events00:29:220
329268499272311,2708cyclictest3303833-21kworker/0:2+events19:52:210
329269299271911,2704cyclictest3379359-21kworker/2:1+events23:44:342
329268499271811,2703cyclictest3306922-21kworker/0:0+events19:59:560
329268499271513,2700cyclictest3382247-21kworker/0:1+events00:05:230
329268499271511,2700cyclictest3350093-21kworker/0:1+events22:10:320
329268499271413,2697cyclictest3372643-21kworker/0:1+events23:24:240
329269299271313,2696cyclictest3313445-21kworker/2:2+events20:17:132
329269299271213,2695cyclictest3319797-21kworker/2:1+events20:43:072
329268499271213,2695cyclictest3382247-21kworker/0:1+events00:21:230
329268499271113,2696cyclictest3395013-21kworker/0:2+events00:37:460
329268499270913,2693cyclictest3382247-21kworker/0:1+events00:14:260
329269299270414,2686cyclictest3357994-21kworker/2:2+events22:39:242
329269299270313,2686cyclictest3371274-21kworker/2:0+events23:19:542
329269299269912,2683cyclictest3351424-21kworker/2:1+events22:15:262
329269299269811,2683cyclictest3317157-21kworker/2:0+events20:30:122
329268499269713,2680cyclictest3329289-21kworker/0:0+events21:18:450
329269599269613,2679cyclictest3292065-21kworker/3:1+events19:35:493
329269299269612,2680cyclictest3357994-21kworker/2:2+events22:44:032
329269299269513,2679cyclictest3351424-21kworker/2:1+events22:21:092
329269299269510,2681cyclictest3313445-21kworker/2:2+events20:29:262
329269299269413,2677cyclictest3390264-21kworker/2:2+events00:22:092
329269299269313,2676cyclictest3376122-21kworker/2:0+events23:32:042
329269299269313,2675cyclictest3302238-21kworker/2:0+events19:41:112
329268999269013,2673cyclictest3377165-21kworker/1:2+events23:35:291
329269299268712,2671cyclictest3394875-21kworker/2:0+events00:35:512
329269299268513,2668cyclictest3329409-21kworker/2:1+events21:07:002
32926929926849,2671cyclictest3302238-21kworker/2:0+events19:38:532
329269299268413,2667cyclictest3351424-21kworker/2:1+events22:30:402
329269299268413,2667cyclictest3310154-21kworker/2:0+events20:05:452
329269299268213,2665cyclictest3337156-21kworker/2:2+events21:37:112
329269299268113,2664cyclictest3385686-21kworker/2:0+events00:09:322
329269299268113,2664cyclictest3374142-21kworker/2:2+events23:22:532
329269299268112,2665cyclictest3337156-21kworker/2:2+events21:27:212
329269299267812,2662cyclictest3292264-21kworker/2:0+events19:17:082
329269299267513,2658cyclictest3390264-21kworker/2:2+events00:25:372
329269299267113,2654cyclictest3345366-21kworker/2:2+events22:06:242
329269299267111,2656cyclictest3385686-21kworker/2:0+events00:00:482
329269299266711,2652cyclictest3337156-21kworker/2:2+events21:33:012
329269599266513,2648cyclictest3351453-21kworker/3:1+events22:34:293
329268499265713,2640cyclictest3339090-21kworker/0:3+events21:52:260
329269299265213,2635cyclictest3305530-21kworker/2:2+events19:52:422
329269299265113,2635cyclictest3327724-21kworker/2:0+events20:58:132
329268999264213,2625cyclictest3369154-21kworker/1:0+events23:28:111
329269299263913,2622cyclictest3374142-21kworker/2:2+events23:25:562
329269299263912,2623cyclictest3362707-21kworker/2:0+events22:51:372
329268999263913,2622cyclictest3337393-21kworker/1:1+events21:30:211
329269599263711,2622cyclictest3314781-21kworker/3:0+events20:33:153
329269299263513,2618cyclictest3319797-21kworker/2:1+events20:46:552
329269299263410,2620cyclictest3293992-21kworker/2:2+events19:14:492
329269299263213,2617cyclictest3338878-21kworker/2:0+events21:47:302
329268499262113,2604cyclictest3380655-21kworker/0:2+events23:42:180
329268999259113,2574cyclictest3372675-21kworker/1:2+events23:20:391
329269299257612,2560cyclictest3302238-21kworker/2:0+events19:49:372
329269599257412,2558cyclictest3351453-21kworker/3:1+events22:29:573
329269599257315,2555cyclictest3388549-21kworker/3:0+events00:16:003
32926959925678,2556cyclictest3395075-21kworker/3:0+events00:30:313
329268999254710,2533cyclictest3286136-21kworker/1:0+events19:11:501
329269299251811,2503cyclictest3359806-21kworker/2:1+events22:45:552
329269299249613,2480cyclictest3327724-21kworker/2:0+events21:03:112
329268499248412,2468cyclictest3290661-21kworker/0:2+events19:13:210
329269299247312,2458cyclictest3383942-21kworker/2:1+events23:55:332
329269299245912,2443cyclictest3364338-21kworker/2:2+events23:06:452
329269299241112,2397cyclictest3388669-21kworker/2:1+events00:11:482
329269299239411,2379cyclictest3297663-21kworker/2:2+events19:32:232
32923862156112,25sleep30-21swapper/319:09:333
32923802144111,28sleep20-21swapper/219:09:272
32923832142108,29sleep00-21swapper/019:09:300
32910852139112,22sleep10-21swapper/119:05:021
3292689992312,8cyclictest3350919-21ntpq22:10:181
3292692992218,2cyclictest3371242-21systemd-run23:15:002
3292684991910,7cyclictest3298455-21ntpq19:25:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional