You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 07:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Tue Aug 04, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
362573699442819,4405cyclictest3653001-21kworker/1:0+events20:45:071
362573999404319,4018cyclictest3633832-21kworker/2:0+events19:40:192
362573999389913,3883cyclictest3661150-21kworker/2:0+events21:00:172
362573699336610,3351cyclictest3662648-21kworker/1:1+events21:15:201
362573699336015,3341cyclictest3669402-21kworker/1:2+events21:25:221
362573299334613,3328cyclictest3637074-21kworker/0:1+events19:50:180
362574299315815,3138cyclictest3670949-21kworker/3:0+events21:35:193
362573699303216,3011cyclictest3697489-21kworker/1:1+events23:05:181
362573699296313,2946cyclictest3684170-21kworker/1:1+events22:24:371
362574299295814,2940cyclictest3652892-21kworker/3:0+events20:31:243
362573699293314,2915cyclictest3640379-21kworker/1:2+events19:59:461
362573699291814,2900cyclictest3648541-21kworker/1:2+events20:25:211
362573699291213,2894cyclictest3653001-21kworker/1:0+events20:37:531
362573999290514,2887cyclictest3710792-21kworker/2:2+events23:35:162
362573699288013,2862cyclictest3690082-21kworker/1:2+events22:35:121
362573999283914,2821cyclictest3685412-21kworker/2:0+events22:23:062
362573299283810,2825cyclictest3659784-21kworker/0:2+events21:05:400
362573299282614,2807cyclictest3673993-21kworker/0:1+events21:45:140
362574299281812,2802cyclictest3694763-21kworker/3:1+events23:01:513
362573999281013,2792cyclictest3682071-21kworker/2:2+events22:05:232
362573699281013,2795cyclictest3688366-21kworker/1:0+events22:25:221
362573299280713,2790cyclictest3689901-21kworker/0:1+events22:32:120
362573299280613,2789cyclictest3703035-21kworker/0:2+events23:09:030
362573299280213,2787cyclictest3643515-21kworker/0:2+events20:11:150
362573299279813,2781cyclictest3694946-21kworker/0:2+events22:49:210
362573699278014,2764cyclictest3633879-21kworker/1:0+events20:01:191
362573699276413,2749cyclictest3722031-21kworker/1:2+events00:27:321
362573699276311,2748cyclictest3682218-21kworker/1:2+events22:11:531
362573699276112,2745cyclictest3633879-21kworker/1:0+events19:35:451
362573699276112,2745cyclictest3633879-21kworker/1:0+events19:35:451
362573699275913,2742cyclictest3711079-21kworker/1:1+events23:38:201
362573699275813,2741cyclictest3646853-21kworker/1:0+events20:24:331
362573699275813,2740cyclictest3690082-21kworker/1:2+events22:48:571
362573699275713,2740cyclictest3727291-21kworker/1:1+events00:31:181
362573299275713,2740cyclictest3647179-21kworker/0:1+events20:18:250
362573699275611,2742cyclictest3669402-21kworker/1:2+events21:33:251
362573699275611,2742cyclictest3669402-21kworker/1:2+events21:33:251
362573699275512,2739cyclictest3671097-21kworker/1:0+events21:50:331
362573699275413,2739cyclictest3657922-21kworker/1:2+events20:50:071
362573699274413,2727cyclictest3722031-21kworker/1:2+events00:19:531
362574299274314,2727cyclictest3652892-21kworker/3:0+events20:35:133
362573699274112,2725cyclictest3693406-21kworker/1:1+events22:44:471
362573699273510,2721cyclictest3662648-21kworker/1:1+events21:22:411
362573699273412,2718cyclictest3654629-21kworker/1:2+events20:42:471
362573699272713,2710cyclictest3682218-21kworker/1:2+events22:06:521
362573699272413,2707cyclictest3722031-21kworker/1:2+events00:14:101
362574299272013,2703cyclictest3674203-21kworker/3:2+events21:41:233
362573699271913,2702cyclictest3671097-21kworker/1:0+events21:38:441
362573699271812,2703cyclictest3646853-21kworker/1:0+events20:18:011
362573999271713,2700cyclictest3638679-21kworker/2:1+events20:13:112
362573699271513,2698cyclictest3718765-21kworker/1:0+events00:09:581
362573699271411,2699cyclictest3624000-21kworker/1:0+events19:17:101
362573699271313,2696cyclictest3731700-21kworker/1:2+events00:39:401
362573699271313,2696cyclictest3720408-21kworker/1:1+events00:03:261
362573699271313,2696cyclictest3697489-21kworker/1:1+events23:03:431
362573699271313,2696cyclictest3638043-21kworker/1:1+events19:50:411
362573699271310,2699cyclictest3640379-21kworker/1:2+events20:08:581
362573999271112,2694cyclictest3646297-21kworker/2:0+events20:36:442
362573699271113,2694cyclictest3662648-21kworker/1:1+events21:01:231
362574299271013,2693cyclictest3646803-21kworker/3:1+events20:17:413
362573999271010,2696cyclictest3638679-21kworker/2:1+events19:47:582
362573699271013,2693cyclictest3684170-21kworker/1:1+events22:19:211
36257369927099,2696cyclictest3630489-21kworker/1:1+events19:31:281
362573699270913,2692cyclictest3715553-21kworker/1:2+events23:58:551
362573699270913,2692cyclictest3664546-21kworker/1:2+events21:12:151
362573699270913,2692cyclictest3657922-21kworker/1:2+events20:58:511
362573699270913,2692cyclictest3638043-21kworker/1:1+events19:46:481
362573999270813,2691cyclictest3672465-21kworker/2:0+events21:34:342
362573999270813,2691cyclictest3672465-21kworker/2:0+events21:34:342
362573999270813,2691cyclictest3646297-21kworker/2:0+events20:30:392
362573999270812,2694cyclictest3661150-21kworker/2:0+events21:06:502
362573699270713,2690cyclictest3697489-21kworker/1:1+events22:51:131
362573699270711,2692cyclictest3677191-21kworker/1:1+events22:00:491
362573999270613,2691cyclictest3638679-21kworker/2:1+events20:00:092
362574299270513,2688cyclictest3696365-21kworker/3:2+events22:49:433
362574299270413,2689cyclictest3670949-21kworker/3:0+events21:31:073
362574299270413,2689cyclictest3670949-21kworker/3:0+events21:31:063
362573699270411,2689cyclictest3671097-21kworker/1:0+events21:41:451
362574299270313,2686cyclictest3648752-21kworker/3:0+events20:23:483
362573999270311,2688cyclictest3720376-21kworker/2:0+events00:20:172
362573699270213,2685cyclictest3702882-21kworker/1:0+events23:26:261
362573999270112,2685cyclictest3707915-21kworker/2:1+events23:44:452
362573699270111,2686cyclictest3697489-21kworker/1:1+events22:57:181
362573999269913,2682cyclictest3654539-21kworker/2:1+events20:50:292
36257429926967,2685cyclictest3726989-21kworker/3:2+events00:28:413
362573999269511,2680cyclictest3682071-21kworker/2:2+events22:15:342
362573299269513,2678cyclictest3653143-21kworker/0:0+events20:35:350
362573299269312,2677cyclictest3710759-21kworker/0:0+events23:43:130
362574299269213,2675cyclictest3684906-21kworker/3:2+events22:17:243
362573999268913,2672cyclictest3702938-21kworker/2:0+events23:10:572
362573999268913,2672cyclictest3702938-21kworker/2:0+events23:10:572
362573299268813,2671cyclictest3637074-21kworker/0:1+events19:59:230
362573699268312,2667cyclictest3711079-21kworker/1:1+events23:43:581
362574299268113,2664cyclictest3691537-21kworker/3:2+events22:33:423
362573299268012,2664cyclictest3677565-21kworker/0:3+events21:53:560
362574299267513,2658cyclictest3708185-21kworker/3:2+events23:30:133
362573999267511,2662cyclictest3646297-21kworker/2:0+events20:40:092
362574299267413,2657cyclictest3728635-21kworker/3:1+events00:32:053
362574299267413,2657cyclictest3667699-21kworker/3:1+events21:19:583
362573299267213,2656cyclictest3669432-21kworker/0:2+events21:30:200
362573299267213,2656cyclictest3669432-21kworker/0:2+events21:30:200
362574299266813,2651cyclictest3717984-21kworker/3:1+events23:59:383
362574299266810,2654cyclictest3632324-21kworker/3:0+events19:40:433
362574299266713,2651cyclictest3654875-21kworker/3:3+events21:02:343
362574299266610,2652cyclictest3662862-21kworker/3:1+events21:09:563
362573299266613,2649cyclictest3666094-21kworker/0:0+events21:21:550
362573999266413,2647cyclictest3707915-21kworker/2:1+events23:27:572
362573999266412,2648cyclictest3646297-21kworker/2:0+events20:27:122
362573699266412,2648cyclictest3677191-21kworker/1:1+events21:47:071
362574299266313,2648cyclictest3706400-21kworker/3:0+events00:01:093
362574299266311,2649cyclictest3703148-21kworker/3:1+events23:10:343
362574299266311,2649cyclictest3703148-21kworker/3:1+events23:10:343
362573999266310,2649cyclictest3638679-21kworker/2:1+events19:51:272
362574299266213,2646cyclictest3682542-21kworker/3:1+events22:09:363
362574299266213,2645cyclictest3640220-21kworker/3:1+events20:06:413
362573999266213,2647cyclictest3638679-21kworker/2:1+events20:15:012
362573299266213,2645cyclictest3634500-21kworker/0:2+events19:36:310
362573299266213,2645cyclictest3634500-21kworker/0:2+events19:36:310
362573299266113,2644cyclictest3647179-21kworker/0:1+events20:29:520
362573999266013,2643cyclictest3685412-21kworker/2:0+events22:26:532
362574299265913,2642cyclictest3696365-21kworker/3:2+events22:52:233
362574299265813,2641cyclictest3669330-21kworker/3:2+events21:28:493
362574299265813,2641cyclictest3626873-21kworker/3:2+events19:12:383
36257399926588,2646cyclictest3728652-21kworker/2:0+events00:32:282
362573999265712,2643cyclictest3696370-21kworker/2:1+events22:50:052
362573299265713,2639cyclictest3677565-21kworker/0:3+events22:10:430
36257429926569,2643cyclictest3632324-21kworker/3:0+events19:49:303
362574299265613,2639cyclictest3654875-21kworker/3:3+events20:52:023
362573999265513,2638cyclictest3701249-21kworker/2:1+events23:07:092
362574299265313,2636cyclictest3680944-21kworker/3:0+events22:03:533
362573999265312,2637cyclictest3730249-21kworker/2:2+events00:38:072
362574299265113,2634cyclictest3651300-21kworker/3:1+events20:44:443
36257399926513,2645cyclictest3654539-21kworker/2:1+events20:55:272
362573999265113,2635cyclictest3706179-21kworker/2:2+events23:19:412
362573999265112,2636cyclictest3722060-21kworker/2:2+events00:11:512
362574299265013,2634cyclictest3661215-21kworker/3:0+events20:59:563
362574299265013,2634cyclictest3643543-21kworker/3:2+events20:12:483
362574299265013,2633cyclictest3630607-21kworker/3:2+events19:36:093
362574299265013,2633cyclictest3630607-21kworker/3:2+events19:36:083
362573999265013,2634cyclictest3701249-21kworker/2:1+events23:03:212
362573299265013,2633cyclictest3710759-21kworker/0:0+events23:53:370
362574299264913,2634cyclictest3703148-21kworker/3:1+events23:20:243
362574299264913,2632cyclictest3694763-21kworker/3:1+events22:59:593
362574299264910,2635cyclictest3682542-21kworker/3:1+events22:14:523
362573999264913,2632cyclictest3648401-21kworker/2:2+events20:21:052
362573999264912,2634cyclictest3623872-21kworker/2:1+events19:22:072
362574299264813,2631cyclictest3712458-21kworker/3:2+events23:39:503
362574299264813,2631cyclictest3689932-21kworker/3:1+events22:29:333
362573999264713,2630cyclictest3678852-21kworker/2:0+events21:57:002
362573299264213,2625cyclictest3637074-21kworker/0:1+events20:02:280
362573999264113,2625cyclictest3623872-21kworker/2:1+events19:29:142
362573999263810,2624cyclictest3685412-21kworker/2:0+events22:34:502
362573999263712,2621cyclictest3667925-21kworker/2:1+events21:27:412
362573999263610,2622cyclictest3661150-21kworker/2:0+events21:19:152
362573299263313,2617cyclictest3677565-21kworker/0:3+events22:08:020
362573299263114,2613cyclictest3710759-21kworker/0:0+events00:06:060
362573299262713,2612cyclictest3725308-21kworker/0:1+events00:21:040
362573299262712,2611cyclictest3671217-21kworker/0:0+events21:39:280
362573299262513,2608cyclictest3673993-21kworker/0:1+events21:42:090
362573299262513,2608cyclictest3664484-21kworker/0:1+events21:13:230
362573299262313,2606cyclictest3632406-21kworker/0:0+events19:33:010
362573299262113,2606cyclictest3730044-21kworker/0:1+events00:35:050
362573299262113,2604cyclictest3706323-21kworker/0:1+events23:23:030
362573299262113,2604cyclictest3647179-21kworker/0:1+events20:22:160
362573299262112,2604cyclictest3625344-21kworker/0:0+events19:18:410
36257329926198,2607cyclictest3706323-21kworker/0:1+events23:26:050
362573299261913,2602cyclictest3689901-21kworker/0:1+events22:37:530
362573299261813,2602cyclictest3693230-21kworker/0:0+events22:44:230
362574299261613,2600cyclictest3677433-21kworker/3:0+events21:50:543
362573299261411,2601cyclictest3659784-21kworker/0:2+events20:56:130
36257329926139,2600cyclictest3625344-21kworker/0:0+events19:20:590
362574299261213,2596cyclictest3657306-21kworker/3:0+events20:48:353
362573699261112,2596cyclictest3624000-21kworker/1:0+events19:21:221
362573699261112,2595cyclictest3713922-21kworker/1:0+events23:50:571
36257429926089,2595cyclictest3651300-21kworker/3:1+events20:26:503
362573299260611,2591cyclictest3643515-21kworker/0:2+events20:08:340
362573699259712,2581cyclictest3709425-21kworker/1:2+events23:34:521
362574299259511,2581cyclictest3701457-21kworker/3:2+events23:15:573
362574299258912,2572cyclictest3701457-21kworker/3:2+events23:09:483
362574299258812,2574cyclictest3630607-21kworker/3:2+events19:25:083
36257329925826,2573cyclictest3669432-21kworker/0:2+events21:25:450
36257329925821,2578cyclictest3703035-21kworker/0:2+events23:17:500
362573299258112,2565cyclictest3696637-21kworker/0:1+events22:51:590
362574299257911,2564cyclictest3638637-21kworker/3:2+events19:51:043
362573299257812,2562cyclictest3654750-21kworker/0:2+events20:41:170
362573299257712,2561cyclictest3710759-21kworker/0:0+events23:47:060
362573299257712,2561cyclictest3647179-21kworker/0:1+events20:34:030
362573299257612,2560cyclictest3647179-21kworker/0:1+events20:49:440
362573999257012,2554cyclictest3678852-21kworker/2:0+events22:02:202
362573699257013,2553cyclictest3702882-21kworker/1:0+events23:21:521
362573299256810,2555cyclictest3677565-21kworker/0:3+events21:56:150
362573999256713,2550cyclictest3633832-21kworker/2:0+events19:36:542
362573999256713,2550cyclictest3633832-21kworker/2:0+events19:36:542
362574299256313,2547cyclictest3622065-21kworker/3:1+events19:24:003
362574299256212,2547cyclictest3706400-21kworker/3:0+events23:25:203
362573699256013,2543cyclictest3653001-21kworker/1:0+events20:33:411
362573299255812,2542cyclictest3719091-21kworker/0:3+events00:04:580
362573299254412,2528cyclictest3701428-21kworker/0:1+events23:11:190
362573299254412,2528cyclictest3701428-21kworker/0:1+events23:11:190
362573299253912,2523cyclictest3723601-21kworker/0:2+events00:13:460
36257429925369,2523cyclictest3679073-21kworker/3:1+events21:58:543
362574299253413,2517cyclictest3640220-21kworker/3:1+events19:57:303
362573699253112,2516cyclictest3702882-21kworker/1:0+events23:12:271
362573699253112,2516cyclictest3702882-21kworker/1:0+events23:12:271
362573999252913,2512cyclictest3633832-21kworker/2:0+events19:56:212
362573999252712,2512cyclictest3666246-21kworker/2:2+events21:13:462
362573699251812,2503cyclictest3662648-21kworker/1:1+events21:08:471
36257399925129,2499cyclictest3720376-21kworker/2:0+events00:03:492
362574299250413,2487cyclictest3661215-21kworker/3:0+events21:14:093
362573299250413,2489cyclictest3685385-21kworker/0:0+events22:22:440
36257369925008,2488cyclictest3715553-21kworker/1:2+events23:47:291
36257329925006,2490cyclictest3689901-21kworker/0:1+events22:26:290
362573299249812,2482cyclictest3629070-21kworker/0:2+events19:28:060
362573699249712,2481cyclictest3645209-21kworker/1:1+events20:14:401
36257369924868,2474cyclictest3633879-21kworker/1:0+events19:42:361
362574299248212,2466cyclictest3632324-21kworker/3:0+events19:32:383
362573699248212,2466cyclictest3632257-21kworker/1:2+events19:29:361
36257369924788,2467cyclictest3690082-21kworker/1:2+events22:31:491
362573699247812,2463cyclictest3725368-21kworker/1:0+events00:22:141
362573699247612,2460cyclictest3704544-21kworker/1:1+events23:17:281
362573699247610,2463cyclictest3677191-21kworker/1:1+events21:55:521
362573299247511,2461cyclictest3710759-21kworker/0:0+events00:29:050
362573299247414,2456cyclictest3710759-21kworker/0:0+events00:19:070
362573299247312,2459cyclictest3696637-21kworker/0:1+events22:55:010
362573999247213,2455cyclictest3675768-21kworker/2:1+events21:52:002
362574299246011,2446cyclictest3628919-21kworker/3:0+events19:19:493
362573299245713,2440cyclictest3703035-21kworker/0:2+events23:33:190
362573999245511,2440cyclictest3632024-21kworker/2:2+events19:30:432
362574299245411,2439cyclictest3706400-21kworker/3:0+events00:11:303
362573999245412,2438cyclictest3641888-21kworker/2:2+events20:06:192
362574299245112,2435cyclictest3694763-21kworker/3:1+events22:42:513
362574299244910,2435cyclictest3730239-21kworker/3:0+events00:36:113
362574299244710,2433cyclictest3641901-21kworker/3:0+events20:00:553
362573999244611,2432cyclictest3707915-21kworker/2:1+events23:49:012
362573999244311,2429cyclictest3667925-21kworker/2:1+events21:22:182
362573999243912,2423cyclictest3698264-21kworker/2:0+events22:56:332
362573999243712,2422cyclictest3669552-21kworker/2:2+events21:42:552
362574299243412,2420cyclictest3706400-21kworker/3:0+events23:45:093
362574299243410,2421cyclictest3686733-21kworker/3:0+events22:20:493
362574299243312,2418cyclictest3725111-21kworker/3:1+events00:17:343
362574299242712,2411cyclictest3712458-21kworker/3:2+events23:44:223
362573999242511,2410cyclictest3724050-21kworker/2:1+events00:16:272
362574299242412,2409cyclictest3715900-21kworker/3:3+events23:52:053
362574299242412,2408cyclictest3691537-21kworker/3:2+events22:39:473
362573999242312,2407cyclictest3669552-21kworker/2:2+events21:46:202
362573999242311,2408cyclictest3707915-21kworker/2:1+events23:31:232
362574299242111,2406cyclictest3720292-21kworker/3:2+events00:05:443
362574299241912,2404cyclictest3674203-21kworker/3:2+events21:49:023
36257399924199,2408cyclictest3715935-21kworker/2:0+events23:55:072
362573999241512,2399cyclictest3724050-21kworker/2:1+events00:27:542
362573999241412,2399cyclictest3720376-21kworker/2:0+events00:08:042
362573299241411,2400cyclictest3632406-21kworker/0:0+events19:41:060
362573999241112,2395cyclictest3702938-21kworker/2:0+events23:24:582
362573299240912,2394cyclictest3685385-21kworker/0:0+events22:16:180
362573299240812,2392cyclictest3677565-21kworker/0:3+events22:03:280
362573299239912,2383cyclictest3664484-21kworker/0:1+events21:18:270
36257329923989,2385cyclictest3693230-21kworker/0:0+events23:02:580
362573299239511,2381cyclictest3632406-21kworker/0:0+events19:46:020
362573299239312,2377cyclictest3659784-21kworker/0:2+events21:02:110
362573299239212,2376cyclictest3727182-21kworker/0:2+events00:34:190
362573299239110,2377cyclictest3712442-21kworker/0:1+events23:37:580
362574299234011,2326cyclictest3667699-21kworker/3:1+events21:24:593
362573999234012,2325cyclictest3691805-21kworker/2:1+events22:37:302
362573299233812,2322cyclictest3717312-21kworker/0:1+events23:55:310
362573999233512,2320cyclictest3682071-21kworker/2:2+events22:14:062
362573999232712,2312cyclictest3694672-21kworker/2:2+events22:47:252
362573999232411,2310cyclictest3685412-21kworker/2:0+events22:40:532
362573999231112,2296cyclictest3623872-21kworker/2:1+events19:14:532
362573299231011,2296cyclictest3623685-21kworker/0:2+events19:11:520
362573299227610,2262cyclictest3657680-21kworker/0:0+events20:54:410
362574299225811,2244cyclictest3706400-21kworker/3:0+events00:23:433
362573999207210,2060cyclictest3625514-21kworker/2:0+events19:19:282
362573699205311,2039cyclictest3624000-21kworker/1:0+events19:10:411
36252272179151,23sleep20-21swapper/219:06:022
36253562176146,26sleep00-21swapper/019:07:400
36254352147103,25sleep10-21swapper/119:08:411
36252602147111,31sleep30-21swapper/319:06:283
362573999301,9cyclictest3658116-21apt-key20:50:002
362573999251,9cyclictest3674391-21tr21:40:002
3625739991610,4cyclictest3716394-21idleruntime23:50:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional