You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 19:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Aug 13, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
361446699387117,3849cyclictest3627707-21kworker/1:2+events19:55:121
361446699358414,3565cyclictest3670677-21kworker/1:2+events22:00:221
361445999335916,3339cyclictest3654174-21kworker/0:0+events21:15:160
361447599306213,3044cyclictest3658903-21kworker/3:1+events21:35:193
361446699298514,2967cyclictest3683501-21kworker/1:1+events22:49:431
361447599297513,2958cyclictest3658903-21kworker/3:1+events21:25:283
361447199297014,2953cyclictest3639228-21kworker/2:1+events20:35:012
36144669929309,2917cyclictest3624750-21kworker/1:0+events19:40:211
361445999288714,2869cyclictest3664084-21kworker/0:2+events21:40:210
361445999288514,2867cyclictest3664084-21kworker/0:2+events21:50:110
36144759928395,2830cyclictest3660579-21kworker/3:2+events21:49:483
361447599283414,2818cyclictest3658903-21kworker/3:1+events21:30:013
361447599282213,2805cyclictest3654291-21kworker/3:2+events21:13:033
36144759928120,2808cyclictest3707765-21kworker/3:1+events23:57:223
361447599280813,2791cyclictest3714017-21kworker/3:2+events00:22:473
361447599280613,2790cyclictest3683342-21kworker/3:0+events23:01:073
361446699280412,2788cyclictest3670677-21kworker/1:2+events22:25:211
361447599279112,2775cyclictest3637639-21kworker/3:0+events20:19:573
361445999278611,2770cyclictest3664084-21kworker/0:2+events21:45:180
361446699277713,2762cyclictest3644619-21kworker/1:1+events20:45:091
361445999276413,2747cyclictest3658874-21kworker/0:1+events21:28:080
36144669927599,2746cyclictest3709434-21kworker/1:2+events00:13:151
361445999275913,2744cyclictest3639353-21kworker/0:1+events20:26:180
361446699275813,2741cyclictest3704185-21kworker/1:2+events23:44:411
361445999274813,2731cyclictest3694745-21kworker/0:0+events23:20:000
361446699273113,2715cyclictest3646288-21kworker/1:2+events21:13:261
361446699272513,2708cyclictest3632665-21kworker/1:0+events20:10:261
361445999272513,2708cyclictest3627617-21kworker/0:1+events20:07:250
361445999272213,2705cyclictest3637671-21kworker/0:0+events20:20:190
361446699272113,2705cyclictest3616204-21kworker/1:0+events19:20:151
361446699272112,2705cyclictest3636158-21kworker/1:1+events20:15:211
361446699271813,2701cyclictest3655804-21kworker/1:1+events21:38:231
361447599271312,2698cyclictest3675534-21kworker/3:3+events22:22:443
361445999271312,2697cyclictest3664084-21kworker/0:2+events22:09:280
361446699271213,2695cyclictest3662804-21kworker/1:2+events21:46:011
361445999271212,2696cyclictest3627617-21kworker/0:1+events19:54:250
361446699271013,2693cyclictest3648116-21kworker/1:0+events20:54:411
36144669927093,2702cyclictest3713989-21kworker/1:1+events00:20:541
361446699270913,2692cyclictest3709434-21kworker/1:2+events00:15:351
361445999270811,2694cyclictest3684937-21kworker/0:1+events22:44:440
361447599270612,2690cyclictest3658903-21kworker/3:1+events21:43:453
361446699270413,2687cyclictest3621048-21kworker/1:2+events19:31:131
361446699270212,2687cyclictest3670677-21kworker/1:2+events22:20:521
361445999270113,2684cyclictest3694745-21kworker/0:0+events23:27:290
36144669927007,2689cyclictest3662804-21kworker/1:2+events21:44:531
36144759926849,2670cyclictest3660579-21kworker/3:2+events22:35:103
361447599268413,2667cyclictest3675534-21kworker/3:3+events22:17:023
361445999268412,2670cyclictest3720793-21kworker/0:0+events00:35:050
361447199268012,2664cyclictest3627722-21kworker/2:2+events19:49:262
361447199267913,2662cyclictest3694675-21kworker/2:2+events23:22:382
361447199267613,2659cyclictest3632852-21kworker/2:1+events20:13:512
361447599266013,2643cyclictest3693121-21kworker/3:1+events23:32:253
361446699265612,2640cyclictest3669053-21kworker/1:0+events21:56:141
361447599265213,2635cyclictest3619766-21kworker/3:2+events19:50:123
361446699264412,2628cyclictest3655804-21kworker/1:1+events21:26:591
361445999264413,2627cyclictest3647819-21kworker/0:2+events21:01:360
361447199264311,2628cyclictest3714150-21kworker/2:2+events00:27:462
361446699264213,2627cyclictest3706144-21kworker/1:1+events23:55:021
361447599264113,2624cyclictest3701080-21kworker/3:0+events23:46:143
361447599264013,2623cyclictest3660579-21kworker/3:2+events22:07:573
361447199264013,2624cyclictest3712547-21kworker/2:0+events00:11:432
361447199263913,2624cyclictest3636335-21kworker/2:2+events20:17:402
361447199263912,2623cyclictest3629578-21kworker/2:1+events19:56:212
361447599263713,2620cyclictest3720856-21kworker/3:2+events00:36:163
361446699263612,2620cyclictest3707821-21kworker/1:0+events00:09:081
361447599263413,2617cyclictest3639408-21kworker/3:2+events20:24:253
361447199263213,2615cyclictest3670476-21kworker/2:0+events22:05:362
361446699263113,2614cyclictest3624750-21kworker/1:0+events19:50:591
361447599263013,2613cyclictest3627828-21kworker/3:1+events20:05:563
361447199262913,2612cyclictest3664408-21kworker/2:2+events21:44:322
361447199262613,2610cyclictest3643511-21kworker/2:0+events21:10:472
361445999262513,2608cyclictest3677983-21kworker/0:2+events22:38:130
361447199262213,2605cyclictest3719032-21kworker/2:1+events00:32:012
361447199262213,2605cyclictest3719032-21kworker/2:1+events00:32:002
361447599261710,2603cyclictest3631273-21kworker/3:0+events20:02:053
361446699261012,2594cyclictest3683501-21kworker/1:1+events23:01:551
361446699260812,2592cyclictest3707821-21kworker/1:0+events00:04:551
361445999260812,2592cyclictest3694745-21kworker/0:0+events23:44:190
361445999260713,2590cyclictest3654174-21kworker/0:0+events21:23:590
361445999260411,2590cyclictest3693152-21kworker/0:1+events23:10:350
361447599260112,2585cyclictest3627828-21kworker/3:1+events20:12:193
361445999259512,2579cyclictest3623117-21kworker/0:2+events19:38:040
361447599258512,2569cyclictest3712419-21kworker/3:1+events00:09:503
361446699258213,2565cyclictest3670677-21kworker/1:2+events22:17:261
361447199258012,2564cyclictest3707693-21kworker/2:0+events23:51:582
361447599257912,2563cyclictest3712419-21kworker/3:1+events00:14:473
361447599257912,2563cyclictest3683342-21kworker/3:0+events22:59:133
361447599257912,2563cyclictest3641270-21kworker/3:1+events20:35:463
361447199257912,2563cyclictest3641080-21kworker/2:2+events20:31:132
361447599257812,2563cyclictest3693121-21kworker/3:1+events23:35:073
361447599257812,2562cyclictest3641270-21kworker/3:1+events20:48:373
361447599257812,2562cyclictest3619766-21kworker/3:2+events19:38:263
361447599257812,2562cyclictest3617614-21kworker/3:1+events19:28:123
361447199257812,2562cyclictest3620050-21kworker/2:0+events19:32:232
361447599257712,2562cyclictest3627828-21kworker/3:1+events19:56:453
361447599257612,2561cyclictest3648004-21kworker/3:0+events20:50:293
361447599257512,2560cyclictest3717319-21kworker/3:1+events00:34:193
361447599257512,2560cyclictest3717319-21kworker/3:1+events00:34:193
361447599257412,2558cyclictest3660579-21kworker/3:2+events21:59:163
361447599257312,2557cyclictest3686274-21kworker/3:2+events22:46:393
361447599257312,2557cyclictest3670445-21kworker/3:1+events22:01:293
36144759925729,2559cyclictest3649654-21kworker/3:1+events21:09:153
361447599257112,2555cyclictest3658903-21kworker/3:1+events21:23:353
361447599257111,2556cyclictest3641270-21kworker/3:1+events20:31:343
361447599257012,2555cyclictest3681507-21kworker/3:1+events22:41:423
361447599257012,2554cyclictest3660579-21kworker/3:2+events22:27:143
361447599256914,2553cyclictest3686274-21kworker/3:2+events22:50:073
361445999256912,2553cyclictest3704277-21kworker/0:1+events00:08:460
361447599256810,2555cyclictest3622880-21kworker/3:0+events19:31:363
361445999256812,2552cyclictest3694745-21kworker/0:0+events23:36:380
361447599256712,2552cyclictest3693121-21kworker/3:1+events23:28:583
361447599256712,2551cyclictest3626227-21kworker/3:0+events19:46:003
36144719925654,2557cyclictest3702578-21kworker/2:1+events23:45:042
361447199256212,2548cyclictest3643511-21kworker/2:0+events21:16:012
361446699255911,2545cyclictest3657429-21kworker/1:0+events21:23:121
361447599255712,2542cyclictest3717319-21kworker/3:1+events00:28:323
361447199255010,2536cyclictest3607825-21kworker/2:2+events19:14:312
361445999254212,2526cyclictest3642961-21kworker/0:1+events20:38:040
361447199254012,2525cyclictest3641080-21kworker/2:2+events20:29:172
361447199253212,2516cyclictest3670476-21kworker/2:0+events22:17:492
361447199253212,2516cyclictest3649368-21kworker/2:1+events20:58:572
361445999252912,2515cyclictest3647819-21kworker/0:2+events20:55:050
361445999252813,2511cyclictest3627617-21kworker/0:1+events20:14:350
361446699252313,2507cyclictest3675216-21kworker/1:1+events22:14:001
36144599925238,2512cyclictest3636070-21kworker/0:2+events20:16:070
361446699251913,2502cyclictest3636158-21kworker/1:1+events20:27:031
361447599251812,2502cyclictest3696170-21kworker/3:0+events23:21:093
361446699251812,2502cyclictest3655804-21kworker/1:1+events21:17:331
361447599251512,2500cyclictest3673739-21kworker/3:1+events22:10:373
361447199251412,2498cyclictest3660683-21kworker/2:0+events21:37:132
36144599925109,2497cyclictest3707912-21kworker/0:2+events23:55:480
36144669925098,2498cyclictest3654201-21kworker/1:0+events21:08:521
361445999250912,2493cyclictest3718820-21kworker/0:2+events00:33:330
361445999250912,2493cyclictest3718820-21kworker/0:2+events00:33:320
361445999250512,2489cyclictest3694745-21kworker/0:0+events23:22:170
361446699250411,2490cyclictest3678450-21kworker/1:0+events22:34:021
36144669925030,2498cyclictest3691079-21kworker/1:0+events23:05:201
361446699250112,2485cyclictest3629859-21kworker/1:1+events20:00:571
361446699249912,2484cyclictest3670677-21kworker/1:2+events22:05:141
36144719924967,2485cyclictest3670476-21kworker/2:0+events22:01:532
361447199249512,2481cyclictest3641080-21kworker/2:2+events20:45:332
361446699249412,2478cyclictest3629859-21kworker/1:1+events20:05:321
361447199249212,2478cyclictest3715781-21kworker/2:1+events00:18:402
36144669924928,2480cyclictest3717288-21kworker/1:2+events00:30:071
36144669924928,2480cyclictest3717288-21kworker/1:2+events00:30:071
361446699249211,2477cyclictest3639590-21kworker/1:0+events20:37:181
361445999249212,2476cyclictest3694745-21kworker/0:0+events23:48:550
361445999249112,2475cyclictest3691283-21kworker/0:0+events23:06:500
361445999249012,2474cyclictest3684937-21kworker/0:1+events23:00:450
361447599248911,2474cyclictest3619766-21kworker/3:2+events19:42:593
361446699248912,2473cyclictest3678450-21kworker/1:0+events22:37:501
361446699248912,2473cyclictest3627707-21kworker/1:2+events19:49:491
361445999248910,2475cyclictest3613964-21kworker/0:1+events19:17:090
361445999248810,2474cyclictest3662451-21kworker/0:0+events21:34:330
361446699248712,2471cyclictest3637940-21kworker/1:2+events20:23:391
361445999248712,2473cyclictest3642961-21kworker/0:1+events20:50:080
361445999248711,2472cyclictest3704277-21kworker/0:1+events00:02:370
361445999248711,2472cyclictest3642961-21kworker/0:1+events20:47:270
361447599248612,2470cyclictest3652477-21kworker/3:0+events21:02:453
361446699248611,2471cyclictest3706144-21kworker/1:1+events23:51:351
361446699248512,2469cyclictest3717288-21kworker/1:2+events00:27:241
361446699248512,2469cyclictest3683501-21kworker/1:1+events22:54:411
361446699248512,2469cyclictest3683501-21kworker/1:1+events22:43:361
361446699248510,2472cyclictest3622912-21kworker/1:1+events19:39:341
361445999248512,2469cyclictest3619477-21kworker/0:0+events19:45:370
361447599248412,2468cyclictest3689661-21kworker/3:2+events23:11:433
361446699248412,2469cyclictest3644619-21kworker/1:1+events20:41:021
361446699248412,2468cyclictest3696141-21kworker/1:0+events23:19:381
361445999248410,2470cyclictest3677983-21kworker/0:2+events22:21:590
361445999248410,2470cyclictest3642961-21kworker/0:1+events20:44:450
36144669924837,2473cyclictest3621048-21kworker/1:2+events19:29:221
36144669924837,2472cyclictest3655804-21kworker/1:1+events21:33:031
361446699248311,2468cyclictest3701313-21kworker/1:0+events23:38:081
36144599924828,2471cyclictest3616005-21kworker/0:3+events19:25:330
361445999248212,2466cyclictest3677983-21kworker/0:2+events22:26:070
361446699248112,2465cyclictest3641680-21kworker/1:2+events20:34:141
36144599924818,2470cyclictest3699149-21kworker/0:2+events23:30:280
361445999248112,2467cyclictest3684937-21kworker/0:1+events22:53:300
361447199248012,2464cyclictest3709299-21kworker/2:1+events00:09:292
361446699248012,2464cyclictest3697762-21kworker/1:2+events23:24:061
361446699247912,2463cyclictest3683501-21kworker/1:1+events22:59:361
361446699247910,2465cyclictest3667103-21kworker/1:1+events21:53:591
361445999247912,2463cyclictest3683250-21kworker/0:0+events22:45:280
361445999247912,2463cyclictest3641327-21kworker/0:0+events20:32:420
361447599247812,2462cyclictest3660579-21kworker/3:2+events21:51:433
36144599924758,2465cyclictest3688026-21kworker/0:2+events22:55:050
361445999247512,2459cyclictest3664084-21kworker/0:2+events22:04:510
361445999247512,2459cyclictest3624865-21kworker/0:3+events19:42:130
361445999247311,2459cyclictest3717233-21kworker/0:1+events00:26:390
36144599924669,2453cyclictest3673856-21kworker/0:1+events22:16:160
361445999246412,2449cyclictest3677983-21kworker/0:2+events22:33:420
361445999246311,2448cyclictest3616005-21kworker/0:3+events19:23:370
361447199244910,2435cyclictest3668812-21kworker/2:1+events21:51:192
361445999244512,2429cyclictest3662451-21kworker/0:0+events21:37:590
361445999243912,2423cyclictest3673856-21kworker/0:1+events22:11:000
361445999243912,2423cyclictest3613964-21kworker/0:1+events19:14:080
361445999243910,2426cyclictest3627617-21kworker/0:1+events20:04:250
36144719924361,2431cyclictest3699504-21kworker/2:2+events23:39:172
361446699243212,2417cyclictest3697762-21kworker/1:2+events23:29:441
361445999243212,2416cyclictest3717233-21kworker/0:1+events00:24:410
361446699242911,2414cyclictest3646288-21kworker/1:2+events21:04:171
361445999242912,2413cyclictest3704277-21kworker/0:1+events00:12:540
361447199242712,2411cyclictest3681483-21kworker/2:1+events22:35:532
361447199242612,2410cyclictest3678638-21kworker/2:0+events22:31:272
361446699242611,2411cyclictest3704185-21kworker/1:2+events23:49:411
361447199242411,2409cyclictest3686358-21kworker/2:1+events22:51:372
36144719924229,2409cyclictest3652583-21kworker/2:2+events21:05:502
361445999242214,2404cyclictest3709520-21kworker/0:0+events00:17:540
361446699242112,2405cyclictest3683501-21kworker/1:1+events23:12:501
361447199242013,2405cyclictest3643511-21kworker/2:0+events20:40:192
361447199241910,2406cyclictest3614241-21kworker/2:0+events19:15:172
361446699241912,2403cyclictest3699472-21kworker/1:1+events23:33:341
361445999241810,2405cyclictest3621107-21kworker/0:1+events19:30:300
361447599241112,2395cyclictest3707765-21kworker/3:1+events23:53:533
361447199241010,2396cyclictest3704208-21kworker/2:0+events23:41:352
361447599240911,2394cyclictest3649654-21kworker/3:1+events20:55:493
361445999240912,2394cyclictest3619477-21kworker/0:0+events19:55:350
36144719924083,2402cyclictest3720898-21kworker/2:0+events00:38:272
361447199240812,2393cyclictest3639228-21kworker/2:1+events20:22:312
361447199240612,2390cyclictest3643511-21kworker/2:0+events21:20:542
36144719924048,2392cyclictest3687965-21kworker/2:2+events23:08:212
36144719924047,2393cyclictest3693073-21kworker/2:0+events23:12:052
361447199240412,2389cyclictest3631176-21kworker/2:2+events20:08:102
361445999240412,2390cyclictest3654174-21kworker/0:0+events21:10:010
361445999240412,2388cyclictest3704277-21kworker/0:1+events23:54:390
361447199240012,2385cyclictest3677021-21kworker/2:2+events22:26:282
361446699240011,2386cyclictest3650970-21kworker/1:1+events20:59:421
361447199239910,2385cyclictest3617915-21kworker/2:1+events19:23:592
361445999239811,2383cyclictest3647819-21kworker/0:2+events21:05:280
361447599239711,2383cyclictest3609308-21kworker/3:0+events19:16:013
361445999239712,2382cyclictest3670388-21kworker/0:1+events21:58:320
36144719923965,2388cyclictest3624504-21kworker/2:2+events19:36:312
361447199239612,2380cyclictest3629578-21kworker/2:1+events19:53:412
361446699239612,2380cyclictest3720735-21kworker/1:1+events00:39:121
361447199239512,2381cyclictest3696272-21kworker/2:0+events23:30:082
361446699239512,2379cyclictest3610944-21kworker/1:2+events19:15:391
36144719923938,2382cyclictest3689566-21kworker/2:0+events23:01:302
36144759923928,2380cyclictest3706052-21kworker/3:2+events00:03:013
36144719923929,2380cyclictest3696272-21kworker/2:0+events23:26:442
361447199239210,2378cyclictest3694675-21kworker/2:2+events23:16:582
361447199239112,2375cyclictest3643511-21kworker/2:0+events20:54:182
361447199238812,2374cyclictest3714150-21kworker/2:2+events00:20:092
361447199238811,2373cyclictest3622903-21kworker/2:1+events19:44:302
361447199236012,2346cyclictest3684695-21kworker/2:0+events22:45:062
361447599235612,2340cyclictest3683342-21kworker/3:0+events23:06:053
361447199234612,2330cyclictest3666961-21kworker/2:0+events21:47:102
361447599234212,2327cyclictest3681507-21kworker/3:1+events22:33:173
361447199233510,2322cyclictest3660683-21kworker/2:0+events21:31:332
36144719923328,2320cyclictest3626125-21kworker/2:0+events20:00:352
361447199232911,2314cyclictest3709299-21kworker/2:1+events00:04:092
361447199232811,2314cyclictest3687965-21kworker/2:2+events22:58:032
361447599232612,2311cyclictest3646321-21kworker/3:2+events20:44:233
361447199232612,2310cyclictest3657455-21kworker/2:1+events21:27:212
361447199232412,2309cyclictest3673705-21kworker/2:2+events22:12:082
361447599232312,2308cyclictest3617614-21kworker/3:1+events19:24:463
361447199232311,2309cyclictest3643511-21kworker/2:0+events21:00:522
361447199231112,2296cyclictest3707693-21kworker/2:0+events23:55:272
361447599230010,2287cyclictest3657253-21kworker/3:0+events21:19:463
361447199228711,2272cyclictest3670476-21kworker/2:0+events21:57:442
361447599223111,2217cyclictest3714017-21kworker/3:2+events00:17:073
361447599214410,2130cyclictest3637639-21kworker/3:0+events20:27:243
36144669921369,2124cyclictest3614182-21kworker/1:1+events19:13:221
361447599209011,2076cyclictest3693121-21kworker/3:1+events23:18:073
36144759920055,1997cyclictest3614167-21kworker/3:2+events19:11:033
36140882143111,27sleep30-21swapper/319:07:263
36139732143111,27sleep00-21swapper/019:05:550
36142812141105,31sleep20-21swapper/219:09:492
36129632141112,24sleep10-21swapper/119:05:081
3614475992614,12cyclictest26450irq/143-i91523:44:183
3614471992013,2cyclictest191rcu_preempt22:20:212
3614471991912,2cyclictest191rcu_preempt19:25:192
361447199191,11cyclictest43-21ksoftirqd/222:40:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional