You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 18:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Fri Jun 12, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
360191699347318,3448cyclictest3644117-21kworker/1:1+events21:20:201
360191699340813,3391cyclictest3692561-21kworker/1:2+events00:00:151
360192299293914,2922cyclictest3669805-21kworker/3:1+events22:40:233
36019229928539,2840cyclictest3637650-21kworker/3:0+events21:00:013
360191699283013,2812cyclictest3678002-21kworker/1:2+events23:05:001
360191699281112,2795cyclictest3674779-21kworker/1:1+events23:10:181
360191299279313,2778cyclictest3648973-21kworker/0:0+events21:40:040
360191699279113,2776cyclictest3619998-21kworker/1:2+events20:20:111
36019169927636,2754cyclictest3690659-21kworker/1:0+events23:45:011
360191299274814,2729cyclictest3660613-21kworker/0:0+events22:10:150
360192299271712,2700cyclictest3631203-21kworker/3:2+events20:50:113
360191699268910,2674cyclictest3623309-21kworker/1:0+events20:15:121
360191899268113,2663cyclictest3624560-21kworker/2:0+events20:35:202
360191899266112,2645cyclictest3689254-21kworker/2:2+events23:50:412
360191299263313,2617cyclictest3673119-21kworker/0:0+events23:25:130
360192299262213,2607cyclictest3657558-21kworker/3:0+events22:05:183
36019189926229,2609cyclictest3689254-21kworker/2:2+events23:55:172
360191299261710,2603cyclictest3611819-21kworker/0:0+events20:03:490
360192299260013,2583cyclictest3663512-21kworker/3:0+events22:26:133
36019229925986,2588cyclictest3661915-21kworker/3:2+events22:13:173
360191899258812,2573cyclictest3678117-21kworker/2:0+events23:12:112
360192299258212,2565cyclictest3618284-21kworker/3:1+events20:05:223
360192299257712,2561cyclictest3688946-21kworker/3:0+events23:38:553
360192299257412,2558cyclictest3655638-21kworker/3:2+events21:56:533
360191299256612,2550cyclictest3647215-21kworker/0:1+events21:38:590
360191299256612,2550cyclictest3647215-21kworker/0:1+events21:38:580
360192299256112,2545cyclictest3702117-21kworker/3:0+events00:34:583
360192299254512,2529cyclictest3647472-21kworker/3:0+events21:32:493
360192299253012,2515cyclictest3663512-21kworker/3:0+events22:30:463
360191299251912,2503cyclictest3684200-21kworker/0:2+events23:23:430
360191299251512,2499cyclictest3673119-21kworker/0:0+events23:39:180
360191899250911,2495cyclictest3622874-21kworker/2:1+events20:14:502
360191299250912,2493cyclictest3689131-21kworker/0:1+events00:03:170
360191299250811,2493cyclictest3640969-21kworker/0:1+events21:09:120
360191299250712,2492cyclictest3663886-21kworker/0:0+events22:28:510
360191299250412,2488cyclictest3643018-21kworker/0:0+events21:16:500
360191699250311,2488cyclictest3707130-21kworker/1:1+events00:35:211
36019169925029,2490cyclictest3613414-21kworker/1:2+events19:42:021
360191699250210,2489cyclictest3658859-21kworker/1:2+events22:13:421
360191899249812,2482cyclictest3629471-21kworker/2:2+events21:09:582
360192299249612,2480cyclictest3673061-21kworker/3:1+events23:02:213
360191899249612,2481cyclictest3665324-21kworker/2:1+events22:33:262
360191899249611,2482cyclictest3663667-21kworker/2:2+events22:19:442
360192299249512,2480cyclictest3629507-21kworker/3:1+events20:37:403
360192299249512,2480cyclictest3621485-21kworker/3:2+events20:22:253
360191899249512,2479cyclictest3648913-21kworker/2:0+events21:41:342
360191899249512,2479cyclictest3629471-21kworker/2:2+events20:48:402
360192299249412,2478cyclictest3652108-21kworker/3:1+events21:46:123
360191899249412,2479cyclictest3669895-21kworker/2:2+events22:47:572
360191899249412,2479cyclictest3642692-21kworker/2:0+events21:18:472
360191899249312,2477cyclictest3659133-21kworker/2:2+events22:09:052
360191899249312,2477cyclictest3638508-21kworker/2:1+events21:14:372
360191899249212,2478cyclictest3650578-21kworker/2:1+events21:45:022
360192299249112,2476cyclictest3688946-21kworker/3:0+events00:05:323
360192299249112,2475cyclictest3695710-21kworker/3:1+events00:10:513
360192299249111,2475cyclictest3663512-21kworker/3:0+events22:20:303
360191899249012,2474cyclictest3638508-21kworker/2:1+events21:24:052
360191899249011,2476cyclictest3687320-21kworker/2:1+events23:40:282
360191899248912,2475cyclictest3673155-21kworker/2:1+events23:00:502
360191899248912,2474cyclictest3616620-21kworker/2:2+events19:59:132
360191899248912,2474cyclictest3611972-21kworker/2:1+events19:39:452
360191899248811,2473cyclictest3608681-21kworker/2:0+events19:29:592
360191899248811,2473cyclictest3608681-21kworker/2:0+events19:29:582
360191899248712,2471cyclictest3671555-21kworker/2:0+events22:43:282
360191899248610,2472cyclictest3652230-21kworker/2:2+events21:53:062
360191699248512,2469cyclictest3697380-21kworker/1:0+events00:08:131
360191899248414,2467cyclictest3648913-21kworker/2:0+events21:39:202
360191899248414,2467cyclictest3648913-21kworker/2:0+events21:39:202
360191899248312,2467cyclictest3624560-21kworker/2:0+events20:31:312
36019229924829,2468cyclictest3632939-21kworker/3:0+events20:49:033
360191899248212,2466cyclictest3705256-21kworker/2:1+events00:26:322
360192299248012,2464cyclictest3702117-21kworker/3:0+events00:27:173
360192299248012,2464cyclictest3673061-21kworker/3:1+events22:56:403
360192299248011,2465cyclictest3695710-21kworker/3:1+events00:01:013
360191899248010,2466cyclictest3644299-21kworker/2:2+events21:33:122
360191899247810,2465cyclictest3697172-21kworker/2:2+events00:07:262
360191899247712,2461cyclictest3636113-21kworker/2:0+events20:58:072
360192299247512,2459cyclictest3663512-21kworker/3:0+events22:39:593
360192299247511,2460cyclictest3673061-21kworker/3:1+events23:19:103
360192299247411,2460cyclictest3673061-21kworker/3:1+events22:53:573
360191899247411,2460cyclictest3678117-21kworker/2:0+events23:15:412
360192299247112,2456cyclictest3637650-21kworker/3:0+events21:10:453
360192299246912,2453cyclictest3607120-21kworker/3:0+events19:57:413
360191699246612,2450cyclictest3639241-21kworker/1:2+events21:19:111
360192299246510,2452cyclictest3642480-21kworker/3:2+events21:24:483
360192299246412,2449cyclictest3661915-21kworker/3:2+events22:16:163
360191699246112,2445cyclictest3629595-21kworker/1:2+events20:40:201
360192299246012,2444cyclictest3702117-21kworker/3:0+events00:21:343
360191899246012,2444cyclictest3682671-21kworker/2:2+events23:31:222
360191899245612,2441cyclictest3665461-21kworker/2:3+events22:28:032
36019189924558,2443cyclictest3655493-21kworker/2:0+events22:02:382
360191299245212,2437cyclictest3624717-21kworker/0:2+events20:21:200
360191299245211,2437cyclictest3623079-21kworker/0:1+events20:17:530
360191699245012,2434cyclictest3698983-21kworker/1:2+events00:16:091
360191899244811,2433cyclictest3655493-21kworker/2:0+events22:21:402
360191299244712,2432cyclictest3677973-21kworker/0:1+events23:07:380
360192299244410,2430cyclictest3607120-21kworker/3:0+events19:42:463
360191699244411,2429cyclictest3649035-21kworker/1:2+events21:35:541
360191699244411,2429cyclictest3649035-21kworker/1:2+events21:35:541
360192299243912,2424cyclictest3607120-21kworker/3:0+events20:10:183
360191699243512,2420cyclictest3658859-21kworker/1:2+events22:28:261
360191699243412,2419cyclictest3632823-21kworker/1:1+events21:00:471
360191299243212,2416cyclictest3609326-21kworker/0:1+events19:35:580
360191299243012,2414cyclictest3653824-21kworker/0:2+events21:56:060
360191699242910,2415cyclictest3632823-21kworker/1:1+events20:55:271
36019129924298,2417cyclictest3621363-21kworker/0:2+events20:07:380
360191299242912,2413cyclictest3639331-21kworker/0:2+events21:28:370
360191699242812,2412cyclictest3651900-21kworker/1:1+events21:47:211
360192299242712,2411cyclictest3645884-21kworker/3:1+events21:29:483
360191699242712,2412cyclictest3687347-21kworker/1:1+events23:48:001
360191699242612,2410cyclictest3685741-21kworker/1:0+events23:30:111
360191299242612,2411cyclictest3708407-21kworker/0:1+events00:36:510
360191299242612,2411cyclictest3666893-21kworker/0:1+events22:30:230
360191299242612,2411cyclictest3611819-21kworker/0:0+events19:41:380
360191699242312,2407cyclictest3639241-21kworker/1:2+events21:08:041
360191299242312,2407cyclictest3609326-21kworker/0:1+events19:32:340
360191299242310,2409cyclictest3687529-21kworker/0:2+events23:44:370
360191299242212,2407cyclictest3643018-21kworker/0:0+events21:22:120
360191699242011,2405cyclictest3678002-21kworker/1:2+events23:25:381
360191299242010,2406cyclictest3700407-21kworker/0:2+events00:24:150
360191699241912,2405cyclictest3627904-21kworker/1:1+events20:30:231
360191299241912,2403cyclictest3659009-21kworker/0:2+events22:23:340
360191299241912,2403cyclictest3635789-21kworker/0:0+events20:51:420
360191699241512,2400cyclictest3655369-21kworker/1:0+events22:03:451
360191699241212,2397cyclictest3647426-21kworker/1:0+events21:34:451
360192299241112,2396cyclictest3607120-21kworker/3:0+events19:39:013
360191699241012,2395cyclictest3671463-21kworker/1:2+events22:44:571
360191699241012,2395cyclictest3655369-21kworker/1:0+events22:06:271
360191699240912,2394cyclictest3673040-21kworker/1:0+events22:53:351
360191699240912,2394cyclictest3651900-21kworker/1:1+events21:51:321
360191299240812,2393cyclictest3637409-21kworker/0:1+events20:57:190
360191899240712,2392cyclictest3629471-21kworker/2:2+events20:52:072
360191699240712,2391cyclictest3655369-21kworker/1:0+events21:56:301
360191699240711,2392cyclictest3619998-21kworker/1:2+events20:06:521
360191299240712,2391cyclictest3615229-21kworker/0:2+events19:51:130
360191699240612,2391cyclictest3698983-21kworker/1:2+events00:13:331
360191699240611,2391cyclictest3705408-21kworker/1:2+events00:28:281
360191299240610,2392cyclictest3668532-21kworker/0:2+events22:47:330
360191699240512,2389cyclictest3668500-21kworker/1:1+events22:34:581
360191699240411,2390cyclictest3690659-21kworker/1:0+events23:50:191
360191699240410,2391cyclictest3671463-21kworker/1:2+events22:46:231
360191699240112,2385cyclictest3606796-21kworker/1:0+events19:34:291
360191299240012,2386cyclictest3611819-21kworker/0:0+events19:45:040
360191699239912,2384cyclictest3616681-21kworker/1:0+events19:58:501
360192299239612,2380cyclictest3631203-21kworker/3:2+events21:02:433
360191699239112,2375cyclictest3627904-21kworker/1:1+events20:28:111
360192299238912,2373cyclictest3650490-21kworker/3:2+events21:44:403
360191699238811,2373cyclictest3698983-21kworker/1:2+events00:20:471
36019129923889,2375cyclictest3692024-21kworker/0:0+events23:51:020
360192299238311,2368cyclictest3681177-21kworker/3:2+events23:22:553
360191699237911,2365cyclictest3606796-21kworker/1:0+events19:35:371
360191699237411,2360cyclictest3705408-21kworker/1:2+events00:31:071
360191699237011,2356cyclictest3616681-21kworker/1:0+events20:04:121
360191299236712,2352cyclictest3624717-21kworker/0:2+events20:33:470
360191299236711,2352cyclictest3689131-21kworker/0:1+events00:06:170
360191299235911,2344cyclictest3700407-21kworker/0:2+events00:29:350
36019169923529,2340cyclictest3598400-21kworker/1:2+events19:20:321
360191899234412,2328cyclictest3680994-21kworker/2:1+events23:21:502
360191899233611,2322cyclictest3705256-21kworker/2:1+events00:30:202
360192299233412,2318cyclictest3688946-21kworker/3:0+events23:53:433
360191299233212,2316cyclictest3673119-21kworker/0:0+events23:30:580
360191899232812,2312cyclictest3610341-21kworker/2:2+events19:32:572
36019129923259,2313cyclictest3623079-21kworker/0:1+events20:14:260
360191899232310,2310cyclictest3629471-21kworker/2:2+events21:00:232
360192299232211,2307cyclictest3673061-21kworker/3:1+events23:08:233
36019189923188,2307cyclictest3674749-21kworker/2:0+events22:54:192
360191699231711,2302cyclictest3668500-21kworker/1:1+events22:38:271
36019129923168,2305cyclictest3648973-21kworker/0:0+events21:51:110
360191699231110,2298cyclictest3687347-21kworker/1:1+events23:38:101
360192299230911,2296cyclictest3652108-21kworker/3:1+events22:00:463
360191299230911,2294cyclictest3603190-21kworker/0:1+events19:20:540
360191899230712,2292cyclictest3706917-21kworker/2:0+events00:38:482
360192299230111,2286cyclictest3673061-21kworker/3:1+events23:14:323
360191699229812,2282cyclictest3674779-21kworker/1:1+events23:09:081
360191699229712,2282cyclictest3619998-21kworker/1:2+events20:12:101
360191299228711,2273cyclictest3601529-21kworker/0:3+events19:25:490
360191299228711,2273cyclictest3601529-21kworker/0:3+events19:25:490
360191899228411,2270cyclictest3689254-21kworker/2:2+events23:45:222
36019189922806,2271cyclictest3624560-21kworker/2:0+events20:18:382
360191699228012,2265cyclictest3598400-21kworker/1:2+events19:27:191
360191699228012,2265cyclictest3598400-21kworker/1:2+events19:27:181
360191299227912,2263cyclictest3626632-21kworker/0:1+events20:28:550
360192299227611,2261cyclictest3629507-21kworker/3:1+events20:34:583
360192299227511,2260cyclictest3683083-21kworker/3:0+events23:26:003
360192299227311,2259cyclictest3616647-21kworker/3:2+events19:52:443
360192299227310,2259cyclictest3673061-21kworker/3:1+events22:49:493
360191899227211,2258cyclictest3603305-21kworker/2:1+events19:22:232
360191899227211,2257cyclictest3685711-21kworker/2:0+events23:28:182
360192299227111,2257cyclictest3693775-21kworker/3:2+events23:57:113
360192299227110,2258cyclictest3621485-21kworker/3:2+events20:26:143
360192299227011,2256cyclictest3702117-21kworker/3:0+events00:17:203
360192299227011,2256cyclictest3642480-21kworker/3:2+events21:15:453
360192299227011,2255cyclictest3603026-21kworker/3:1+events19:24:403
360192299227010,2257cyclictest3640817-21kworker/3:1+events21:06:323
360191899227010,2256cyclictest3702688-21kworker/2:2+events00:22:422
360191899227010,2256cyclictest3610341-21kworker/2:2+events19:42:242
360192299226911,2255cyclictest3652108-21kworker/3:1+events21:52:183
360191899226911,2254cyclictest3695197-21kworker/2:0+events00:04:232
360192299226811,2254cyclictest3607120-21kworker/3:0+events19:26:353
360192299226811,2254cyclictest3607120-21kworker/3:0+events19:26:343
360191899226811,2254cyclictest3613679-21kworker/2:0+events19:51:352
360191899226711,2252cyclictest3678117-21kworker/2:0+events23:06:322
360191899226512,2250cyclictest3698770-21kworker/2:1+events00:15:252
360191899226411,2250cyclictest3618404-21kworker/2:1+events20:00:462
360192299226310,2250cyclictest3631203-21kworker/3:2+events20:44:273
36019189922638,2252cyclictest3655493-21kworker/2:0+events21:58:492
360191899226310,2251cyclictest3673155-21kworker/2:1+events22:55:072
360191899226110,2247cyclictest3661945-21kworker/2:1+events22:12:072
36019229922609,2247cyclictest3702117-21kworker/3:0+events00:37:163
360191899225911,2244cyclictest3611972-21kworker/2:1+events19:48:342
360191299225910,2246cyclictest3671495-21kworker/0:1+events22:44:350
360192299225811,2244cyclictest3623268-21kworker/3:1+events20:19:463
360191899225811,2243cyclictest3665324-21kworker/2:1+events22:36:552
360191899225711,2244cyclictest3624560-21kworker/2:0+events20:25:072
360191299225711,2242cyclictest3659009-21kworker/0:2+events22:09:300
360191299225410,2239cyclictest3668532-21kworker/0:2+events22:50:120
360191699225311,2239cyclictest3613414-21kworker/1:2+events19:52:201
360192299224910,2236cyclictest3685651-21kworker/3:1+events23:32:533
360191899224710,2233cyclictest3685711-21kworker/2:0+events23:37:002
36019189922455,2237cyclictest3629471-21kworker/2:2+events20:43:212
360191299223211,2217cyclictest3700407-21kworker/0:2+events00:14:180
360191299223111,2216cyclictest3700407-21kworker/0:2+events00:34:110
36019129922309,2217cyclictest3673119-21kworker/0:0+events23:03:500
36019129922288,2217cyclictest3603190-21kworker/0:1+events19:14:220
360191299222811,2213cyclictest3647215-21kworker/0:1+events21:33:590
360191299222810,2214cyclictest3611819-21kworker/0:0+events19:55:250
36019129922279,2214cyclictest3700407-21kworker/0:2+events00:19:150
360191299222711,2213cyclictest3626632-21kworker/0:1+events20:49:490
360191299222710,2213cyclictest3631264-21kworker/0:0+events20:44:070
360191699222611,2212cyclictest3692561-21kworker/1:2+events23:56:011
360191299222511,2211cyclictest3668532-21kworker/0:2+events22:59:430
360191299222510,2212cyclictest3601529-21kworker/0:3+events19:16:410
360191299222510,2211cyclictest3659009-21kworker/0:2+events22:17:250
360191699222411,2209cyclictest3673040-21kworker/1:0+events22:57:021
360191299222411,2210cyclictest3673119-21kworker/0:0+events23:19:580
360191299222311,2209cyclictest3680879-21kworker/0:2+events23:11:490
360191299222311,2208cyclictest3637409-21kworker/0:1+events21:01:100
360191699222210,2208cyclictest3651900-21kworker/1:1+events21:42:191
360192299222111,2206cyclictest3607120-21kworker/3:0+events19:46:393
360191699222111,2207cyclictest3632823-21kworker/1:1+events20:49:271
360191299222011,2205cyclictest3663886-21kworker/0:0+events22:37:190
360191899221911,2205cyclictest3620115-21kworker/2:0+events20:07:172
360191699221910,2206cyclictest3634514-21kworker/1:2+events20:54:221
360191699221910,2206cyclictest3615014-21kworker/1:1+events19:47:001
360191699221710,2205cyclictest3662128-21kworker/1:0+events22:20:071
360191699221411,2200cyclictest3603490-21kworker/1:3+events19:19:461
360191299220711,2193cyclictest3689131-21kworker/0:1+events23:48:230
360191699220410,2190cyclictest3662128-21kworker/1:0+events22:15:551
360191699220310,2190cyclictest3640845-21kworker/1:0+events21:11:331
360191699220211,2187cyclictest3639241-21kworker/1:2+events21:25:561
360191299220111,2187cyclictest3631264-21kworker/0:0+events20:39:110
360191299219810,2184cyclictest3648973-21kworker/0:0+events21:46:580
360191299219611,2181cyclictest3689131-21kworker/0:1+events23:57:570
360191699218611,2172cyclictest3678002-21kworker/1:2+events23:16:521
360191699218610,2172cyclictest3684113-21kworker/1:1+events23:24:521
360191699218411,2169cyclictest3623309-21kworker/1:0+events20:39:341
360192299215911,2144cyclictest3605083-21kworker/3:2+events19:18:593
36019169921399,2127cyclictest3598400-21kworker/1:2+events19:13:591
360192299212310,2110cyclictest3691966-21kworker/3:1+events23:47:173
360191899211810,2106cyclictest3697172-21kworker/2:2+events00:10:282
36019229921109,2098cyclictest3687354-21kworker/3:2+events23:41:573
360191899209610,2083cyclictest3598286-21kworker/2:2+events19:12:532
360192299209510,2081cyclictest3618284-21kworker/3:1+events20:01:093
36019189920949,2082cyclictest3599907-21kworker/2:0+events19:17:492
360191899209210,2079cyclictest3616620-21kworker/2:2+events20:21:402
36019229920849,2072cyclictest3607120-21kworker/3:0+events19:30:453
360191299208010,2066cyclictest3657357-21kworker/0:1+events22:04:080
36019229920577,2035cyclictest3595263-21kworker/3:0+events19:11:233
36019229919506,1940cyclictest3647472-21kworker/3:0+events21:38:133
36019229919506,1940cyclictest3647472-21kworker/3:0+events21:38:123
3601341214598,35sleep00-21swapper/019:06:050
36014522143113,25sleep30-21swapper/319:07:283
36013422141110,26sleep10-21swapper/119:06:061
36014052140101,36sleep20-21swapper/219:06:562
3601912991710,7cyclictest0-21swapper/021:10:200
360191899150,3cyclictest3646167-21/usr/sbin/munin21:25:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional