You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 07:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Wed Jul 08, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
335879499380718,3784cyclictest3381163-21kworker/2:1+events20:59:392
335878599321815,3197cyclictest3384536-21kworker/0:2+events20:40:120
335879099315613,3138cyclictest3416950-21kworker/1:1+events22:15:001
335878599308214,3063cyclictest3436088-21kworker/0:2+events23:25:120
335879699301111,2996cyclictest3353502-21kworker/3:2+events19:15:213
335879499295511,2940cyclictest3431179-21kworker/2:0+events23:05:182
335879499295114,2932cyclictest3431179-21kworker/2:0+events23:00:172
335879499295014,2932cyclictest3437871-21kworker/2:0+events23:35:212
335879699293412,2916cyclictest3408643-21kworker/3:2+events21:55:133
33587909928195,2810cyclictest3416950-21kworker/1:1+events22:30:131
335879099280713,2790cyclictest3456802-21kworker/1:0+events00:30:121
335879099280611,2792cyclictest3382914-21kworker/1:2+events20:32:381
335879099279913,2782cyclictest3437811-21kworker/1:1+events23:27:021
335879499279513,2778cyclictest3450343-21kworker/2:0+events23:57:292
335879099279511,2780cyclictest3418667-21kworker/1:0+events22:15:461
33587859927929,2779cyclictest3400416-21kworker/0:1+events21:28:110
335879499277713,2760cyclictest3384362-21kworker/2:0+events20:30:202
335879499277013,2753cyclictest3371833-21kworker/2:1+events20:04:282
335879499276912,2753cyclictest3365447-21kworker/2:2+events19:38:572
335879499276613,2749cyclictest3401998-21kworker/2:1+events21:57:102
335879099276413,2747cyclictest3402147-21kworker/1:1+events21:47:081
335879099276313,2746cyclictest3423085-21kworker/1:0+events22:35:351
335879099275913,2742cyclictest3455048-21kworker/1:2+events00:13:241
335879099275912,2743cyclictest3405444-21kworker/1:2+events21:39:011
335879099275911,2744cyclictest3439450-21kworker/1:2+events23:20:581
335879499275813,2741cyclictest3365447-21kworker/2:2+events19:53:502
335879099275713,2742cyclictest3353620-21kworker/1:2+events19:26:011
335879099275613,2739cyclictest3371505-21kworker/1:0+events19:52:181
335879099275513,2738cyclictest3423085-21kworker/1:0+events22:40:301
335878599275013,2733cyclictest3436088-21kworker/0:2+events23:10:130
335879099274913,2733cyclictest3362231-21kworker/1:1+events19:40:511
335879499274212,2726cyclictest3395998-21kworker/2:2+events21:15:192
33587949927393,2732cyclictest3412148-21kworker/2:2+events22:01:222
335879499273812,2723cyclictest3394369-21kworker/2:0+events21:07:202
335879499273513,2718cyclictest3365447-21kworker/2:2+events19:30:562
335879499273413,2717cyclictest3371833-21kworker/2:1+events19:57:402
335879499273412,2719cyclictest3368486-21kworker/2:0+events19:48:282
335879499273312,2717cyclictest3451954-21kworker/2:1+events00:10:182
335879499273213,2715cyclictest3401998-21kworker/2:1+events21:54:262
335879099273213,2715cyclictest3384508-21kworker/1:0+events21:16:521
335879499272913,2713cyclictest3451954-21kworker/2:1+events00:08:252
335879499272513,2708cyclictest3376481-21kworker/2:2+events20:15:552
335879099271913,2704cyclictest3416950-21kworker/1:1+events22:20:241
335879499271713,2700cyclictest3439480-21kworker/2:1+events23:20:362
335879499271713,2700cyclictest3417068-21kworker/2:1+events23:10:572
335879499271611,2703cyclictest3399411-21kworker/2:0+events21:25:112
335879499271413,2697cyclictest3390755-21kworker/2:0+events20:48:382
335878599271413,2698cyclictest3419974-21kworker/0:2+events22:25:200
335879099271113,2694cyclictest3428003-21kworker/1:1+events22:57:371
335878599271010,2696cyclictest3397238-21kworker/0:0+events21:20:190
335879499270913,2691cyclictest3437871-21kworker/2:0+events23:15:132
33587949927067,2695cyclictest3417068-21kworker/2:1+events22:38:372
335878599270613,2688cyclictest3439147-21kworker/0:0+events23:20:140
335879099269813,2683cyclictest3458458-21kworker/1:1+events00:20:101
33587949926968,2683cyclictest3360009-21kworker/2:1+events19:20:182
335879099269612,2681cyclictest3398883-21kworker/1:1+events21:12:191
335878599268813,2671cyclictest3424835-21kworker/0:0+events22:34:480
33587909926838,2671cyclictest3450670-21kworker/1:1+events00:00:281
335879099267212,2656cyclictest3373109-21kworker/1:1+events19:56:541
335878599267013,2653cyclictest3436088-21kworker/0:2+events23:17:320
33587859926697,2657cyclictest3410187-21kworker/0:0+events22:00:130
335879499266612,2650cyclictest3381163-21kworker/2:1+events20:26:142
335878599266613,2650cyclictest3448949-21kworker/0:0+events00:15:150
335878599266313,2647cyclictest3426441-21kworker/0:2+events22:49:420
335879699265613,2639cyclictest3379889-21kworker/3:0+events20:35:153
335879499265613,2639cyclictest3403594-21kworker/2:2+events21:30:302
335879699265313,2636cyclictest3415437-21kworker/3:1+events22:09:183
335879099265111,2637cyclictest3455048-21kworker/1:2+events00:09:551
335878599265113,2635cyclictest3410187-21kworker/0:0+events21:46:440
335878599265113,2634cyclictest3419974-21kworker/0:2+events22:18:520
335878599265013,2634cyclictest3382942-21kworker/0:1+events20:30:410
335878599264813,2631cyclictest3426441-21kworker/0:2+events22:43:350
335878599264713,2631cyclictest3410187-21kworker/0:0+events21:50:130
335878599264313,2626cyclictest3410187-21kworker/0:0+events22:05:530
335879699264113,2624cyclictest3376687-21kworker/3:2+events20:19:223
335879699264013,2624cyclictest3402263-21kworker/3:0+events21:45:343
33587859926408,2628cyclictest3436088-21kworker/0:2+events23:07:350
335878599264013,2623cyclictest3419974-21kworker/0:2+events22:22:430
335879699263813,2621cyclictest3456682-21kworker/3:1+events00:14:073
335878599263713,2620cyclictest3390981-21kworker/0:1+events20:57:200
335879699263113,2616cyclictest3448776-21kworker/3:2+events23:50:283
335879699263113,2616cyclictest3371447-21kworker/3:2+events19:50:023
335879499263112,2615cyclictest3407165-21kworker/2:2+events21:38:382
335878599263113,2614cyclictest3384536-21kworker/0:2+events20:39:270
335879699262911,2614cyclictest3412597-21kworker/3:0+events22:03:593
335879699261311,2598cyclictest3362317-21kworker/3:1+events19:26:223
335879499261013,2593cyclictest3463218-21kworker/2:2+events00:37:512
335878599261011,2596cyclictest3416770-21kworker/0:1+events22:12:460
33587859925867,2575cyclictest3397238-21kworker/0:0+events21:07:430
335879099257812,2562cyclictest3436120-21kworker/1:0+events23:18:181
335878599257812,2563cyclictest3426441-21kworker/0:2+events22:39:200
335879699257212,2556cyclictest3447081-21kworker/3:1+events23:42:133
335878599257112,2555cyclictest3358560-21kworker/0:2+events19:17:380
33587969925678,2556cyclictest3402263-21kworker/3:0+events21:34:463
335878599256513,2548cyclictest3381237-21kworker/0:0+events20:23:140
335878599256412,2548cyclictest3363501-21kworker/0:0+events19:28:150
335879699256210,2548cyclictest3408643-21kworker/3:2+events21:42:513
33587909925577,2546cyclictest3439450-21kworker/1:2+events23:34:381
335879099255713,2541cyclictest3436120-21kworker/1:0+events23:10:351
335878599255412,2538cyclictest3458216-21kworker/0:2+events00:29:480
335878599254511,2532cyclictest3461426-21kworker/0:0+events00:31:220
335879699254412,2528cyclictest3434494-21kworker/3:2+events23:16:003
335879499254413,2528cyclictest3376481-21kworker/2:2+events20:24:192
335879099254212,2526cyclictest3413667-21kworker/1:1+events21:59:261
335879099254012,2524cyclictest3449009-21kworker/1:0+events23:52:491
335879699253811,2524cyclictest3410493-21kworker/3:1+events21:50:353
335879699253612,2520cyclictest3379889-21kworker/3:0+events20:49:253
335879499253312,2517cyclictest3429521-21kworker/2:2+events22:51:592
33587909925328,2520cyclictest3379621-21kworker/1:0+events20:15:321
335879099253212,2516cyclictest3447266-21kworker/1:2+events23:59:431
335878599253211,2518cyclictest3371684-21kworker/0:1+events20:03:230
335879099253112,2515cyclictest3382914-21kworker/1:2+events20:23:351
335879099253112,2515cyclictest3368250-21kworker/1:2+events19:38:341
335879099253012,2514cyclictest3374744-21kworker/1:2+events20:08:191
335879499252910,2516cyclictest3451954-21kworker/2:1+events00:23:382
335879099252912,2514cyclictest3461554-21kworker/1:2+events00:36:191
335879099252911,2514cyclictest3384508-21kworker/1:0+events20:50:561
335879499252812,2512cyclictest3447141-21kworker/2:1+events23:42:362
335879099252611,2510cyclictest3374744-21kworker/1:2+events20:11:211
33587949925258,2514cyclictest3408879-21kworker/2:0+events21:49:042
335879099252410,2511cyclictest3374744-21kworker/1:2+events20:01:071
335879499252311,2509cyclictest3413785-21kworker/2:0+events22:11:112
335879099252312,2507cyclictest3353620-21kworker/1:2+events19:24:081
33587859925238,2511cyclictest3436088-21kworker/0:2+events23:31:110
335879099252212,2506cyclictest3412060-21kworker/1:2+events22:08:101
335879499252113,2505cyclictest3401998-21kworker/2:1+events21:41:412
33587909925219,2509cyclictest3447266-21kworker/1:2+events23:44:511
335879099252112,2506cyclictest3365504-21kworker/1:0+events19:34:001
335879099252012,2504cyclictest3412060-21kworker/1:2+events22:00:591
335879099251912,2502cyclictest3384508-21kworker/1:0+events20:28:491
335879099251911,2504cyclictest3402147-21kworker/1:1+events21:23:191
335879099251811,2503cyclictest3384508-21kworker/1:0+events20:42:071
33587909925169,2503cyclictest3416950-21kworker/1:1+events22:25:441
335879099251610,2503cyclictest3397273-21kworker/1:2+events21:06:571
335879099251511,2501cyclictest3428003-21kworker/1:1+events22:48:101
335879099251511,2500cyclictest3407447-21kworker/1:0+events21:44:001
335879099251312,2497cyclictest3402147-21kworker/1:1+events21:34:221
335879099251210,2498cyclictest3407447-21kworker/1:0+events21:51:211
335879499250912,2493cyclictest3437871-21kworker/2:0+events23:28:352
335879499250712,2491cyclictest3378314-21kworker/2:0+events20:12:532
335879499250611,2491cyclictest3427915-21kworker/2:0+events22:44:452
335879499250412,2488cyclictest3431179-21kworker/2:0+events22:59:302
335879099250412,2488cyclictest3456802-21kworker/1:0+events00:28:151
33587859925022,2496cyclictest3371684-21kworker/0:1+events20:07:320
335879499250012,2484cyclictest3381163-21kworker/2:1+events20:53:562
335879499250011,2485cyclictest3387890-21kworker/2:3+events20:41:452
335878599250013,2483cyclictest3371684-21kworker/0:1+events19:50:480
335879499249712,2481cyclictest3444513-21kworker/2:2+events23:52:012
335879099249612,2481cyclictest3387503-21kworker/1:1+events20:36:471
335879499249312,2478cyclictest3417068-21kworker/2:1+events22:32:052
335879499249312,2477cyclictest3413785-21kworker/2:0+events22:06:392
335879499249311,2478cyclictest3371833-21kworker/2:1+events20:05:592
335879699248912,2473cyclictest3373051-21kworker/3:1+events19:59:133
33587949924895,2481cyclictest3395998-21kworker/2:2+events21:13:262
335879499248912,2473cyclictest3362111-21kworker/2:0+events19:27:542
335879099248912,2473cyclictest3431413-21kworker/1:2+events23:02:371
335879499248812,2472cyclictest3401998-21kworker/2:1+events21:24:252
335879499248812,2472cyclictest3381163-21kworker/2:1+events21:01:582
33587909924879,2474cyclictest3387503-21kworker/1:1+events20:45:571
335878599248713,2470cyclictest3390981-21kworker/0:1+events21:03:070
335879499248612,2470cyclictest3386106-21kworker/2:2+events20:37:312
335879499248512,2470cyclictest3456741-21kworker/2:0+events00:15:382
335878599248210,2468cyclictest3368365-21kworker/0:0+events19:38:130
335879499248012,2465cyclictest3417068-21kworker/2:1+events22:21:102
33587969924796,2470cyclictest3440928-21kworker/3:1+events23:27:493
335879499247612,2460cyclictest3451954-21kworker/2:1+events00:29:022
335879099247510,2462cyclictest3384508-21kworker/1:0+events20:59:151
335879099247212,2456cyclictest3392709-21kworker/1:1+events21:02:221
335879499247012,2454cyclictest3444513-21kworker/2:2+events23:48:382
335879099247011,2455cyclictest3431413-21kworker/1:2+events23:07:121
335878599246310,2450cyclictest3447297-21kworker/0:2+events23:45:380
33587909924607,2451cyclictest3429611-21kworker/1:0+events22:50:051
33587969924558,2443cyclictest3397575-21kworker/3:1+events21:18:023
335878599245115,2433cyclictest3397238-21kworker/0:0+events21:16:060
335878599244513,2430cyclictest3453448-21kworker/0:1+events00:21:190
335878599244412,2428cyclictest3378046-21kworker/0:0+events20:10:340
335878599244411,2429cyclictest3426441-21kworker/0:2+events22:54:580
335879499244011,2426cyclictest3417068-21kworker/2:1+events22:16:082
335878599243812,2422cyclictest3397238-21kworker/0:0+events21:11:130
335879699243612,2420cyclictest3432596-21kworker/3:0+events22:57:133
335879699243512,2419cyclictest3442514-21kworker/3:0+events23:47:093
335879499243512,2419cyclictest3451954-21kworker/2:1+events00:03:072
335879099243512,2419cyclictest3456802-21kworker/1:0+events00:17:101
335878599243512,2420cyclictest3400416-21kworker/0:1+events21:30:530
335879099243012,2415cyclictest3353620-21kworker/1:2+events19:16:281
335879099242712,2412cyclictest3437811-21kworker/1:1+events23:38:491
335879099242712,2411cyclictest3368250-21kworker/1:2+events19:46:571
335879099242011,2405cyclictest3402147-21kworker/1:1+events21:28:341
335878599242011,2405cyclictest3368365-21kworker/0:0+events19:45:280
335878599241912,2403cyclictest3453448-21kworker/0:1+events00:13:020
335879499241612,2400cyclictest3451954-21kworker/2:1+events00:32:072
335878599241512,2399cyclictest3382942-21kworker/0:1+events20:26:370
335878599241212,2396cyclictest3381237-21kworker/0:0+events20:17:500
335878599241212,2396cyclictest3363501-21kworker/0:0+events19:23:450
335878599241112,2395cyclictest3447297-21kworker/0:2+events23:44:070
335878599241112,2395cyclictest3434194-21kworker/0:1+events23:02:130
335879699241012,2394cyclictest3426287-21kworker/3:1+events23:04:543
335879499241012,2395cyclictest3368486-21kworker/2:0+events19:42:482
335878599241012,2394cyclictest3407409-21kworker/0:1+events21:40:560
335879699240910,2395cyclictest3458342-21kworker/3:0+events00:22:073
33587859924099,2397cyclictest3389390-21kworker/0:0+events20:45:340
335878599240912,2394cyclictest3366763-21kworker/0:1+events19:42:250
335879699240812,2392cyclictest3395817-21kworker/3:2+events21:05:243
335878599240812,2393cyclictest3448949-21kworker/0:0+events23:52:250
335878599240812,2393cyclictest3448949-21kworker/0:0+events00:04:380
335879699240711,2392cyclictest3376687-21kworker/3:2+events20:14:473
335879499240612,2391cyclictest3429521-21kworker/2:2+events22:48:562
335879499240412,2389cyclictest3439480-21kworker/2:1+events23:30:262
335879699240312,2388cyclictest3365129-21kworker/3:0+events19:46:133
335879699240012,2384cyclictest3366825-21kworker/3:2+events19:37:053
335879499240012,2385cyclictest3362111-21kworker/2:0+events19:19:312
335879699239912,2383cyclictest3379889-21kworker/3:0+events21:02:433
335879699239612,2381cyclictest3440928-21kworker/3:1+events23:24:253
335879699239312,2377cyclictest3366825-21kworker/3:2+events19:34:233
335878599239310,2379cyclictest3448949-21kworker/0:0+events00:09:320
335878599239112,2375cyclictest3448949-21kworker/0:0+events23:58:590
335878599238911,2374cyclictest3410187-21kworker/0:0+events21:55:360
335878599238312,2368cyclictest3371684-21kworker/0:1+events19:59:340
335879699237812,2363cyclictest3424681-21kworker/3:2+events22:36:183
335878599236912,2354cyclictest3403773-21kworker/0:0+events21:36:410
335879699236011,2346cyclictest3434494-21kworker/3:2+events23:06:023
335878599235912,2344cyclictest3463070-21kworker/0:1+events00:37:060
335878599235912,2344cyclictest3440808-21kworker/0:1+events23:37:410
335878599235210,2339cyclictest3363501-21kworker/0:0+events19:30:340
335879699235012,2336cyclictest3379889-21kworker/3:0+events21:10:033
335878599234812,2332cyclictest3389390-21kworker/0:0+events20:54:200
335879699234712,2333cyclictest3405475-21kworker/3:1+events21:35:553
335879699234212,2327cyclictest3442514-21kworker/3:0+events00:05:253
335879699234112,2325cyclictest3444302-21kworker/3:2+events23:39:353
335879699234112,2325cyclictest3390696-21kworker/3:2+events20:51:193
335879699234012,2325cyclictest3415437-21kworker/3:1+events22:14:173
335879699234011,2326cyclictest3400573-21kworker/3:2+events21:24:023
335879699234010,2326cyclictest3428126-21kworker/3:0+events22:47:483
335879699233912,2325cyclictest3426287-21kworker/3:1+events22:50:283
335879699233911,2324cyclictest3418966-21kworker/3:0+events22:21:583
335879699233712,2321cyclictest3373051-21kworker/3:1+events20:04:083
335878599232710,2313cyclictest3426441-21kworker/0:2+events22:59:080
335879699232611,2312cyclictest3453658-21kworker/3:2+events00:04:173
335879699232511,2310cyclictest3442514-21kworker/3:0+events23:58:133
335879699232411,2310cyclictest3379889-21kworker/3:0+events20:29:563
335878599229311,2279cyclictest3352057-21kworker/0:0+events19:13:480
335879499225613,2240cyclictest3421546-21kworker/2:0+events22:26:072
335879699223610,2222cyclictest3461743-21kworker/3:0+events00:39:003
33587909922358,2224cyclictest3437811-21kworker/1:1+events23:47:311
335879099222810,2214cyclictest3353620-21kworker/1:2+events19:14:331
33587949922049,2192cyclictest3358295-21kworker/2:2+events19:11:542
335879699215711,2144cyclictest3379889-21kworker/3:0+events20:20:093
335879699212610,2113cyclictest3417038-21kworker/3:2+events22:15:233
335879699211411,2100cyclictest3453658-21kworker/3:2+events00:17:553
335879699211411,2100cyclictest3424681-21kworker/3:2+events22:41:173
335879699210711,2092cyclictest3379889-21kworker/3:0+events20:56:583
335879699210611,2091cyclictest3418966-21kworker/3:0+events22:30:563
335879699209510,2082cyclictest3368545-21kworker/3:1+events19:40:303
33587969920909,2077cyclictest3384654-21kworker/3:2+events20:31:283
335879699208510,2072cyclictest3353502-21kworker/3:2+events19:13:243
33578152172111,52sleep00-21swapper/019:05:160
33582862155110,26sleep30-21swapper/319:05:563
33585992151112,26sleep20-21swapper/219:09:562
33583582149104,26sleep10-21swapper/119:06:501
3358796992515,7cyclictest865-10wireplumber23:15:013
3358796992019,1cyclictest26450irq/143-i91523:33:323
3358796992019,1cyclictest26450irq/143-i91500:25:553
3358796991911,5cyclictest3378366-21perf20:10:003
3358796991710,5cyclictest3423409-21sshd22:29:403
335879699170,5cyclictest3462927-21runrttasks00:30:323
335879699167,6cyclictest3388663-21ntpq20:40:183
335879699161,11cyclictest3363868-21munin-run19:25:003
3358796991511,2cyclictest3403349-21python321:25:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional