You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 20:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun Aug 30, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
328195499378716,3766cyclictest3302429-21kworker/3:0+events20:15:183
328195199317116,3149cyclictest3316451-21kworker/2:0+events21:10:162
328194699316810,3153cyclictest3299608-21kworker/1:2+events20:30:201
328195499310713,3089cyclictest3342817-21kworker/3:0+events22:20:153
328195199310515,3085cyclictest3384341-21kworker/2:1+events00:35:192
328194699289813,2880cyclictest3291403-21kworker/1:0+events20:00:001
328194299285113,2834cyclictest3365175-21kworker/0:1+events23:55:190
328195199277712,2761cyclictest3375031-21kworker/2:0+events00:30:452
328194699276813,2751cyclictest3308875-21kworker/1:0+events20:40:121
328195499274013,2724cyclictest3363769-21kworker/3:0+events23:30:143
328195499272413,2707cyclictest3331313-21kworker/3:0+events21:55:443
328195499272213,2705cyclictest3334504-21kworker/3:1+events22:14:133
328194699271713,2699cyclictest3326525-21kworker/1:1+events22:00:171
328195199271313,2696cyclictest3375031-21kworker/2:0+events00:00:122
328195199270213,2685cyclictest3384341-21kworker/2:1+events00:27:182
328195199270213,2685cyclictest3334594-21kworker/2:1+events22:11:352
328195499267813,2660cyclictest3350797-21kworker/3:2+events22:45:223
328195499266112,2645cyclictest3378285-21kworker/3:1+events00:26:323
328195199265912,2643cyclictest3316451-21kworker/2:0+events21:07:152
328194299265813,2641cyclictest3365175-21kworker/0:1+events00:12:250
328194299265813,2641cyclictest3365175-21kworker/0:1+events00:12:240
328195499264512,2630cyclictest3285001-21kworker/3:2+events19:32:043
328194299264412,2625cyclictest3339562-21kworker/0:2+events22:15:200
328195199262612,2610cyclictest3352334-21kworker/2:0+events22:53:392
328194699256511,2550cyclictest3307248-21kworker/1:1+events20:52:501
328194699254812,2534cyclictest3381387-21kworker/1:0+events00:36:051
328194699254012,2524cyclictest3383021-21kworker/1:1+events00:24:381
328194699253010,2516cyclictest3286593-21kworker/1:1+events19:31:171
32819549925281,2523cyclictest3378285-21kworker/3:1+events00:17:273
328195199252711,2512cyclictest3356724-21kworker/2:0+events23:00:542
328194699252412,2509cyclictest3350767-21kworker/1:2+events22:48:451
328194699251612,2500cyclictest3352364-21kworker/1:0+events22:51:221
328194699251513,2498cyclictest3299608-21kworker/1:2+events20:24:211
328194699251513,2498cyclictest3299608-21kworker/1:2+events20:24:201
32819469925148,2502cyclictest3294695-21kworker/1:2+events19:53:081
328194699251412,2499cyclictest3317232-21kworker/1:1+events21:16:181
328194699251312,2497cyclictest3344373-21kworker/1:1+events22:29:041
32819549925108,2498cyclictest3296212-21kworker/3:1+events20:13:253
328194699250912,2494cyclictest3381387-21kworker/1:0+events00:31:541
328195199250811,2493cyclictest3291784-21kworker/2:1+events20:23:342
328195199250811,2493cyclictest3291784-21kworker/2:1+events20:23:332
328194699250812,2492cyclictest3378107-21kworker/1:0+events00:08:391
328194699250812,2492cyclictest3349154-21kworker/1:0+events22:42:421
328194699250712,2491cyclictest3326525-21kworker/1:1+events21:38:081
328195499250612,2490cyclictest3288474-21kworker/3:1+events19:35:313
328194699250612,2491cyclictest3328122-21kworker/1:2+events21:34:141
328194699250610,2492cyclictest3374540-21kworker/1:2+events00:11:171
328194699250610,2492cyclictest3374540-21kworker/1:2+events00:11:171
328194699250512,2489cyclictest3366554-21kworker/1:1+events23:43:591
328194699250412,2488cyclictest3344373-21kworker/1:1+events22:56:221
328194699250312,2487cyclictest3297952-21kworker/1:1+events20:02:421
328194699250311,2488cyclictest3360029-21kworker/1:0+events23:21:551
328195499250210,2488cyclictest3318676-21kworker/3:2+events21:10:383
328194699250212,2487cyclictest3341097-21kworker/1:0+events22:15:441
328195499250112,2486cyclictest3341215-21kworker/3:2+events22:30:133
328195499250012,2484cyclictest3320278-21kworker/3:0+events21:23:323
328194299249810,2484cyclictest3307366-21kworker/0:2+events20:28:500
32819549924958,2483cyclictest3324926-21kworker/3:2+events21:36:583
328194699249312,2478cyclictest3381387-21kworker/1:0+events00:25:261
328194699249311,2478cyclictest3339469-21kworker/1:1+events22:07:511
32819549924927,2482cyclictest3304121-21kworker/3:2+events20:27:453
328195499249211,2477cyclictest3349184-21kworker/3:1+events22:55:583
328195499248812,2472cyclictest3296212-21kworker/3:1+events20:09:113
328194699248810,2474cyclictest3299608-21kworker/1:2+events20:14:551
328195499248712,2471cyclictest3355390-21kworker/3:2+events23:10:283
328195499248712,2471cyclictest3318676-21kworker/3:2+events21:05:443
328194299248712,2471cyclictest3318795-21kworker/0:0+events21:12:280
328195499248611,2471cyclictest3363769-21kworker/3:0+events23:53:483
328195499248510,2472cyclictest3341215-21kworker/3:2+events22:25:153
328195499248412,2468cyclictest3291945-21kworker/3:2+events20:01:323
328194699248012,2464cyclictest3344373-21kworker/1:1+events22:35:121
328195199247811,2463cyclictest3344281-21kworker/2:2+events22:31:462
328195199247810,2464cyclictest3344281-21kworker/2:2+events22:57:512
32819519924758,2463cyclictest3291784-21kworker/2:1+events20:15:402
32819519924733,2467cyclictest3329712-21kworker/2:0+events21:42:442
328195199247312,2457cyclictest3283091-21kworker/2:2+events19:27:062
328195499247212,2456cyclictest3318676-21kworker/3:2+events21:03:263
328195199247112,2455cyclictest3358542-21kworker/2:1+events23:08:312
328195199247111,2457cyclictest3373211-21kworker/2:2+events00:05:352
328195499247012,2454cyclictest3353637-21kworker/3:0+events22:51:443
32819519924696,2460cyclictest3329712-21kworker/2:0+events21:46:572
328194699246912,2453cyclictest3361681-21kworker/1:2+events23:18:031
328195199246811,2454cyclictest3334594-21kworker/2:1+events22:05:332
32819519924678,2455cyclictest3305827-21kworker/2:2+events20:54:192
328195199246512,2450cyclictest3316451-21kworker/2:0+events21:20:522
328195499246412,2450cyclictest3353637-21kworker/3:0+events23:05:083
328195499246012,2445cyclictest3349184-21kworker/3:1+events22:45:003
328195199245811,2443cyclictest3363199-21kworker/2:2+events23:29:282
328195199245212,2437cyclictest3329712-21kworker/2:0+events21:58:452
328195199245012,2434cyclictest3326465-21kworker/2:2+events21:27:222
328194699244612,2431cyclictest3324893-21kworker/1:0+events21:26:591
328195499244212,2427cyclictest3386154-21kworker/3:2+events00:35:433
328194299244212,2426cyclictest3285217-21kworker/0:2+events19:41:570
328195199244114,2424cyclictest3313908-21kworker/2:1+events20:49:222
328195199243910,2427cyclictest3291784-21kworker/2:1+events19:45:252
328195499243812,2423cyclictest3363769-21kworker/3:0+events23:49:153
328194699243610,2423cyclictest3288194-21kworker/1:2+events19:28:581
328195199243412,2420cyclictest3358542-21kworker/2:1+events23:15:262
328194699243412,2419cyclictest3318848-21kworker/1:2+events21:06:071
328195499243312,2417cyclictest3361981-21kworker/3:1+events23:21:333
328195199243312,2417cyclictest3342544-21kworker/2:0+events22:19:542
328194699243311,2419cyclictest3307248-21kworker/1:1+events20:47:491
328195499243210,2420cyclictest3296212-21kworker/3:1+events19:55:063
32819469924298,2417cyclictest3372915-21kworker/1:1+events23:52:411
32819469924288,2417cyclictest3344373-21kworker/1:1+events23:13:341
328194699242813,2411cyclictest3374540-21kworker/1:2+events23:57:131
328194699242812,2412cyclictest3294695-21kworker/1:2+events19:48:541
328194699242712,2412cyclictest3344373-21kworker/1:1+events22:24:511
328194699242712,2411cyclictest3291403-21kworker/1:0+events19:38:551
328194699242612,2410cyclictest3329997-21kworker/1:3+events21:44:391
328195499242512,2409cyclictest3378285-21kworker/3:1+events00:22:453
328194699242511,2410cyclictest3332762-21kworker/1:0+events21:52:181
328194699242412,2409cyclictest3313936-21kworker/1:2+events20:58:491
328194699242311,2409cyclictest3324893-21kworker/1:0+events21:22:021
328194299242311,2408cyclictest3285217-21kworker/0:2+events19:47:440
328195499242212,2406cyclictest3334504-21kworker/3:1+events22:01:273
328195199242212,2406cyclictest3329712-21kworker/2:0+events22:02:112
328195199242211,2408cyclictest3363199-21kworker/2:2+events23:32:582
328194699242212,2407cyclictest3344373-21kworker/1:1+events22:30:371
328194699242212,2406cyclictest3339469-21kworker/1:1+events22:12:441
328194299242212,2407cyclictest3378315-21kworker/0:0+events00:39:070
328195499242112,2405cyclictest3363769-21kworker/3:0+events23:44:453
328195499242012,2404cyclictest3341215-21kworker/3:2+events22:19:303
328195199242012,2405cyclictest3324864-21kworker/2:1+events21:33:072
328194699242012,2405cyclictest3299608-21kworker/1:2+events20:16:471
328194699242011,2405cyclictest3307248-21kworker/1:1+events20:38:431
328195199241812,2402cyclictest3375031-21kworker/2:0+events00:23:542
328195499241710,2404cyclictest3308989-21kworker/3:0+events20:39:053
328195199241712,2401cyclictest3334594-21kworker/2:1+events22:24:312
328195199241611,2401cyclictest3286752-21kworker/2:0+events19:35:542
328194699241612,2402cyclictest3286593-21kworker/1:1+events19:40:491
328194699241611,2403cyclictest3344373-21kworker/1:1+events23:00:071
328194699241611,2402cyclictest3358425-21kworker/1:2+events23:06:381
328195499241512,2399cyclictest3286783-21kworker/3:0+events19:26:193
328194699241312,2397cyclictest3318848-21kworker/1:2+events21:13:381
328195499241212,2396cyclictest3360274-21kworker/3:0+events23:16:343
32819519924129,2401cyclictest3291784-21kworker/2:1+events20:25:062
328194699241212,2397cyclictest3299608-21kworker/1:2+events20:26:371
32819429924118,2400cyclictest3317080-21kworker/0:2+events20:59:140
328194299241012,2396cyclictest3307366-21kworker/0:2+events20:35:120
328195199240912,2395cyclictest3360942-21kworker/2:0+events23:21:092
328194699240911,2396cyclictest3368185-21kworker/1:2+events23:45:081
328195499240812,2393cyclictest3378285-21kworker/3:1+events00:30:223
328194299240812,2393cyclictest3344112-21kworker/0:1+events22:21:490
328195499240712,2392cyclictest3373151-21kworker/3:2+events23:59:093
328195499240712,2391cyclictest3363769-21kworker/3:0+events23:26:263
328195499240711,2393cyclictest3312569-21kworker/3:1+events20:52:273
328195499240611,2391cyclictest3296212-21kworker/3:1+events20:21:213
328195499240611,2391cyclictest3296212-21kworker/3:1+events20:21:213
328195499240412,2388cyclictest3367895-21kworker/3:2+events23:35:563
328195499240412,2388cyclictest3331313-21kworker/3:0+events21:46:343
328195499240412,2388cyclictest3320278-21kworker/3:0+events21:17:483
328195199240312,2387cyclictest3350530-21kworker/2:1+events22:43:522
328194299240311,2388cyclictest3299292-21kworker/0:1+events20:12:370
328195499240212,2387cyclictest3285001-21kworker/3:2+events19:16:443
328195499240210,2389cyclictest3378285-21kworker/3:1+events00:10:533
328195499240210,2389cyclictest3378285-21kworker/3:1+events00:10:533
328195199240212,2388cyclictest3375031-21kworker/2:0+events00:15:072
328195199240012,2386cyclictest3301153-21kworker/2:2+events20:11:512
328195199240012,2384cyclictest3288445-21kworker/2:1+events19:32:282
328194699240011,2385cyclictest3299608-21kworker/1:2+events20:07:191
328194299240012,2384cyclictest3354204-21kworker/0:2+events22:56:450
328194299239912,2383cyclictest3365175-21kworker/0:1+events23:38:130
32819549923989,2385cyclictest3373151-21kworker/3:2+events00:09:453
328195499239812,2382cyclictest3312569-21kworker/3:1+events20:48:133
328195499239812,2382cyclictest3291945-21kworker/3:2+events19:42:423
328195499239712,2382cyclictest3307338-21kworker/3:1+events20:33:393
328195499239710,2384cyclictest3312569-21kworker/3:1+events20:56:303
328195199239612,2381cyclictest3305827-21kworker/2:2+events21:03:492
328195199239612,2380cyclictest3291784-21kworker/2:1+events19:53:552
328195499239511,2381cyclictest3347581-21kworker/3:0+events22:39:453
32819519923958,2383cyclictest3344281-21kworker/2:2+events22:27:542
328195199239512,2379cyclictest3366495-21kworker/2:0+events23:50:482
328195199239412,2380cyclictest3363199-21kworker/2:2+events23:40:102
328195199239412,2379cyclictest3283091-21kworker/2:2+events19:22:522
328195199239312,2378cyclictest3305827-21kworker/2:2+events20:36:222
328194299239312,2378cyclictest3339562-21kworker/0:2+events22:26:450
328195199239210,2378cyclictest3291784-21kworker/2:1+events19:43:292
328195199239012,2374cyclictest3321872-21kworker/2:2+events21:17:272
328195199239011,2377cyclictest3366495-21kworker/2:0+events23:46:162
328195199238912,2373cyclictest3332993-21kworker/2:2+events21:51:332
328195199238911,2376cyclictest3344281-21kworker/2:2+events22:49:292
328195199238811,2373cyclictest3373211-21kworker/2:2+events23:58:232
328195199238711,2372cyclictest3344281-21kworker/2:2+events23:12:002
328195199238612,2371cyclictest3305827-21kworker/2:2+events20:30:412
328194299238411,2370cyclictest3323570-21kworker/0:2+events21:53:030
328195499238211,2367cyclictest3291945-21kworker/3:2+events19:46:363
328194699237911,2364cyclictest3374540-21kworker/1:2+events00:04:481
328195199237711,2363cyclictest3326465-21kworker/2:2+events21:37:202
32819519923758,2364cyclictest3283091-21kworker/2:2+events19:17:092
328195499236910,2356cyclictest3373151-21kworker/3:2+events00:02:553
328194299236311,2349cyclictest3359999-21kworker/0:1+events23:11:360
328195499235911,2345cyclictest3331313-21kworker/3:0+events21:50:223
328194299235112,2336cyclictest3369782-21kworker/0:2+events23:47:450
328194299235110,2337cyclictest3321814-21kworker/0:1+events21:30:490
328195199234811,2334cyclictest3305827-21kworker/2:2+events20:55:252
32819429923449,2332cyclictest3341185-21kworker/0:0+events22:14:590
328194299234212,2327cyclictest3386003-21kworker/0:1+events00:34:580
328194299234112,2326cyclictest3352042-21kworker/0:0+events22:47:140
328194299234012,2324cyclictest3361658-21kworker/0:0+events23:24:140
328194299233910,2326cyclictest3361658-21kworker/0:0+events23:27:560
328194299233812,2322cyclictest3356924-21kworker/0:0+events23:04:430
328194299233811,2323cyclictest3285217-21kworker/0:2+events20:05:460
328195499233612,2320cyclictest3326508-21kworker/3:1+events21:40:503
328194299233512,2320cyclictest3296394-21kworker/0:0+events19:55:520
328194299233510,2322cyclictest3368093-21kworker/0:0+events23:42:300
328194699233112,2316cyclictest3332762-21kworker/1:0+events21:48:511
328194299233112,2315cyclictest3365175-21kworker/0:1+events23:32:100
328194299233012,2314cyclictest3299292-21kworker/0:1+events20:31:500
328194699232911,2315cyclictest3332762-21kworker/1:0+events21:59:311
32819549923279,2315cyclictest3308989-21kworker/3:0+events20:42:293
328194299232612,2311cyclictest3293028-21kworker/0:1+events19:50:250
328194299232612,2310cyclictest3288173-21kworker/0:1+events19:27:290
328194299232512,2310cyclictest3299292-21kworker/0:1+events20:20:140
328194299232512,2310cyclictest3299292-21kworker/0:1+events20:20:140
328194299232512,2309cyclictest3299292-21kworker/0:1+events20:17:570
328194299232510,2312cyclictest3365175-21kworker/0:1+events23:52:160
328195199232411,2309cyclictest3291784-21kworker/2:1+events20:09:352
328194299232412,2310cyclictest3285217-21kworker/0:2+events19:35:090
328194299232412,2308cyclictest3365175-21kworker/0:1+events00:02:090
328194299232410,2310cyclictest3334535-21kworker/0:1+events22:04:480
328194299232310,2309cyclictest3318795-21kworker/0:0+events21:04:570
32819429923228,2310cyclictest3323570-21kworker/0:2+events21:28:310
328195499231912,2304cyclictest3334504-21kworker/3:1+events22:08:593
328194299231710,2304cyclictest3382800-21kworker/0:2+events00:23:070
328194299231612,2301cyclictest3323570-21kworker/0:2+events21:41:130
328194299231211,2297cyclictest3317080-21kworker/0:2+events21:07:370
328194299231111,2297cyclictest3278318-21kworker/0:1+events19:15:150
328194699230912,2293cyclictest3361681-21kworker/1:2+events23:28:201
32819519923008,2288cyclictest3366495-21kworker/2:0+events23:37:062
328195499229611,2281cyclictest3326508-21kworker/3:1+events21:27:453
328194299229411,2280cyclictest3283153-21kworker/0:0+events19:22:070
328194699229111,2276cyclictest3374540-21kworker/1:2+events00:17:021
328194299228610,2273cyclictest3289983-21kworker/0:0+events19:34:230
32819469922839,2270cyclictest3286593-21kworker/1:1+events19:22:311
328194299226512,2249cyclictest3307366-21kworker/0:2+events20:44:230
328195499225810,2244cyclictest3291945-21kworker/3:2+events19:52:213
32819429922487,2239cyclictest3354204-21kworker/0:2+events23:15:040
328194299224010,2226cyclictest3365175-21kworker/0:1+events00:18:330
328195499223811,2224cyclictest3286783-21kworker/3:0+events19:24:013
328194699222111,2207cyclictest3279779-21kworker/1:2+events19:19:021
328194699222011,2206cyclictest3364945-21kworker/1:0+events23:36:421
32819549922169,2204cyclictest3326508-21kworker/3:1+events21:33:543
328194299220812,2194cyclictest3310920-21kworker/0:0+events20:50:090
328195199219910,2185cyclictest3312274-21kworker/2:0+events20:42:522
328194699219910,2186cyclictest3317232-21kworker/1:1+events21:00:451
32819469921987,2187cyclictest3364945-21kworker/1:0+events23:33:411
328195499219710,2184cyclictest3355390-21kworker/3:2+events23:03:593
328195199219711,2183cyclictest3278154-21kworker/2:0+events19:14:112
32819469921938,2182cyclictest3279779-21kworker/1:2+events19:12:181
328195199219011,2175cyclictest3291784-21kworker/2:1+events19:57:432
328195199217911,2164cyclictest3291784-21kworker/2:1+events20:03:492
328194299215611,2142cyclictest3285217-21kworker/0:2+events20:01:090
32819429921554,2148cyclictest3347461-21kworker/0:1+events22:39:250
328194299211611,2102cyclictest3354204-21kworker/0:2+events23:05:290
328194299211611,2102cyclictest3347461-21kworker/0:1+events22:33:400
328194299211611,2102cyclictest3331218-21kworker/0:0+events21:46:130
328194299211511,2101cyclictest3339562-21kworker/0:2+events22:09:210
328194299211511,2101cyclictest3321814-21kworker/0:1+events21:22:260
32819429920949,2082cyclictest3318795-21kworker/0:0+events21:15:320
328194299209310,2080cyclictest3278318-21kworker/0:1+events19:12:400
32819429920749,2062cyclictest3349157-21kworker/0:2+events22:43:290
32819549920698,2057cyclictest3279842-21kworker/3:0+events19:13:493
328195199202710,2014cyclictest3344281-21kworker/2:2+events22:35:542
32819549916558,1646cyclictest3279842-21kworker/3:0+events19:10:013
32814082155113,24sleep00-21swapper/019:06:270
32814422141106,30sleep10-21swapper/119:06:511
32813322141103,31sleep20-21swapper/219:05:282
328195199109106,2cyclictest3375031-21kworker/2:0+pm00:14:572
328195199109106,2cyclictest3375031-21kworker/2:0+pm00:14:562
328194299238,5cyclictest0-21swapper/000:10:000
3281942992010,7cyclictest3335699-21smartctlcvt21:55:200
3281942991913,4cyclictest3329933-21cron21:40:000
328194299181,14cyclictest304-21jbd2/nvme0n1p2-822:55:010
328194299180,16cyclictest3384530-21taskset00:28:210
328194299150,4cyclictest739-21runrttasks20:48:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional