You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 04:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat May 16, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
336059799455517,4533cyclictest3436295-21kworker/0:1+events23:10:150
336060399284512,2828cyclictest3389401-21kworker/2:0+events20:40:122
336060399282314,2804cyclictest3418320-21kworker/2:0+events22:15:182
336059999282213,2805cyclictest3437661-21kworker/1:0+events23:15:111
336059999277211,2757cyclictest3378247-21kworker/1:1+events20:35:161
336059999276310,2751cyclictest3424931-21kworker/1:1+events22:30:541
336060699270313,2686cyclictest3376765-21kworker/3:2+events20:00:173
336059799266313,2645cyclictest3442334-21kworker/0:0+events23:25:170
336060699265313,2636cyclictest3429408-21kworker/3:0+events22:45:203
336060399263013,2613cyclictest3453806-21kworker/2:3+events00:25:192
336060399257912,2563cyclictest3434296-21kworker/2:0+events23:01:592
33606039925790,2575cyclictest3364366-21kworker/2:2+events19:35:112
336059799257312,2559cyclictest3436295-21kworker/0:1+events23:20:280
336059799257312,2557cyclictest3448754-21kworker/0:0+events23:54:530
336059999257012,2554cyclictest3443865-21kworker/1:2+events23:30:131
33606039925649,2551cyclictest3453531-21kworker/2:2+events23:59:032
336059799253112,2515cyclictest3458297-21kworker/0:2+events00:20:230
336059799253112,2515cyclictest3458297-21kworker/0:2+events00:20:230
336059799252212,2507cyclictest3375108-21kworker/0:0+events19:59:070
336059799250512,2490cyclictest3426268-21kworker/0:1+events22:57:490
336059999250410,2490cyclictest3443865-21kworker/1:2+events23:27:131
336059999249512,2479cyclictest3423329-21kworker/1:0+events22:44:571
336060399249212,2477cyclictest3434296-21kworker/2:0+events23:27:592
336060399249112,2476cyclictest3428079-21kworker/2:0+events22:49:542
336060399248912,2473cyclictest3421589-21kworker/2:1+events22:21:042
336059999248812,2472cyclictest3428107-21kworker/1:2+events22:48:221
336060699248610,2472cyclictest3436266-21kworker/3:1+events23:05:463
336059799248511,2471cyclictest3426268-21kworker/0:1+events22:48:000
336059999248111,2466cyclictest3367234-21kworker/1:1+events19:32:521
336059999248012,2464cyclictest3378247-21kworker/1:1+events20:03:211
336060399247910,2465cyclictest3424694-21kworker/2:2+events22:28:592
336059999247112,2455cyclictest3453354-21kworker/1:0+events23:56:471
336060399246911,2455cyclictest3392626-21kworker/2:0+events20:52:422
336060399246811,2453cyclictest3400599-21kworker/2:0+events21:15:342
336060399246712,2451cyclictest3391028-21kworker/2:2+events20:46:402
336060399246312,2448cyclictest3407186-21kworker/2:0+events21:54:592
336059999245912,2442cyclictest3456684-21kworker/1:0+events00:08:311
336059799245912,2444cyclictest3432758-21kworker/0:2+events23:09:070
336059799245812,2443cyclictest3365472-21kworker/0:2+events19:25:210
336060399245711,2443cyclictest3373708-21kworker/2:0+events19:56:022
336059999245512,2441cyclictest3408548-21kworker/1:2+events21:40:161
336060399245312,2436cyclictest3373708-21kworker/2:0+events20:05:142
336059799245312,2437cyclictest3459937-21kworker/0:0+events00:37:560
336059799245312,2437cyclictest3403924-21kworker/0:1+events21:26:400
336059799245211,2437cyclictest3389281-21kworker/0:1+events20:46:180
336059799245012,2434cyclictest3390998-21kworker/0:0+events20:43:390
336059799244912,2434cyclictest3453709-21kworker/0:1+events00:06:570
336059799244911,2435cyclictest3416955-21kworker/0:0+events22:05:490
336060399244812,2433cyclictest3424694-21kworker/2:2+events22:37:032
336059799244812,2433cyclictest3424630-21kworker/0:2+events22:40:460
336059799244812,2432cyclictest3440709-21kworker/0:2+events23:38:320
336059799244712,2431cyclictest3373496-21kworker/0:1+events19:49:580
336059799244611,2431cyclictest3448754-21kworker/0:0+events23:48:000
336059999244512,2431cyclictest3410366-21kworker/1:1+events21:45:041
336059799244512,2430cyclictest3389281-21kworker/0:1+events20:39:500
336059999244412,2428cyclictest3416747-21kworker/1:0+events22:03:311
336059799244412,2429cyclictest3402175-21kworker/0:0+events21:20:550
336059999244212,2427cyclictest3382478-21kworker/1:0+events20:19:151
336059799244111,2427cyclictest3426268-21kworker/0:1+events22:35:550
336060399244011,2426cyclictest3387767-21kworker/2:1+events21:05:202
336059999244012,2425cyclictest3455061-21kworker/1:2+events00:39:251
336059799243911,2424cyclictest3440709-21kworker/0:2+events23:33:360
336059799243710,2423cyclictest3459937-21kworker/0:0+events00:33:410
33606069924369,2425cyclictest3424841-21kworker/3:0+events22:30:083
336059799243412,2420cyclictest3418561-21kworker/0:1+events22:10:010
336060399242911,2415cyclictest3434296-21kworker/2:0+events23:24:562
336060699242112,2405cyclictest3387800-21kworker/3:0+events21:43:153
336059999242012,2405cyclictest3418375-21kworker/1:2+events22:07:421
336059999241812,2402cyclictest3431007-21kworker/1:1+events23:03:521
336059799241511,2401cyclictest3358475-21kworker/0:2+events19:15:270
336059799241511,2400cyclictest3398970-21kworker/0:2+events21:14:240
336059799241211,2398cyclictest3373496-21kworker/0:1+events19:54:540
336060699240711,2392cyclictest3358738-21kworker/3:2+events19:30:123
336060399240212,2387cyclictest3451898-21kworker/2:0+events00:03:592
336059799240212,2388cyclictest3416955-21kworker/0:0+events22:30:310
336060699239412,2379cyclictest3402057-21kworker/3:2+events21:18:173
33605979923929,2379cyclictest3426268-21kworker/0:1+events22:50:180
336060699238611,2371cyclictest3414968-21kworker/3:1+events21:59:393
336060699237911,2365cyclictest3437863-21kworker/3:0+events23:15:333
336060399237512,2359cyclictest3378306-21kworker/2:2+events20:10:332
336059999236111,2346cyclictest3373739-21kworker/1:2+events19:51:321
336059799236011,2345cyclictest3422058-21kworker/0:1+events22:20:410
336059799235210,2340cyclictest3408755-21kworker/0:0+events21:50:050
33606069923519,2339cyclictest3448785-21kworker/3:1+events23:53:453
336060399234812,2333cyclictest3387767-21kworker/2:1+events20:35:372
336059999234510,2332cyclictest3363881-21kworker/1:2+events19:24:101
336060699233711,2323cyclictest3365411-21kworker/3:1+events19:46:073
336060699233611,2322cyclictest3418408-21kworker/3:1+events22:22:593
336060699233511,2322cyclictest3378455-21kworker/3:1+events20:15:043
336060699233112,2316cyclictest3447164-21kworker/3:0+events23:39:163
336060699233112,2316cyclictest3405642-21kworker/3:2+events21:32:003
336060399233012,2315cyclictest3442622-21kworker/2:1+events23:41:122
336060699232712,2312cyclictest3458234-21kworker/3:2+events00:26:053
336060699232711,2313cyclictest3387800-21kworker/3:0+events22:10:233
336060699232312,2307cyclictest3445563-21kworker/3:2+events23:32:293
336060699232111,2306cyclictest3387800-21kworker/3:0+events21:23:133
336060399231812,2303cyclictest3453806-21kworker/2:3+events00:30:132
336060699231712,2302cyclictest3448785-21kworker/3:1+events23:48:473
336059999231312,2297cyclictest3408548-21kworker/1:2+events21:37:131
336059999231311,2299cyclictest3378247-21kworker/1:1+events20:09:241
336059999231310,2299cyclictest3402236-21kworker/1:1+events21:23:371
336060699231112,2296cyclictest3380151-21kworker/3:0+events20:14:193
336060699230811,2292cyclictest3432727-21kworker/3:0+events22:54:503
336060399230812,2293cyclictest3432608-21kworker/2:2+events22:55:572
33605999923079,2294cyclictest3461539-21kworker/1:0+events00:27:571
336060399230612,2291cyclictest3373708-21kworker/2:0+events20:02:122
336059999230412,2288cyclictest3439315-21kworker/1:1+events23:41:561
33605979923019,2288cyclictest3386106-21kworker/0:2+events20:29:320
336060399229610,2283cyclictest3445623-21kworker/2:2+events23:37:472
336059799229011,2276cyclictest3432758-21kworker/0:2+events23:02:430
336059999228211,2267cyclictest3412851-21kworker/1:2+events21:56:081
336060699227910,2266cyclictest3397485-21kworker/3:2+events21:05:423
336060399227610,2263cyclictest3408785-21kworker/2:2+events21:41:002
336060399227411,2260cyclictest3442622-21kworker/2:1+events23:48:252
336060399227311,2259cyclictest3364366-21kworker/2:2+events19:22:152
336060399227211,2258cyclictest3413422-21kworker/2:1+events22:00:262
336060399227211,2258cyclictest3405465-21kworker/2:1+events21:37:382
336060399227211,2258cyclictest3379913-21kworker/2:1+events20:18:302
336060699227111,2258cyclictest3426450-21kworker/3:2+events22:35:103
336060699227110,2257cyclictest3387800-21kworker/3:0+events21:49:173
336060399227110,2258cyclictest3453806-21kworker/2:3+events00:23:032
336060399227110,2258cyclictest3453806-21kworker/2:3+events00:23:032
336060399227011,2257cyclictest3403566-21kworker/2:2+events21:31:392
336060399226911,2255cyclictest3418320-21kworker/2:0+events22:31:172
336060399226910,2256cyclictest3394341-21kworker/2:2+events20:57:382
336060399226811,2254cyclictest3366870-21kworker/2:1+events19:43:062
336060399226710,2254cyclictest3419949-21kworker/2:2+events22:13:472
33606039922668,2254cyclictest3437931-21kworker/2:1+events23:12:272
336060399226511,2250cyclictest3360329-21kworker/2:1+events19:19:402
336059799226511,2250cyclictest3424630-21kworker/0:2+events22:27:070
336060399226411,2250cyclictest3442622-21kworker/2:1+events23:32:532
336060699226311,2248cyclictest3426450-21kworker/3:2+events23:04:373
336060399226210,2249cyclictest3387767-21kworker/2:1+events21:01:082
336059799226212,2247cyclictest3383340-21kworker/0:0+events20:21:350
336060399225811,2244cyclictest3386166-21kworker/2:2+events20:31:512
33606039922579,2245cyclictest3413422-21kworker/2:1+events22:06:112
336059799225511,2241cyclictest3440709-21kworker/0:2+events23:42:180
33605999922519,2239cyclictest3412851-21kworker/1:2+events21:54:141
336059999225111,2237cyclictest3402236-21kworker/1:1+events21:25:311
336059999224911,2235cyclictest3378247-21kworker/1:1+events20:23:521
336060399224811,2234cyclictest3451898-21kworker/2:0+events00:09:412
336059999224811,2234cyclictest3432790-21kworker/1:0+events22:58:561
336060399224710,2233cyclictest3373708-21kworker/2:0+events19:50:212
33605999922479,2235cyclictest3461539-21kworker/1:0+events00:24:561
33605999922479,2235cyclictest3461539-21kworker/1:0+events00:24:561
33605999922457,2235cyclictest3455061-21kworker/1:2+events00:19:351
33606039922445,2236cyclictest3403566-21kworker/2:2+events21:24:452
336060399224111,2227cyclictest3460130-21kworker/2:0+events00:39:022
336060399224011,2226cyclictest3434296-21kworker/2:0+events23:18:122
336059999223910,2226cyclictest3463166-21kworker/1:1+events00:31:001
336059799223610,2223cyclictest3436295-21kworker/0:1+events23:18:350
336059799223610,2223cyclictest3363851-21kworker/0:0+events19:20:440
336059999223510,2222cyclictest3373739-21kworker/1:2+events20:11:191
33605979922359,2223cyclictest3378366-21kworker/0:1+events20:12:490
336060699223412,2219cyclictest3407270-21kworker/3:1+events21:36:523
33606039922345,2225cyclictest3383145-21kworker/2:0+events20:26:342
336059999223211,2218cyclictest3398851-21kworker/1:2+events21:19:471
336059999223110,2218cyclictest3384564-21kworker/1:2+events20:26:111
33605979922319,2218cyclictest3415060-21kworker/0:1+events22:03:090
336059799223111,2216cyclictest3453709-21kworker/0:1+events00:03:150
336060699223011,2216cyclictest3459964-21kworker/3:1+events00:20:003
336059799223010,2218cyclictest3402175-21kworker/0:0+events21:30:060
336059999222911,2216cyclictest3390909-21kworker/1:0+events20:45:101
336059799222910,2216cyclictest3458297-21kworker/0:2+events00:13:320
336059999222811,2214cyclictest3450479-21kworker/1:2+events23:52:581
33605999922279,2214cyclictest3420039-21kworker/1:1+events22:16:281
336059999222711,2214cyclictest3456684-21kworker/1:0+events00:10:051
336059999222711,2213cyclictest3437661-21kworker/1:0+events23:10:591
336059799222712,2212cyclictest3394402-21kworker/0:1+events21:15:580
336059799222711,2213cyclictest3386106-21kworker/0:2+events20:32:360
336059799222710,2214cyclictest3406985-21kworker/0:2+events21:38:470
336059799222710,2213cyclictest3406985-21kworker/0:2+events21:43:370
33605999922267,2215cyclictest3437661-21kworker/1:0+events23:22:211
33605999922267,2215cyclictest3387991-21kworker/1:2+events20:58:251
336059999222611,2212cyclictest3421710-21kworker/1:2+events22:28:151
336059799222610,2213cyclictest3380001-21kworker/0:0+events20:09:460
336059799222610,2213cyclictest3365472-21kworker/0:2+events19:32:050
33605999922259,2213cyclictest3416747-21kworker/1:0+events22:13:021
336059799222512,2209cyclictest3448754-21kworker/0:0+events23:57:310
336059799222511,2211cyclictest3376734-21kworker/0:2+events20:02:570
336059799222510,2212cyclictest3394402-21kworker/0:1+events21:02:180
336059999222411,2210cyclictest3434445-21kworker/1:2+events23:09:291
336059999222410,2211cyclictest3398851-21kworker/1:2+events21:09:061
336059999222410,2211cyclictest3394223-21kworker/1:0+events21:00:231
336059999222410,2210cyclictest3439315-21kworker/1:1+events23:49:101
336059799222412,2209cyclictest3459937-21kworker/0:0+events00:19:150
336059799222411,2209cyclictest3392714-21kworker/0:2+events20:59:360
336059799222411,2209cyclictest3390998-21kworker/0:0+events20:51:120
336059799222410,2211cyclictest3459937-21kworker/0:0+events00:26:280
33606069922239,2211cyclictest3358738-21kworker/3:2+events19:13:093
336059999222310,2210cyclictest3431007-21kworker/1:1+events22:54:051
336060699222211,2208cyclictest3371930-21kworker/3:0+events19:55:173
336059999222211,2208cyclictest3402236-21kworker/1:1+events21:33:301
336059999222211,2208cyclictest3396242-21kworker/1:1+events21:11:001
336059999222210,2209cyclictest3387991-21kworker/1:2+events20:44:021
336059999222210,2208cyclictest3439315-21kworker/1:1+events23:36:171
336059799222211,2208cyclictest3420157-21kworker/0:2+events22:16:040
336059999222011,2206cyclictest3421710-21kworker/1:2+events22:24:261
336059999221910,2206cyclictest3367234-21kworker/1:1+events19:49:341
336059799221711,2203cyclictest3410398-21kworker/0:1+events21:48:570
33606069922129,2200cyclictest3429408-21kworker/3:0+events22:41:543
336059999220310,2190cyclictest3367234-21kworker/1:1+events19:41:121
336059799220311,2189cyclictest3381655-21kworker/0:2+events20:19:390
336060699219911,2184cyclictest3365411-21kworker/3:1+events19:24:583
336060399219710,2184cyclictest3442622-21kworker/2:1+events23:52:122
33606039921919,2179cyclictest3451898-21kworker/2:0+events00:12:232
33605999921877,2177cyclictest3363881-21kworker/1:2+events19:29:041
33605979921859,2173cyclictest3361805-21kworker/0:1+events19:14:190
33606069921769,2164cyclictest3437863-21kworker/3:0+events23:24:353
336060699216710,2154cyclictest3387800-21kworker/3:0+events20:34:323
336060699216210,2149cyclictest3371930-21kworker/3:0+events19:52:183
336060399216210,2148cyclictest3387767-21kworker/2:1+events21:14:022
33606069921588,2147cyclictest3450446-21kworker/3:2+events23:57:103
336060399215611,2142cyclictest3405465-21kworker/2:1+events21:28:122
336060699215311,2139cyclictest3380151-21kworker/3:0+events20:20:483
336060399215310,2140cyclictest3407186-21kworker/2:0+events21:57:422
336060399214611,2133cyclictest3430944-21kworker/2:1+events22:51:462
336060699214011,2126cyclictest3358738-21kworker/3:2+events19:27:343
336059799213211,2118cyclictest3371872-21kworker/0:0+events19:41:570
336060699212811,2114cyclictest3437863-21kworker/3:0+events23:10:363
336060699212611,2112cyclictest3458234-21kworker/3:2+events00:39:463
336060699212511,2111cyclictest3389671-21kworker/3:2+events20:44:463
336060699211710,2103cyclictest3387800-21kworker/3:0+events22:08:523
336060399211510,2101cyclictest3366870-21kworker/2:1+events19:27:562
33606039921109,2098cyclictest3434296-21kworker/2:0+events23:05:222
33606039921104,2104cyclictest3458444-21kworker/2:1+events00:18:082
336060699210811,2094cyclictest3450446-21kworker/3:2+events00:01:193
336060699210811,2093cyclictest3387800-21kworker/3:0+events20:53:503
336060699210711,2093cyclictest3459964-21kworker/3:1+events00:23:493
336060699210711,2093cyclictest3459964-21kworker/3:1+events00:23:493
336060699210710,2094cyclictest3439548-21kworker/3:1+events23:26:273
336060699210511,2090cyclictest3387800-21kworker/3:0+events21:11:473
336060699210510,2092cyclictest3387800-21kworker/3:0+events20:57:163
336060699210411,2091cyclictest3423213-21kworker/3:2+events22:25:113
336060699210411,2090cyclictest3456566-21kworker/3:0+events00:07:443
336060699210410,2091cyclictest3358738-21kworker/3:2+events19:35:323
336060699210410,2090cyclictest3392450-21kworker/3:1+events20:48:573
33606039921049,2093cyclictest3383145-21kworker/2:0+events20:20:022
336060699210310,2090cyclictest3413364-21kworker/3:2+events22:02:223
336060699210310,2090cyclictest3386193-21kworker/3:1+events20:29:103
336060699210211,2088cyclictest3413364-21kworker/3:2+events21:53:283
336059999210210,2089cyclictest3439315-21kworker/1:1+events00:01:441
336060699210111,2087cyclictest3387800-21kworker/3:0+events21:04:333
336060699210111,2087cyclictest3365411-21kworker/3:1+events19:41:363
33605999920999,2086cyclictest3392596-21kworker/1:1+events20:50:501
33606069920985,2090cyclictest3363700-21kworker/3:0+events19:18:533
336060399209810,2085cyclictest3366870-21kworker/2:1+events19:33:352
336060699209711,2083cyclictest3376765-21kworker/3:2+events20:09:023
336059999209410,2080cyclictest3361720-21kworker/1:1+events19:13:331
33605979920933,2087cyclictest3365472-21kworker/0:2+events19:36:420
336059799208310,2069cyclictest3397311-21kworker/0:0+events21:06:040
33605999920789,2066cyclictest3367234-21kworker/1:1+events19:39:211
336060699207611,2062cyclictest3432727-21kworker/3:0+events22:58:313
33606069920759,2063cyclictest3387800-21kworker/3:0+events22:15:423
336059999207210,2059cyclictest3363881-21kworker/1:2+events19:19:171
336060699206711,2053cyclictest3387800-21kworker/3:0+events21:29:203
336060699204210,2029cyclictest3447164-21kworker/3:0+events23:42:423
336059799201810,2005cyclictest3412033-21kworker/0:2+events21:58:280
33606069919797,1969cyclictest3453678-21kworker/3:1+events00:10:283
33606069919779,1965cyclictest3386193-21kworker/3:1+events20:38:193
33606039919528,1941cyclictest3372047-21kworker/2:2+events19:49:102
33605999919417,1931cyclictest3386310-21kworker/1:0+events20:30:191
33601002153111,24sleep10-21swapper/119:06:391
33601072142108,29sleep30-21swapper/319:06:453
33600372140102,33sleep00-21swapper/019:05:510
33600292140107,28sleep20-21swapper/219:05:442
3360599996260,1cyclictest3423329-21kworker/1:0+pm22:39:531
336060399180,16cyclictest3411763-21taskset21:46:282
3360606991514,1cyclictest26450irq/143-i91500:31:453
336059999158,5cyclictest3376941-21cron20:00:001
3360603991312,1cyclictest65-21kcompactd022:41:082
3360603991310,2cyclictest3360329-21kworker/2:1+pm19:14:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional