You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 21:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Apr 02, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
344767199295015,2931cyclictest3452780-21kworker/3:0+events19:50:193
344767199293212,2916cyclictest3498481-21kworker/3:2+events21:55:213
344766299287315,2855cyclictest3490157-21kworker/1:2+events21:45:001
34476719928379,2824cyclictest3537643-21kworker/3:0+events23:50:173
344767199282113,2804cyclictest3478650-21kworker/3:1+events21:15:203
344767199278613,2768cyclictest3498481-21kworker/3:2+events22:05:183
344767199277213,2755cyclictest3480515-21kworker/3:0+events20:55:193
344767199276313,2745cyclictest3459549-21kworker/3:1+events19:48:503
344766299270913,2693cyclictest3549965-21kworker/1:1+events00:25:101
344766299258612,2571cyclictest3483450-21kworker/1:0+events21:13:261
344765999257511,2560cyclictest3531542-21kworker/0:1+events23:35:190
34476599925639,2550cyclictest3543666-21kworker/0:1+events00:08:170
344767199253911,2524cyclictest3512297-21kworker/3:0+events22:47:013
344767199253911,2524cyclictest3508265-21kworker/3:1+events22:15:153
344767199253911,2524cyclictest3508265-21kworker/3:1+events22:15:153
344766299253112,2515cyclictest3501506-21kworker/1:0+events22:02:381
344766299250712,2492cyclictest3468898-21kworker/1:1+events20:17:561
344765999250712,2491cyclictest3504998-21kworker/0:1+events22:07:130
344766799250010,2486cyclictest3532473-21kworker/2:0+events23:36:522
344765999249912,2484cyclictest3462632-21kworker/0:1+events20:09:570
344765999249912,2483cyclictest3522966-21kworker/0:1+events23:00:250
344765999249812,2483cyclictest3485187-21kworker/0:1+events21:03:590
344766299249612,2480cyclictest3527572-21kworker/1:0+events23:12:411
344766299249512,2480cyclictest3483450-21kworker/1:0+events21:18:211
344765999249412,2478cyclictest3490306-21kworker/0:2+events21:43:300
344765999249311,2478cyclictest3468724-21kworker/0:0+events20:21:220
344765999249212,2477cyclictest3454463-21kworker/0:1+events19:28:240
344766299249111,2476cyclictest3551673-21kworker/1:0+events00:39:421
344766299248912,2474cyclictest3541980-21kworker/1:0+events00:00:131
344766299248912,2474cyclictest3523191-21kworker/1:2+events23:09:391
344766299248912,2474cyclictest3509542-21kworker/1:2+events22:16:251
344766299248912,2474cyclictest3509542-21kworker/1:2+events22:16:251
344766299248812,2472cyclictest3465646-21kworker/1:0+events20:09:341
344765999248812,2473cyclictest3460925-21kworker/0:2+events19:51:050
344765999248711,2474cyclictest3468724-21kworker/0:0+events20:25:340
344765999248711,2473cyclictest3541947-21kworker/0:0+events00:13:170
344765999248710,2473cyclictest3481208-21kworker/0:0+events20:51:320
344766299248511,2471cyclictest3544057-21kworker/1:1+events00:05:351
344765999248412,2468cyclictest3481208-21kworker/0:0+events20:56:500
344765999248312,2468cyclictest3493207-21kworker/0:1+events21:31:000
344766299248211,2468cyclictest3475303-21kworker/1:0+events20:35:291
344767199247911,2465cyclictest3541887-21kworker/3:0+events00:17:093
344766299247612,2461cyclictest3516344-21kworker/1:2+events22:50:261
344766299247612,2460cyclictest3493392-21kworker/1:0+events21:34:471
344766299247512,2461cyclictest3527572-21kworker/1:0+events23:15:461
344766299247412,2458cyclictest3551673-21kworker/1:0+events00:30:321
344765999247412,2458cyclictest3468724-21kworker/0:0+events20:16:030
344766299247011,2456cyclictest3546669-21kworker/1:2+events00:16:461
344766299246912,2453cyclictest3523191-21kworker/1:2+events23:02:461
344765999246812,2453cyclictest3496798-21kworker/0:1+events21:39:200
34476599924679,2455cyclictest3490306-21kworker/0:2+events22:18:380
34476599924679,2455cyclictest3490306-21kworker/0:2+events22:18:370
344766299246412,2448cyclictest3501506-21kworker/1:0+events21:58:011
344766299245910,2446cyclictest3512768-21kworker/1:1+events22:39:461
344766299245111,2436cyclictest3490157-21kworker/1:2+events21:54:341
344767199244712,2432cyclictest3523027-21kworker/3:0+events23:21:553
344766299244612,2431cyclictest3531047-21kworker/1:0+events23:40:201
344767199244511,2430cyclictest3461393-21kworker/3:2+events20:18:183
344765999244112,2425cyclictest3535691-21kworker/0:0+events23:45:410
344767199243511,2420cyclictest3500195-21kworker/3:0+events22:00:213
344765999243512,2420cyclictest3551451-21kworker/0:2+events00:32:510
344766299243112,2416cyclictest3493392-21kworker/1:0+events21:36:411
344766299242910,2415cyclictest3462755-21kworker/1:2+events20:34:241
344767199242814,2410cyclictest3496857-21kworker/3:1+events21:39:443
344767199242511,2410cyclictest3494933-21kworker/3:2+events21:33:383
344767199242510,2412cyclictest3535780-21kworker/3:1+events23:59:493
344767199242412,2410cyclictest3508265-21kworker/3:1+events22:20:093
344767199242212,2407cyclictest3496857-21kworker/3:1+events21:42:233
344767199242112,2406cyclictest3551613-21kworker/3:2+events00:31:193
344767199242112,2406cyclictest3483773-21kworker/3:2+events21:05:303
344767199242111,2406cyclictest3541887-21kworker/3:0+events00:29:453
344767199242012,2405cyclictest3523027-21kworker/3:0+events23:26:553
344767199241912,2404cyclictest3491634-21kworker/3:2+events21:21:483
344767199241812,2403cyclictest3493301-21kworker/3:1+events21:29:493
344767199241812,2402cyclictest3452780-21kworker/3:0+events19:31:273
344767199241612,2401cyclictest3535780-21kworker/3:1+events23:49:083
344767199241611,2402cyclictest3534024-21kworker/3:2+events23:33:253
34476679924169,2404cyclictest3493809-21kworker/2:2+events21:35:322
344766799241612,2400cyclictest3548246-21kworker/2:0+events00:17:552
344767199241410,2401cyclictest3523027-21kworker/3:0+events23:12:213
344767199241311,2399cyclictest3521069-21kworker/3:1+events23:03:533
344765999241310,2399cyclictest3541947-21kworker/0:0+events00:20:120
344767199241012,2395cyclictest3452780-21kworker/3:0+events19:23:273
344766299241010,2397cyclictest3529417-21kworker/1:1+events23:25:001
344766299240812,2392cyclictest3439345-21kworker/1:2+events19:35:111
344766799240512,2389cyclictest3527602-21kworker/2:2+events23:31:302
344767199239610,2382cyclictest3470476-21kworker/3:1+events20:22:543
344765999239410,2381cyclictest3485187-21kworker/0:1+events21:11:550
344766799239112,2375cyclictest3524716-21kworker/2:0+events23:17:172
344766299238610,2373cyclictest3514715-21kworker/1:0+events22:32:591
344767199238410,2371cyclictest3472389-21kworker/3:0+events20:35:543
344766799238212,2367cyclictest3534141-21kworker/2:1+events23:54:062
344766799237111,2357cyclictest3503523-21kworker/2:1+events22:18:172
344766799237111,2357cyclictest3503523-21kworker/2:1+events22:18:172
344766799236112,2346cyclictest3534141-21kworker/2:1+events23:40:422
344766799235711,2343cyclictest3534141-21kworker/2:1+events00:05:582
34476629923477,2340cyclictest3490157-21kworker/1:2+events21:48:011
34476599923479,2335cyclictest3503280-21kworker/0:0+events21:58:240
344766799234610,2333cyclictest3511280-21kworker/2:2+events22:35:142
344766799234212,2326cyclictest3485098-21kworker/2:2+events21:21:252
344766799234112,2325cyclictest3479061-21kworker/2:1+events21:08:092
344766799234011,2326cyclictest3479061-21kworker/2:1+events21:11:102
344766799233911,2324cyclictest3498333-21kworker/2:1+events21:47:172
344766799233811,2324cyclictest3451083-21kworker/2:0+events19:29:312
344766799233711,2323cyclictest3540197-21kworker/2:0+events23:55:372
344766799233711,2323cyclictest3491903-21kworker/2:0+events21:34:232
34476629923338,2321cyclictest3462755-21kworker/1:2+events20:46:121
344765999233010,2316cyclictest3551451-21kworker/0:2+events00:37:460
34476719923279,2315cyclictest3524688-21kworker/3:2+events23:08:523
344766799232111,2307cyclictest3490275-21kworker/2:1+events21:28:422
344766299232010,2307cyclictest3483450-21kworker/1:0+events21:21:001
344767199231210,2298cyclictest3461393-21kworker/3:2+events20:07:183
344766799231111,2296cyclictest3517771-21kworker/2:1+events22:59:382
344766299231110,2298cyclictest3483450-21kworker/1:0+events20:56:281
344766299230911,2295cyclictest3509542-21kworker/1:2+events22:26:141
344766799230812,2292cyclictest3551582-21kworker/2:1+events00:37:232
344766299230712,2292cyclictest3519585-21kworker/1:0+events22:48:541
344766799230610,2293cyclictest3548246-21kworker/2:0+events00:25:332
344766299230612,2292cyclictest3462755-21kworker/1:2+events20:02:041
344767199230512,2290cyclictest3461393-21kworker/3:2+events20:28:583
344766299230510,2292cyclictest3456110-21kworker/1:1+events19:52:141
344766299230412,2289cyclictest3456110-21kworker/1:1+events19:56:031
344766299230210,2289cyclictest3531047-21kworker/1:0+events23:30:201
344767199230011,2287cyclictest3480515-21kworker/3:0+events20:50:023
344765999230011,2286cyclictest3547045-21kworker/0:1+events00:26:440
344766299229810,2286cyclictest3485071-21kworker/1:2+events21:05:071
344766799229411,2280cyclictest3465877-21kworker/2:0+events20:21:462
344766299227911,2265cyclictest3537137-21kworker/1:2+events23:55:131
344765999227810,2265cyclictest3456129-21kworker/0:2+events19:39:190
344766799227711,2263cyclictest3460798-21kworker/2:2+events20:08:492
344766299227411,2260cyclictest3538744-21kworker/1:0+events23:48:461
344765999227411,2259cyclictest3535691-21kworker/0:0+events23:41:050
344765999227410,2261cyclictest3508362-21kworker/0:0+events22:29:350
344766299227310,2260cyclictest3459431-21kworker/1:0+events19:48:251
344766299227211,2257cyclictest3546669-21kworker/1:2+events00:22:531
344765999227210,2259cyclictest3473904-21kworker/0:2+events20:33:370
344766299227110,2258cyclictest3503403-21kworker/1:1+events22:14:061
344766299227110,2258cyclictest3462755-21kworker/1:2+events20:41:381
344767199227012,2255cyclictest3452780-21kworker/3:0+events19:35:343
344766299227011,2255cyclictest3449019-21kworker/1:0+events19:16:541
344765999227011,2256cyclictest3468724-21kworker/0:0+events20:12:130
344765999227011,2255cyclictest3462632-21kworker/0:1+events19:59:470
34476599922699,2257cyclictest3527634-21kworker/0:0+events23:29:340
344765999226911,2255cyclictest3500230-21kworker/0:1+events21:54:580
344765999226910,2256cyclictest3541947-21kworker/0:0+events00:01:230
344766299226810,2255cyclictest3452954-21kworker/1:0+events19:29:091
344766299226810,2254cyclictest3509542-21kworker/1:2+events22:24:411
344765999226811,2254cyclictest3457723-21kworker/0:1+events19:42:200
344765999226811,2253cyclictest3527634-21kworker/0:0+events23:18:260
344765999226810,2255cyclictest3521040-21kworker/0:2+events22:52:440
344766299226711,2253cyclictest3451325-21kworker/1:1+events19:23:031
34476599922678,2256cyclictest3527634-21kworker/0:0+events23:20:450
344765999226611,2251cyclictest3504998-21kworker/0:1+events22:12:110
34476629922659,2253cyclictest3456110-21kworker/1:1+events19:43:301
344766299226513,2249cyclictest3521252-21kworker/1:1+events22:56:351
344765999226511,2251cyclictest3477115-21kworker/0:1+events20:44:180
344765999226510,2252cyclictest3478738-21kworker/0:2+events20:46:360
344765999226510,2251cyclictest3440801-21kworker/0:1+events19:18:260
34476599922639,2251cyclictest3459340-21kworker/0:0+events19:47:170
344765999226311,2249cyclictest3490306-21kworker/0:2+events22:02:580
344767199226210,2249cyclictest3461393-21kworker/3:2+events20:01:423
344766299226211,2248cyclictest3462755-21kworker/1:2+events20:27:041
344766299226210,2249cyclictest3540378-21kworker/1:1+events23:53:431
344765999226211,2247cyclictest3538621-21kworker/0:2+events23:57:540
344765999226111,2247cyclictest3493207-21kworker/0:1+events21:26:240
344765999226110,2248cyclictest3519437-21kworker/0:0+events22:56:120
344765999226110,2248cyclictest3488559-21kworker/0:0+events21:19:060
344765999225911,2245cyclictest3541947-21kworker/0:0+events00:18:400
344765999225911,2245cyclictest3488559-21kworker/0:0+events21:22:550
344765999225910,2246cyclictest3513028-21kworker/0:2+events22:31:060
344766299225811,2244cyclictest3493392-21kworker/1:0+events21:29:251
344765999225810,2245cyclictest3449081-21kworker/0:0+events19:21:540
344766799225611,2242cyclictest3460798-21kworker/2:2+events19:52:352
34476629922529,2240cyclictest3531047-21kworker/1:0+events23:27:191
344765999225011,2236cyclictest3540345-21kworker/0:1+events23:54:510
344765999224611,2232cyclictest3531542-21kworker/0:1+events23:31:060
34476629922378,2226cyclictest3531047-21kworker/1:0+events23:37:161
344766799223312,2219cyclictest3460798-21kworker/2:2+events19:55:392
344766799223212,2216cyclictest3479061-21kworker/2:1+events20:53:492
34476719922319,2219cyclictest3551613-21kworker/3:2+events00:35:293
34476719922319,2219cyclictest3468841-21kworker/3:0+events20:14:073
34476719922292,2224cyclictest3512297-21kworker/3:0+events22:41:193
344767199222911,2214cyclictest3463997-21kworker/3:1+events19:57:533
344766799222911,2215cyclictest3470384-21kworker/2:2+events20:28:352
344767199222811,2214cyclictest3534024-21kworker/3:2+events23:44:323
344767199222611,2212cyclictest3523027-21kworker/3:0+events23:15:233
344767199222610,2212cyclictest3541887-21kworker/3:0+events00:09:263
34476719922252,2220cyclictest3483773-21kworker/3:2+events21:13:463
344767199222510,2212cyclictest3512297-21kworker/3:0+events22:51:363
344767199222411,2209cyclictest3512297-21kworker/3:0+events22:36:003
344767199222410,2211cyclictest3540227-21kworker/3:2+events00:04:043
344767199222311,2209cyclictest3512297-21kworker/3:0+events22:27:443
344767199222311,2209cyclictest3476876-21kworker/3:2+events20:43:093
344767199222310,2210cyclictest3541887-21kworker/3:0+events00:12:093
344766299222110,2208cyclictest3462755-21kworker/1:2+events20:51:541
344767199221710,2204cyclictest3451146-21kworker/3:2+events19:19:113
344767199221310,2200cyclictest3506665-21kworker/3:0+events22:13:213
344767199221211,2198cyclictest3549935-21kworker/3:1+events00:23:373
344766299220311,2189cyclictest3485071-21kworker/1:2+events21:01:431
344767199220111,2186cyclictest3496857-21kworker/3:1+events21:48:253
344767199219710,2184cyclictest3498481-21kworker/3:2+events21:52:393
344767199219611,2182cyclictest3521069-21kworker/3:1+events22:58:523
344765999219310,2179cyclictest3514891-21kworker/0:1+events22:42:480
344767199218210,2169cyclictest3498481-21kworker/3:2+events22:30:433
344766799216611,2152cyclictest3501652-21kworker/2:2+events21:59:342
344766299216611,2152cyclictest3544057-21kworker/1:1+events00:14:041
344766799216011,2147cyclictest3517771-21kworker/2:1+events23:05:022
344766299215910,2146cyclictest3505088-21kworker/1:2+events22:06:261
344766799215611,2141cyclictest3505147-21kworker/2:0+events22:06:502
344766799215511,2141cyclictest3511280-21kworker/2:2+events22:23:092
344766799215411,2140cyclictest3534141-21kworker/2:1+events00:14:512
344766799215410,2141cyclictest3527602-21kworker/2:2+events23:22:182
344766799215311,2139cyclictest3519406-21kworker/2:2+events22:51:132
344766799215311,2138cyclictest3456274-21kworker/2:1+events19:34:262
344766799215310,2140cyclictest3514959-21kworker/2:0+events22:40:332
344766799215210,2139cyclictest3451083-21kworker/2:0+events19:42:442
34476679921509,2138cyclictest3499929-21kworker/2:0+events21:54:112
34476679921419,2128cyclictest3473728-21kworker/2:1+events20:37:022
34476679921417,2131cyclictest3470384-21kworker/2:2+events20:30:312
344766799214111,2127cyclictest3517771-21kworker/2:1+events22:49:402
344766799214110,2129cyclictest3524716-21kworker/2:0+events23:14:372
344766799214110,2128cyclictest3451083-21kworker/2:0+events19:24:352
344766799214011,2126cyclictest3546640-21kworker/2:2+events00:24:012
344766799214011,2126cyclictest3468695-21kworker/2:1+events20:12:592
344766799214011,2126cyclictest3465877-21kworker/2:0+events20:17:102
344766799213911,2125cyclictest3477144-21kworker/2:2+events20:49:392
344766799213911,2124cyclictest3503523-21kworker/2:1+events22:31:492
344766799213910,2126cyclictest3506832-21kworker/2:2+events22:12:572
344766799213910,2126cyclictest3485098-21kworker/2:2+events21:03:142
344766799213811,2124cyclictest3527602-21kworker/2:2+events23:28:032
344766799213711,2123cyclictest3503523-21kworker/2:1+events22:27:212
344766799213611,2122cyclictest3503523-21kworker/2:1+events22:02:152
344767199211811,2104cyclictest3445565-21kworker/3:0+events19:13:273
344766799211710,2103cyclictest3480895-21kworker/2:0+events20:56:052
344766299211710,2104cyclictest3470535-21kworker/1:0+events20:20:591
34476679921159,2103cyclictest3534141-21kworker/2:1+events23:46:512
34476599921157,2105cyclictest3440801-21kworker/0:1+events19:14:380
344765999211111,2096cyclictest3519437-21kworker/0:0+events22:49:180
344765999211110,2098cyclictest3514891-21kworker/0:1+events22:37:530
34476679921109,2098cyclictest3456274-21kworker/2:1+events19:49:572
34476629921109,2098cyclictest3462755-21kworker/1:2+events20:10:201
34476629921096,2099cyclictest3456110-21kworker/1:1+events19:34:061
34476599921088,2097cyclictest3475516-21kworker/0:0+events20:38:570
344765999210610,2093cyclictest3522966-21kworker/0:1+events23:15:000
344765999210510,2092cyclictest3508362-21kworker/0:0+events22:22:460
34476629921039,2090cyclictest3512768-21kworker/1:1+events22:43:121
344765999210010,2087cyclictest3464259-21kworker/0:0+events20:03:560
34476679920989,2086cyclictest3475484-21kworker/2:0+events20:43:322
344765999209810,2085cyclictest3456129-21kworker/0:2+events19:32:560
344767199207510,2062cyclictest3478650-21kworker/3:1+events20:48:283
34476719920709,2058cyclictest3478650-21kworker/3:1+events21:04:213
34476719920676,2058cyclictest3534024-21kworker/3:2+events23:39:573
34476719920626,2053cyclictest3474024-21kworker/3:1+events20:34:463
344766299206010,2047cyclictest3449019-21kworker/1:0+events19:15:001
344767199203910,2026cyclictest3452780-21kworker/3:0+events19:29:553
34476679920318,2020cyclictest3451083-21kworker/2:0+events19:35:572
344766799201511,2001cyclictest3523087-21kworker/2:2+events23:01:352
344765999201010,1997cyclictest3521040-21kworker/0:2+events23:06:330
344766799199810,1985cyclictest3464170-21kworker/2:1+events20:02:262
34476679919946,1985cyclictest3490275-21kworker/2:1+events21:19:512
344766799199010,1977cyclictest3493809-21kworker/2:2+events21:42:002
344766799198010,1968cyclictest3541857-21kworker/2:2+events00:01:462
344766799195610,1943cyclictest3445793-21kworker/2:1+events19:16:322
34476679918398,1828cyclictest3447424-21kworker/2:2+events19:11:582
34473842155114,24sleep30-21swapper/319:08:583
34472652142110,27sleep00-21swapper/019:07:280
34461352141107,28sleep20-21swapper/219:05:052
34471992140106,29sleep10-21swapper/119:06:371
344767199113110,2cyclictest3452780-21kworker/3:0+pm19:44:523
344765999209,8cyclictest3500159-21sh21:50:000
344765999147,5cyclictest739-21runrttasks21:06:440
3447667991311,1cyclictest3552112-21cstates00:30:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional