You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 06:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Tue Mar 24, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34048869938479,3833cyclictest3493112-21kworker/3:0+events23:55:193
340488299319116,3172cyclictest82-21kswapd023:12:281
340488699312715,3106cyclictest3496496-21kworker/3:1+events00:05:173
340488199296711,2951cyclictest3448440-21kworker/0:2+events21:25:170
340488699286410,2849cyclictest3432767-21kworker/3:2+events20:35:183
340488699278212,2765cyclictest3398107-21kworker/3:0+events19:50:113
340488199276513,2747cyclictest3498006-21kworker/0:2+events00:00:180
340488299276211,2746cyclictest3447087-21kworker/1:1+events21:20:211
34048829927597,2748cyclictest3437557-21kworker/1:2+events21:00:161
340488699269513,2678cyclictest3448650-21kworker/3:0+events21:30:133
340488699265413,2637cyclictest3459706-21kworker/3:2+events21:59:483
340488399265013,2634cyclictest3466663-21kworker/2:2+events22:35:212
340488699264810,2633cyclictest3430907-21kworker/3:0+events20:40:143
340488399264313,2627cyclictest3474076-21kworker/2:1+events22:45:142
340488699261211,2598cyclictest3398107-21kworker/3:0+events19:35:213
340488199260412,2590cyclictest3399853-21kworker/0:1+events19:20:130
340488199255510,2541cyclictest3488452-21kworker/0:1+events23:35:000
340488399255112,2535cyclictest3474076-21kworker/2:1+events22:42:352
340488399254912,2533cyclictest3501001-21kworker/2:1+events00:36:352
340488199252912,2515cyclictest3501434-21kworker/0:1+events00:15:340
340488399252612,2510cyclictest3434424-21kworker/2:2+events20:46:162
340488399252512,2510cyclictest3425936-21kworker/2:1+events20:18:002
340488299251512,2499cyclictest3449982-21kworker/1:0+events21:50:171
340488399249712,2481cyclictest3475737-21kworker/2:2+events22:51:152
340488399249712,2481cyclictest3425936-21kworker/2:1+events20:14:342
340488399249712,2481cyclictest3416452-21kworker/2:2+events19:52:062
340488399249612,2481cyclictest3479129-21kworker/2:2+events23:05:422
340488199249612,2480cyclictest3406667-21kworker/0:2+events19:15:140
340488399249512,2480cyclictest3454748-21kworker/2:2+events21:46:292
340488399249412,2479cyclictest3414767-21kworker/2:0+events19:39:072
340488399249312,2478cyclictest3494804-21kworker/2:0+events23:51:542
340488399249212,2477cyclictest3437375-21kworker/2:1+events20:55:222
340488399249111,2477cyclictest3416452-21kworker/2:2+events20:00:482
340488399249012,2475cyclictest3496436-21kworker/2:1+events23:58:212
340488399249012,2474cyclictest3430759-21kworker/2:1+events20:33:272
340488199249012,2474cyclictest3419712-21kworker/0:2+events20:10:420
340488399248612,2471cyclictest3501001-21kworker/2:1+events00:18:582
340488399248612,2471cyclictest3501001-21kworker/2:1+events00:08:222
340488399248512,2470cyclictest3422701-21kworker/2:0+events20:06:112
340488199248312,2469cyclictest3472722-21kworker/0:2+events23:00:000
340488399247912,2464cyclictest3481889-21kworker/2:0+events23:10:172
340488299247211,2457cyclictest3501597-21kworker/1:2+events00:12:081
340488399246511,2451cyclictest3485407-21kworker/2:0+events23:38:302
340488199246312,2448cyclictest3477305-21kworker/0:0+events23:11:500
340488299246212,2447cyclictest3430790-21kworker/1:0+events20:48:341
34048829924589,2445cyclictest3477243-21kworker/1:2+events22:56:341
340488199245711,2442cyclictest3440668-21kworker/0:1+events21:13:550
340488199245612,2441cyclictest3436102-21kworker/0:2+events21:01:030
340488199245612,2441cyclictest3429191-21kworker/0:2+events20:32:190
340488399245512,2440cyclictest3442225-21kworker/2:2+events21:03:152
340488199245111,2437cyclictest3438945-21kworker/0:0+events20:54:130
340488699245011,2435cyclictest3462989-21kworker/3:2+events22:28:263
340488199245011,2436cyclictest3469160-21kworker/0:0+events22:28:490
340488199244812,2432cyclictest3448440-21kworker/0:2+events21:24:090
340488199244712,2433cyclictest3451735-21kworker/0:0+events21:35:100
340488399244511,2430cyclictest3501001-21kworker/2:1+events00:22:462
340488199244510,2433cyclictest3434365-21kworker/0:1+events20:45:080
340488199244412,2428cyclictest3493929-21kworker/0:1+events23:48:520
340488199244411,2430cyclictest3469160-21kworker/0:0+events22:30:450
340488199244312,2427cyclictest3456706-21kworker/0:3+events22:18:060
340488699244211,2428cyclictest3462989-21kworker/3:2+events22:38:263
340488199244211,2427cyclictest3413234-21kworker/0:1+events19:49:030
340488399244112,2426cyclictest3477452-21kworker/2:1+events22:55:292
340488199244111,2427cyclictest3477305-21kworker/0:0+events23:17:050
340488699244012,2424cyclictest3398107-21kworker/3:0+events19:40:163
340488199243810,2424cyclictest3488452-21kworker/0:1+events23:38:080
34048869924349,2422cyclictest3429162-21kworker/3:2+events20:25:123
340488199243410,2420cyclictest3499726-21kworker/0:0+events00:14:480
340488399242712,2412cyclictest3469008-21kworker/2:1+events22:26:562
340488299242512,2410cyclictest3437557-21kworker/1:2+events20:50:271
340488199242411,2410cyclictest3480703-21kworker/0:1+events23:06:500
340488699242112,2405cyclictest3437615-21kworker/3:2+events20:58:233
340488299242112,2405cyclictest3414799-21kworker/1:2+events19:51:201
340488299242111,2407cyclictest3435957-21kworker/1:1+events20:44:001
340488199241911,2404cyclictest3426590-21kworker/0:1+events20:16:070
34048839924189,2407cyclictest3461113-21kworker/2:2+events22:05:082
340488399241810,2404cyclictest3443941-21kworker/2:1+events21:35:552
340488199241712,2401cyclictest3491725-21kworker/0:0+events23:44:170
340488199241611,2402cyclictest3416511-21kworker/0:0+events19:51:420
34048869924125,2403cyclictest3424483-21kworker/3:2+events20:11:063
340488399241111,2396cyclictest3487122-21kworker/2:2+events23:28:322
340488399240812,2393cyclictest3446939-21kworker/2:2+events21:31:212
340488699240712,2392cyclictest3475911-21kworker/3:1+events22:58:053
340488399240610,2393cyclictest3493081-21kworker/2:2+events23:48:302
34048869924059,2392cyclictest3493112-21kworker/3:0+events23:44:403
340488699240512,2389cyclictest3498235-21kworker/3:3+events00:01:513
340488299240212,2386cyclictest3432675-21kworker/1:2+events20:32:421
340488299240111,2387cyclictest3493021-21kworker/1:0+events23:51:311
340488299240012,2386cyclictest3414799-21kworker/1:2+events19:55:051
340488299239912,2384cyclictest3472574-21kworker/1:0+events23:09:301
340488299239910,2386cyclictest3501597-21kworker/1:2+events00:17:261
340488399239812,2383cyclictest3427865-21kworker/2:2+events20:20:162
34048869923973,2391cyclictest3494866-21kworker/3:2+events23:53:273
340488299239511,2381cyclictest3485220-21kworker/1:0+events23:27:461
340488299239511,2381cyclictest3464472-21kworker/1:1+events22:32:181
340488299239412,2379cyclictest3462839-21kworker/1:0+events22:13:561
340488299238311,2369cyclictest3470622-21kworker/1:2+events22:38:021
340488199237611,2362cyclictest3470824-21kworker/0:1+events22:36:530
340488299237312,2358cyclictest3451797-21kworker/1:2+events21:34:251
340488399237012,2354cyclictest3501001-21kworker/2:1+events00:11:462
340488199236912,2354cyclictest3486872-21kworker/0:2+events23:27:220
340488299236611,2351cyclictest3505948-21kworker/1:1+events00:23:311
340488399236312,2347cyclictest3462742-21kworker/2:1+events22:14:182
340488699236111,2346cyclictest3450252-21kworker/3:2+events21:39:203
340488199235412,2339cyclictest3467557-21kworker/0:1+events22:23:310
340488199235110,2337cyclictest3477305-21kworker/0:0+events23:20:570
340488299234612,2330cyclictest3461237-21kworker/1:1+events22:06:171
340488699234111,2327cyclictest3483676-21kworker/3:0+events23:22:463
340488699234012,2325cyclictest3437615-21kworker/3:2+events20:52:433
340488299234010,2327cyclictest3449982-21kworker/1:0+events21:26:251
340488699233912,2324cyclictest3496496-21kworker/3:1+events00:24:413
340488399233412,2319cyclictest3430759-21kworker/2:1+events20:29:412
340488699233212,2318cyclictest3462989-21kworker/3:2+events22:40:193
340488699233212,2316cyclictest3461385-21kworker/3:1+events22:07:253
34048829923329,2320cyclictest3401331-21kworker/1:2+events19:15:591
340488199233212,2316cyclictest3504141-21kworker/0:2+events00:24:180
340488199233111,2316cyclictest3429191-21kworker/0:2+events20:21:240
340488699233012,2315cyclictest3419539-21kworker/3:1+events19:57:223
340488699233012,2314cyclictest3461385-21kworker/3:1+events22:17:463
340488699233012,2314cyclictest3454837-21kworker/3:0+events21:46:063
34048869923297,2319cyclictest3475911-21kworker/3:1+events22:52:263
340488699232712,2312cyclictest3437615-21kworker/3:2+events21:00:393
340488699232612,2311cyclictest3470707-21kworker/3:0+events22:33:263
340488399232610,2313cyclictest3485407-21kworker/2:0+events23:22:252
340488199232611,2312cyclictest3411507-21kworker/0:2+events19:30:470
34048869923259,2313cyclictest3467404-21kworker/3:0+events22:21:093
340488699232512,2310cyclictest3483676-21kworker/3:0+events23:14:013
340488699232512,2309cyclictest3398107-21kworker/3:0+events19:28:543
340488699232511,2310cyclictest3496496-21kworker/3:1+events00:27:223
34048869923248,2313cyclictest3430907-21kworker/3:0+events20:33:033
340488699232411,2310cyclictest3437615-21kworker/3:2+events21:12:003
340488299232411,2310cyclictest3505948-21kworker/1:1+events00:27:471
340488699231712,2302cyclictest3493112-21kworker/3:0+events23:49:173
340488299231312,2299cyclictest3449982-21kworker/1:0+events22:00:101
340488199230510,2292cyclictest3448440-21kworker/0:2+events21:32:070
340488199229811,2283cyclictest3469160-21kworker/0:0+events22:42:110
34048819922968,2286cyclictest3477305-21kworker/0:0+events22:56:110
340488199229610,2283cyclictest3477305-21kworker/0:0+events22:53:340
340488299229511,2280cyclictest3437557-21kworker/1:2+events21:09:421
340488699229211,2278cyclictest3446972-21kworker/3:1+events21:21:293
340488699228612,2271cyclictest3422825-21kworker/3:1+events20:09:573
340488299228611,2272cyclictest3449982-21kworker/1:0+events21:45:211
340488199228311,2268cyclictest3429191-21kworker/0:2+events20:28:560
340488299228111,2266cyclictest3509526-21kworker/1:1+events00:38:511
340488199227810,2265cyclictest3493929-21kworker/0:1+events23:55:430
340488199227511,2261cyclictest3504141-21kworker/0:2+events00:38:280
340488399227411,2260cyclictest3479129-21kworker/2:2+events23:15:332
340488399227411,2260cyclictest3458131-21kworker/2:1+events21:55:172
340488399227311,2258cyclictest3443941-21kworker/2:1+events21:17:222
340488399227211,2258cyclictest3456371-21kworker/2:0+events22:01:202
340488399227111,2256cyclictest3507665-21kworker/2:0+events00:33:562
340488399227111,2256cyclictest3507665-21kworker/2:0+events00:33:562
340488399227111,2256cyclictest3411534-21kworker/2:0+events19:29:412
340488399227011,2255cyclictest3432797-21kworker/2:0+events20:41:452
340488399226811,2253cyclictest3446939-21kworker/2:2+events21:22:152
340488399226710,2253cyclictest3443941-21kworker/2:1+events21:10:062
340488399226611,2252cyclictest3490226-21kworker/2:1+events23:41:372
340488399226610,2253cyclictest3406347-21kworker/2:1+events19:16:222
34048829922639,2251cyclictest3474282-21kworker/1:1+events22:49:011
34048839922627,2251cyclictest3416452-21kworker/2:2+events19:47:082
340488399226111,2246cyclictest3432797-21kworker/2:0+events20:39:052
340488399225911,2245cyclictest3470614-21kworker/2:0+events22:33:502
340488399225911,2245cyclictest3434424-21kworker/2:2+events20:50:502
34048839922579,2245cyclictest3477452-21kworker/2:1+events23:04:582
340488399225710,2244cyclictest3421074-21kworker/2:1+events19:59:382
34048819922546,2245cyclictest3459493-21kworker/0:1+events22:00:580
34048819922538,2242cyclictest3408936-21kworker/0:0+events19:28:300
340488399225111,2237cyclictest3406347-21kworker/2:1+events19:21:212
340488399225110,2237cyclictest3439511-21kworker/2:0+events21:09:192
340488299224111,2227cyclictest3422792-21kworker/1:2+events20:06:331
34048819922417,2231cyclictest3475556-21kworker/0:1+events22:48:150
340488699224010,2226cyclictest3398107-21kworker/3:0+events20:01:573
340488199223810,2225cyclictest3432708-21kworker/0:0+events20:38:200
340488199223711,2223cyclictest3432708-21kworker/0:0+events20:42:310
340488199223710,2223cyclictest3498006-21kworker/0:2+events00:09:280
340488699223610,2223cyclictest3480374-21kworker/3:2+events23:02:183
340488199223211,2218cyclictest3453396-21kworker/0:2+events21:41:350
340488199223210,2219cyclictest3419712-21kworker/0:2+events19:57:460
340488199223110,2218cyclictest3507564-21kworker/0:1+events00:31:140
340488199223110,2218cyclictest3507564-21kworker/0:1+events00:31:140
340488299222810,2215cyclictest3472574-21kworker/1:0+events23:03:271
340488299222512,2210cyclictest3449982-21kworker/1:0+events21:41:131
340488199222511,2210cyclictest3413234-21kworker/0:1+events19:44:050
340488299222410,2211cyclictest3411272-21kworker/1:1+events19:31:331
340488199222410,2211cyclictest3440668-21kworker/0:1+events21:15:510
340488199222110,2209cyclictest3419712-21kworker/0:2+events20:00:020
340488299221912,2205cyclictest3425967-21kworker/1:1+events20:22:541
340488199221910,2205cyclictest3456706-21kworker/0:3+events21:58:210
340488199221811,2204cyclictest3438945-21kworker/0:0+events20:55:450
340488199221810,2204cyclictest3442398-21kworker/0:0+events21:08:090
340488199221711,2203cyclictest3424157-21kworker/0:0+events20:07:190
34048819922169,2204cyclictest3455043-21kworker/0:0+events21:48:240
340488199221610,2203cyclictest3413234-21kworker/0:1+events19:38:210
34048829922148,2203cyclictest3507636-21kworker/1:2+events00:34:181
34048829922148,2203cyclictest3507636-21kworker/1:2+events00:34:171
340488299221310,2199cyclictest3419446-21kworker/1:0+events20:03:301
340488199221311,2199cyclictest3461324-21kworker/0:0+events22:07:480
340488199221310,2200cyclictest3504141-21kworker/0:2+events00:28:340
34048829922096,2200cyclictest3443790-21kworker/1:1+events21:11:151
340488299220910,2195cyclictest3485220-21kworker/1:0+events23:24:171
340488299220811,2194cyclictest3493021-21kworker/1:0+events00:06:291
340488699220712,2192cyclictest3437615-21kworker/3:2+events21:05:553
34048839922069,2195cyclictest3451953-21kworker/2:0+events21:40:052
34048869922059,2193cyclictest3453125-21kworker/3:1+events21:44:143
34048829922049,2191cyclictest3406215-21kworker/1:1+events19:14:511
340488299220310,2190cyclictest3490266-21kworker/1:1+events23:39:171
340488299220111,2186cyclictest3414799-21kworker/1:2+events19:48:171
34048829921988,2186cyclictest3472574-21kworker/1:0+events22:52:031
340488299219811,2184cyclictest3488571-21kworker/1:2+events23:30:511
340488299219811,2184cyclictest3408488-21kworker/1:0+events19:24:441
34048839921979,2184cyclictest3443941-21kworker/2:1+events21:28:182
340488299219610,2184cyclictest3483521-21kworker/1:1+events23:16:191
340488299219610,2183cyclictest3462839-21kworker/1:0+events22:15:271
340488299219511,2181cyclictest3499610-21kworker/1:1+events00:04:571
34048829921949,2181cyclictest3488571-21kworker/1:2+events23:43:311
34048829921947,2183cyclictest3488571-21kworker/1:2+events23:45:491
340488299218411,2170cyclictest3425967-21kworker/1:1+events20:14:561
34048829921799,2167cyclictest3449982-21kworker/1:0+events21:36:411
340488299217911,2165cyclictest3437557-21kworker/1:2+events21:16:131
340488299217710,2164cyclictest3459611-21kworker/1:2+events21:59:061
34048829921706,2161cyclictest3439155-21kworker/1:1+events20:57:151
340488699216611,2151cyclictest3488602-21kworker/3:0+events23:34:373
340488299215010,2137cyclictest3401331-21kworker/1:2+events19:25:301
340488699214511,2131cyclictest3406156-21kworker/3:2+events19:23:153
34048839921448,2133cyclictest3413151-21kworker/2:1+events19:43:192
340488699214310,2130cyclictest3462989-21kworker/3:2+events22:10:533
340488699213611,2122cyclictest3475911-21kworker/3:1+events23:08:443
340488699213611,2122cyclictest3426326-21kworker/3:0+events20:19:103
340488699213311,2118cyclictest3475911-21kworker/3:1+events23:35:473
340488699213211,2118cyclictest3398107-21kworker/3:0+events19:31:103
34048869921315,2123cyclictest3475911-21kworker/3:1+events23:19:023
34048869921299,2117cyclictest3398107-21kworker/3:0+events19:19:033
340488699212911,2115cyclictest3448650-21kworker/3:0+events21:29:063
340488699212811,2115cyclictest3453125-21kworker/3:1+events21:52:593
340488699212711,2113cyclictest3398107-21kworker/3:0+events19:48:403
340488699212511,2111cyclictest3509466-21kworker/3:1+events00:37:463
340488699212511,2111cyclictest3486900-21kworker/3:2+events23:25:273
340488699212511,2111cyclictest3458070-21kworker/3:0+events22:00:343
340488399212010,2106cyclictest3501001-21kworker/2:1+events00:28:562
34048829921196,2110cyclictest3432675-21kworker/1:2+events20:36:511
340488299211710,2104cyclictest3425967-21kworker/1:1+events20:26:211
34048869921169,2104cyclictest3505887-21kworker/3:2+events00:32:463
34048869921169,2104cyclictest3505887-21kworker/3:2+events00:32:453
34048839921139,2101cyclictest3464351-21kworker/2:0+events22:20:252
34048839921129,2100cyclictest3456371-21kworker/2:0+events21:53:452
340488699210711,2092cyclictest3437615-21kworker/3:2+events21:19:593
34048869921068,2095cyclictest3504259-21kworker/3:0+events00:17:503
340488399210611,2092cyclictest3408348-21kworker/2:2+events19:34:572
340488699210511,2091cyclictest3422825-21kworker/3:1+events20:20:393
34048839921058,2094cyclictest3494804-21kworker/2:0+events00:04:102
340488699210410,2091cyclictest3462989-21kworker/3:2+events22:46:213
34048839920916,2082cyclictest3394576-21kworker/2:2+events19:12:582
34048819920908,2079cyclictest3462960-21kworker/0:1+events22:12:010
34048829920827,2071cyclictest3413136-21kworker/1:0+events19:42:331
340488199208210,2069cyclictest3493929-21kworker/0:1+events23:53:480
34048819920767,2066cyclictest3455043-21kworker/0:0+events21:53:220
34048829920698,2057cyclictest3493021-21kworker/1:0+events23:57:371
340488699206511,2051cyclictest3434394-21kworker/3:1+events20:48:123
340488299205710,2044cyclictest3466076-21kworker/1:2+events22:22:201
340488299204510,2032cyclictest3419446-21kworker/1:0+events20:16:281
34048829920449,2031cyclictest3470622-21kworker/1:2+events22:40:411
34048869920417,2031cyclictest3496496-21kworker/3:1+events00:14:043
340488299204011,2025cyclictest3413136-21kworker/1:0+events19:37:361
34048819920033,1997cyclictest3388717-21kworker/0:0+events19:11:060
34048869919728,1961cyclictest3398107-21kworker/3:0+events19:14:283
34047042145113,27sleep10-21swapper/119:09:181
34046272143110,27sleep20-21swapper/219:08:182
34045952142107,30sleep00-21swapper/019:07:520
34044632142103,35sleep30-21swapper/319:06:153
3404883991711,5cyclictest3489866-21taskset23:30:552
340488399161,11cyclictest3466177-21awk22:20:002
89398140,10rtkit-daemon710-21mta-sts-daemon22:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional