You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 10:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Apr 08, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207855499328416,3263cyclictest2177107-21kworker/1:1+events00:20:161
207854999325516,3234cyclictest2138331-21kworker/0:1+events22:45:150
207854999319013,3172cyclictest2138331-21kworker/0:1+events22:15:150
207855499304914,3030cyclictest2171801-21kworker/1:0+events00:10:021
207855499304914,3030cyclictest2171801-21kworker/1:0+events00:10:011
207855799296913,2952cyclictest2179384-21kworker/2:0+events00:25:132
207855799281611,2801cyclictest2118527-21kworker/2:1+events21:15:152
207854999280913,2792cyclictest2167096-21kworker/0:0+events23:45:170
207854999280913,2792cyclictest2123540-21kworker/0:1+events21:38:030
207854999280613,2789cyclictest2160777-21kworker/0:0+events23:32:250
207855799280011,2787cyclictest2164158-21kworker/2:0+events23:55:122
207855799280011,2786cyclictest2179384-21kworker/2:0+events00:30:142
207855799277313,2758cyclictest2150816-21kworker/2:2+events23:05:012
207855499275013,2734cyclictest2149289-21kworker/1:1+events22:50:121
207854999266815,2650cyclictest2133224-21kworker/0:0+events22:00:110
207854999263813,2623cyclictest2112365-21kworker/0:3+events21:05:150
207855499263212,2617cyclictest2131243-21kworker/1:2+events22:20:111
207854999258012,2564cyclictest2091224-21kworker/0:2+events19:48:520
207854999257912,2563cyclictest2167096-21kworker/0:0+events23:41:530
207854999257512,2560cyclictest2173563-21kworker/0:1+events00:13:460
207854999257512,2560cyclictest2173563-21kworker/0:1+events00:13:450
207855499257412,2560cyclictest2123627-21kworker/1:2+events21:35:011
207855499256912,2553cyclictest2155655-21kworker/1:2+events23:28:141
207854999256412,2548cyclictest2173563-21kworker/0:1+events00:09:380
207854999256412,2548cyclictest2173563-21kworker/0:1+events00:09:380
207854999255712,2543cyclictest2092884-21kworker/0:0+events20:01:230
207854999255212,2536cyclictest2170295-21kworker/0:2+events00:29:510
207854999255212,2536cyclictest2099637-21kworker/0:1+events20:19:190
20785499925506,2540cyclictest2167096-21kworker/0:0+events23:51:520
207855499254912,2533cyclictest2108267-21kworker/1:2+events20:59:581
207855499254812,2532cyclictest2115614-21kworker/1:1+events21:16:001
207854999254811,2533cyclictest2146214-21kworker/0:0+events22:41:050
207854999254112,2526cyclictest2104136-21kworker/0:0+events20:48:310
20785579925338,2524cyclictest2150816-21kworker/2:2+events23:06:322
20785579925269,2513cyclictest2162431-21kworker/2:1+events23:29:002
207854999252112,2505cyclictest2160777-21kworker/0:0+events23:25:340
207855499251812,2502cyclictest2100966-21kworker/1:2+events20:18:091
207855799251412,2498cyclictest2086451-21kworker/2:0+events19:36:382
207855499251412,2498cyclictest2177107-21kworker/1:1+events00:27:311
207854999251412,2498cyclictest2099637-21kworker/0:1+events20:35:000
207855799251012,2494cyclictest2162431-21kworker/2:1+events23:39:132
207855799250812,2492cyclictest2130038-21kworker/2:1+events21:55:122
207854999250512,2489cyclictest2173563-21kworker/0:1+events00:15:190
207854999250512,2489cyclictest2173563-21kworker/0:1+events00:15:180
207855799250312,2488cyclictest2079814-21kworker/2:1+events19:27:252
207855499249812,2482cyclictest2155655-21kworker/1:2+events23:19:091
207855499249812,2482cyclictest2141231-21kworker/1:0+events22:38:271
207854999249712,2481cyclictest2134843-21kworker/0:1+events22:08:080
207855499249512,2480cyclictest2108267-21kworker/1:2+events21:13:001
207854999249512,2479cyclictest2157142-21kworker/0:2+events23:19:540
207854999249512,2479cyclictest2092884-21kworker/0:0+events19:56:010
207854999249412,2478cyclictest2149553-21kworker/0:0+events23:12:160
207854999249412,2478cyclictest2099637-21kworker/0:1+events20:43:070
207855799249312,2478cyclictest2091284-21kworker/2:0+events20:04:012
207854999249212,2477cyclictest2089626-21kworker/0:1+events19:51:550
207855499249112,2475cyclictest2104375-21kworker/1:2+events20:34:371
207854999249111,2476cyclictest2170295-21kworker/0:2+events00:38:370
207854999249111,2476cyclictest2092884-21kworker/0:0+events20:11:410
207854999249012,2475cyclictest2112365-21kworker/0:3+events21:11:500
207855499248912,2474cyclictest2168925-21kworker/1:1+events23:53:201
207855499248912,2474cyclictest2086633-21kworker/1:1+events19:54:541
207854999248912,2474cyclictest2123540-21kworker/0:1+events21:31:350
207855499248811,2473cyclictest2128036-21kworker/1:0+events21:49:561
207854999248812,2472cyclictest2180743-21kworker/0:1+events00:33:590
207854999248811,2474cyclictest2086391-21kworker/0:2+events19:40:510
207854999248712,2471cyclictest2112365-21kworker/0:3+events21:03:210
207854999248611,2472cyclictest2141354-21kworker/0:2+events22:28:340
207854999248610,2472cyclictest2127060-21kworker/0:2+events22:13:220
207855499248512,2469cyclictest2086633-21kworker/1:1+events19:42:251
20785499924858,2474cyclictest2147835-21kworker/0:2+events22:50:370
207855499248312,2467cyclictest2073532-21kworker/1:0+events19:30:281
207854999248312,2469cyclictest2112365-21kworker/0:3+events21:16:460
207854999248312,2468cyclictest2149553-21kworker/0:0+events22:55:300
207855499248212,2467cyclictest2131243-21kworker/1:2+events22:15:381
207855499248212,2466cyclictest2115614-21kworker/1:1+events21:22:301
207854999248212,2468cyclictest2127060-21kworker/0:2+events21:52:570
207855499248112,2465cyclictest2171801-21kworker/1:0+events00:08:311
207855499248112,2465cyclictest2171801-21kworker/1:0+events00:08:301
207855799247812,2463cyclictest2138186-21kworker/2:0+events22:16:002
207855499247810,2465cyclictest2177107-21kworker/1:1+events00:32:101
207855499247710,2463cyclictest2153939-21kworker/1:1+events23:14:321
207855499247612,2462cyclictest2115614-21kworker/1:1+events21:30:051
207855499247612,2460cyclictest2097499-21kworker/1:1+events20:07:051
207855499247511,2460cyclictest2158865-21kworker/1:0+events23:22:561
207855499247412,2460cyclictest2131243-21kworker/1:2+events22:05:021
207855499247412,2459cyclictest2155655-21kworker/1:2+events23:31:171
207855499247412,2459cyclictest2128036-21kworker/1:0+events21:44:581
207854999247110,2458cyclictest2121936-21kworker/0:0+events21:28:580
207855499246812,2452cyclictest2168925-21kworker/1:1+events23:58:131
207855499246811,2454cyclictest2134961-21kworker/1:0+events22:13:451
207855499246711,2452cyclictest2094269-21kworker/1:0+events20:03:371
207855499246611,2452cyclictest2108267-21kworker/1:2+events20:54:121
207855799246510,2452cyclictest2105714-21kworker/2:0+events20:42:442
207855799246212,2447cyclictest2110528-21kworker/2:2+events20:57:172
207854999246012,2444cyclictest2167096-21kworker/0:0+events00:01:350
207855799245811,2444cyclictest2115647-21kworker/2:2+events21:20:132
207855799245712,2442cyclictest2177286-21kworker/2:1+events00:21:242
207855499245712,2442cyclictest2133163-21kworker/1:1+events22:01:171
207855799245111,2436cyclictest2115647-21kworker/2:2+events21:04:522
207855799245012,2435cyclictest2105714-21kworker/2:0+events20:36:072
207855799245012,2434cyclictest2097769-21kworker/2:1+events20:28:292
207855799245011,2435cyclictest2162431-21kworker/2:1+events23:40:232
207855799245011,2435cyclictest2079814-21kworker/2:1+events19:31:392
207855499245012,2434cyclictest2141231-21kworker/1:0+events22:47:531
207855499244911,2434cyclictest2073532-21kworker/1:0+events19:19:211
207855799244811,2434cyclictest2074868-21kworker/2:0+events19:15:552
207855799244811,2433cyclictest2097769-21kworker/2:1+events20:33:502
207855799244712,2432cyclictest2126740-21kworker/2:2+events21:43:012
207855799244611,2431cyclictest2089658-21kworker/2:2+events19:46:332
207855799244511,2431cyclictest2150816-21kworker/2:2+events22:57:492
207855799244510,2432cyclictest2170794-21kworker/2:1+events00:01:132
207855799244412,2429cyclictest2091284-21kworker/2:0+events19:51:092
207855799244212,2428cyclictest2097769-21kworker/2:1+events20:45:252
207855799244212,2427cyclictest2185271-21kworker/2:0+events00:37:042
207855799244212,2427cyclictest2096135-21kworker/2:2+events20:14:222
207855799244212,2427cyclictest2079814-21kworker/2:1+events19:43:532
207855799244210,2429cyclictest2158681-21kworker/2:1+events23:20:422
207855799244111,2427cyclictest2139934-21kworker/2:2+events22:21:212
207855799243912,2424cyclictest2144499-21kworker/2:0+events22:33:302
207855799243811,2424cyclictest2105714-21kworker/2:0+events21:06:502
207855799243712,2422cyclictest2097769-21kworker/2:1+events20:24:182
207855799243612,2421cyclictest2130038-21kworker/2:1+events22:03:542
207854999243612,2421cyclictest2127060-21kworker/0:2+events21:43:250
207855799243412,2418cyclictest2092913-21kworker/2:2+events19:57:332
207855799242812,2412cyclictest2141565-21kworker/2:1+events22:47:062
207855499242611,2412cyclictest2168925-21kworker/1:1+events00:01:591
207855799242511,2410cyclictest2105714-21kworker/2:0+events20:53:492
207855499242212,2407cyclictest2155655-21kworker/1:2+events23:08:491
20785499924227,2412cyclictest2086391-21kworker/0:2+events19:33:090
207855499242112,2406cyclictest2165552-21kworker/1:1+events23:40:011
207854999242010,2406cyclictest2158835-21kworker/0:1+events23:20:170
207855799241910,2406cyclictest2149227-21kworker/2:0+events22:51:202
207855499241911,2405cyclictest2177107-21kworker/1:1+events00:16:291
207855499241911,2405cyclictest2177107-21kworker/1:1+events00:16:291
207855499241812,2403cyclictest2102683-21kworker/1:0+events20:27:191
207855799240212,2386cyclictest2173442-21kworker/2:2+events00:13:222
207855799240212,2386cyclictest2173442-21kworker/2:2+events00:13:222
207855499240212,2386cyclictest2152280-21kworker/1:0+events22:56:391
207855499240012,2385cyclictest2146069-21kworker/1:2+events22:40:181
207855499239311,2378cyclictest2110408-21kworker/1:0+events20:48:081
207855799238912,2373cyclictest2121735-21kworker/2:0+events21:36:102
207855499238312,2367cyclictest2115614-21kworker/1:1+events21:06:251
207855799237414,2357cyclictest2118527-21kworker/2:1+events21:25:322
20785499923539,2340cyclictest2097711-21kworker/0:2+events20:09:250
207854999235212,2336cyclictest2160777-21kworker/0:0+events23:35:300
20785499923519,2339cyclictest2099637-21kworker/0:1+events20:38:280
207856299233012,2315cyclictest2099426-21kworker/3:1+events20:35:233
207855499232911,2315cyclictest2086633-21kworker/1:1+events19:37:471
207856299232212,2308cyclictest2165638-21kworker/3:2+events00:06:353
207856299232212,2308cyclictest2165638-21kworker/3:2+events00:06:353
20785579923209,2308cyclictest2139934-21kworker/2:2+events22:26:392
207854999232010,2307cyclictest2149553-21kworker/0:0+events23:06:540
207856299231612,2300cyclictest2128465-21kworker/3:2+events21:46:523
207856299231512,2299cyclictest2109215-21kworker/3:2+events21:05:393
207854999231412,2299cyclictest2099637-21kworker/0:1+events20:22:470
207854999231111,2296cyclictest2109038-21kworker/0:2+events20:51:350
207856299230610,2292cyclictest2142894-21kworker/3:2+events22:54:423
207854999230510,2292cyclictest2127060-21kworker/0:2+events21:46:060
207854999228512,2269cyclictest2138331-21kworker/0:1+events22:22:300
207855499227511,2261cyclictest2155655-21kworker/1:2+events23:46:501
20785549922750,2271cyclictest2091518-21kworker/1:3+events19:59:071
207855499227311,2259cyclictest2097499-21kworker/1:1+events20:38:041
207855499227310,2260cyclictest2155655-21kworker/1:2+events23:40:461
207855499227310,2260cyclictest2120315-21kworker/1:0+events21:26:151
207855499227211,2258cyclictest2131243-21kworker/1:2+events21:54:281
207855499227111,2257cyclictest2177107-21kworker/1:1+events00:39:441
207855499227011,2256cyclictest2097499-21kworker/1:1+events20:13:591
207855499227010,2257cyclictest2152280-21kworker/1:0+events23:01:361
207854999227010,2257cyclictest2099637-21kworker/0:1+events20:29:380
207854999226911,2255cyclictest2153878-21kworker/0:2+events23:04:140
207854999226811,2253cyclictest2138331-21kworker/0:1+events22:30:520
20785549922679,2254cyclictest2142835-21kworker/1:2+events22:30:291
207854999226710,2254cyclictest2170295-21kworker/0:2+events00:22:100
207854999226710,2253cyclictest2127060-21kworker/0:2+events21:58:140
207854999226610,2253cyclictest2061611-21kworker/0:0+events19:39:190
207854999226410,2251cyclictest2112365-21kworker/0:3+events20:56:300
207854999226210,2248cyclictest2061611-21kworker/0:0+events19:16:190
207855499226011,2246cyclictest2128036-21kworker/1:0+events21:55:571
20785579922589,2245cyclictest2150816-21kworker/2:2+events23:32:022
20785549922588,2247cyclictest2142835-21kworker/1:2+events22:28:111
207854999225710,2243cyclictest2138331-21kworker/0:1+events22:39:100
207855499225510,2242cyclictest2108267-21kworker/1:2+events21:03:431
207855799225410,2241cyclictest2091284-21kworker/2:0+events20:07:282
20785499922549,2242cyclictest2075074-21kworker/0:1+events19:14:450
207855799225110,2238cyclictest2173442-21kworker/2:2+events00:17:362
207855799225110,2238cyclictest2173442-21kworker/2:2+events00:17:362
207855799224911,2235cyclictest2150816-21kworker/2:2+events23:14:092
207855499224910,2236cyclictest2081729-21kworker/1:1+events19:22:051
207855499224711,2233cyclictest2097499-21kworker/1:1+events20:40:251
207855499224711,2232cyclictest2073532-21kworker/1:0+events19:27:461
207855799224010,2227cyclictest2130038-21kworker/2:1+events22:14:532
207855799224010,2227cyclictest2096135-21kworker/2:2+events20:19:422
20785579922399,2226cyclictest2079814-21kworker/2:1+events19:23:102
207855799223711,2223cyclictest2162431-21kworker/2:1+events23:47:372
207855799223711,2223cyclictest2115647-21kworker/2:2+events21:10:402
207855799223710,2224cyclictest2158681-21kworker/2:1+events23:17:372
20785579922367,2225cyclictest2123417-21kworker/2:2+events21:31:572
207854999223611,2222cyclictest2112365-21kworker/0:3+events21:23:360
207855499223411,2220cyclictest2086633-21kworker/1:1+events19:45:251
20785579922329,2220cyclictest2173442-21kworker/2:2+events00:08:072
20785579922329,2220cyclictest2173442-21kworker/2:2+events00:08:072
207855799223210,2219cyclictest2164158-21kworker/2:0+events23:52:152
207855799223110,2219cyclictest2144499-21kworker/2:0+events22:35:022
207855799222710,2214cyclictest2136529-21kworker/2:2+events22:07:202
207855799221610,2203cyclictest2130038-21kworker/2:1+events21:51:042
20785579922078,2195cyclictest2073269-21kworker/2:2+events19:12:052
207854999215711,2143cyclictest2083616-21kworker/0:1+events19:28:550
20785629921517,2140cyclictest2165638-21kworker/3:2+events00:15:433
20785629921517,2140cyclictest2165638-21kworker/3:2+events00:15:423
207855499213811,2123cyclictest2102683-21kworker/1:0+events20:24:411
207856299213410,2121cyclictest2157109-21kworker/3:0+events23:38:053
20785499921279,2116cyclictest2061611-21kworker/0:0+events19:20:080
207855799212210,2109cyclictest2141565-21kworker/2:1+events22:40:422
207854999211910,2106cyclictest2170295-21kworker/0:2+events23:58:350
207856299211811,2103cyclictest2086601-21kworker/3:2+events19:38:113
207856299211511,2101cyclictest2140027-21kworker/3:0+events22:21:453
207856299211511,2101cyclictest2120404-21kworker/3:0+events21:35:483
207856299211410,2101cyclictest2109215-21kworker/3:2+events21:19:283
20785549921118,2100cyclictest2076997-21kworker/1:2+events19:12:261
207856299211011,2096cyclictest2099426-21kworker/3:1+events20:17:453
207856299210611,2092cyclictest2140027-21kworker/3:0+events22:27:033
20785579921027,2092cyclictest2126740-21kworker/2:2+events21:45:212
207856299209410,2081cyclictest2101028-21kworker/3:2+events20:22:003
207856299209311,2079cyclictest2170593-21kworker/3:0+events23:57:273
207856299209311,2079cyclictest2083669-21kworker/3:0+events20:12:263
207856299208911,2074cyclictest2151006-21kworker/3:1+events23:11:523
207856299208711,2073cyclictest2175310-21kworker/3:1+events00:11:313
207856299208711,2073cyclictest2175310-21kworker/3:1+events00:11:303
20785629920857,2075cyclictest2160664-21kworker/3:2+events23:24:023
20785629919609,1948cyclictest2142894-21kworker/3:2+events22:39:543
20785629919468,1935cyclictest2083669-21kworker/3:0+events19:33:333
20785629918647,1854cyclictest2073577-21kworker/3:1+events19:28:093
20782732153112,24sleep00-21swapper/019:09:180
20782712144102,38sleep30-21swapper/319:09:173
20782082142107,30sleep20-21swapper/219:08:282
20780602142108,28sleep10-21swapper/119:06:351
2078562993310,11cyclictest2114159-21systemctl21:00:003
2078562992816,9cyclictest0-21swapper/300:04:593
2078562992816,8cyclictest2081995-21munin-run19:20:003
2078562992723,3cyclictest2092255-21ntpq19:50:163
207856299268,7cyclictest2169007-21awk23:50:003
2078562992519,4cyclictest2152633-21idleruntime-cro23:00:003
2078562992515,6cyclictest2154243-21awk23:05:003
2078562992417,4cyclictest2128404-21munin-run21:45:003
2078562992416,5cyclictest2094654-21perf20:00:013
2078562992413,2cyclictest0-21swapper/321:30:173
2078562992320,2cyclictest2095851-21/usr/sbin/munin20:00:213
2078562992318,2cyclictest2097827-21dpkg20:10:003
2078562992317,3cyclictest2162664-21munin-run23:30:013
2078562992312,8cyclictest2184052-21awk00:35:003
2078562992214,6cyclictest2170575-21awk23:55:003
2078562992214,2cyclictest2144736-21munin-run22:35:003
207856299216,11cyclictest2121313-21ntpq21:20:173
207856299215,7cyclictest2139172-21ntpq22:15:153
2078562992114,4cyclictest2110743-21awk20:50:003
2078562992111,7cyclictest2132304-21chrt21:55:133
2078562992017,2cyclictest653-21gmain23:30:183
2078562992015,4cyclictest0-21swapper/319:20:143
2078562992015,2cyclictest2167416-21munin-run23:44:593
2078562992014,4cyclictest2182163-21chrt00:26:233
2078562992013,5cyclictest2135002-21perf-exec22:05:003
2078562992013,5cyclictest0-21swapper/321:54:593
2078562992013,4cyclictest2147913-21awk22:45:013
2078562992012,6cyclictest2136831-21perf22:09:593
2078562992012,6cyclictest2109167-21idleruntime-cro20:45:013
2078562992012,5cyclictest2185635-21awk00:40:003
207856299198,9cyclictest2090683-21ldconfig19:45:173
207856299196,4cyclictest2137616-21ntpq22:10:163
207856299196,4cyclictest2105987-21munin-run20:35:003
207856299196,3cyclictest2155021-21ntpq23:05:183
207856299195,4cyclictest2118080-21gcc21:10:173
2078562991912,4cyclictest2123656-21perf21:30:003
2078562991911,6cyclictest2104418-21awk20:30:003
2078562991911,5cyclictest355-21systemd-journal23:20:003
207856299190,7cyclictest0-21swapper/322:50:013
2078562991811,5cyclictest2180892-21perf00:25:003
2078562991810,5cyclictest2112676-21latency_hist20:55:013
2078562991710,5cyclictest2089924-21awk19:45:003
207856299165,3cyclictest2114822-21meminfo21:00:153
207856299158,6cyclictest2078691-21apt-get19:10:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional