You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 22:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Sep 14, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
199056099398220,3957cyclictest1990133-21kworker/1:2+events19:20:001
199056099371018,3687cyclictest2060612-21kworker/1:2+events22:50:001
199056399343613,3418cyclictest2070764-21kworker/2:2+events23:29:592
19905639931959,3181cyclictest2011176-21kworker/2:2+events20:15:222
199056099279813,2779cyclictest2028971-21kworker/1:1+events21:25:121
19905679927819,2768cyclictest2024000-21kworker/3:1+events21:01:203
199055799269512,2679cyclictest2049330-21kworker/0:1+events22:31:030
199056399269316,2673cyclictest2061514-21kworker/2:2+events23:00:122
199056099268313,2665cyclictest2094339-21kworker/1:0+events00:35:141
199056099267910,2665cyclictest2036651-21kworker/1:0+events21:31:401
199056799266613,2650cyclictest1997025-21kworker/3:0+events19:37:283
199056099265113,2633cyclictest2055721-21kworker/1:0+events22:55:171
199055799263212,2616cyclictest2019152-21kworker/0:0+events20:48:490
199056399261713,2601cyclictest2011176-21kworker/2:2+events20:20:162
199056099257912,2563cyclictest2051519-21kworker/1:1+events22:26:071
199056099257211,2559cyclictest2055721-21kworker/1:0+events22:40:111
199056099257211,2559cyclictest2055721-21kworker/1:0+events22:40:101
199056099256312,2547cyclictest2005000-21kworker/1:0+events20:38:051
199056099255712,2542cyclictest2047900-21kworker/1:0+events22:16:541
199056099255711,2542cyclictest2028971-21kworker/1:1+events21:22:321
199056099254512,2530cyclictest2041680-21kworker/1:2+events21:54:571
199056399254412,2528cyclictest2086419-21kworker/2:1+events00:30:112
199056099254112,2526cyclictest2036651-21kworker/1:0+events21:35:221
19905609925378,2526cyclictest2024561-21kworker/1:2+events21:10:451
199056799253312,2517cyclictest2073875-21kworker/3:1+events23:33:223
199056399253113,2514cyclictest2017609-21kworker/2:2+events20:40:452
199055799253011,2515cyclictest2060641-21kworker/0:1+events23:02:540
19905679925248,2513cyclictest2003188-21kworker/3:1+events20:05:123
199056799252212,2506cyclictest2078491-21kworker/3:1+events23:47:213
199056399249912,2484cyclictest2043253-21kworker/2:0+events21:57:342
199056399249711,2482cyclictest2054145-21kworker/2:0+events22:29:062
199056399249512,2480cyclictest2015980-21kworker/2:0+events20:30:312
199056399249412,2478cyclictest2006559-21kworker/2:2+events20:01:022
199056399249312,2478cyclictest2094368-21kworker/2:0+events00:36:232
199056399249212,2476cyclictest2069152-21kworker/2:1+events23:23:542
199056399249112,2476cyclictest2013013-21kworker/2:1+events20:28:182
199056399249112,2475cyclictest2077023-21kworker/2:2+events23:53:272
199056399249012,2475cyclictest2001591-21kworker/2:0+events19:47:182
199056099249012,2474cyclictest2040074-21kworker/1:0+events21:45:451
199056099248912,2475cyclictest2027164-21kworker/1:0+events21:05:051
199056099248912,2473cyclictest2027164-21kworker/1:0+events21:01:421
199056099248712,2471cyclictest2040074-21kworker/1:0+events21:44:581
199056099248712,2471cyclictest2020761-21kworker/1:2+events20:44:111
199056099248711,2472cyclictest2055721-21kworker/1:0+events23:06:411
199056399248512,2470cyclictest2057415-21kworker/2:0+events22:39:252
199056099248512,2469cyclictest2089725-21kworker/1:1+events00:19:591
199056099248512,2469cyclictest2019120-21kworker/1:1+events20:49:341
199056099248411,2469cyclictest2011320-21kworker/1:2+events20:22:561
199056399248212,2466cyclictest2017609-21kworker/2:2+events20:37:422
199056099248112,2465cyclictest2019120-21kworker/1:1+events20:57:541
199056099247812,2463cyclictest2005000-21kworker/1:0+events20:25:371
199056099247811,2463cyclictest2003370-21kworker/1:2+events19:59:521
199056099247611,2461cyclictest2075481-21kworker/1:1+events23:43:351
199056099247510,2461cyclictest2003370-21kworker/1:2+events19:49:591
19905609924726,2463cyclictest2055721-21kworker/1:0+events22:37:061
199056799246812,2453cyclictest2072180-21kworker/3:2+events23:24:393
199055799246710,2453cyclictest2087668-21kworker/0:0+events00:13:550
199055799246112,2445cyclictest2028725-21kworker/0:1+events21:06:370
199056799246010,2446cyclictest2094401-21kworker/3:0+events00:37:533
199056799245712,2442cyclictest2067020-21kworker/3:1+events23:11:393
199055799245511,2441cyclictest2080181-21kworker/0:0+events00:01:470
199056799245412,2438cyclictest2046505-21kworker/3:2+events22:07:003
199056799245312,2437cyclictest2091110-21kworker/3:1+events00:24:103
199056799245312,2437cyclictest2070545-21kworker/3:0+events23:25:253
199055799245012,2434cyclictest2024124-21kworker/0:0+events21:00:110
199055799244912,2433cyclictest2073687-21kworker/0:1+events23:37:350
199056799244811,2434cyclictest2085165-21kworker/3:2+events00:10:283
199056799244611,2431cyclictest2006408-21kworker/3:2+events20:02:083
199056799244512,2429cyclictest2020671-21kworker/3:0+events20:54:303
199055799244511,2430cyclictest2057294-21kworker/0:2+events22:42:480
199055799244511,2430cyclictest2057294-21kworker/0:2+events22:42:480
199056799244412,2428cyclictest2030360-21kworker/3:2+events21:29:043
199056099244412,2429cyclictest2079999-21kworker/1:0+events23:51:561
199056799244312,2428cyclictest2030360-21kworker/3:2+events21:14:313
199056799244212,2426cyclictest2091110-21kworker/3:1+events00:28:183
199056799244111,2426cyclictest2008066-21kworker/3:0+events20:13:043
199055799244112,2425cyclictest2012719-21kworker/0:2+events20:18:010
199055799244112,2425cyclictest2000063-21kworker/0:2+events19:48:510
199056799244012,2424cyclictest2036988-21kworker/3:1+events21:40:003
199056799243911,2424cyclictest2065427-21kworker/3:0+events23:04:023
199056799243911,2423cyclictest2046505-21kworker/3:2+events22:32:303
199056799243812,2424cyclictest2060673-21kworker/3:2+events23:05:083
199056799243712,2421cyclictest2046505-21kworker/3:2+events22:35:113
199056799243711,2423cyclictest2057446-21kworker/3:0+events22:40:333
199056799243711,2423cyclictest2057446-21kworker/3:0+events22:40:333
199056799243611,2421cyclictest2014590-21kworker/3:1+events20:32:023
199056799243510,2421cyclictest2067020-21kworker/3:1+events23:16:593
199056799242912,2414cyclictest2014590-21kworker/3:1+events20:35:463
199056799242912,2413cyclictest2050926-21kworker/3:0+events22:19:583
199056799242611,2413cyclictest2055807-21kworker/3:1+events22:45:073
199056799242211,2408cyclictest2024000-21kworker/3:1+events21:05:273
199056799242012,2404cyclictest1989932-21kworker/3:1+events19:17:423
199055799242011,2405cyclictest2065484-21kworker/0:0+events23:14:390
199056399241912,2404cyclictest2050160-21kworker/2:1+events22:21:062
199056099241412,2399cyclictest2005000-21kworker/1:0+events20:14:351
199055799241312,2397cyclictest2073687-21kworker/0:1+events23:47:450
19905579924125,2403cyclictest2004941-21kworker/0:0+events19:55:180
199056099240911,2394cyclictest2064162-21kworker/1:2+events23:00:581
199055799240912,2393cyclictest2030331-21kworker/0:2+events21:18:420
199055799240811,2393cyclictest2043373-21kworker/0:0+events21:56:040
199056799240611,2391cyclictest2030360-21kworker/3:2+events21:32:483
199056399240212,2387cyclictest2001591-21kworker/2:0+events20:10:472
199056799239512,2380cyclictest2035316-21kworker/3:0+events21:46:303
199055799239412,2379cyclictest2080181-21kworker/0:0+events23:54:590
199056799239012,2375cyclictest2030360-21kworker/3:2+events21:16:483
199055799239012,2374cyclictest1986774-21kworker/0:2+events19:14:360
199056099238912,2373cyclictest2049652-21kworker/1:2+events22:20:201
199055799238911,2374cyclictest2065484-21kworker/0:0+events23:05:540
199055799238810,2374cyclictest2092827-21kworker/0:0+events00:29:030
199055799238712,2372cyclictest1995186-21kworker/0:2+events19:25:380
199055799238610,2374cyclictest2065484-21kworker/0:0+events23:20:030
199055799238610,2372cyclictest2038497-21kworker/0:0+events21:40:210
199055799238512,2369cyclictest2004941-21kworker/0:0+events20:00:140
199055799238510,2371cyclictest2006739-21kworker/0:2+events20:05:580
199055799238412,2369cyclictest2009461-21kworker/0:1+events20:27:110
199055799238112,2366cyclictest2049330-21kworker/0:1+events22:12:010
199056799238011,2366cyclictest2072180-21kworker/3:2+events23:37:563
199056799237911,2364cyclictest2060673-21kworker/3:2+events22:54:543
199056799237812,2362cyclictest2046505-21kworker/3:2+events22:21:523
199055799237812,2362cyclictest2060641-21kworker/0:1+events22:51:530
199056799237712,2362cyclictest1997025-21kworker/3:0+events19:56:503
199055799237612,2361cyclictest2022463-21kworker/0:2+events20:52:130
199056799237511,2361cyclictest2089481-21kworker/3:0+events00:16:333
199055799237312,2357cyclictest1992835-21kworker/0:1+events19:31:230
199055799236312,2347cyclictest2091203-21kworker/0:2+events00:31:220
199055799236012,2344cyclictest2000063-21kworker/0:2+events19:43:090
199056799235911,2344cyclictest2035316-21kworker/3:0+events21:43:053
199055799235512,2339cyclictest2051007-21kworker/0:0+events22:17:150
199055799235112,2336cyclictest2040143-21kworker/0:2+events22:03:150
199055799235111,2336cyclictest2000063-21kworker/0:2+events19:53:030
199055799234912,2334cyclictest2040143-21kworker/0:2+events22:06:390
199056799234612,2331cyclictest2052585-21kworker/3:1+events22:25:433
199056099234612,2331cyclictest2055721-21kworker/1:0+events23:17:451
199055799233912,2324cyclictest2073687-21kworker/0:1+events23:40:530
199056399232711,2312cyclictest2083546-21kworker/2:3+events00:11:142
199055799232612,2311cyclictest2019152-21kworker/0:0+events20:41:310
199056399232512,2309cyclictest2083546-21kworker/2:3+events00:08:342
199056399232510,2311cyclictest2063892-21kworker/2:0+events22:58:412
199056399232411,2311cyclictest2033798-21kworker/2:2+events21:30:112
199056399232312,2307cyclictest2057415-21kworker/2:0+events22:49:172
199056399232311,2309cyclictest2083233-21kworker/2:0+events00:04:482
199056399232012,2305cyclictest2086419-21kworker/2:1+events00:21:302
199056099232012,2305cyclictest2046152-21kworker/1:1+events22:10:511
199055799231511,2301cyclictest2070793-21kworker/0:2+events23:30:220
199056399231112,2295cyclictest2061514-21kworker/2:2+events23:08:592
199055799231011,2295cyclictest1996840-21kworker/0:0+events19:38:140
19905609923098,2298cyclictest1998417-21kworker/1:2+events19:39:241
199056399230810,2294cyclictest2050160-21kworker/2:1+events22:32:092
199055799230810,2295cyclictest2085329-21kworker/0:1+events00:05:560
199056399230711,2293cyclictest2073692-21kworker/2:0+events23:37:122
199056399230611,2292cyclictest1988169-21kworker/2:2+events19:29:512
199056399230511,2291cyclictest2088204-21kworker/2:0+events00:16:562
199056399230511,2290cyclictest2023794-21kworker/2:2+events21:00:352
199056399230310,2290cyclictest2041498-21kworker/2:2+events21:54:102
19905579922989,2286cyclictest2091203-21kworker/0:2+events00:39:460
199055799229712,2281cyclictest2049330-21kworker/0:1+events22:39:000
199055799229310,2279cyclictest2022463-21kworker/0:2+events20:55:380
199056099228712,2272cyclictest2089725-21kworker/1:1+events00:25:181
199056099228611,2271cyclictest2055721-21kworker/1:0+events23:28:261
199055799228411,2270cyclictest2015955-21kworker/0:2+events20:36:110
19905639922839,2270cyclictest2027316-21kworker/2:0+events21:07:012
199056399227911,2264cyclictest2077023-21kworker/2:2+events23:41:182
199056399227511,2261cyclictest2020552-21kworker/2:0+events20:56:012
199056399227310,2260cyclictest1997084-21kworker/2:1+events19:41:392
199056099227311,2259cyclictest2028971-21kworker/1:1+events21:16:041
199056399227111,2257cyclictest2067289-21kworker/2:0+events23:10:072
19905609922708,2258cyclictest2070612-21kworker/1:1+events23:20:471
199056099226710,2253cyclictest1993920-21kworker/1:1+events19:33:161
199056099226610,2252cyclictest2075481-21kworker/1:1+events23:36:031
19905609922657,2255cyclictest2017492-21kworker/1:2+events20:33:321
199056099226511,2251cyclictest2086511-21kworker/1:0+events00:11:371
199056399226410,2251cyclictest2083233-21kworker/2:0+events23:58:232
199056099226210,2249cyclictest2041680-21kworker/1:2+events22:02:291
19905609922617,2250cyclictest2086511-21kworker/1:0+events00:23:471
199056399225911,2245cyclictest2020552-21kworker/2:0+events20:51:502
199056399225911,2244cyclictest2044854-21kworker/2:1+events22:00:142
19905609922599,2247cyclictest2075481-21kworker/1:1+events23:46:121
19905609922598,2247cyclictest2079999-21kworker/1:0+events00:01:231
19905609922568,2244cyclictest2047900-21kworker/1:0+events22:09:421
199056099225611,2241cyclictest2055721-21kworker/1:0+events23:12:021
199056099225511,2240cyclictest2081633-21kworker/1:2+events23:56:541
199056099225511,2240cyclictest1990133-21kworker/1:2+events19:23:441
199056399225411,2240cyclictest1991929-21kworker/2:1+events19:18:512
199056099225410,2240cyclictest2084910-21kworker/1:1+events00:09:421
19905609922539,2240cyclictest2011320-21kworker/1:2+events20:17:411
199056399225212,2236cyclictest2033798-21kworker/2:2+events21:28:172
199056099225211,2237cyclictest2001650-21kworker/1:1+events19:52:391
199056099225011,2236cyclictest2091525-21kworker/1:2+events00:32:071
199056799224910,2235cyclictest1997025-21kworker/3:0+events19:51:063
199056099224611,2232cyclictest2072271-21kworker/1:2+events23:32:391
199056099224511,2231cyclictest2008256-21kworker/1:1+events20:07:031
199056099224511,2231cyclictest2003370-21kworker/1:2+events20:02:291
199056799224212,2227cyclictest1989932-21kworker/3:1+events19:20:243
199056399224012,2224cyclictest2043253-21kworker/2:0+events22:19:132
19905679922399,2226cyclictest1989932-21kworker/3:1+events19:14:133
199055799223612,2221cyclictest2060641-21kworker/0:1+events22:57:080
199056799223510,2222cyclictest1997025-21kworker/3:0+events19:34:243
19905679922348,2223cyclictest2078491-21kworker/3:1+events23:53:043
199056799223411,2220cyclictest2031961-21kworker/3:0+events21:20:373
199056799223410,2221cyclictest2078491-21kworker/3:1+events23:58:013
199056799223311,2220cyclictest1997025-21kworker/3:0+events19:40:113
199056799223010,2218cyclictest2044765-21kworker/3:1+events22:10:063
199056799223010,2216cyclictest2044765-21kworker/3:1+events21:59:063
199055799222810,2214cyclictest2089511-21kworker/0:1+events00:24:310
199055799222711,2213cyclictest2028725-21kworker/0:1+events21:14:540
199056799222611,2211cyclictest2003188-21kworker/3:1+events19:47:413
199056399222611,2211cyclictest2044854-21kworker/2:1+events22:09:192
199056799221911,2205cyclictest2009666-21kworker/3:2+events20:16:323
199056799221410,2201cyclictest2078491-21kworker/3:1+events00:00:143
199056399221412,2198cyclictest2069152-21kworker/2:1+events23:18:092
19905679922087,2197cyclictest2035316-21kworker/3:0+events21:52:183
19905639922088,2197cyclictest2075438-21kworker/2:1+events23:34:342
199056799220610,2192cyclictest2020671-21kworker/3:0+events20:49:133
199056799220510,2192cyclictest2020671-21kworker/3:0+events20:43:483
199056399220511,2191cyclictest2055780-21kworker/2:2+events22:41:402
199056399220511,2191cyclictest2055780-21kworker/2:2+events22:41:402
19905679922046,2195cyclictest2083308-21kworker/3:0+events00:06:413
199056799220410,2191cyclictest2062589-21kworker/3:1+events22:59:283
19905679921838,2172cyclictest2009666-21kworker/3:2+events20:23:433
199055799218111,2166cyclictest2031918-21kworker/0:0+events21:28:390
199055799218011,2166cyclictest2060641-21kworker/0:1+events22:49:380
199055799218011,2166cyclictest2041734-21kworker/0:1+events21:54:340
199055799217911,2165cyclictest2078571-21kworker/0:2+events23:55:450
19905639921777,2166cyclictest2086419-21kworker/2:1+events00:26:252
199056099217210,2159cyclictest2043315-21kworker/1:0+events21:55:401
19905579921719,2159cyclictest2049330-21kworker/0:1+events22:22:150
199055799216810,2155cyclictest2065484-21kworker/0:0+events23:15:480
199055799216711,2153cyclictest2012719-21kworker/0:2+events20:21:230
199055799216711,2152cyclictest2052901-21kworker/0:3+events22:29:540
19905579921669,2153cyclictest2033560-21kworker/0:1+events21:39:380
19905679921649,2152cyclictest2085165-21kworker/3:2+events00:32:543
199055799216411,2150cyclictest2070793-21kworker/0:2+events23:27:180
199056399216310,2150cyclictest2048129-21kworker/2:2+events22:14:392
199056099216211,2147cyclictest1990133-21kworker/1:2+events19:11:591
199056099216111,2146cyclictest2000021-21kworker/1:0+events19:42:231
199055799216111,2147cyclictest1995186-21kworker/0:2+events19:21:540
19905579921609,2149cyclictest2006739-21kworker/0:2+events20:10:020
199055799216011,2145cyclictest2087668-21kworker/0:0+events00:16:100
199055799215810,2144cyclictest2015955-21kworker/0:2+events20:33:100
199055799215810,2144cyclictest1985167-21kworker/0:0+events19:19:360
199056399215411,2140cyclictest2025654-21kworker/2:1+events21:13:222
199055799215210,2138cyclictest2033560-21kworker/0:1+events21:33:100
199056799215011,2136cyclictest2078491-21kworker/3:1+events23:44:213
199056399214411,2129cyclictest2035435-21kworker/2:0+events21:38:072
199056399214112,2126cyclictest2061514-21kworker/2:2+events22:51:302
199055799212910,2116cyclictest2030331-21kworker/0:2+events21:21:000
199056399211710,2104cyclictest2004910-21kworker/2:1+events19:54:342
199056399211211,2098cyclictest2025654-21kworker/2:1+events21:24:502
199056099211210,2098cyclictest2049652-21kworker/1:2+events22:31:241
199056399210611,2091cyclictest2035435-21kworker/2:0+events21:41:312
199056399210511,2090cyclictest2038291-21kworker/2:1+events21:46:542
199056399210411,2091cyclictest2001591-21kworker/2:0+events19:59:292
199056399210311,2089cyclictest2030505-21kworker/2:2+events21:17:112
199056399210311,2089cyclictest1995216-21kworker/2:0+events19:22:362
199056099209911,2084cyclictest1995775-21kworker/1:0+events19:28:201
199056099209811,2084cyclictest2060612-21kworker/1:2+events22:52:381
199056099209710,2084cyclictest2022431-21kworker/1:0+events20:51:301
199056399209511,2080cyclictest2009579-21kworker/2:1+events20:08:542
19905639920929,2079cyclictest1997084-21kworker/2:1+events19:35:562
19905679920778,2066cyclictest2014590-21kworker/3:1+events20:27:573
199056799207210,2059cyclictest2035316-21kworker/3:0+events22:02:523
19905679920585,2050cyclictest1995363-21kworker/3:2+events19:29:063
199056399202911,2014cyclictest2020552-21kworker/2:0+events20:46:092
199055799200610,1993cyclictest2038497-21kworker/0:0+events21:45:220
19905639919508,1939cyclictest1988169-21kworker/2:2+events19:15:002
19901762203176,23sleep30-21swapper/319:08:353
19901942153112,24sleep10-21swapper/119:08:501
19900432143116,22sleep20-21swapper/219:06:542
19900332141105,31sleep00-21swapper/019:06:490
199056399209,9cyclictest1997391-21apt-get19:30:132
1990563991912,5cyclictest2079214-21sh23:45:142
199056799140,12cyclictest2024572-21/usr/sbin/munin20:55:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional