You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 05:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Mar 21, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197230599334012,3322cyclictest2017139-21kworker/0:0+events21:30:140
197231199331915,3301cyclictest2050742-21kworker/2:2+events23:25:022
197230799291714,2898cyclictest1991780-21kworker/1:1+events20:10:171
197231599280712,2790cyclictest1996339-21kworker/3:2+events20:50:143
197231599280613,2789cyclictest2052405-21kworker/3:0+events23:30:003
197230599276910,2755cyclictest1982047-21kworker/0:1+events20:15:130
197230599276712,2751cyclictest2028290-21kworker/0:2+events22:20:000
197230599274313,2726cyclictest2028290-21kworker/0:2+events22:05:180
197230799273713,2720cyclictest2063772-21kworker/1:0+events23:55:141
197230799272913,2713cyclictest2044280-21kworker/1:0+events23:10:141
19723159926688,2656cyclictest1985299-21kworker/3:2+events20:05:193
197231199266813,2651cyclictest2001378-21kworker/2:2+events20:55:112
197231599263012,2615cyclictest2073369-21kworker/3:1+events00:38:513
197230599263011,2615cyclictest1982047-21kworker/0:1+events19:51:260
197231599258012,2564cyclictest2047532-21kworker/3:1+events23:05:153
197230599257612,2559cyclictest1999686-21kworker/0:2+events20:35:180
197231599257112,2556cyclictest2073369-21kworker/3:1+events00:32:243
197230799253612,2520cyclictest2068684-21kworker/1:0+events00:15:211
197230799253612,2520cyclictest2068684-21kworker/1:0+events00:15:211
197231599253412,2518cyclictest2040781-21kworker/3:1+events22:53:263
197231599252011,2505cyclictest2031279-21kworker/3:1+events22:19:143
19723159925106,2501cyclictest2049195-21kworker/3:2+events23:19:253
197230599250913,2492cyclictest2028290-21kworker/0:2+events22:03:240
19723059925067,2495cyclictest2037821-21kworker/0:2+events22:55:210
197230599249912,2483cyclictest2010978-21kworker/0:2+events21:26:010
197230599249611,2482cyclictest2003009-21kworker/0:2+events20:47:160
197231599249410,2481cyclictest2052405-21kworker/3:0+events23:21:403
197231199249411,2479cyclictest2015478-21kworker/2:2+events21:21:492
19723079924949,2483cyclictest1997908-21kworker/1:2+events20:41:051
197230799249412,2479cyclictest2009401-21kworker/1:0+events21:11:341
197231599248911,2474cyclictest2063986-21kworker/3:0+events23:55:353
197231599248812,2472cyclictest2007866-21kworker/3:2+events21:13:273
197231599248711,2472cyclictest1985299-21kworker/3:2+events20:14:283
197231599248612,2471cyclictest2067232-21kworker/3:1+events00:05:523
197231599248612,2470cyclictest2045909-21kworker/3:2+events22:59:333
197231599248412,2469cyclictest1985299-21kworker/3:2+events19:58:453
197231599248411,2470cyclictest2038012-21kworker/3:2+events22:37:283
197231599248411,2469cyclictest2036368-21kworker/3:0+events22:43:113
197231599248411,2469cyclictest2017381-21kworker/3:1+events21:31:223
197231599248411,2469cyclictest1967149-21kworker/3:2+events19:39:593
197231599248311,2469cyclictest2007866-21kworker/3:2+events21:22:583
197231599248212,2467cyclictest2058740-21kworker/3:1+events23:38:033
197230599248112,2466cyclictest2010978-21kworker/0:2+events21:15:190
197230799248012,2464cyclictest2017171-21kworker/1:0+events21:35:541
197230799248012,2464cyclictest2012635-21kworker/1:1+events21:16:541
197231599247911,2464cyclictest2040781-21kworker/3:1+events22:46:133
197231599247911,2464cyclictest2040781-21kworker/3:1+events22:46:133
197231599247812,2462cyclictest2031279-21kworker/3:1+events22:24:143
197231599247811,2464cyclictest2060370-21kworker/3:2+events00:18:043
197231599247811,2464cyclictest2060370-21kworker/3:2+events00:18:043
197231599247810,2465cyclictest1996339-21kworker/3:2+events20:41:513
197231599246810,2455cyclictest2021945-21kworker/3:1+events22:03:013
197231599246512,2449cyclictest1985299-21kworker/3:2+events19:50:173
197230599246511,2450cyclictest2044039-21kworker/0:1+events23:07:100
197231599245712,2442cyclictest2031279-21kworker/3:1+events22:32:533
197231599245412,2439cyclictest2070405-21kworker/3:0+events00:22:163
197231599245412,2438cyclictest1983674-21kworker/3:0+events19:42:403
197231599245112,2437cyclictest2007866-21kworker/3:2+events21:35:103
197231599245012,2434cyclictest2045909-21kworker/3:2+events23:01:293
197231599244912,2433cyclictest1967149-21kworker/3:2+events19:26:353
197231599244812,2432cyclictest1985299-21kworker/3:2+events19:48:203
197231599244811,2433cyclictest2004374-21kworker/3:1+events20:49:303
197230599244412,2428cyclictest2036131-21kworker/0:0+events22:31:020
197230799243912,2423cyclictest1986756-21kworker/1:1+events20:00:181
197231199243012,2415cyclictest1975401-21kworker/2:1+events19:21:362
197231199241411,2400cyclictest2053758-21kworker/2:1+events23:46:272
197230599241212,2397cyclictest2015536-21kworker/0:1+events21:24:050
19723119924119,2399cyclictest2042620-21kworker/2:2+events22:54:352
197231199241112,2395cyclictest2028378-21kworker/2:2+events22:18:522
197230599240912,2393cyclictest1998092-21kworker/0:0+events20:42:150
197230799240811,2394cyclictest2049011-21kworker/1:1+events23:17:101
19723079924049,2392cyclictest1975431-21kworker/1:2+events19:17:021
197230599240111,2386cyclictest2064043-21kworker/0:1+events00:08:280
197230799240012,2385cyclictest2057733-21kworker/1:2+events23:40:451
197230799239812,2383cyclictest1983877-21kworker/1:2+events19:48:441
197230799239812,2382cyclictest1996244-21kworker/1:1+events20:25:511
197230599239812,2382cyclictest1982047-21kworker/0:1+events20:23:330
197230599239811,2383cyclictest1982047-21kworker/0:1+events20:29:170
197230799239712,2382cyclictest2034857-21kworker/1:1+events22:32:311
197230799239712,2382cyclictest2014295-21kworker/1:2+events21:29:051
197230799239712,2381cyclictest2055859-21kworker/1:1+events23:38:251
197230799239612,2381cyclictest2009401-21kworker/1:0+events21:09:171
197230799239612,2380cyclictest2057733-21kworker/1:2+events00:11:101
197230799239512,2381cyclictest1990173-21kworker/1:2+events20:20:071
197230599239512,2380cyclictest2072063-21kworker/0:3+events00:21:050
197230599239512,2380cyclictest1998092-21kworker/0:0+events21:02:450
197230799239412,2379cyclictest2031429-21kworker/1:1+events22:14:231
197230799239311,2378cyclictest1994622-21kworker/1:0+events20:31:121
197230599239311,2380cyclictest2023696-21kworker/0:1+events21:55:060
197230799239210,2378cyclictest2053847-21kworker/1:0+events23:34:111
197230599239212,2377cyclictest2006091-21kworker/0:1+events20:56:390
197230599239212,2376cyclictest2036131-21kworker/0:0+events22:35:330
197230599239111,2377cyclictest1976839-21kworker/0:2+events19:40:450
197230799239012,2374cyclictest2012635-21kworker/1:1+events21:24:521
197230599238912,2375cyclictest2009311-21kworker/0:1+events21:06:140
19723159923889,2375cyclictest1994682-21kworker/3:1+events20:24:193
197230599238812,2373cyclictest1998092-21kworker/0:0+events20:30:470
197230599238711,2372cyclictest2057136-21kworker/0:2+events23:37:160
197230599238412,2368cyclictest2022034-21kworker/0:0+events21:44:420
197230799238311,2368cyclictest2017171-21kworker/1:0+events21:48:541
197230799238212,2368cyclictest2071981-21kworker/1:1+events00:20:431
197230799238212,2368cyclictest2057733-21kworker/1:2+events00:00:091
197230599237010,2357cyclictest2062440-21kworker/0:2+events23:49:500
197231199236612,2350cyclictest2042620-21kworker/2:2+events23:01:502
197231599236311,2348cyclictest2021945-21kworker/3:1+events21:47:433
197231599236011,2346cyclictest1999700-21kworker/3:1+events20:38:023
197230599236011,2346cyclictest1982047-21kworker/0:1+events19:49:550
197231199235312,2337cyclictest2053758-21kworker/2:1+events23:53:182
197231199235212,2337cyclictest2042620-21kworker/2:2+events22:56:542
197231599235012,2335cyclictest2031279-21kworker/3:1+events22:12:043
197231599235011,2336cyclictest1996339-21kworker/3:2+events20:25:273
197231199234812,2332cyclictest2042620-21kworker/2:2+events22:49:592
197231199234812,2332cyclictest2042620-21kworker/2:2+events22:49:592
197230599234711,2332cyclictest1976839-21kworker/0:2+events19:36:340
197231599234611,2333cyclictest2052405-21kworker/3:0+events23:45:423
197230799234311,2329cyclictest2039397-21kworker/1:2+events22:40:531
197230599234210,2329cyclictest1982047-21kworker/0:1+events20:06:270
197231199234112,2326cyclictest2068534-21kworker/2:1+events00:07:432
197231199233311,2318cyclictest2015478-21kworker/2:2+events21:25:142
19723119923309,2317cyclictest2023427-21kworker/2:0+events22:03:462
197231199232912,2314cyclictest2028378-21kworker/2:2+events22:23:502
197231199232912,2313cyclictest2050742-21kworker/2:2+events23:21:172
197231199232712,2312cyclictest1978925-21kworker/2:0+events19:44:122
197231199232711,2312cyclictest1997876-21kworker/2:1+events20:32:192
197231199232311,2309cyclictest2036338-21kworker/2:0+events22:35:102
197231199232310,2311cyclictest2036338-21kworker/2:0+events22:40:072
197231199231912,2304cyclictest1990141-21kworker/2:2+events20:04:552
197231199231910,2306cyclictest1975401-21kworker/2:1+events19:26:582
197230799230910,2295cyclictest1999630-21kworker/1:1+events20:38:231
197230599230712,2292cyclictest1978861-21kworker/0:0+events19:31:120
197230599230711,2292cyclictest2068561-21kworker/0:0+events00:31:380
197231599229311,2279cyclictest2007866-21kworker/3:2+events21:05:513
197231599228911,2274cyclictest2031279-21kworker/3:1+events22:29:533
197230599227711,2262cyclictest1976839-21kworker/0:2+events20:01:050
197231199227510,2262cyclictest2020525-21kworker/2:2+events21:51:132
197230799227512,2259cyclictest2033088-21kworker/1:2+events22:19:381
197230599227511,2261cyclictest1973731-21kworker/0:1+events19:20:270
19723079922749,2261cyclictest2044280-21kworker/1:0+events23:06:231
197230599227412,2259cyclictest2068561-21kworker/0:0+events00:26:250
197230599227212,2256cyclictest2041108-21kworker/0:0+events22:47:410
197230599227212,2256cyclictest2041108-21kworker/0:0+events22:47:410
197231199226911,2255cyclictest2001378-21kworker/2:2+events21:07:472
197231599226610,2252cyclictest2052405-21kworker/3:0+events23:32:183
197231599226411,2250cyclictest2060370-21kworker/3:2+events23:44:563
197231599226310,2249cyclictest1979907-21kworker/3:1+events19:31:353
197230599226311,2249cyclictest2052105-21kworker/0:1+events23:16:470
197231599226210,2249cyclictest1967149-21kworker/3:2+events19:21:133
197231199226212,2246cyclictest2070344-21kworker/2:0+events00:18:272
197231199226212,2246cyclictest2070344-21kworker/2:0+events00:18:272
197231599226011,2246cyclictest2023545-21kworker/3:0+events21:52:463
19723159922599,2247cyclictest2028409-21kworker/3:2+events22:08:403
197231599225910,2246cyclictest2015775-21kworker/3:0+events21:28:413
19723119922599,2246cyclictest2062537-21kworker/2:2+events00:28:182
197231599225811,2243cyclictest2060370-21kworker/3:2+events00:04:433
19723079922589,2245cyclictest1997908-21kworker/1:2+events20:54:491
197230799225811,2244cyclictest2057733-21kworker/1:2+events00:39:141
197230799225710,2244cyclictest2052232-21kworker/1:2+events23:24:411
197231199225611,2242cyclictest2028378-21kworker/2:2+events22:25:222
197231599225511,2240cyclictest1998001-21kworker/3:0+events20:31:343
197231599225411,2240cyclictest1994682-21kworker/3:1+events20:17:053
19723079922547,2243cyclictest2037762-21kworker/1:0+events22:38:141
197231599225210,2239cyclictest2062354-21kworker/3:1+events23:52:323
197230799225011,2235cyclictest2017171-21kworker/1:0+events22:07:111
197230799224912,2233cyclictest2033088-21kworker/1:2+events22:21:561
197231199224611,2232cyclictest2075037-21kworker/2:0+events00:39:372
197231199224312,2228cyclictest2028378-21kworker/2:2+events22:10:112
197230799224210,2229cyclictest2068684-21kworker/1:0+events00:09:141
197230599224211,2227cyclictest2068561-21kworker/0:0+events00:16:070
197230599224211,2227cyclictest2068561-21kworker/0:0+events00:16:070
197231599224111,2227cyclictest2049195-21kworker/3:2+events23:13:443
197231599223910,2226cyclictest2007866-21kworker/3:2+events21:00:283
197230799223912,2224cyclictest1986756-21kworker/1:1+events19:52:571
197231199223812,2223cyclictest2020525-21kworker/2:2+events21:40:522
197231199223812,2223cyclictest2001378-21kworker/2:2+events20:47:382
19723159922338,2222cyclictest2006267-21kworker/3:0+events20:59:423
197231599223011,2216cyclictest2060370-21kworker/3:2+events00:14:583
197231599222910,2215cyclictest2023545-21kworker/3:0+events21:57:223
197230799222911,2215cyclictest2033088-21kworker/1:2+events22:28:441
197231599222810,2215cyclictest2075010-21kworker/3:2+events00:28:423
197230599222810,2215cyclictest2009311-21kworker/0:1+events21:13:490
197231599222410,2211cyclictest2007866-21kworker/3:2+events21:42:243
197231199222311,2209cyclictest1980623-21kworker/2:2+events19:38:032
197230799222111,2207cyclictest2018834-21kworker/1:1+events21:34:461
19723079922169,2204cyclictest2057733-21kworker/1:2+events00:27:341
197230599221211,2197cyclictest2018743-21kworker/0:2+events21:53:090
19723079922069,2194cyclictest2004229-21kworker/1:1+events20:48:221
197230599220510,2192cyclictest2039485-21kworker/0:1+events22:43:570
19723059922022,2197cyclictest2018743-21kworker/0:2+events21:38:110
197230799220111,2187cyclictest2044280-21kworker/1:0+events23:02:131
197230799220111,2186cyclictest1977470-21kworker/1:0+events19:33:541
19723079922009,2188cyclictest1990173-21kworker/1:2+events20:15:351
197230799219910,2186cyclictest2062176-21kworker/1:1+events23:46:491
197230799219910,2185cyclictest2022093-21kworker/1:1+events21:53:561
197230599219810,2184cyclictest2070225-21kworker/0:2+events00:13:520
19723079921979,2184cyclictest1983877-21kworker/1:2+events19:55:391
197230799219710,2184cyclictest2057733-21kworker/1:2+events23:54:271
197230799219710,2184cyclictest2041021-21kworker/1:1+events22:46:351
197230799219710,2184cyclictest2041021-21kworker/1:1+events22:46:351
197230599219711,2183cyclictest2053994-21kworker/0:0+events23:30:470
197230799219611,2181cyclictest2041021-21kworker/1:1+events22:52:391
197231599219510,2181cyclictest1986964-21kworker/3:0+events20:03:223
19723079921949,2181cyclictest2017171-21kworker/1:0+events21:57:001
197230799219411,2180cyclictest2052232-21kworker/1:2+events23:25:461
197230599218910,2177cyclictest2053994-21kworker/0:0+events23:26:580
197230799218810,2175cyclictest1997908-21kworker/1:2+events20:58:341
19723059921889,2175cyclictest1978861-21kworker/0:0+events19:28:060
197230599218811,2173cyclictest2052105-21kworker/0:1+events23:24:180
19723059921878,2175cyclictest2029918-21kworker/0:1+events22:11:190
197230599218710,2173cyclictest2062440-21kworker/0:2+events23:54:500
19723059921859,2173cyclictest2033206-21kworker/0:1+events22:26:500
19723079921848,2172cyclictest2044280-21kworker/1:0+events22:56:311
197230599218310,2169cyclictest2062440-21kworker/0:2+events00:00:550
197230599218210,2168cyclictest1998092-21kworker/0:0+events20:52:100
197230799218111,2167cyclictest1972152-21kworker/1:1+events19:28:311
197230599218011,2165cyclictest2049353-21kworker/0:0+events23:12:100
197230599218010,2167cyclictest2018743-21kworker/0:2+events21:49:390
197230599217711,2164cyclictest2064043-21kworker/0:1+events23:56:420
197230599217611,2162cyclictest2076743-21kworker/0:2+events00:38:280
19723079921739,2160cyclictest2020436-21kworker/1:2+events21:40:291
197230799217311,2158cyclictest2028203-21kworker/1:1+events22:02:151
197231599217211,2158cyclictest2007866-21kworker/3:2+events21:18:483
19723079921717,2161cyclictest1977470-21kworker/1:0+events19:38:511
197230599217110,2158cyclictest2058834-21kworker/0:1+events23:43:470
197231599216910,2156cyclictest1973537-21kworker/3:0+events19:15:323
197230599216810,2155cyclictest2033206-21kworker/0:1+events22:21:090
197230599216711,2153cyclictest2037821-21kworker/0:2+events22:51:520
197230599216410,2151cyclictest2044039-21kworker/0:1+events23:04:540
197231199214911,2134cyclictest1978925-21kworker/2:0+events19:55:162
197231199213714,2119cyclictest2050742-21kworker/2:2+events23:31:102
197231199213111,2117cyclictest1994835-21kworker/2:2+events20:19:222
197231199212811,2114cyclictest2028378-21kworker/2:2+events22:32:092
197231199212811,2113cyclictest2004290-21kworker/2:0+events20:51:232
197231199212810,2116cyclictest1978925-21kworker/2:0+events19:45:182
197231199212810,2115cyclictest2001378-21kworker/2:2+events21:04:172
197231199212810,2114cyclictest2073307-21kworker/2:1+events00:22:382
197231199212711,2113cyclictest2046200-21kworker/2:0+events23:16:232
197231199212411,2110cyclictest2068534-21kworker/2:1+events00:10:472
19723119921238,2113cyclictest2020525-21kworker/2:2+events21:46:142
19723119921213,2114cyclictest2062537-21kworker/2:2+events23:58:162
197231199212110,2108cyclictest2053758-21kworker/2:1+events23:44:322
197231199211911,2105cyclictest2058952-21kworker/2:2+events23:39:592
19723119921189,2105cyclictest1986873-21kworker/2:1+events19:53:202
197231199211710,2104cyclictest2028378-21kworker/2:2+events22:05:402
197231199211710,2104cyclictest1997876-21kworker/2:1+events20:40:432
197231199211710,2104cyclictest1986873-21kworker/2:1+events20:12:552
197231199211611,2102cyclictest2046200-21kworker/2:0+events23:05:382
197231199211511,2101cyclictest2017232-21kworker/2:1+events21:39:422
197231199211311,2099cyclictest2023427-21kworker/2:0+events21:56:362
197230799211210,2099cyclictest2007778-21kworker/1:1+events21:01:361
19723059921059,2093cyclictest1991751-21kworker/0:2+events20:14:040
197231199210211,2088cyclictest2062537-21kworker/2:2+events00:30:322
197231199209811,2084cyclictest1968659-21kworker/2:0+events19:18:102
19723079920799,2067cyclictest2057733-21kworker/1:2+events00:33:551
19723059920789,2066cyclictest1982047-21kworker/0:1+events19:58:210
197231599207712,2061cyclictest1967149-21kworker/3:2+events19:14:233
197231199206910,2056cyclictest2050742-21kworker/2:2+events23:14:522
197230799206210,2048cyclictest1990173-21kworker/1:2+events20:09:311
197231199205311,2039cyclictest1997876-21kworker/2:1+events20:28:542
197230599205310,2040cyclictest1973731-21kworker/0:1+events19:16:400
197230799204310,2030cyclictest1972152-21kworker/1:1+events19:23:321
197230799203410,2021cyclictest1963999-21kworker/1:0+events19:12:501
197230599202610,2013cyclictest1972061-21kworker/0:0+events19:14:470
197230799200910,1996cyclictest1977470-21kworker/1:0+events19:44:331
197231199200410,1990cyclictest2012694-21kworker/2:0+events21:33:592
19723119919907,1980cyclictest2010890-21kworker/2:1+events21:15:432
19723119919878,1976cyclictest1986873-21kworker/2:1+events20:07:382
197231199197211,1958cyclictest1975401-21kworker/2:1+events19:30:492
197231199196910,1956cyclictest2001378-21kworker/2:2+events21:11:122
19723119919654,1957cyclictest1951781-21kworker/2:2+events19:11:402
19723119919646,1955cyclictest1999513-21kworker/2:0+events20:35:412
19723119919609,1948cyclictest1993232-21kworker/2:0+events20:22:262
19723119919267,1916cyclictest2062537-21kworker/2:2+events00:00:322
19717322141104,22sleep30-21swapper/319:05:263
19718462140103,31sleep00-21swapper/019:06:510
19718422140105,29sleep10-21swapper/119:06:471
19717962140100,37sleep20-21swapper/219:06:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional