You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Wed May 13, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
193561799327610,3261cyclictest1982708-21kworker/0:0+events21:55:140
193561999292212,2905cyclictest2000195-21kworker/1:0+events22:40:191
193561999273313,2715cyclictest2030929-21kworker/1:0+events00:05:121
193561999273113,2713cyclictest1947569-21kworker/1:2+events20:15:121
193562799268311,2668cyclictest1992282-21kworker/3:0+events22:15:173
193562399266313,2646cyclictest2013148-21kworker/2:2+events23:10:012
193561999265213,2635cyclictest2024428-21kworker/1:1+events23:50:161
193562799257110,2557cyclictest2009920-21kworker/3:0+events23:30:143
193562799254712,2531cyclictest1974457-21kworker/3:2+events21:20:313
193562799254312,2527cyclictest1960316-21kworker/3:2+events20:54:193
193562399254112,2525cyclictest1971167-21kworker/2:2+events21:00:272
193562799252012,2503cyclictest1947326-21kworker/3:2+events19:57:233
193562399250112,2486cyclictest1947474-21kworker/2:0+events19:48:382
193561799250112,2485cyclictest2006614-21kworker/0:1+events23:03:550
193562799249812,2482cyclictest2040436-21kworker/3:0+events00:40:003
193562799248812,2472cyclictest2024545-21kworker/3:1+events23:57:533
193562799248611,2471cyclictest1969865-21kworker/3:0+events21:07:223
193561799248611,2472cyclictest1992187-21kworker/0:0+events22:14:550
193562399248412,2469cyclictest2019467-21kworker/2:1+events23:45:192
193562799247712,2461cyclictest1992282-21kworker/3:0+events22:35:473
193562799247412,2458cyclictest1952192-21kworker/3:0+events20:06:063
193562399247412,2459cyclictest2019467-21kworker/2:1+events23:40:412
193562799246612,2450cyclictest1990627-21kworker/3:2+events22:00:093
193562799246012,2444cyclictest2018015-21kworker/3:3+events23:41:523
193562399245911,2445cyclictest2001840-21kworker/2:0+events22:50:352
193562799245812,2442cyclictest2000301-21kworker/3:1+events22:31:583
193562799245811,2444cyclictest2024545-21kworker/3:1+events00:04:053
19356239924579,2444cyclictest1977881-21kworker/2:1+events21:26:122
193562799245611,2442cyclictest1981070-21kworker/3:1+events21:31:573
193562799245412,2439cyclictest1960316-21kworker/3:2+events20:30:373
193562799245412,2438cyclictest2006661-21kworker/3:0+events22:52:073
193562799245311,2439cyclictest1952192-21kworker/3:0+events20:00:483
193562799245212,2437cyclictest1974457-21kworker/3:2+events21:16:413
193562799245212,2436cyclictest2032200-21kworker/3:0+events00:22:253
193562799245212,2436cyclictest1988996-21kworker/3:1+events21:53:223
193562799245210,2440cyclictest1988996-21kworker/3:1+events22:05:103
193562399245212,2436cyclictest2037199-21kworker/2:1+events00:29:412
193562399245212,2436cyclictest2006540-21kworker/2:2+events23:01:122
193562399245211,2437cyclictest1971167-21kworker/2:2+events20:58:562
193562799245112,2436cyclictest2009920-21kworker/3:0+events23:22:393
193562399245112,2435cyclictest2026117-21kworker/2:0+events23:58:172
193562399245112,2435cyclictest1958816-21kworker/2:2+events20:29:282
193561999244912,2433cyclictest1968289-21kworker/1:0+events21:10:211
193562399244812,2432cyclictest2028935-21kworker/2:1+events00:00:382
193562399244812,2432cyclictest1950179-21kworker/2:2+events20:08:252
193562399244712,2433cyclictest2001840-21kworker/2:0+events22:55:072
19356179924478,2435cyclictest1936884-21kworker/0:0+events19:29:390
19356279924459,2433cyclictest1949021-21kworker/3:1+events19:53:563
193562799244512,2429cyclictest2009920-21kworker/3:0+events23:18:253
193562399244512,2430cyclictest1998298-21kworker/2:0+events22:23:132
19356279924316,2421cyclictest2033833-21kworker/3:2+events00:15:093
193562799243011,2416cyclictest1969865-21kworker/3:0+events20:56:583
193561999242612,2410cyclictest1947569-21kworker/1:2+events19:56:381
193562799242512,2410cyclictest1979330-21kworker/3:0+events21:27:003
193562399242510,2412cyclictest1995597-21kworker/2:1+events22:16:482
193562799242412,2409cyclictest1942232-21kworker/3:1+events19:32:003
193561999241212,2397cyclictest1968289-21kworker/1:0+events21:29:141
193561799241212,2398cyclictest2003147-21kworker/0:2+events22:45:170
19356179924119,2398cyclictest1986359-21kworker/0:2+events21:50:190
193561999240611,2392cyclictest1968289-21kworker/1:0+events21:03:531
19356179924017,2391cyclictest1957013-21kworker/0:2+events21:17:040
193562399239812,2383cyclictest1942294-21kworker/2:2+events19:40:142
193561999239212,2378cyclictest1947569-21kworker/1:2+events20:00:021
193562799239012,2375cyclictest2009920-21kworker/3:0+events23:26:033
193561999239012,2375cyclictest1947569-21kworker/1:2+events20:32:111
193561799239011,2376cyclictest2025818-21kworker/0:2+events23:46:500
193562399238812,2372cyclictest1957216-21kworker/2:0+events20:30:132
193561999238312,2367cyclictest1947569-21kworker/1:2+events19:47:051
193562799237912,2364cyclictest1956954-21kworker/3:2+events20:13:443
193561999236912,2354cyclictest2009708-21kworker/1:1+events22:56:141
193561999236112,2345cyclictest2013062-21kworker/1:1+events23:12:441
193561799236011,2346cyclictest1943878-21kworker/0:1+events19:52:250
193561999234812,2332cyclictest1968289-21kworker/1:0+events21:22:221
193561999234712,2332cyclictest1968289-21kworker/1:0+events21:07:431
193561999234711,2333cyclictest2030929-21kworker/1:0+events00:14:461
193562799234110,2327cyclictest2004797-21kworker/3:2+events22:42:373
193561999234110,2328cyclictest2029209-21kworker/1:1+events00:24:431
193561999233911,2325cyclictest1975805-21kworker/1:2+events21:16:191
193561799233912,2324cyclictest1982708-21kworker/0:0+events21:39:380
193561799233912,2324cyclictest1957013-21kworker/0:2+events21:13:470
193561799233811,2324cyclictest2000268-21kworker/0:0+events22:32:430
193561999233612,2321cyclictest1987364-21kworker/1:1+events21:51:261
193562399233510,2322cyclictest1993826-21kworker/2:2+events22:09:002
193561999233012,2314cyclictest1985731-21kworker/1:0+events22:12:431
193561999232910,2315cyclictest2022713-21kworker/1:0+events23:56:001
19356199923289,2316cyclictest2000195-21kworker/1:0+events22:53:591
193561999232712,2312cyclictest1985731-21kworker/1:0+events21:41:321
193561999232611,2311cyclictest1964965-21kworker/1:1+events20:53:091
193561999232512,2310cyclictest2024428-21kworker/1:1+events23:48:221
193561999232412,2310cyclictest1996961-21kworker/1:2+events22:25:081
193561999232211,2308cyclictest1942202-21kworker/1:2+events19:33:301
19356179923218,2309cyclictest1988906-21kworker/0:1+events22:02:270
193561999232012,2305cyclictest1940356-21kworker/1:0+events19:26:121
193561799231812,2302cyclictest1982708-21kworker/0:0+events21:45:220
193562799231711,2303cyclictest2038741-21kworker/3:1+events00:34:423
193562799231512,2301cyclictest1960316-21kworker/3:2+events20:40:083
193561799231511,2300cyclictest1997075-21kworker/0:1+events22:27:250
193561799231312,2298cyclictest2025818-21kworker/0:2+events23:53:430
193561799231112,2295cyclictest2041917-21kworker/0:1+events00:39:140
193561799231011,2295cyclictest1963547-21kworker/0:1+events20:38:570
193561799230812,2293cyclictest1978034-21kworker/0:0+events21:21:150
193561799230712,2292cyclictest1966123-21kworker/0:0+events20:41:390
193561799230610,2292cyclictest2025818-21kworker/0:2+events00:12:510
193561999230511,2291cyclictest1963370-21kworker/1:0+events20:39:221
193561799230512,2290cyclictest1957013-21kworker/0:2+events20:12:590
193562799229311,2279cyclictest1947326-21kworker/3:2+events19:44:483
193562399229111,2276cyclictest2016058-21kworker/2:0+events23:33:582
193562799228812,2272cyclictest1943844-21kworker/3:2+events19:36:533
19356279922869,2274cyclictest2032200-21kworker/3:0+events00:11:183
193562799228110,2267cyclictest1985914-21kworker/3:2+events21:46:103
193562399228111,2266cyclictest1989207-21kworker/2:0+events21:57:292
193561799227510,2262cyclictest2008259-21kworker/0:2+events22:53:360
193562399227411,2260cyclictest2024213-21kworker/2:2+events00:18:112
19356239922736,2264cyclictest1965148-21kworker/2:0+events20:50:262
193562399227111,2256cyclictest1974741-21kworker/2:2+events21:17:272
193561999227111,2257cyclictest1992371-21kworker/1:2+events22:09:451
193562399227011,2256cyclictest2037366-21kworker/2:3+events00:30:282
193562799226911,2255cyclictest1952192-21kworker/3:0+events20:17:273
19356179922699,2257cyclictest1988906-21kworker/0:1+events22:07:050
193562399226811,2254cyclictest1950179-21kworker/2:2+events20:04:342
193562399226711,2253cyclictest2039573-21kworker/2:0+events00:38:042
193561999226611,2252cyclictest2016267-21kworker/1:1+events23:19:571
193561999226510,2252cyclictest1985731-21kworker/1:0+events22:01:171
193561799226311,2249cyclictest2016440-21kworker/0:2+events23:26:500
193562399226211,2247cyclictest1999972-21kworker/2:1+events22:26:382
193561999226211,2247cyclictest1964965-21kworker/1:1+events20:40:521
193562799226111,2247cyclictest1960316-21kworker/3:2+events20:26:533
193562399226111,2247cyclictest1981311-21kworker/2:0+events21:43:502
193561799225411,2241cyclictest1957013-21kworker/0:2+events21:25:010
193561799225212,2237cyclictest2016440-21kworker/0:2+events23:22:170
193562799224311,2228cyclictest2032200-21kworker/3:0+events00:06:193
193562399223810,2225cyclictest1963307-21kworker/2:1+events20:35:122
193561799223811,2224cyclictest1943878-21kworker/0:1+events20:01:120
193562399223711,2223cyclictest2034178-21kworker/2:0+events00:23:362
19356279922355,2226cyclictest1952192-21kworker/3:0+events20:23:293
19356279922347,2224cyclictest2006661-21kworker/3:0+events22:47:553
193562799223411,2219cyclictest1940631-21kworker/3:2+events19:22:463
193562399223411,2220cyclictest1950179-21kworker/2:2+events20:12:362
193562399223310,2220cyclictest1974741-21kworker/2:2+events21:13:242
193562799223211,2218cyclictest1984251-21kworker/3:0+events21:43:043
193562799223210,2219cyclictest1960316-21kworker/3:2+events20:37:043
193562799223111,2217cyclictest2011605-21kworker/3:2+events23:06:353
193562799223111,2217cyclictest2009920-21kworker/3:0+events23:12:213
193562799223111,2217cyclictest1949021-21kworker/3:1+events19:49:443
193562799223110,2217cyclictest1974457-21kworker/3:2+events21:11:063
193562399223111,2216cyclictest2026117-21kworker/2:0+events23:52:562
193562799223011,2217cyclictest1960316-21kworker/3:2+events20:45:523
193562799222911,2215cyclictest2009920-21kworker/3:0+events23:00:283
193562799222910,2215cyclictest2018015-21kworker/3:3+events23:36:353
193562399222911,2215cyclictest2013148-21kworker/2:2+events23:11:572
193562399222910,2216cyclictest1993826-21kworker/2:2+events22:30:272
193562399222910,2216cyclictest1933576-21kworker/2:1+events19:31:372
193561799222911,2215cyclictest2011361-21kworker/0:0+events23:05:260
193562799222711,2213cyclictest1969865-21kworker/3:0+events21:00:503
193562399222711,2213cyclictest1957216-21kworker/2:0+events20:15:372
193562399222710,2214cyclictest1977881-21kworker/2:1+events21:24:162
19356279922267,2216cyclictest2037105-21kworker/3:2+events00:28:093
193562399222611,2211cyclictest2017686-21kworker/2:2+events23:25:422
193562399222610,2213cyclictest1933576-21kworker/2:1+events19:27:202
193562799222510,2212cyclictest1995802-21kworker/3:2+events22:27:023
193562399222510,2212cyclictest1963307-21kworker/2:1+events20:44:222
193562399222510,2212cyclictest1943937-21kworker/2:0+events19:38:012
193562399222510,2211cyclictest2001840-21kworker/2:0+events22:35:232
193562399222410,2210cyclictest1945562-21kworker/2:1+events19:50:312
193562799222311,2208cyclictest1982662-21kworker/3:2+events21:36:343
193562399222311,2209cyclictest1929145-21kworker/2:0+events19:23:092
193562399222311,2208cyclictest1984977-21kworker/2:2+events21:54:522
193562399222310,2210cyclictest2009768-21kworker/2:1+events23:16:102
193562399222111,2207cyclictest2024213-21kworker/2:2+events00:08:362
193562399222111,2207cyclictest1965148-21kworker/2:0+events20:47:482
193562399222110,2208cyclictest2001840-21kworker/2:0+events22:49:042
193561999221611,2201cyclictest2000195-21kworker/1:0+events22:32:201
19356239922156,2206cyclictest2016058-21kworker/2:0+events23:21:302
193561999220911,2195cyclictest2035779-21kworker/1:2+events00:28:321
19356279922079,2194cyclictest1935380-21kworker/3:0+events19:26:343
193562399220010,2187cyclictest1972973-21kworker/2:1+events21:08:062
193561799219811,2183cyclictest1995217-21kworker/0:2+events22:19:260
19356199921849,2172cyclictest2000195-21kworker/1:0+events22:36:331
193562799217611,2162cyclictest2026185-21kworker/3:3+events23:54:263
193561999217611,2161cyclictest1982860-21kworker/1:2+events21:36:571
193561999217311,2158cyclictest2030929-21kworker/1:0+events00:19:201
19356199921627,2152cyclictest2040166-21kworker/1:0+events00:36:351
193561999215711,2143cyclictest1995360-21kworker/1:1+events22:24:441
193561799215411,2140cyclictest2003147-21kworker/0:2+events22:37:180
19356239921538,2142cyclictest1958816-21kworker/2:2+events20:21:552
193562799214910,2135cyclictest1992282-21kworker/3:0+events22:11:133
193562399214910,2137cyclictest1989207-21kworker/2:0+events22:10:072
193561999214911,2135cyclictest1982860-21kworker/1:2+events21:45:461
193561799214811,2134cyclictest2022804-21kworker/0:0+events23:42:150
19356199921419,2129cyclictest1940356-21kworker/1:0+events19:21:381
193561999213811,2124cyclictest1947569-21kworker/1:2+events20:22:421
193561799213810,2125cyclictest1997075-21kworker/0:1+events22:40:420
193561999213611,2122cyclictest1985731-21kworker/1:0+events21:59:011
193562399213010,2117cyclictest1984977-21kworker/2:2+events21:48:472
193561999213012,2115cyclictest2017924-21kworker/1:2+events23:34:201
193561999213011,2116cyclictest1947569-21kworker/1:2+events20:26:301
193561999212911,2115cyclictest1947569-21kworker/1:2+events20:08:501
193561999212811,2115cyclictest2027482-21kworker/1:2+events00:02:551
193561999212711,2113cyclictest1995360-21kworker/1:1+events22:17:581
193561999212711,2113cyclictest1955333-21kworker/1:1+events20:13:231
193561999212511,2111cyclictest1950408-21kworker/1:1+events19:54:181
193561799211911,2105cyclictest2032560-21kworker/0:0+events00:20:530
193561799211911,2105cyclictest1943878-21kworker/0:1+events19:43:180
193561799211811,2104cyclictest2008259-21kworker/0:2+events22:55:280
19356199921178,2106cyclictest1942202-21kworker/1:2+events19:36:061
193561999211710,2104cyclictest1933665-21kworker/1:2+events19:17:051
193561799211711,2103cyclictest1940604-21kworker/0:2+events19:22:020
193561999211610,2103cyclictest2022713-21kworker/1:0+events23:44:321
193561799211511,2102cyclictest1936884-21kworker/0:0+events19:35:010
193561799211411,2100cyclictest1957013-21kworker/0:2+events20:28:450
193561799211410,2101cyclictest1957013-21kworker/0:2+events20:20:260
193561999211110,2098cyclictest1969925-21kworker/1:2+events20:56:141
193561799211111,2096cyclictest2025818-21kworker/0:2+events23:57:080
19356179921109,2098cyclictest1995217-21kworker/0:2+events22:22:040
193561799211010,2097cyclictest2016440-21kworker/0:2+events23:36:130
193562399210810,2095cyclictest2019467-21kworker/2:1+events23:35:512
193561999210811,2094cyclictest2011393-21kworker/1:2+events23:08:081
193561799210811,2093cyclictest1955146-21kworker/0:0+events20:16:180
193561799210810,2095cyclictest2025818-21kworker/0:2+events00:07:290
193561799210810,2095cyclictest1966123-21kworker/0:0+events20:53:330
193561799210711,2093cyclictest2035377-21kworker/0:1+events00:26:170
193561799210611,2092cyclictest1955146-21kworker/0:0+events20:07:400
19356239921056,2095cyclictest1929145-21kworker/2:0+events19:18:372
193561799210511,2091cyclictest1947386-21kworker/0:2+events19:47:270
193561799210511,2090cyclictest2025818-21kworker/0:2+events00:03:410
193562799210410,2091cyclictest2004797-21kworker/3:2+events22:57:473
193561999210411,2090cyclictest2035779-21kworker/1:2+events00:31:151
193561799210410,2090cyclictest1957013-21kworker/0:2+events20:47:250
193561799210311,2089cyclictest1943878-21kworker/0:1+events19:58:060
193561799210311,2088cyclictest2038709-21kworker/0:0+events00:33:100
193561799210210,2088cyclictest2020947-21kworker/0:1+events23:34:420
193562399210111,2087cyclictest2028935-21kworker/2:1+events00:10:322
19356179921018,2090cyclictest1973095-21kworker/0:0+events21:06:130
193561999209910,2086cyclictest1968289-21kworker/1:0+events21:32:211
193561999209711,2081cyclictest2014664-21kworker/1:0+events23:24:331
19356199920969,2084cyclictest2000195-21kworker/1:0+events23:03:301
19356199920938,2082cyclictest1964965-21kworker/1:1+events20:46:161
193561999209211,2079cyclictest2020771-21kworker/1:1+events23:35:061
193561799208910,2076cyclictest1971318-21kworker/0:1+events21:01:330
193562799208710,2074cyclictest1935380-21kworker/3:0+events19:15:123
193561999208711,2073cyclictest2014664-21kworker/1:0+events23:27:371
193561799208711,2073cyclictest1957013-21kworker/0:2+events20:57:450
193562399208310,2070cyclictest1929145-21kworker/2:0+events19:14:502
19356279920719,2058cyclictest1988996-21kworker/3:1+events21:57:523
193562799206810,2055cyclictest1933781-21kworker/3:2+events19:12:553
19356239920659,2054cyclictest1974741-21kworker/2:2+events21:30:012
193561799206210,2049cyclictest1984435-21kworker/0:1+events21:43:260
193561799205811,2044cyclictest1936884-21kworker/0:0+events19:32:220
19356279920499,2037cyclictest1992282-21kworker/3:0+events22:23:573
193562399200310,1990cyclictest1989207-21kworker/2:0+events22:02:512
19356199920007,1990cyclictest1935263-21kworker/1:0+events19:12:091
193561799199710,1984cyclictest2006614-21kworker/0:1+events23:14:160
193561799198210,1969cyclictest2014726-21kworker/0:0+events23:15:240
19356179919629,1950cyclictest1982708-21kworker/0:0+events21:33:300
19356179919598,1948cyclictest1933546-21kworker/0:1+events19:19:010
193561999195710,1944cyclictest1945648-21kworker/1:1+events19:44:021
19356179919578,1946cyclictest1933546-21kworker/0:1+events19:12:320
19356179919466,1937cyclictest2032560-21kworker/0:0+events00:15:530
19356179918808,1869cyclictest1957013-21kworker/0:2+events20:34:270
19352422156113,24sleep30-21swapper/319:07:363
19350642148102,41sleep00-21swapper/019:05:210
19352892143113,25sleep10-21swapper/119:08:121
19354212141105,31sleep20-21swapper/219:09:522
1935623993024,4cyclictest593-21dbus-daemon20:00:002
193561999291,12cyclictest2005066-21apt-get22:45:021
1935627992317,4cyclictest2024818-21/usr/sbin/munin23:45:183
1935623991712,3cyclictest2005263-21latency_hist22:45:002
193562399161,11cyclictest1984502-21munin-run21:40:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional