You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Fri May 02, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191927499333216,3311cyclictest2004146-21kworker/3:1+events23:40:173
191926299317916,3160cyclictest1922561-21kworker/0:0+events19:25:190
191926299306214,3042cyclictest1999446-21kworker/0:0+events23:20:130
191926299282314,2804cyclictest1994879-21kworker/0:2+events23:10:200
191927099279013,2773cyclictest1927425-21kworker/2:1+events19:50:212
191926699273713,2720cyclictest1964517-21kworker/1:1+events21:45:191
191926299267913,2663cyclictest1940625-21kworker/0:0+events20:30:180
191927099266713,2650cyclictest1959920-21kworker/2:2+events21:25:202
191926699262913,2613cyclictest1939116-21kworker/1:1+events20:25:191
191927099262813,2611cyclictest1927425-21kworker/2:1+events19:35:202
19192629925746,2564cyclictest1989882-21kworker/0:2+events22:50:150
191927499257312,2557cyclictest1947154-21kworker/3:0+events20:56:363
191926299255412,2538cyclictest1937136-21kworker/0:1+events20:04:000
19192709925357,2525cyclictest1909012-21kworker/2:1+events19:20:432
191927499253012,2514cyclictest1920728-21kworker/3:2+events19:28:243
19192669925289,2515cyclictest1945554-21kworker/1:0+events20:31:501
191927499252312,2508cyclictest1985187-21kworker/3:1+events22:37:243
191927499250612,2491cyclictest1937317-21kworker/3:2+events20:16:333
191927499249712,2481cyclictest1933804-21kworker/3:2+events19:53:003
191927499249612,2480cyclictest1947154-21kworker/3:0+events20:45:563
191927099249512,2481cyclictest1972825-21kworker/2:2+events22:05:082
191926699249512,2479cyclictest1928914-21kworker/1:2+events19:39:141
191927499249412,2479cyclictest2001388-21kworker/3:2+events23:27:293
191927499249312,2477cyclictest1980422-21kworker/3:0+events22:25:123
191927099249312,2477cyclictest1953252-21kworker/2:2+events20:53:332
191926699249211,2477cyclictest1961292-21kworker/1:0+events21:34:261
191927099249112,2475cyclictest1933953-21kworker/2:0+events20:12:442
191927099249012,2474cyclictest1972825-21kworker/2:2+events22:49:502
191927099249011,2476cyclictest1999685-21kworker/2:1+events23:20:382
191926299249011,2475cyclictest2004442-21kworker/0:0+events23:46:230
191926299248912,2473cyclictest2023077-21kworker/0:1+events00:31:580
19192709924889,2473cyclictest1959920-21kworker/2:2+events21:21:092
191927499248711,2472cyclictest1955058-21kworker/3:2+events21:01:353
191926299248710,2473cyclictest1994879-21kworker/0:2+events23:27:500
191927099248611,2471cyclictest2018928-21kworker/2:0+events00:21:112
191927099248611,2471cyclictest1945602-21kworker/2:2+events20:39:512
191926299248612,2470cyclictest1943972-21kworker/0:2+events20:47:290
191926299248610,2472cyclictest1922561-21kworker/0:0+events19:31:060
191927499248512,2470cyclictest1980422-21kworker/3:0+events22:58:333
191926699248510,2471cyclictest1915906-21kworker/1:0+events19:28:471
191927499248411,2469cyclictest1967917-21kworker/3:1+events21:57:063
191926299248412,2468cyclictest1956596-21kworker/0:1+events21:20:450
191926299248411,2469cyclictest1940625-21kworker/0:0+events20:13:290
191927499248212,2467cyclictest1929004-21kworker/3:2+events19:42:393
191927099248112,2465cyclictest1933953-21kworker/2:0+events20:29:312
19192669924817,2471cyclictest1925725-21kworker/1:1+events19:33:021
191927099248012,2465cyclictest2002639-21kworker/2:0+events23:56:102
191926699248012,2465cyclictest1989941-21kworker/1:0+events22:51:221
191926699248012,2464cyclictest1947193-21kworker/1:1+events20:37:571
191926299248012,2464cyclictest1994879-21kworker/0:2+events23:08:040
191926299248012,2464cyclictest1928823-21kworker/0:2+events19:55:180
191926699247912,2464cyclictest1932468-21kworker/1:2+events19:57:341
191926699247911,2465cyclictest2020672-21kworker/1:0+events00:30:511
191926699247612,2461cyclictest2004181-21kworker/1:1+events23:50:531
191926699247611,2461cyclictest2010847-21kworker/1:2+events00:04:511
191927099247512,2460cyclictest1996478-21kworker/2:1+events23:09:562
191926699247512,2460cyclictest1920400-21kworker/1:2+events19:14:421
19192629924736,2464cyclictest1977290-21kworker/0:2+events22:11:330
191926299247312,2459cyclictest1940625-21kworker/0:0+events20:23:460
19192709924729,2460cyclictest1950487-21kworker/2:0+events20:47:062
191926699247011,2455cyclictest2005772-21kworker/1:0+events23:39:311
191926699246711,2452cyclictest1977379-21kworker/1:0+events22:26:461
191927099246410,2450cyclictest2014491-21kworker/2:2+events00:06:242
191927099246112,2447cyclictest1962736-21kworker/2:1+events21:35:332
191927099246012,2445cyclictest1958290-21kworker/2:1+events21:10:492
191927099245911,2444cyclictest1972825-21kworker/2:2+events22:34:212
191927099245711,2442cyclictest2022214-21kworker/2:1+events00:32:432
191927099245710,2443cyclictest2022214-21kworker/2:1+events00:36:352
191926699245712,2441cyclictest1993172-21kworker/1:2+events23:06:081
191926299245610,2442cyclictest1962705-21kworker/0:0+events22:42:430
19192629924549,2441cyclictest2012430-21kworker/0:0+events23:58:510
191926299245411,2439cyclictest1962705-21kworker/0:0+events21:58:150
191926299245212,2437cyclictest2007575-21kworker/0:2+events23:44:520
191926299245212,2436cyclictest1962705-21kworker/0:0+events22:04:450
191926299245211,2438cyclictest1937136-21kworker/0:1+events20:09:200
191927099245111,2436cyclictest1954912-21kworker/2:1+events21:00:472
191926699244311,2429cyclictest1915906-21kworker/1:0+events19:47:161
191926699242312,2407cyclictest1969893-21kworker/1:0+events21:50:161
191926699241410,2400cyclictest1980656-21kworker/1:1+events23:00:461
19192629924119,2398cyclictest1965968-21kworker/0:1+events21:34:030
191927499241010,2396cyclictest2019227-21kworker/3:0+events00:20:483
191927099239912,2384cyclictest2002639-21kworker/2:0+events23:39:542
191927499239712,2382cyclictest1943849-21kworker/3:1+events20:29:093
191927099239112,2376cyclictest2014491-21kworker/2:2+events00:16:162
191927499238712,2371cyclictest1980422-21kworker/3:0+events23:35:193
191927499238412,2368cyclictest2020925-21kworker/3:1+events00:26:343
191926299238412,2370cyclictest1975662-21kworker/0:1+events22:05:540
191927499236612,2351cyclictest1985187-21kworker/3:1+events22:33:363
19192709923569,2344cyclictest1990059-21kworker/2:0+events23:03:262
191926699235612,2341cyclictest1964517-21kworker/1:1+events21:39:201
191927099235110,2337cyclictest1932198-21kworker/2:2+events19:47:392
191927099235010,2337cyclictest1972825-21kworker/2:2+events23:31:342
191927099234912,2333cyclictest1956628-21kworker/2:0+events21:18:022
191926299234312,2329cyclictest1930742-21kworker/0:0+events19:45:210
191926699234212,2326cyclictest1996424-21kworker/1:1+events23:14:081
19192629923319,2318cyclictest1943972-21kworker/0:2+events20:38:420
191927099233011,2315cyclictest1948782-21kworker/2:1+events20:42:542
191926699232711,2313cyclictest1947193-21kworker/1:1+events21:01:581
191926299232711,2312cyclictest1932331-21kworker/0:1+events19:52:150
191926299232710,2314cyclictest1951861-21kworker/0:0+events20:53:560
191927499232511,2311cyclictest2017331-21kworker/3:2+events00:33:303
191927499232511,2311cyclictest1969541-21kworker/3:2+events21:44:553
191927499232412,2309cyclictest2009351-21kworker/3:2+events00:02:403
191926299232010,2306cyclictest1962705-21kworker/0:0+events21:43:060
191926699231911,2305cyclictest1932468-21kworker/1:2+events20:05:301
191927499231811,2304cyclictest1947154-21kworker/3:0+events20:34:553
191926699231711,2302cyclictest1983876-21kworker/1:2+events22:33:141
191927499230611,2292cyclictest1997855-21kworker/3:2+events23:13:453
191927099230411,2290cyclictest1929037-21kworker/2:0+events19:44:342
191927099230312,2288cyclictest1933953-21kworker/2:0+events20:23:002
191926299230112,2285cyclictest2020644-21kworker/0:2+events00:26:580
19192669923008,2289cyclictest2014487-21kworker/1:0+events00:10:351
191927099229611,2282cyclictest1978918-21kworker/2:1+events22:14:132
191927099228911,2274cyclictest1972825-21kworker/2:2+events22:36:382
191926299228912,2274cyclictest1927153-21kworker/0:1+events19:37:170
19192629922879,2274cyclictest1965968-21kworker/0:1+events21:38:110
191927099228310,2269cyclictest1933953-21kworker/2:0+events20:18:042
191927499227812,2263cyclictest1950079-21kworker/3:2+events20:41:473
191927499227711,2262cyclictest1950079-21kworker/3:2+events20:50:283
191927499227211,2258cyclictest1958558-21kworker/3:1+events21:13:503
191926699227110,2257cyclictest1980656-21kworker/1:1+events22:44:121
191926299227111,2256cyclictest1986968-21kworker/0:1+events22:39:410
191927099226911,2254cyclictest2002639-21kworker/2:0+events23:28:342
191927499226811,2254cyclictest1947154-21kworker/3:0+events21:06:103
191927099226811,2254cyclictest2007939-21kworker/2:1+events23:47:332
191927099226811,2253cyclictest1980598-21kworker/2:0+events22:23:162
191927099226710,2254cyclictest1925575-21kworker/2:2+events19:27:382
191927499226611,2252cyclictest1972438-21kworker/3:0+events21:51:483
191927099226611,2252cyclictest1945602-21kworker/2:2+events20:33:222
191927099226610,2252cyclictest1925575-21kworker/2:2+events19:34:342
191927099226610,2251cyclictest1990059-21kworker/2:0+events22:53:392
19192749922659,2253cyclictest1937317-21kworker/3:2+events20:05:073
191927499226511,2251cyclictest1925666-21kworker/3:0+events19:39:373
191926299226511,2250cyclictest1986968-21kworker/0:1+events23:00:240
191926299226510,2251cyclictest1962705-21kworker/0:0+events22:22:550
191927099226411,2251cyclictest1971135-21kworker/2:0+events22:00:092
191927099226411,2250cyclictest1986785-21kworker/2:1+events22:44:342
191927099226410,2250cyclictest1932198-21kworker/2:2+events20:01:012
19192669922645,2255cyclictest1956477-21kworker/1:0+events21:08:531
191926299226411,2251cyclictest1953462-21kworker/0:2+events20:55:040
191926299226410,2251cyclictest1969480-21kworker/0:2+events21:46:270
19192709922638,2252cyclictest1990059-21kworker/2:0+events22:57:042
191927099226311,2249cyclictest1967830-21kworker/2:0+events21:42:202
191927099226311,2248cyclictest1956628-21kworker/2:0+events21:06:572
191927099226310,2250cyclictest1933953-21kworker/2:0+events19:55:422
191926699226310,2250cyclictest1948908-21kworker/1:0+events20:44:481
191927499226211,2248cyclictest1920728-21kworker/3:2+events19:31:293
191927499226211,2247cyclictest1937317-21kworker/3:2+events20:11:153
191927099226211,2248cyclictest1962736-21kworker/2:1+events21:46:522
191927099226210,2249cyclictest2010827-21kworker/2:2+events23:53:552
191927099226210,2249cyclictest1998082-21kworker/2:0+events23:15:392
191927099226210,2248cyclictest1972825-21kworker/2:2+events23:12:362
191927499226111,2248cyclictest2009351-21kworker/3:2+events23:55:033
191927099226110,2247cyclictest1971135-21kworker/2:0+events21:57:522
19192669922619,2248cyclictest1977379-21kworker/1:0+events22:19:061
191927099226011,2246cyclictest2017068-21kworker/2:1+events00:12:522
191927099226011,2246cyclictest1954912-21kworker/2:1+events20:58:532
191927099226011,2245cyclictest1962736-21kworker/2:1+events21:31:462
191926299226011,2247cyclictest1994879-21kworker/0:2+events23:16:500
191927099225811,2243cyclictest1972825-21kworker/2:2+events22:28:152
191926699225711,2244cyclictest2007659-21kworker/1:2+events23:42:571
191926699225711,2243cyclictest1942288-21kworker/1:0+events20:19:591
191926699225710,2244cyclictest2004181-21kworker/1:1+events23:47:121
191927099225610,2243cyclictest2018928-21kworker/2:0+events00:27:422
191926699225611,2242cyclictest1980656-21kworker/1:1+events22:57:261
19192669922559,2242cyclictest2017037-21kworker/1:1+events00:17:461
191926699225511,2241cyclictest1947193-21kworker/1:1+events20:57:001
191926299225510,2241cyclictest1986968-21kworker/0:1+events22:55:580
191926299225510,2241cyclictest1962705-21kworker/0:0+events21:52:540
191926699225411,2240cyclictest1967979-21kworker/1:2+events21:44:131
19192669922539,2241cyclictest2004181-21kworker/1:1+events23:33:051
19192669922539,2241cyclictest1972451-21kworker/1:2+events21:58:381
191926699225311,2239cyclictest1958103-21kworker/1:2+events21:11:111
191926699225310,2240cyclictest1980656-21kworker/1:1+events22:22:321
191927499225211,2238cyclictest1994668-21kworker/3:2+events23:05:243
19192669922529,2239cyclictest1964517-21kworker/1:1+events21:29:071
19192669922527,2242cyclictest1974115-21kworker/1:0+events22:00:551
191926699225210,2238cyclictest1998051-21kworker/1:2+events23:28:111
19192749922509,2238cyclictest1967917-21kworker/3:1+events22:00:323
19192669922507,2240cyclictest1932468-21kworker/1:2+events20:01:231
191926699225011,2236cyclictest1958103-21kworker/1:2+events21:16:291
191926699225010,2237cyclictest1915906-21kworker/1:0+events19:16:141
191927499224911,2235cyclictest1947154-21kworker/3:0+events20:37:333
19192669922499,2237cyclictest1928914-21kworker/1:2+events19:41:541
191926699224911,2235cyclictest1975763-21kworker/1:1+events22:06:161
191927499224710,2234cyclictest1935664-21kworker/3:0+events20:00:143
191926699224710,2234cyclictest2017037-21kworker/1:1+events00:25:241
19192669922456,2235cyclictest1998051-21kworker/1:2+events23:22:081
191926699224511,2231cyclictest1996424-21kworker/1:1+events23:19:061
19192629922459,2232cyclictest1943972-21kworker/0:2+events20:27:360
191926299224311,2229cyclictest2010799-21kworker/0:1+events00:18:090
191926699223910,2226cyclictest2019051-21kworker/1:2+events00:21:561
191926699223910,2225cyclictest1980656-21kworker/1:1+events22:46:251
191927499223811,2223cyclictest1997855-21kworker/3:2+events23:16:263
191927499223310,2219cyclictest1924003-21kworker/3:1+events19:21:543
191926299223210,2218cyclictest1943972-21kworker/0:2+events20:43:180
19192709922319,2218cyclictest1933953-21kworker/2:0+events20:07:492
191927499222911,2215cyclictest2007753-21kworker/3:0+events23:46:003
191926299222911,2215cyclictest2001215-21kworker/0:1+events23:32:410
19192629922289,2215cyclictest1962705-21kworker/0:0+events21:26:270
19192709922278,2216cyclictest1921814-21kworker/2:2+events19:16:382
19192669922277,2217cyclictest1977379-21kworker/1:0+events22:13:061
191926299222711,2212cyclictest1962705-21kworker/0:0+events22:27:090
19192629922269,2214cyclictest1962705-21kworker/0:0+events22:32:510
191926299222611,2211cyclictest2017303-21kworker/0:0+events00:22:430
191926299222611,2211cyclictest2007575-21kworker/0:2+events23:54:170
191926699222510,2212cyclictest1953213-21kworker/1:0+events20:54:431
191926299222411,2209cyclictest2010799-21kworker/0:1+events00:09:270
191926299222010,2207cyclictest1951861-21kworker/0:0+events21:03:300
19192709922147,2203cyclictest1917546-21kworker/2:0+events19:13:552
191926299220811,2195cyclictest1956596-21kworker/0:1+events21:05:020
191926299220810,2194cyclictest1920492-21kworker/0:1+events19:23:040
191926299219710,2184cyclictest1986968-21kworker/0:1+events22:49:290
191926299219511,2180cyclictest1939026-21kworker/0:2+events20:15:250
19192749921939,2180cyclictest1942194-21kworker/3:0+events20:22:133
19192629921939,2181cyclictest2010799-21kworker/0:1+events00:03:250
191926299219211,2178cyclictest2023077-21kworker/0:1+events00:35:500
191926699219110,2178cyclictest2022276-21kworker/1:2+events00:36:581
191927499216112,2146cyclictest2015646-21kworker/3:1+events00:18:323
191927499215510,2141cyclictest1925666-21kworker/3:0+events19:46:533
191926699214111,2127cyclictest1951630-21kworker/1:2+events20:48:151
191927499213511,2121cyclictest2023853-21kworker/3:0+events00:39:353
191927099213110,2117cyclictest2002639-21kworker/2:0+events23:43:412
19192709921230,2120cyclictest1972825-21kworker/2:2+events22:16:292
19192749921209,2108cyclictest1919030-21kworker/3:0+events19:19:363
191926299211610,2103cyclictest1956596-21kworker/0:1+events21:16:080
191926699211410,2099cyclictest1939116-21kworker/1:1+events20:23:231
19192629921139,2099cyclictest2004442-21kworker/0:0+events23:35:420
19192629921109,2098cyclictest1956596-21kworker/0:1+events21:13:290
19192749921085,2100cyclictest1947154-21kworker/3:0+events21:27:373
19192749921069,2094cyclictest1980422-21kworker/3:0+events23:01:103
191927499210611,2091cyclictest1947154-21kworker/3:0+events21:32:543
191927499210610,2093cyclictest1947154-21kworker/3:0+events21:38:333
19192669921068,2094cyclictest1915906-21kworker/1:0+events19:24:121
191927099210210,2089cyclictest1962736-21kworker/2:1+events21:51:262
191927499210111,2087cyclictest1962765-21kworker/3:2+events21:24:103
191927499210111,2087cyclictest1958558-21kworker/3:1+events21:19:583
191927499210110,2088cyclictest2014050-21kworker/3:0+events00:12:053
191927499210110,2088cyclictest1980422-21kworker/3:0+events22:19:303
19192629921019,2088cyclictest2010799-21kworker/0:1+events00:11:190
191927499210011,2086cyclictest2015646-21kworker/3:1+events00:09:493
191927499210011,2086cyclictest1969541-21kworker/3:2+events21:47:363
191926299210010,2087cyclictest1920492-21kworker/0:1+events19:18:050
19192669920989,2086cyclictest2009238-21kworker/1:0+events23:55:461
191926699209810,2085cyclictest1937197-21kworker/1:0+events20:10:301
19192669920978,2086cyclictest1930880-21kworker/1:1+events19:53:241
191926699209710,2084cyclictest1959709-21kworker/1:1+events21:21:521
191927499209610,2082cyclictest2007753-21kworker/3:0+events23:52:453
191927499209510,2082cyclictest1980422-21kworker/3:0+events23:31:123
191926699209410,2081cyclictest2010847-21kworker/1:2+events00:06:021
19192749920938,2082cyclictest1977467-21kworker/3:1+events22:11:573
191927499209011,2076cyclictest1931157-21kworker/3:1+events19:57:123
19192629920893,2082cyclictest1920492-21kworker/0:1+events19:13:080
191926299207810,2064cyclictest1928823-21kworker/0:2+events19:43:010
191927499202410,2011cyclictest1919030-21kworker/3:0+events19:11:163
191927499195110,1937cyclictest1990089-21kworker/3:2+events22:50:353
19192749919503,1944cyclictest1982044-21kworker/3:2+events22:22:093
19192749919408,1929cyclictest1999652-21kworker/3:1+events23:23:163
19192749918968,1885cyclictest1985187-21kworker/3:1+events22:45:173
19192669918699,1857cyclictest1985468-21kworker/1:0+events22:35:521
19192749918672,1862cyclictest1975724-21kworker/3:2+events22:09:173
19187302156113,25sleep20-21swapper/219:05:322
19188612155113,24sleep30-21swapper/319:07:133
19190352143112,27sleep10-21swapper/119:09:281
19177552138107,26sleep00-21swapper/019:05:100
191926299176,7cyclictest638-21dbus-daemon22:15:290
191927499140,2cyclictest1987337-21/usr/sbin/munin22:40:213
191927099141,10cyclictest2014262-21munin-run00:04:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional