You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 06:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Mon May 04, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
185900899436021,4334cyclictest1945491-21kworker/0:1+events23:40:190
185901299321216,3192cyclictest1915543-21kworker/1:2+events22:20:171
185901299317015,3150cyclictest1922849-21kworker/1:1+events22:30:131
185900899312615,3105cyclictest1873517-21kworker/0:1+events20:00:170
185900899303113,3014cyclictest1932643-21kworker/0:1+events23:10:380
185900899296212,2945cyclictest1950319-21kworker/0:0+events23:55:120
185901899284511,2830cyclictest1892588-21kworker/3:1+events21:05:173
185901299280413,2788cyclictest1897411-21kworker/1:1+events21:15:351
185901299280413,2787cyclictest1876415-21kworker/1:0+events20:01:281
185901499280010,2786cyclictest1924839-21kworker/2:2+events22:45:482
185901499279912,2783cyclictest1879701-21kworker/2:0+events20:20:472
185900899279716,2778cyclictest1862172-21kworker/0:2+events19:25:180
18590149927752,2769cyclictest1960367-21kworker/2:2+events00:25:142
185901499277513,2758cyclictest1868565-21kworker/2:2+events19:42:252
185901499276213,2744cyclictest1879701-21kworker/2:0+events20:30:182
185901299275913,2742cyclictest1892302-21kworker/1:0+events20:53:071
185901299274810,2734cyclictest1940882-21kworker/1:1+events23:26:131
185901899273613,2718cyclictest1916583-21kworker/3:1+events22:10:183
185900899273413,2716cyclictest1898862-21kworker/0:2+events21:15:110
185901499272213,2705cyclictest1910540-21kworker/2:0+events21:56:552
185900899271013,2693cyclictest1898862-21kworker/0:2+events21:12:060
185901899266013,2644cyclictest1870252-21kworker/3:1+events19:58:233
185901899265213,2636cyclictest1887612-21kworker/3:0+events21:01:313
185901499262911,2614cyclictest1907333-21kworker/2:1+events21:53:092
185901899262313,2607cyclictest1879668-21kworker/3:2+events20:15:473
185901499262013,2603cyclictest1878100-21kworker/2:2+events20:08:122
185901499261913,2602cyclictest1955404-21kworker/2:1+events00:20:182
185901899261413,2597cyclictest1887612-21kworker/3:0+events20:38:313
185901499261212,2596cyclictest1945307-21kworker/2:1+events23:41:522
185901499257512,2560cyclictest1876445-21kworker/2:1+events20:04:512
185901499257512,2559cyclictest1934276-21kworker/2:2+events23:13:392
185901499257112,2555cyclictest1868565-21kworker/2:2+events19:59:082
185901499256712,2551cyclictest1896017-21kworker/2:2+events21:14:002
185901499256512,2550cyclictest1907333-21kworker/2:1+events21:40:532
185901499256312,2547cyclictest1879701-21kworker/2:0+events20:27:382
185901499256212,2546cyclictest1876445-21kworker/2:1+events20:11:372
18590149925619,2549cyclictest1879701-21kworker/2:0+events20:41:112
185901499256110,2548cyclictest1862768-21kworker/2:0+events19:30:572
185901499256012,2544cyclictest1890850-21kworker/2:1+events20:53:512
185901299255912,2543cyclictest1897411-21kworker/1:1+events21:31:141
185901299255612,2540cyclictest1908718-21kworker/1:0+events21:49:431
185901899255411,2539cyclictest1921516-21kworker/3:0+events22:25:113
185901299255412,2539cyclictest1897411-21kworker/1:1+events21:29:431
185901299255312,2537cyclictest1951888-21kworker/1:1+events00:12:201
185901299255211,2537cyclictest1878068-21kworker/1:1+events20:26:061
185901499255012,2534cyclictest1907333-21kworker/2:1+events21:48:342
18590129925509,2537cyclictest1868627-21kworker/1:1+events19:42:011
185901299254912,2533cyclictest1879762-21kworker/1:2+events20:17:211
185901299254812,2532cyclictest1902098-21kworker/1:2+events21:24:211
185901299254812,2532cyclictest1870343-21kworker/1:0+events19:53:541
185901299254812,2532cyclictest1864140-21kworker/1:2+events19:30:341
185901299254810,2535cyclictest1934244-21kworker/1:2+events23:09:071
185901299254612,2531cyclictest1935901-21kworker/1:0+events23:19:201
185901299254412,2529cyclictest1951888-21kworker/1:1+events00:19:311
185901299253712,2521cyclictest1872006-21kworker/1:1+events19:56:321
185901499253612,2520cyclictest1924839-21kworker/2:2+events22:34:192
185901299253612,2520cyclictest1884355-21kworker/1:2+events20:43:521
185901299252912,2514cyclictest1940882-21kworker/1:1+events23:45:401
185901499252810,2515cyclictest1865353-21kworker/2:1+events19:35:122
185901299252812,2514cyclictest1943972-21kworker/1:0+events23:35:011
18590149925277,2517cyclictest1896017-21kworker/2:2+events21:29:192
185901499252712,2512cyclictest1941697-21kworker/2:0+events23:38:042
185901299252212,2507cyclictest1908718-21kworker/1:0+events22:05:171
185901899252111,2506cyclictest1944137-21kworker/3:0+events23:37:403
185901299252112,2507cyclictest1939228-21kworker/1:2+events23:30:051
185901299251912,2503cyclictest1895812-21kworker/1:2+events21:06:031
185901499251812,2503cyclictest1865353-21kworker/2:1+events19:27:312
185901499251112,2495cyclictest1915064-21kworker/2:1+events22:06:512
185901299251112,2495cyclictest1878068-21kworker/1:1+events20:07:261
185901499251011,2495cyclictest1892497-21kworker/2:2+events20:55:462
185901299250812,2493cyclictest1915543-21kworker/1:2+events22:29:031
18590089925059,2492cyclictest1888695-21kworker/0:0+events20:41:580
185900899250512,2489cyclictest1913470-21kworker/0:0+events22:02:580
185901899250312,2485cyclictest1900596-21kworker/3:2+events21:23:123
185901499250112,2486cyclictest1919896-21kworker/2:1+events22:19:312
185901499250011,2486cyclictest1924839-21kworker/2:2+events22:35:522
18590149924990,2495cyclictest1950167-21kworker/2:1+events23:57:292
185901299249612,2480cyclictest1935901-21kworker/1:0+events23:24:211
185901299249612,2480cyclictest1908718-21kworker/1:0+events21:52:241
185901299249612,2480cyclictest1886137-21kworker/1:0+events20:38:091
185901899249511,2480cyclictest1892588-21kworker/3:1+events21:13:143
185901299249512,2479cyclictest1950135-21kworker/1:2+events23:53:191
185901299249412,2479cyclictest1945603-21kworker/1:2+events23:41:281
185901299249412,2478cyclictest1881429-21kworker/1:0+events20:23:061
185901499249212,2477cyclictest1941697-21kworker/2:0+events23:29:432
185901299249212,2478cyclictest1915543-21kworker/1:2+events22:11:041
185901299249212,2476cyclictest1924716-21kworker/1:0+events22:55:231
185901299249210,2478cyclictest1928066-21kworker/1:1+events22:43:291
185901299249112,2476cyclictest1960676-21kworker/1:0+events00:32:301
185901299249112,2476cyclictest1928066-21kworker/1:1+events22:47:191
185901299249112,2476cyclictest1908718-21kworker/1:0+events22:01:281
185901299249112,2475cyclictest1884355-21kworker/1:2+events20:33:401
185900899249110,2477cyclictest1884624-21kworker/0:1+events20:32:340
18590129924909,2477cyclictest1897411-21kworker/1:1+events21:35:291
185901299249012,2474cyclictest1935901-21kworker/1:0+events23:12:301
185901899248912,2474cyclictest1877004-21kworker/3:0+events20:11:593
185901299248912,2474cyclictest1879762-21kworker/1:2+events20:14:181
185901499248812,2473cyclictest1853505-21kworker/2:2+events19:16:472
185901299248812,2474cyclictest1924716-21kworker/1:0+events22:37:481
185900899248812,2472cyclictest1890724-21kworker/0:1+events20:47:210
185901299248712,2472cyclictest1951888-21kworker/1:1+events00:06:121
185900899248712,2471cyclictest1913470-21kworker/0:0+events22:18:460
185901499248612,2471cyclictest1963671-21kworker/2:0+events00:36:192
185901299248612,2470cyclictest1911904-21kworker/1:2+events21:56:331
185901299248611,2473cyclictest1884355-21kworker/1:2+events20:45:471
185900899248612,2471cyclictest1894265-21kworker/0:3+events21:04:090
185901499248512,2470cyclictest1931040-21kworker/2:1+events23:00:492
185900899248512,2469cyclictest1883024-21kworker/0:0+events20:29:310
185900899248312,2468cyclictest1924869-21kworker/0:2+events22:33:120
185901499248212,2467cyclictest1924839-21kworker/2:2+events22:40:522
185901299248211,2468cyclictest1965214-21kworker/1:2+events00:38:141
185901299248211,2468cyclictest1931308-21kworker/1:1+events23:01:121
185900899248112,2466cyclictest1924869-21kworker/0:2+events22:35:290
185901499248012,2465cyclictest1934276-21kworker/2:2+events23:30:282
185901499248012,2464cyclictest1910540-21kworker/2:0+events22:11:292
185901499247912,2464cyclictest1853505-21kworker/2:2+events19:24:542
185901499247812,2462cyclictest1868565-21kworker/2:2+events19:48:092
185901899247712,2462cyclictest1862356-21kworker/3:2+events19:19:053
185901499247712,2462cyclictest1934276-21kworker/2:2+events23:16:192
185901499247712,2461cyclictest1871855-21kworker/2:1+events19:52:472
185900899247712,2461cyclictest1865722-21kworker/0:3+events19:35:350
18590149924769,2464cyclictest1955404-21kworker/2:1+events00:17:372
185901499247512,2460cyclictest1896017-21kworker/2:2+events21:35:522
185901299247411,2459cyclictest1895812-21kworker/1:2+events21:03:481
185901899247312,2459cyclictest1900596-21kworker/3:2+events21:30:053
185901499247312,2457cyclictest1945307-21kworker/2:1+events23:46:262
185901299247012,2455cyclictest1947301-21kworker/1:0+events23:59:241
185901299246912,2454cyclictest1959039-21kworker/1:2+events00:22:591
185901499246710,2453cyclictest1836865-21kworker/2:1+events19:14:112
185901499246411,2449cyclictest1879701-21kworker/2:0+events20:39:182
185901499246312,2449cyclictest1953770-21kworker/2:2+events00:10:032
185900899245612,2440cyclictest1903826-21kworker/0:2+events21:38:350
185901499245512,2439cyclictest1881340-21kworker/2:1+events20:19:392
185901899245312,2438cyclictest1870252-21kworker/3:1+events19:47:453
185901499244912,2434cyclictest1934276-21kworker/2:2+events23:20:302
185900899244912,2433cyclictest1918346-21kworker/0:1+events22:21:250
185900899244512,2429cyclictest1877981-21kworker/0:2+events20:24:150
185900899244211,2427cyclictest1918346-21kworker/0:1+events22:14:570
185901299243711,2423cyclictest1860463-21kworker/1:0+events19:19:281
185901499243211,2418cyclictest1962037-21kworker/2:1+events00:34:492
185900899243211,2419cyclictest1868477-21kworker/0:0+events19:40:100
185900899243011,2416cyclictest1930365-21kworker/0:0+events22:58:280
185901899242812,2412cyclictest1946900-21kworker/3:1+events23:45:173
185900899242811,2413cyclictest1873517-21kworker/0:1+events20:10:290
185901899242311,2409cyclictest1929793-21kworker/3:0+events23:07:383
185901899242211,2407cyclictest1944137-21kworker/3:0+events23:51:233
185900899242212,2407cyclictest1888695-21kworker/0:0+events20:57:170
185900899242112,2405cyclictest1942213-21kworker/0:0+events23:38:270
185901899242012,2405cyclictest1868596-21kworker/3:0+events19:37:513
185900899242012,2404cyclictest1877981-21kworker/0:2+events20:09:190
185900899241912,2404cyclictest1918346-21kworker/0:1+events22:29:500
185900899241911,2405cyclictest1886223-21kworker/0:2+events20:37:450
185900899241812,2402cyclictest1865722-21kworker/0:3+events19:48:320
185901899241512,2399cyclictest1862356-21kworker/3:2+events19:30:123
185900899241212,2396cyclictest1958792-21kworker/0:2+events00:37:040
185900899241112,2396cyclictest1930365-21kworker/0:0+events22:51:350
185901899240912,2394cyclictest1958825-21kworker/3:0+events00:30:373
185901899240912,2394cyclictest1958825-21kworker/3:0+events00:22:143
185901899240812,2392cyclictest1908754-21kworker/3:2+events21:43:113
18590089924089,2395cyclictest1947113-21kworker/0:2+events00:05:510
185900899240512,2390cyclictest1865722-21kworker/0:3+events19:50:280
185900899240412,2389cyclictest1962194-21kworker/0:1+events00:29:510
185900899240411,2389cyclictest1900498-21kworker/0:1+events21:24:450
185901899240312,2387cyclictest1889360-21kworker/3:2+events20:51:583
185900899240312,2388cyclictest1948714-21kworker/0:1+events23:50:130
185901899240212,2386cyclictest1953800-21kworker/3:2+events00:10:483
185900899240212,2387cyclictest1955074-21kworker/0:0+events00:21:270
185900899240211,2388cyclictest1934367-21kworker/0:2+events23:08:450
185900899240112,2385cyclictest1848809-21kworker/0:0+events19:20:380
185900899240111,2386cyclictest1903826-21kworker/0:2+events21:57:200
185900899240011,2386cyclictest1958792-21kworker/0:2+events00:17:120
185900899240011,2386cyclictest1930365-21kworker/0:0+events23:02:420
185901899239912,2383cyclictest1924777-21kworker/3:2+events22:36:143
185901899239911,2386cyclictest1951798-21kworker/3:0+events00:00:103
185900899239912,2384cyclictest1952173-21kworker/0:3+events00:01:140
185900899239912,2384cyclictest1913470-21kworker/0:0+events22:08:230
185901899239811,2383cyclictest1942309-21kworker/3:2+events23:28:543
185901499239812,2383cyclictest1896017-21kworker/2:2+events21:19:472
185900899239812,2384cyclictest1903826-21kworker/0:2+events21:46:390
185901899239710,2381cyclictest1932731-21kworker/3:2+events22:59:383
185900899239712,2382cyclictest1962194-21kworker/0:1+events00:31:210
185900899239711,2382cyclictest1903826-21kworker/0:2+events21:41:150
18590089923969,2384cyclictest1888695-21kworker/0:0+events20:52:430
185901899239512,2380cyclictest1921516-21kworker/3:0+events22:41:383
185900899239512,2380cyclictest1903826-21kworker/0:2+events21:30:500
185900899239512,2379cyclictest1877981-21kworker/0:2+events20:18:520
185900899239511,2381cyclictest1943882-21kworker/0:2+events23:33:510
185901899239212,2376cyclictest1940674-21kworker/3:1+events23:23:333
185901899238712,2372cyclictest1929793-21kworker/3:0+events22:52:433
185900899238211,2367cyclictest1956942-21kworker/0:1+events00:11:570
185900899237712,2361cyclictest1865722-21kworker/0:3+events19:58:450
185900899237610,2362cyclictest1924869-21kworker/0:2+events22:48:530
185900899236810,2354cyclictest1863804-21kworker/0:1+events19:34:030
185901299236011,2345cyclictest1931308-21kworker/1:1+events22:54:351
185900899235912,2344cyclictest1942213-21kworker/0:0+events23:48:190
185901499234712,2331cyclictest1931040-21kworker/2:1+events22:52:202
185901499234711,2333cyclictest1948564-21kworker/2:0+events00:04:202
185900899234711,2332cyclictest1903826-21kworker/0:2+events21:53:520
185901899234112,2327cyclictest1913679-21kworker/3:2+events22:01:043
185901499234012,2325cyclictest1916678-21kworker/2:2+events22:23:182
185901899233812,2323cyclictest1962068-21kworker/3:2+events00:36:413
185901899233712,2322cyclictest1887612-21kworker/3:0+events20:58:263
185901499233411,2320cyclictest1896017-21kworker/2:2+events21:09:032
185901899232911,2314cyclictest1889360-21kworker/3:2+events20:49:173
185901499232511,2311cyclictest1948564-21kworker/2:0+events23:51:012
185901299232512,2310cyclictest1959039-21kworker/1:2+events00:26:451
185901899232310,2310cyclictest1911992-21kworker/3:0+events21:56:093
185901899232212,2307cyclictest1936175-21kworker/3:2+events23:15:113
185901899232111,2307cyclictest1926407-21kworker/3:1+events22:46:103
185901899232012,2305cyclictest1911992-21kworker/3:0+events22:15:453
185901899231512,2299cyclictest1951798-21kworker/3:0+events00:09:403
185901899231312,2297cyclictest1870252-21kworker/3:1+events20:05:123
185901899231011,2295cyclictest1908754-21kworker/3:2+events21:52:013
185901899230912,2294cyclictest1924777-21kworker/3:2+events22:33:343
185901899230912,2294cyclictest1862356-21kworker/3:2+events19:27:553
185901899230912,2293cyclictest1903942-21kworker/3:1+events21:47:273
185901899230812,2292cyclictest1942309-21kworker/3:2+events23:31:593
185901899230612,2291cyclictest1881308-21kworker/3:1+events20:22:433
185901499229712,2281cyclictest1928125-21kworker/2:0+events22:57:412
185901899227211,2258cyclictest1887612-21kworker/3:0+events20:44:153
18590149922719,2258cyclictest1900564-21kworker/2:0+events21:20:342
185901499227110,2258cyclictest1879701-21kworker/2:0+events20:48:072
185901299227011,2255cyclictest1864140-21kworker/1:2+events19:39:451
185901299226510,2252cyclictest1951888-21kworker/1:1+events00:02:471
18590129922649,2252cyclictest1858690-21kworker/1:1+events19:21:471
185901299226310,2250cyclictest1897411-21kworker/1:1+events21:42:011
185901299226210,2249cyclictest1858690-21kworker/1:1+events19:14:331
185901299225810,2245cyclictest1864140-21kworker/1:2+events19:47:231
185901499225611,2242cyclictest1894132-21kworker/2:0+events21:00:212
185901499225310,2240cyclictest1921547-21kworker/2:0+events22:26:212
18590149922487,2238cyclictest1902189-21kworker/2:1+events21:32:462
18590089922479,2235cyclictest1932643-21kworker/0:1+events23:15:340
185901899223811,2223cyclictest1911992-21kworker/3:0+events22:07:593
185901499223111,2217cyclictest1953770-21kworker/2:2+events00:08:092
185900899222712,2212cyclictest1859500-21kworker/0:1+events19:11:100
185901499222510,2212cyclictest1915064-21kworker/2:1+events22:03:452
185900899221610,2203cyclictest1862172-21kworker/0:2+events19:17:080
185900899221510,2202cyclictest1896283-21kworker/0:1+events21:09:490
185900899220311,2188cyclictest1932643-21kworker/0:1+events23:26:580
185901899220213,2185cyclictest1950196-21kworker/3:1+events23:58:163
185900899219811,2184cyclictest1902126-21kworker/0:0+events21:28:340
185900899219711,2183cyclictest1924869-21kworker/0:2+events22:41:580
185901899219611,2182cyclictest1934484-21kworker/3:1+events23:11:463
185900899219610,2183cyclictest1932643-21kworker/0:1+events23:23:100
185901899219111,2177cyclictest1902218-21kworker/3:0+events21:26:413
18590189921861,2182cyclictest1862356-21kworker/3:2+events19:40:533
185901299215010,2137cyclictest1895812-21kworker/1:2+events21:10:341
185901899213911,2125cyclictest1892588-21kworker/3:1+events21:19:233
185901899212911,2115cyclictest1919864-21kworker/3:1+events22:23:413
185901899211511,2101cyclictest1953800-21kworker/3:2+events00:16:503
185901899211210,2098cyclictest1862356-21kworker/3:2+events19:23:443
185901899210611,2092cyclictest1883056-21kworker/3:0+events20:27:593
18590189921058,2093cyclictest1879668-21kworker/3:2+events20:34:033
185901299209910,2085cyclictest1887734-21kworker/1:1+events20:56:321
185901899208610,2073cyclictest1946900-21kworker/3:1+events23:42:393
18590189920328,2021cyclictest1929793-21kworker/3:0+events23:04:143
185901899201711,2003cyclictest1903942-21kworker/3:1+events21:37:033
185901899201410,2001cyclictest1962068-21kworker/3:2+events00:28:203
185901299199110,1978cyclictest1858690-21kworker/1:1+events19:26:471
185901899196110,1948cyclictest1871917-21kworker/3:0+events19:54:383
18590189919279,1915cyclictest1857521-21kworker/3:0+events19:10:473
18575222190160,25sleep10-21swapper/119:05:081
1858519214994,51sleep00-21swapper/019:05:470
18586792143113,25sleep20-21swapper/219:07:492
18586342139107,26sleep30-21swapper/319:07:143
1859018991711,1cyclictest191rcu_preempt20:05:003
185901299157,5cyclictest1920059-21systemctl22:20:001
1859014991411,2cyclictest1934813-21/usr/sbin/munin23:05:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional