You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 21:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Thu Jul 23, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
213366899314714,3127cyclictest2219469-21kworker/2:0+events23:45:122
213366899311115,3091cyclictest2170674-21kworker/2:1+events21:25:172
213365899285514,2836cyclictest2176613-21kworker/0:2+events21:30:130
213365899280113,2784cyclictest2172026-21kworker/0:0+events21:09:460
213366099279713,2779cyclictest2168704-21kworker/1:1+events21:00:171
213366899272013,2702cyclictest2155770-21kworker/2:1+events20:30:122
213366099272012,2704cyclictest2231304-21kworker/1:1+events00:32:491
21336689927096,2698cyclictest2227994-21kworker/2:1+events00:15:122
213366899270913,2692cyclictest2162392-21kworker/2:0+events20:57:572
213366899269913,2683cyclictest2227343-21kworker/2:2+events00:31:142
213367299269012,2674cyclictest2133149-21kworker/3:2+events19:33:443
213367299268913,2672cyclictest2162572-21kworker/3:1+events20:50:173
213365899266311,2648cyclictest2218052-21kworker/0:2+events00:05:190
213367299264013,2623cyclictest2162572-21kworker/3:1+events20:55:173
213365899261512,2600cyclictest2179872-21kworker/0:1+events21:37:270
213366899260513,2588cyclictest2194134-21kworker/2:0+events22:23:462
213367299258712,2572cyclictest2195870-21kworker/3:0+events22:45:443
213365899258512,2568cyclictest2203814-21kworker/0:2+events23:07:290
213366099258112,2566cyclictest2193987-21kworker/1:1+events22:17:181
213365899257912,2563cyclictest2228283-21kworker/0:1+events00:16:210
213367299257812,2562cyclictest2133149-21kworker/3:2+events19:47:003
213365899257812,2562cyclictest2203814-21kworker/0:2+events22:57:300
213367299257712,2561cyclictest2175063-21kworker/3:1+events21:22:403
213367299257612,2562cyclictest2175063-21kworker/3:1+events21:40:083
213367299257612,2560cyclictest2184541-21kworker/3:1+events22:16:553
213367299257411,2560cyclictest2157402-21kworker/3:0+events20:33:383
213367299257312,2557cyclictest2201925-21kworker/3:2+events23:02:513
213365899257210,2558cyclictest2138334-21kworker/0:0+events19:22:060
213365899257111,2557cyclictest2214877-21kworker/0:1+events23:39:520
213365899257011,2555cyclictest2211596-21kworker/0:1+events23:20:550
213367299256811,2553cyclictest2195870-21kworker/3:0+events22:41:383
213367299256811,2553cyclictest2195870-21kworker/3:0+events22:41:383
213365899256512,2550cyclictest2191249-21kworker/0:1+events22:20:420
213365899256212,2547cyclictest2197149-21kworker/0:2+events22:33:430
213365899256212,2547cyclictest2197149-21kworker/0:2+events22:33:430
213366099255212,2536cyclictest2214820-21kworker/1:2+events23:34:091
213365899254212,2526cyclictest2143264-21kworker/0:2+events19:43:130
213366099253913,2522cyclictest2198068-21kworker/1:1+events22:47:151
213365899253912,2523cyclictest2168674-21kworker/0:0+events20:58:210
213365899253312,2518cyclictest2206587-21kworker/0:1+events23:01:190
213365899253312,2517cyclictest2143264-21kworker/0:2+events19:39:300
213365899253012,2514cyclictest2147418-21kworker/0:0+events20:07:110
213366099252213,2505cyclictest2167100-21kworker/1:2+events21:11:431
213367299252111,2506cyclictest2133149-21kworker/3:2+events19:52:483
213366099251612,2501cyclictest2193987-21kworker/1:1+events22:20:191
213366099251212,2496cyclictest2152851-21kworker/1:1+events20:35:331
213366099250610,2492cyclictest2162363-21kworker/1:0+events20:49:321
21336609925058,2494cyclictest2227727-21kworker/1:2+events00:16:431
213366099250411,2489cyclictest2147915-21kworker/1:2+events20:08:411
213365899250112,2485cyclictest2162544-21kworker/0:2+events20:52:340
21336589924992,2494cyclictest2147418-21kworker/0:0+events20:37:240
213365899249812,2482cyclictest2172026-21kworker/0:0+events21:19:420
213365899249612,2480cyclictest2162544-21kworker/0:2+events20:44:180
213367299249512,2480cyclictest2150011-21kworker/3:0+events20:03:293
213367299249512,2479cyclictest2171862-21kworker/3:1+events21:10:563
213367299249512,2479cyclictest2136919-21kworker/3:1+events19:19:503
213365899249412,2479cyclictest2232489-21kworker/0:2+events00:26:140
213365899249412,2478cyclictest2197149-21kworker/0:2+events22:26:500
213365899249412,2478cyclictest2138334-21kworker/0:0+events19:31:510
213367299249312,2479cyclictest2233052-21kworker/3:1+events00:35:063
213367299249312,2478cyclictest2224207-21kworker/3:2+events00:00:233
213367299249311,2479cyclictest2162572-21kworker/3:1+events20:47:193
213366099249212,2477cyclictest2167100-21kworker/1:2+events21:07:311
213365899249212,2477cyclictest2159085-21kworker/0:2+events20:32:530
213365899249212,2476cyclictest2228283-21kworker/0:1+events00:22:230
213367299249112,2475cyclictest2219397-21kworker/3:1+events23:46:213
213366099249112,2476cyclictest2147915-21kworker/1:2+events20:00:461
213367299249012,2474cyclictest2189347-21kworker/3:0+events22:05:353
213367299249012,2474cyclictest2138526-21kworker/3:0+events19:28:073
213367299248912,2473cyclictest2231447-21kworker/3:2+events00:33:353
213367299248910,2475cyclictest2184541-21kworker/3:1+events22:23:243
213367299248910,2475cyclictest2152575-21kworker/3:2+events20:08:193
21336689924876,2478cyclictest2175079-21kworker/2:0+events21:21:332
213366899248612,2470cyclictest2227343-21kworker/2:2+events00:13:432
213365899248611,2472cyclictest2174989-21kworker/0:1+events21:23:480
213365899248611,2471cyclictest2214877-21kworker/0:1+events23:33:020
213365899248512,2470cyclictest2140338-21kworker/0:1+events19:53:120
213365899248512,2469cyclictest2208363-21kworker/0:0+events23:27:220
213365899248412,2468cyclictest2222464-21kworker/0:1+events23:53:340
213367299248112,2465cyclictest2162572-21kworker/3:1+events20:44:403
213367299248112,2465cyclictest2143334-21kworker/3:0+events19:43:363
213366899248112,2466cyclictest2210088-21kworker/2:2+events23:14:222
213366899248112,2466cyclictest2162392-21kworker/2:0+events20:46:582
213365899248111,2466cyclictest2176613-21kworker/0:2+events21:48:550
213367299248012,2464cyclictest2154156-21kworker/3:0+events20:14:223
21336589924809,2468cyclictest2197149-21kworker/0:2+events22:44:370
21336589924809,2468cyclictest2197149-21kworker/0:2+events22:44:360
213365899248012,2465cyclictest2214877-21kworker/0:1+events23:44:030
213365899248011,2465cyclictest2147418-21kworker/0:0+events20:22:420
213365899247910,2466cyclictest2203814-21kworker/0:2+events23:12:280
213365899247910,2465cyclictest2167070-21kworker/0:1+events21:02:570
213366899247812,2460cyclictest2143297-21kworker/2:0+events19:51:382
213365899247812,2462cyclictest2191249-21kworker/0:1+events22:12:050
213365899247810,2465cyclictest2228283-21kworker/0:1+events00:36:580
213365899247712,2462cyclictest2181576-21kworker/0:0+events21:57:160
213365899247612,2461cyclictest2147418-21kworker/0:0+events20:26:080
213366899247510,2461cyclictest2189304-21kworker/2:2+events22:09:252
213366099247512,2460cyclictest2152851-21kworker/1:1+events20:25:451
213366899247411,2461cyclictest2203535-21kworker/2:0+events22:55:582
213365899247311,2458cyclictest2178267-21kworker/0:0+events21:29:060
213366899247110,2459cyclictest2165766-21kworker/2:1+events20:51:262
213366899247012,2454cyclictest2178389-21kworker/2:0+events21:36:192
213367299246912,2453cyclictest2133149-21kworker/3:2+events19:22:283
213366899246910,2456cyclictest2187681-21kworker/2:0+events22:00:392
213366899246612,2450cyclictest2125256-21kworker/2:0+events19:26:592
213366099246512,2450cyclictest2191414-21kworker/1:2+events22:34:281
213366099246512,2450cyclictest2191414-21kworker/1:2+events22:34:281
213367299246411,2450cyclictest2215178-21kworker/3:0+events23:44:493
213366099246311,2448cyclictest2208273-21kworker/1:2+events23:06:431
21336689924597,2448cyclictest2229775-21kworker/2:0+events00:20:542
213367299245712,2443cyclictest2155762-21kworker/3:1+events20:20:513
213367299245712,2442cyclictest2197753-21kworker/3:1+events22:31:473
213367299245712,2442cyclictest2197753-21kworker/3:1+events22:31:473
213365899245711,2443cyclictest2218052-21kworker/0:2+events00:00:460
213366899245110,2434cyclictest2151142-21kworker/2:2+events20:16:182
21336609924517,2441cyclictest2151256-21kworker/1:0+events20:13:381
213366899245011,2435cyclictest2139989-21kworker/2:1+events19:38:452
213366899244812,2433cyclictest2205174-21kworker/2:1+events23:02:272
213367299244710,2434cyclictest2182943-21kworker/3:2+events21:50:243
213366099244512,2429cyclictest2211565-21kworker/1:2+events23:22:011
213366899244412,2428cyclictest2201894-21kworker/2:1+events22:50:372
213366099244312,2427cyclictest2231304-21kworker/1:1+events00:25:501
213366099244110,2427cyclictest2154580-21kworker/1:2+events20:20:271
213367299244012,2424cyclictest2157402-21kworker/3:0+events20:29:073
213365899243911,2426cyclictest2140338-21kworker/0:1+events19:55:290
21336609924369,2423cyclictest2176846-21kworker/1:2+events21:33:391
213366099243612,2420cyclictest2147915-21kworker/1:2+events19:54:431
213366899243212,2417cyclictest2173448-21kworker/2:2+events21:16:152
213366899243012,2414cyclictest2211712-21kworker/2:1+events23:29:152
213366099242911,2414cyclictest2179726-21kworker/1:0+events21:41:411
213365899242911,2414cyclictest2170422-21kworker/0:2+events21:12:260
21336689924268,2414cyclictest2217808-21kworker/2:1+events23:37:562
213366899242612,2410cyclictest2197478-21kworker/2:1+events22:33:192
213366899242612,2410cyclictest2197478-21kworker/2:1+events22:33:192
213367299242311,2409cyclictest2133149-21kworker/3:2+events19:36:013
213366099242012,2404cyclictest2234579-21kworker/1:2+events00:35:531
213366099242012,2404cyclictest2216419-21kworker/1:0+events23:36:031
213366099241911,2405cyclictest2136801-21kworker/1:2+events19:39:081
213366099241812,2403cyclictest2140196-21kworker/1:0+events19:34:521
213366099241812,2402cyclictest2226097-21kworker/1:1+events00:06:051
213366099241711,2402cyclictest2162363-21kworker/1:0+events20:55:401
213365899241710,2403cyclictest2197149-21kworker/0:2+events22:46:070
213366099241612,2400cyclictest2144653-21kworker/1:1+events19:42:271
213366099241510,2401cyclictest2152851-21kworker/1:1+events20:15:331
213366099241412,2398cyclictest2128533-21kworker/1:0+events19:21:201
21336609924128,2400cyclictest2214820-21kworker/1:2+events23:54:411
213366099241211,2397cyclictest2167100-21kworker/1:2+events20:54:081
213366899241112,2395cyclictest2181638-21kworker/2:1+events21:48:112
213366099241112,2396cyclictest2186112-21kworker/1:1+events22:02:331
213366099241012,2395cyclictest2213216-21kworker/1:0+events23:27:451
213365899241012,2395cyclictest2218052-21kworker/0:2+events00:14:490
213366099240911,2395cyclictest2214820-21kworker/1:2+events23:46:451
213366099240712,2391cyclictest2186112-21kworker/1:1+events21:56:301
213366099240612,2390cyclictest2198068-21kworker/1:1+events22:37:511
213366899240511,2390cyclictest2181638-21kworker/2:1+events21:56:072
213367299240210,2388cyclictest2210029-21kworker/3:2+events23:26:373
213366099240212,2387cyclictest2186112-21kworker/1:1+events22:06:441
213366099240212,2387cyclictest2138567-21kworker/1:1+events19:28:541
213366899239711,2384cyclictest2217808-21kworker/2:1+events23:55:052
213366899239512,2381cyclictest2211712-21kworker/2:1+events23:21:392
213366899239412,2379cyclictest2141647-21kworker/2:2+events19:34:312
213366899239412,2378cyclictest2217808-21kworker/2:1+events23:44:262
213366899239312,2378cyclictest2167368-21kworker/2:2+events21:01:012
213366899239312,2378cyclictest2155770-21kworker/2:1+events20:25:232
213367299239212,2376cyclictest2154156-21kworker/3:0+events20:15:533
213366899239210,2378cyclictest2233035-21kworker/2:0+events00:39:372
213366899239110,2377cyclictest2198627-21kworker/2:2+events22:39:232
213366899239012,2374cyclictest2145099-21kworker/2:2+events19:47:232
213366899238912,2374cyclictest2221074-21kworker/2:2+events23:52:272
213366899238912,2374cyclictest2178389-21kworker/2:0+events21:44:432
213366899238912,2373cyclictest2192480-21kworker/2:1+events22:17:402
213366899238912,2373cyclictest2189304-21kworker/2:2+events22:11:402
213366899238812,2373cyclictest2151142-21kworker/2:2+events20:11:442
213366899238811,2374cyclictest2125256-21kworker/2:0+events19:24:212
213366899238810,2375cyclictest2201894-21kworker/2:1+events22:49:312
213366899238712,2372cyclictest2155770-21kworker/2:1+events20:39:172
213366899238612,2372cyclictest2197478-21kworker/2:1+events22:40:082
213366899238612,2372cyclictest2197478-21kworker/2:1+events22:40:082
213366899238610,2373cyclictest2170674-21kworker/2:1+events21:07:072
213367299238512,2370cyclictest2176730-21kworker/3:2+events21:26:023
213366899238412,2370cyclictest2143297-21kworker/2:0+events19:55:062
21336609923826,2373cyclictest2183314-21kworker/1:2+events21:54:581
213366099237911,2365cyclictest2200300-21kworker/1:0+events22:42:461
213366099237911,2365cyclictest2200300-21kworker/1:0+events22:42:461
213365899237812,2363cyclictest2176613-21kworker/0:2+events21:43:570
213366899237712,2361cyclictest2170674-21kworker/2:1+events21:11:202
213366899237612,2362cyclictest2203535-21kworker/2:0+events23:15:112
213366899237411,2359cyclictest2178389-21kworker/2:0+events21:32:092
213366899237111,2356cyclictest2155770-21kworker/2:1+events20:21:372
213365899236812,2353cyclictest2197149-21kworker/0:2+events22:37:280
213367299236610,2352cyclictest2167668-21kworker/3:2+events21:00:403
21336609923669,2353cyclictest2231304-21kworker/1:1+events00:23:101
213366899236312,2348cyclictest2125256-21kworker/2:0+events19:17:582
213365899234412,2329cyclictest2147418-21kworker/0:0+events20:01:310
213367299234112,2325cyclictest2224207-21kworker/3:2+events23:58:293
213367299234012,2325cyclictest2187730-21kworker/3:2+events21:58:463
213365899234012,2324cyclictest2211596-21kworker/0:1+events23:19:000
213366899233712,2323cyclictest2143297-21kworker/2:0+events20:00:232
213367299233110,2319cyclictest2206768-21kworker/3:0+events23:10:093
213367299232912,2314cyclictest2213275-21kworker/3:1+events23:34:533
213367299232812,2312cyclictest2170245-21kworker/3:0+events21:17:243
213367299232712,2312cyclictest2133149-21kworker/3:2+events19:57:453
213367299232612,2311cyclictest2228225-21kworker/3:0+events00:28:103
213365899232412,2309cyclictest2119980-21kworker/0:2+events19:25:530
213367299232312,2307cyclictest2217281-21kworker/3:2+events23:39:293
213367299232112,2305cyclictest2195870-21kworker/3:0+events22:35:593
213367299232111,2306cyclictest2171862-21kworker/3:1+events21:07:543
21336689923199,2306cyclictest2214909-21kworker/2:2+events23:31:082
213367299231812,2302cyclictest2228225-21kworker/3:0+events00:15:583
213367299231712,2302cyclictest2208404-21kworker/3:1+events23:09:253
213365899231612,2300cyclictest2181576-21kworker/0:0+events22:00:170
213367299231411,2300cyclictest2227560-21kworker/3:1+events00:09:313
213367299231112,2295cyclictest2201925-21kworker/3:2+events22:59:473
213367299231011,2296cyclictest2175063-21kworker/3:1+events21:31:443
213367299230412,2289cyclictest2184541-21kworker/3:1+events22:03:203
213367299230211,2288cyclictest2184541-21kworker/3:1+events21:49:183
213365899227410,2260cyclictest2143264-21kworker/0:2+events19:48:110
213365899227211,2258cyclictest2222464-21kworker/0:1+events23:55:270
213366899227011,2255cyclictest2217808-21kworker/2:1+events00:02:162
213365899227011,2255cyclictest2184836-21kworker/0:1+events21:52:210
213365899226910,2256cyclictest2181576-21kworker/0:0+events22:07:070
21336609922659,2253cyclictest2227727-21kworker/1:2+events00:12:571
21336609922629,2250cyclictest2224355-21kworker/1:0+events00:04:551
21336589922618,2250cyclictest2198799-21kworker/0:1+events22:51:450
213365899225911,2245cyclictest2218052-21kworker/0:2+events23:45:350
213367299225612,2240cyclictest2180328-21kworker/3:0+events21:39:223
213365899225510,2242cyclictest2164199-21kworker/0:0+events20:46:340
213366899224612,2231cyclictest2222815-21kworker/2:0+events00:08:222
213365899224310,2229cyclictest2119980-21kworker/0:2+events19:14:350
21336729922429,2229cyclictest2194250-21kworker/3:2+events22:28:463
21336689922399,2226cyclictest2181638-21kworker/2:1+events21:54:132
213366099223310,2220cyclictest2140196-21kworker/1:0+events19:56:121
213366099223010,2216cyclictest2205415-21kworker/1:1+events23:16:201
213367299222910,2215cyclictest2208404-21kworker/3:1+events23:15:553
21336589922268,2215cyclictest2147418-21kworker/0:0+events20:17:270
213366099222411,2209cyclictest2203713-21kworker/1:0+events23:02:041
213366099222311,2209cyclictest2179726-21kworker/1:0+events21:38:351
21336609922228,2211cyclictest2176846-21kworker/1:2+events21:26:501
213366899222012,2204cyclictest2194134-21kworker/2:0+events22:27:132
213366099222010,2207cyclictest2201954-21kworker/1:2+events22:54:251
21336609922199,2207cyclictest2128533-21kworker/1:0+events19:13:081
213366099221911,2204cyclictest2179726-21kworker/1:0+events21:46:141
21336609922189,2206cyclictest2214820-21kworker/1:2+events23:41:001
213366099221610,2203cyclictest2171963-21kworker/1:1+events21:24:111
213366899220511,2191cyclictest2143297-21kworker/2:0+events20:06:262
213367299220110,2187cyclictest2160944-21kworker/3:2+events20:39:403
213367299219910,2185cyclictest2203564-21kworker/3:0+events22:53:173
213366899219610,2182cyclictest2139989-21kworker/2:1+events19:42:502
213366099219410,2181cyclictest2203713-21kworker/1:0+events22:56:441
213366899218811,2174cyclictest2227343-21kworker/2:2+events00:29:442
213366899218710,2174cyclictest2206828-21kworker/2:2+events23:07:532
213366099218611,2171cyclictest2222639-21kworker/1:1+events23:56:121
213366099218511,2170cyclictest2134794-21kworker/1:1+events19:16:051
213366099218411,2169cyclictest2160764-21kworker/1:2+events20:41:141
213366899218211,2168cyclictest2134337-21kworker/2:2+events19:13:312
213366899218010,2167cyclictest2162392-21kworker/2:0+events20:43:312
213366099214211,2128cyclictest2189394-21kworker/1:0+events22:10:111
21336729921398,2128cyclictest2228225-21kworker/3:0+events00:22:003
21336589921139,2101cyclictest2128581-21kworker/0:1+events19:19:040
213367299210611,2092cyclictest2210029-21kworker/3:2+events23:24:193
213367299210310,2090cyclictest2222595-21kworker/3:1+events23:54:183
213367299209910,2085cyclictest2224207-21kworker/3:2+events00:13:203
213366099209810,2085cyclictest2195757-21kworker/1:0+events22:28:011
21336729920929,2080cyclictest2133149-21kworker/3:2+events19:12:453
21336609920714,2064cyclictest2171963-21kworker/1:1+events21:15:281
21336609920695,2060cyclictest2208273-21kworker/1:2+events23:10:301
213366099203610,2023cyclictest2160764-21kworker/1:2+events20:32:061
21336729920308,2019cyclictest2190942-21kworker/3:2+events22:11:203
213365899201611,2002cyclictest2152674-21kworker/0:1+events20:10:340
21333082160117,24sleep00-21swapper/019:08:350
21333302143110,28sleep20-21swapper/219:08:522
21331052141107,28sleep10-21swapper/119:06:001
21333462139110,24sleep30-21swapper/319:09:053
2133660991910,7cyclictest2145788-21runrttasks19:45:191
213365899146,5cyclictest2234667-21ls00:35:000
2133658991312,1cyclictest0-21swapper/022:15:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional