You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 05:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Tue Jun 09, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
217338499311310,3098cyclictest2256710-21kworker/0:2+events23:50:200
217339199295314,2934cyclictest2179630-21kworker/3:1+events19:30:173
217338699295314,2935cyclictest2219823-21kworker/1:2+events21:35:111
217338699284211,2829cyclictest2239149-21kworker/1:1+events22:50:191
217338499282314,2806cyclictest2174535-21kworker/0:1+events19:15:200
217338499280313,2786cyclictest2256710-21kworker/0:2+events00:28:520
217338499280213,2785cyclictest2221307-21kworker/0:0+events21:40:130
217338699277313,2755cyclictest2255409-21kworker/1:1+events23:30:121
217339199276613,2749cyclictest2222937-21kworker/3:0+events21:43:173
217339199275513,2738cyclictest2216498-21kworker/3:2+events21:25:143
217339199275513,2738cyclictest2216498-21kworker/3:2+events21:25:143
21733899927554,2748cyclictest2275985-21kworker/2:1+events00:30:462
217338699275113,2734cyclictest2201804-21kworker/1:0+events20:37:261
217338999274713,2730cyclictest2226148-21kworker/2:1+events21:55:132
217338999274013,2724cyclictest2193973-21kworker/2:0+events20:16:052
217338999273911,2724cyclictest2205199-21kworker/2:0+events20:54:192
217338999273413,2717cyclictest2252096-21kworker/2:0+events23:18:542
217338999273413,2717cyclictest2252096-21kworker/2:0+events23:18:542
217339199272613,2709cyclictest2260009-21kworker/3:1+events23:44:173
217339199272413,2707cyclictest2219409-21kworker/3:1+events21:58:173
217339199270613,2688cyclictest2197053-21kworker/3:2+events20:30:153
217338999268512,2669cyclictest2255024-21kworker/2:1+events23:23:472
217338499264812,2632cyclictest2271453-21kworker/0:0+events00:20:160
217338499262113,2605cyclictest2258465-21kworker/0:1+events23:35:340
21733849925830,2579cyclictest2209948-21kworker/0:2+events21:16:520
217338499258012,2564cyclictest2181207-21kworker/0:2+events19:32:360
217338999257813,2562cyclictest2274350-21kworker/2:2+events00:21:222
217338699257812,2564cyclictest2184113-21kworker/1:0+events20:25:151
217338499257812,2563cyclictest2245372-21kworker/0:0+events23:10:560
217338999257513,2558cyclictest2190794-21kworker/2:1+events20:21:292
217338499257512,2559cyclictest2236057-21kworker/0:1+events22:28:330
217338499257410,2561cyclictest2178357-21kworker/0:1+events19:44:420
217338499257410,2561cyclictest2178357-21kworker/0:1+events19:44:410
21733849925738,2561cyclictest2190854-21kworker/0:1+events20:13:470
217338499257312,2557cyclictest2256710-21kworker/0:2+events23:27:570
217338499257312,2557cyclictest2198687-21kworker/0:2+events20:28:190
217338499256912,2554cyclictest2185926-21kworker/0:2+events19:54:360
217338499256814,2550cyclictest2221307-21kworker/0:0+events21:37:090
217338499256212,2546cyclictest2214877-21kworker/0:0+events21:27:310
217338499256212,2546cyclictest2214877-21kworker/0:0+events21:27:310
217338499256212,2546cyclictest2201978-21kworker/0:0+events20:40:560
217339199255312,2535cyclictest2169685-21kworker/3:0+events19:24:143
217338499255112,2535cyclictest2243707-21kworker/0:2+events22:54:090
21733849925489,2535cyclictest2252278-21kworker/0:2+events23:18:300
21733849925489,2535cyclictest2252278-21kworker/0:2+events23:18:300
217338499254312,2528cyclictest2245372-21kworker/0:0+events23:08:370
217338999254111,2526cyclictest2205199-21kworker/2:0+events21:02:222
217339199253812,2522cyclictest2263613-21kworker/3:0+events23:59:093
217338999253811,2523cyclictest2190794-21kworker/2:1+events20:29:292
217338999253810,2524cyclictest2269945-21kworker/2:2+events00:12:442
21733899925366,2526cyclictest2271780-21kworker/2:0+events00:25:312
217338699253510,2523cyclictest2232027-21kworker/1:2+events22:15:471
217338499253512,2519cyclictest2211546-21kworker/0:0+events21:08:510
217338999253312,2518cyclictest2238939-21kworker/2:0+events22:36:142
217338999253212,2516cyclictest2258222-21kworker/2:2+events23:37:062
217338499253212,2517cyclictest2176703-21kworker/0:2+events19:24:370
217338999253112,2516cyclictest2238939-21kworker/2:0+events22:46:512
217338999253012,2515cyclictest2238939-21kworker/2:0+events22:32:452
217338999253012,2515cyclictest2211731-21kworker/2:2+events21:17:152
217338999253012,2514cyclictest2229643-21kworker/2:2+events22:04:212
217338699253012,2514cyclictest2216528-21kworker/1:1+events21:29:501
217338699253012,2514cyclictest2216528-21kworker/1:1+events21:29:501
217338999252812,2513cyclictest2184700-21kworker/2:2+events20:07:382
217338999252812,2512cyclictest2266582-21kworker/2:1+events00:19:522
217338699252812,2512cyclictest2174475-21kworker/1:2+events19:32:141
217338499252811,2513cyclictest2256710-21kworker/0:2+events00:07:520
217338999252711,2512cyclictest2266582-21kworker/2:1+events00:06:242
217338999252611,2511cyclictest2216560-21kworker/2:0+events21:27:082
217338999252611,2511cyclictest2216560-21kworker/2:0+events21:27:082
217338699252612,2510cyclictest2207015-21kworker/1:2+events20:58:121
217338999252512,2510cyclictest2259856-21kworker/2:1+events23:42:472
217338699252412,2508cyclictest2240785-21kworker/1:2+events22:43:501
217339199252311,2508cyclictest2208623-21kworker/3:2+events21:11:073
217338999252211,2507cyclictest2184700-21kworker/2:2+events19:52:172
217338699252112,2506cyclictest2250108-21kworker/1:2+events23:21:311
217338499252012,2504cyclictest2201978-21kworker/0:0+events20:50:540
217338999251911,2504cyclictest2255024-21kworker/2:1+events23:27:332
217338699251912,2503cyclictest2255409-21kworker/1:1+events23:35:591
21733869925179,2505cyclictest2248514-21kworker/1:0+events23:02:331
217338499251712,2501cyclictest2247038-21kworker/0:1+events22:59:310
217338999251612,2500cyclictest2169774-21kworker/2:2+events19:23:522
217338499251612,2500cyclictest2243707-21kworker/0:2+events22:49:310
217338699251411,2500cyclictest2184113-21kworker/1:0+events20:00:251
217338499251212,2496cyclictest2255052-21kworker/0:1+events23:21:540
21733869925119,2498cyclictest2216528-21kworker/1:1+events21:49:491
217338699251012,2494cyclictest2168232-21kworker/1:0+events19:21:551
217338499251012,2495cyclictest2274711-21kworker/0:1+events00:32:410
21733869925099,2497cyclictest2197561-21kworker/1:2+events20:40:321
21733869925089,2495cyclictest2239149-21kworker/1:1+events22:47:591
217338499250712,2491cyclictest2256710-21kworker/0:2+events23:58:020
217339199250612,2491cyclictest2277552-21kworker/3:0+events00:32:193
217339199250512,2489cyclictest2252021-21kworker/3:1+events23:26:253
217339199250511,2490cyclictest2191027-21kworker/3:3+events20:05:213
217338699250311,2489cyclictest2211517-21kworker/1:2+events21:10:221
217338499249712,2481cyclictest2218433-21kworker/0:1+events21:30:590
217338499249710,2484cyclictest2183112-21kworker/0:0+events19:49:160
217338699249612,2480cyclictest2216528-21kworker/1:1+events22:12:201
21733919924946,2484cyclictest2266488-21kworker/3:2+events00:03:463
217338499249412,2478cyclictest2190854-21kworker/0:1+events20:06:050
217338499249312,2478cyclictest2274711-21kworker/0:1+events00:35:480
217339199249112,2476cyclictest2269917-21kworker/3:0+events00:19:283
217338499249112,2475cyclictest2222998-21kworker/0:2+events22:19:090
217338499249111,2477cyclictest2209948-21kworker/0:2+events21:01:370
217339199248911,2475cyclictest2234401-21kworker/3:2+events22:24:433
217338699248912,2474cyclictest2263458-21kworker/1:0+events00:00:391
217338699248812,2473cyclictest2214908-21kworker/1:2+events21:24:061
217338499248812,2472cyclictest2271453-21kworker/0:0+events00:16:300
217338699248711,2474cyclictest2252125-21kworker/1:1+events23:15:051
217338699248711,2474cyclictest2252125-21kworker/1:1+events23:15:051
217338499248712,2472cyclictest2256710-21kworker/0:2+events23:40:520
217338499248712,2471cyclictest2222998-21kworker/0:2+events21:57:540
217338499248612,2471cyclictest2256710-21kworker/0:2+events23:34:270
217338499248612,2471cyclictest2234445-21kworker/0:0+events22:24:210
217338499248612,2470cyclictest2256710-21kworker/0:2+events23:46:330
21733919924859,2472cyclictest2268268-21kworker/3:1+events00:07:323
217338499248512,2469cyclictest2213179-21kworker/0:1+events21:13:260
217339199248412,2468cyclictest2205230-21kworker/3:1+events20:53:353
217338499248312,2468cyclictest2194388-21kworker/0:2+events20:19:560
217338499248312,2467cyclictest2232662-21kworker/0:1+events22:14:140
217338499248112,2465cyclictest2198687-21kworker/0:2+events20:32:530
217338699248012,2465cyclictest2184113-21kworker/1:0+events19:45:501
217338499248012,2465cyclictest2189163-21kworker/0:0+events19:58:300
217338499248011,2465cyclictest2226180-21kworker/0:0+events22:05:500
217338999247812,2463cyclictest2198840-21kworker/2:0+events20:36:412
217338499247712,2461cyclictest2185926-21kworker/0:2+events20:03:280
217338699247612,2460cyclictest2197561-21kworker/1:2+events20:33:171
217338499247611,2461cyclictest2256710-21kworker/0:2+events00:03:220
21733919924754,2467cyclictest2255320-21kworker/3:2+events23:34:023
217338499247312,2457cyclictest2222998-21kworker/0:2+events21:49:030
217338499247312,2457cyclictest2213179-21kworker/0:1+events21:22:560
217339199247011,2455cyclictest2192816-21kworker/3:0+events20:16:283
217338699246911,2455cyclictest2211517-21kworker/1:2+events21:06:351
217339199246812,2452cyclictest2238595-21kworker/3:1+events22:56:513
21733869924689,2455cyclictest2205352-21kworker/1:0+events20:53:561
217338999246511,2451cyclictest2236118-21kworker/2:2+events22:25:512
21733899924641,2459cyclictest2224452-21kworker/2:2+events21:54:262
217338499246312,2445cyclictest2236057-21kworker/0:1+events22:40:490
21733869924628,2450cyclictest2228141-21kworker/1:0+events22:08:541
217338699246112,2445cyclictest2250108-21kworker/1:2+events23:11:191
217339199246012,2444cyclictest2238595-21kworker/3:1+events22:53:223
217338999246012,2444cyclictest2184700-21kworker/2:2+events20:02:432
217338999245810,2444cyclictest2242194-21kworker/2:2+events22:44:592
217338999245612,2441cyclictest2261769-21kworker/2:0+events23:46:092
217338999245612,2440cyclictest2202097-21kworker/2:2+events20:41:412
21733869924559,2442cyclictest2205352-21kworker/1:0+events21:03:531
217338999245111,2436cyclictest2221579-21kworker/2:1+events21:41:222
217338999245110,2438cyclictest2234478-21kworker/2:1+events22:20:162
217338999245012,2434cyclictest2231242-21kworker/2:0+events22:13:512
217338999244812,2432cyclictest2264972-21kworker/2:2+events23:54:102
217338999244712,2432cyclictest2181389-21kworker/2:1+events19:47:462
217338999244712,2431cyclictest2169774-21kworker/2:2+events19:18:262
217338999244612,2432cyclictest2266582-21kworker/2:1+events00:00:162
217338999244612,2430cyclictest2213329-21kworker/2:0+events21:14:352
217338699244611,2432cyclictest2250108-21kworker/1:2+events23:28:201
217338999244512,2430cyclictest2231242-21kworker/2:0+events22:16:532
217338999244512,2429cyclictest2256621-21kworker/2:0+events23:31:212
217338999244511,2431cyclictest2181389-21kworker/2:1+events19:42:262
217338999244511,2431cyclictest2181389-21kworker/2:1+events19:42:262
217338999244411,2429cyclictest2205199-21kworker/2:0+events20:46:412
217339199244312,2428cyclictest2274444-21kworker/3:1+events00:36:553
217338999244311,2428cyclictest2264972-21kworker/2:2+events23:58:472
217338699244312,2427cyclictest2232027-21kworker/1:2+events22:21:421
217339199244211,2427cyclictest2198651-21kworker/3:0+events20:28:433
217338699244212,2426cyclictest2218162-21kworker/1:0+events21:32:091
21733899924405,2432cyclictest2169774-21kworker/2:2+events19:38:122
21733899924394,2432cyclictest2211731-21kworker/2:2+events21:21:012
217338999243912,2424cyclictest2190794-21kworker/2:1+events20:34:272
217338699243912,2424cyclictest2224512-21kworker/1:2+events21:54:031
217338999243812,2422cyclictest2243779-21kworker/2:1+events22:55:412
217338999243811,2424cyclictest2274350-21kworker/2:2+events00:36:092
217338999243712,2422cyclictest2208437-21kworker/2:2+events20:57:482
217339199243612,2421cyclictest2232816-21kworker/3:0+events22:17:383
217338999243611,2421cyclictest2226148-21kworker/2:1+events22:06:132
217339199243512,2419cyclictest2238595-21kworker/3:1+events22:33:083
217338699243512,2419cyclictest2174475-21kworker/1:2+events19:29:551
217338699243410,2420cyclictest2187649-21kworker/1:1+events19:54:131
217339199243312,2417cyclictest2219409-21kworker/3:1+events21:39:043
217338699243212,2417cyclictest2228141-21kworker/1:0+events22:02:531
217338699243212,2416cyclictest2250108-21kworker/1:2+events23:09:231
217338699243012,2414cyclictest2272784-21kworker/1:1+events00:21:011
217338699243010,2417cyclictest2263458-21kworker/1:0+events00:12:211
217339199242912,2413cyclictest2214815-21kworker/3:1+events21:19:313
217338999242911,2414cyclictest2210062-21kworker/2:1+events21:09:592
217338699242611,2413cyclictest2272784-21kworker/1:1+events00:35:011
217338699242512,2410cyclictest2261859-21kworker/1:2+events23:53:471
217338699242512,2409cyclictest2259768-21kworker/1:0+events23:40:301
217338699242412,2409cyclictest2266833-21kworker/1:2+events00:16:051
217338699242312,2407cyclictest2174475-21kworker/1:2+events19:35:141
217339199242112,2406cyclictest2219409-21kworker/3:1+events21:31:463
21733869924217,2410cyclictest2193910-21kworker/1:2+events20:14:091
217338999242011,2406cyclictest2190794-21kworker/2:1+events20:10:442
217338999242011,2405cyclictest2248425-21kworker/2:0+events23:01:262
217338699241811,2405cyclictest2237509-21kworker/1:0+events22:30:051
217339199241611,2403cyclictest2187467-21kworker/3:2+events19:56:323
217338999241612,2400cyclictest2184700-21kworker/2:2+events19:59:152
217339199241412,2398cyclictest2179630-21kworker/3:1+events19:38:583
21733869924149,2401cyclictest2195782-21kworker/1:1+events20:24:301
217338699241412,2398cyclictest2181715-21kworker/1:1+events19:43:121
217338699241412,2398cyclictest2181715-21kworker/1:1+events19:43:121
217339199241212,2396cyclictest2274444-21kworker/3:1+events00:22:293
217339199241212,2396cyclictest2179630-21kworker/3:1+events19:42:023
217339199241212,2396cyclictest2179630-21kworker/3:1+events19:42:023
217339199241012,2395cyclictest2250171-21kworker/3:2+events23:12:493
217339199241012,2395cyclictest2189102-21kworker/3:0+events20:01:113
217339199241011,2395cyclictest2260009-21kworker/3:1+events23:51:513
217339199241010,2397cyclictest2205230-21kworker/3:1+events20:56:163
217339199240912,2395cyclictest2224727-21kworker/3:2+events21:51:223
217339199240912,2393cyclictest2219409-21kworker/3:1+events22:00:363
217339199240911,2394cyclictest2230778-21kworker/3:2+events22:08:073
217339199240812,2393cyclictest2238595-21kworker/3:1+events22:44:363
217339199240811,2393cyclictest2238595-21kworker/3:1+events23:05:113
217338699240812,2392cyclictest2184113-21kworker/1:0+events20:08:251
217339199240612,2391cyclictest2191027-21kworker/3:3+events20:14:333
217339199240512,2389cyclictest2205230-21kworker/3:1+events21:07:433
217339199240511,2392cyclictest2200447-21kworker/3:1+events20:39:233
217339199240412,2390cyclictest2234401-21kworker/3:2+events22:35:053
217339199240412,2389cyclictest2205230-21kworker/3:1+events21:03:313
217339199240212,2386cyclictest2187467-21kworker/3:2+events19:51:553
217339199240012,2386cyclictest2253702-21kworker/3:0+events23:20:033
217339199239711,2382cyclictest2219409-21kworker/3:1+events22:13:303
217338699239410,2381cyclictest2261859-21kworker/1:2+events23:49:111
217339199239010,2376cyclictest2252021-21kworker/3:1+events23:19:173
217339199239010,2376cyclictest2252021-21kworker/3:1+events23:19:173
217338999239010,2376cyclictest2243779-21kworker/2:1+events23:13:112
217338699239012,2375cyclictest2224512-21kworker/1:2+events21:56:001
217339199238513,2368cyclictest2256988-21kworker/3:0+events23:39:003
217338499237312,2357cyclictest2198687-21kworker/0:2+events20:38:370
217339199236811,2353cyclictest2169685-21kworker/3:0+events19:18:503
217338699235314,2336cyclictest2184113-21kworker/1:0+events19:55:451
217339199235110,2338cyclictest2179630-21kworker/3:1+events19:27:373
217338699234412,2329cyclictest2266833-21kworker/1:2+events00:05:161
217339199234210,2329cyclictest2269917-21kworker/3:0+events00:10:513
217338499233712,2321cyclictest2239318-21kworker/0:2+events22:38:090
217338999231810,2304cyclictest2219469-21kworker/2:2+events21:34:262
21733869923161,2312cyclictest2263458-21kworker/1:0+events23:59:531
217338699231411,2300cyclictest2272784-21kworker/1:1+events00:26:371
217338499231311,2298cyclictest2234445-21kworker/0:0+events22:33:540
217338499227911,2264cyclictest2226180-21kworker/0:0+events22:01:000
217339199227610,2262cyclictest2198651-21kworker/3:0+events20:43:563
217338499227211,2258cyclictest2174535-21kworker/0:1+events19:13:500
217338499227010,2257cyclictest2245372-21kworker/0:0+events23:00:160
21733899922647,2253cyclictest2169774-21kworker/2:2+events19:25:452
217339199226311,2248cyclictest2238595-21kworker/3:1+events22:46:283
217338499226210,2249cyclictest2222998-21kworker/0:2+events21:52:520
217338499225911,2244cyclictest2201978-21kworker/0:0+events20:48:340
21733849922547,2243cyclictest2192546-21kworker/0:0+events20:22:140
217338499225310,2239cyclictest2168145-21kworker/0:0+events19:29:310
21733869922469,2234cyclictest2197561-21kworker/1:2+events20:45:311
217338999223811,2223cyclictest2216560-21kworker/2:0+events21:47:072
217339199223410,2220cyclictest2184652-21kworker/3:0+events19:48:093
217338999223410,2221cyclictest2243779-21kworker/2:1+events22:53:452
217338699223310,2219cyclictest2168232-21kworker/1:0+events19:14:571
217338699223210,2219cyclictest2237509-21kworker/1:0+events22:35:281
217338699223110,2217cyclictest2222876-21kworker/1:0+events21:44:051
217338699222711,2212cyclictest2174475-21kworker/1:2+events19:16:301
217338699222710,2213cyclictest2239149-21kworker/1:1+events22:59:531
217338699221810,2205cyclictest2235851-21kworker/1:1+events22:26:151
217338699220511,2190cyclictest2276014-21kworker/1:0+events00:30:221
217339199220310,2189cyclictest2238595-21kworker/3:1+events23:02:133
217338999219910,2186cyclictest2181389-21kworker/2:1+events19:34:522
217339199219710,2184cyclictest2202163-21kworker/3:2+events20:46:173
217339199219411,2180cyclictest2213116-21kworker/3:0+events21:23:423
217339199219210,2178cyclictest2261890-21kworker/3:2+events23:48:023
217338999218910,2176cyclictest2216560-21kworker/2:0+events21:39:492
217339199218610,2172cyclictest2195422-21kworker/3:1+events20:21:503
217338999213211,2117cyclictest2171401-21kworker/2:1+events19:14:112
217338999211810,2105cyclictest2243779-21kworker/2:1+events23:08:152
217339199211310,2100cyclictest2173033-21kworker/3:2+events19:12:173
21733849921039,2090cyclictest2256710-21kworker/0:2+events00:14:130
21733849920997,2089cyclictest2181207-21kworker/0:2+events19:35:360
217338699209511,2081cyclictest2213149-21kworker/1:0+events21:18:471
217339199208610,2073cyclictest2219409-21kworker/3:1+events21:49:263
217339199205010,2037cyclictest2236087-21kworker/3:0+events22:26:383
21733869919989,1986cyclictest2193910-21kworker/1:2+events20:15:431
21727772193162,28sleep30-21swapper/319:06:163
21730602155112,25sleep20-21swapper/219:09:512
21729212143109,29sleep00-21swapper/019:08:050
21717342143115,22sleep10-21swapper/119:05:011
217338499177,2cyclictest2208709-21munin-run21:00:000
217339199136,5cyclictest2275998-21sshd00:26:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional