You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 07:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Tue Mar 31, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249877999399618,3968cyclictest2527714-21kworker/1:2+events20:40:181
249877699333816,3319cyclictest2596117-21kworker/0:1+events00:15:170
249877699331617,3295cyclictest2594039-21kworker/0:2+events00:10:170
249877699284013,2823cyclictest2517996-21kworker/0:0+events20:15:170
249877999271413,2698cyclictest2556643-21kworker/1:2+events22:20:191
249878199270813,2691cyclictest2530981-21kworker/2:2+events20:53:172
249877999270613,2689cyclictest2526056-21kworker/1:0+events20:35:191
249877699268113,2664cyclictest2551634-21kworker/0:1+events22:10:170
249877699266812,2651cyclictest2566448-21kworker/0:2+events22:45:150
249877999266113,2644cyclictest2556643-21kworker/1:2+events22:30:171
249878699266012,2644cyclictest2516301-21kworker/3:1+events20:05:183
249878199262912,2614cyclictest2551868-21kworker/2:0+events21:55:182
24987799925462,2540cyclictest2579296-21kworker/1:0+events23:36:461
249877999251611,2501cyclictest2524422-21kworker/1:1+events20:33:281
249877699248812,2472cyclictest2516332-21kworker/0:1+events20:07:570
249877999246912,2454cyclictest2556643-21kworker/1:2+events22:25:211
249877699246711,2452cyclictest2598193-21kworker/0:0+events00:22:060
249877999245512,2441cyclictest2572274-21kworker/1:2+events23:05:211
249878199244812,2432cyclictest2527657-21kworker/2:2+events20:41:282
249878699244512,2430cyclictest2583800-21kworker/3:1+events23:45:143
249878699244312,2427cyclictest2577368-21kworker/3:1+events23:15:283
249878199244011,2425cyclictest2522762-21kworker/2:1+events20:55:142
249878199242312,2408cyclictest2561460-21kworker/2:1+events22:59:412
249878199242112,2406cyclictest2508410-21kworker/2:1+events19:48:382
249877999241912,2405cyclictest2527714-21kworker/1:2+events21:00:151
249877999241712,2403cyclictest2533790-21kworker/1:0+events21:05:581
249878199241612,2400cyclictest2535465-21kworker/2:1+events21:11:182
249878699240912,2393cyclictest2524391-21kworker/3:0+events20:38:243
249878199240712,2392cyclictest2556613-21kworker/2:2+events22:08:432
249878199240310,2389cyclictest2561460-21kworker/2:1+events22:40:382
24987819924029,2390cyclictest2500188-21kworker/2:2+events19:25:462
249878199240212,2387cyclictest2564603-21kworker/2:2+events22:35:142
249878199240110,2388cyclictest2540624-21kworker/2:1+events21:37:142
249878199240012,2384cyclictest2585278-21kworker/2:0+events00:18:152
249877999239912,2383cyclictest2518059-21kworker/1:1+events20:14:091
249878199239810,2384cyclictest2535465-21kworker/2:1+events21:07:322
249878199239712,2381cyclictest2590342-21kworker/2:2+events23:59:112
249878699239610,2384cyclictest2529456-21kworker/3:2+events20:55:593
249878199239612,2381cyclictest2579252-21kworker/2:2+events23:39:292
249878199239512,2380cyclictest2551868-21kworker/2:0+events22:01:482
249878199239512,2380cyclictest2551868-21kworker/2:0+events22:01:482
249878199239512,2379cyclictest2569646-21kworker/2:0+events22:53:342
249878699239412,2379cyclictest2537422-21kworker/3:1+events21:32:153
249878199239412,2379cyclictest2522762-21kworker/2:1+events20:47:392
249878199239411,2379cyclictest2558253-21kworker/2:0+events22:19:342
249877999238912,2374cyclictest2574293-21kworker/1:0+events23:13:151
249877999238912,2373cyclictest2585402-21kworker/1:1+events23:41:501
249877699238912,2373cyclictest2572550-21kworker/0:0+events23:18:090
249877999238812,2372cyclictest2543667-21kworker/1:0+events21:28:231
249877999238812,2372cyclictest2505107-21kworker/1:0+events19:30:191
249877999238612,2371cyclictest2553013-21kworker/1:0+events22:02:331
249877999238612,2371cyclictest2553013-21kworker/1:0+events22:02:331
249877999238611,2371cyclictest2583681-21kworker/1:2+events00:28:081
249877999238512,2369cyclictest2577606-21kworker/1:1+events23:15:511
249877999238312,2367cyclictest2535558-21kworker/1:1+events21:21:351
249877999238210,2369cyclictest2535558-21kworker/1:1+events21:10:561
249878199238011,2365cyclictest2522762-21kworker/2:1+events20:32:432
249878199237912,2364cyclictest2585278-21kworker/2:0+events00:20:352
249878199237612,2361cyclictest2568015-21kworker/2:2+events22:48:162
24987819923759,2363cyclictest2573367-21kworker/2:0+events23:10:372
249878199237510,2362cyclictest2530981-21kworker/2:2+events21:01:252
249878199237211,2357cyclictest2579252-21kworker/2:2+events23:28:232
249878699236912,2353cyclictest2541981-21kworker/3:2+events21:25:233
249878699236511,2351cyclictest2516301-21kworker/3:1+events20:49:563
249877999236312,2348cyclictest2561579-21kworker/1:1+events22:36:231
249877999236212,2347cyclictest2503472-21kworker/1:2+events19:25:221
249878699236011,2346cyclictest2566595-21kworker/3:2+events22:44:303
249878699235811,2344cyclictest2563004-21kworker/3:0+events22:45:383
249877699235812,2343cyclictest2500008-21kworker/0:1+events19:20:270
249877699235512,2341cyclictest2580776-21kworker/0:0+events23:30:200
249878199235111,2337cyclictest2538990-21kworker/2:0+events21:23:522
249877999235110,2338cyclictest2566233-21kworker/1:0+events22:54:451
249877999235110,2337cyclictest2505107-21kworker/1:0+events19:39:321
249878699234910,2336cyclictest2580611-21kworker/3:2+events23:23:313
249877999234111,2327cyclictest2542010-21kworker/1:2+events21:41:511
249877999234011,2325cyclictest2543667-21kworker/1:0+events21:31:051
249878199233911,2325cyclictest2522762-21kworker/2:1+events20:26:382
24987869923379,2324cyclictest2550033-21kworker/3:1+events21:52:363
249878699233711,2322cyclictest2580611-21kworker/3:2+events23:33:223
249877699233712,2321cyclictest2594039-21kworker/0:2+events00:07:100
249877699233612,2322cyclictest2526025-21kworker/0:2+events20:36:250
249877699233612,2321cyclictest2570952-21kworker/0:1+events22:51:450
249877699233610,2322cyclictest2509913-21kworker/0:2+events19:50:570
249878699233512,2319cyclictest2555251-21kworker/3:0+events22:16:293
249878699233212,2317cyclictest2546827-21kworker/3:2+events21:45:433
249877699233111,2316cyclictest2530833-21kworker/0:1+events20:54:270
249878699232912,2315cyclictest2508255-21kworker/3:2+events19:40:183
249878699232912,2314cyclictest2510157-21kworker/3:0+events19:46:423
249878699232712,2311cyclictest2503773-21kworker/3:0+events19:28:023
249877699232711,2313cyclictest2564725-21kworker/0:0+events22:35:380
249878699232612,2311cyclictest2521075-21kworker/3:0+events20:17:313
249877999232612,2311cyclictest2542010-21kworker/1:2+events21:39:551
249877699232612,2312cyclictest2542279-21kworker/0:0+events21:35:190
249878699232412,2310cyclictest2598464-21kworker/3:2+events00:31:513
24987769923239,2311cyclictest2590460-21kworker/0:1+events00:00:210
249877699232312,2307cyclictest2530833-21kworker/0:1+events20:59:510
249877699232212,2307cyclictest2551634-21kworker/0:1+events22:02:110
249877699232212,2307cyclictest2551634-21kworker/0:1+events22:02:100
249877699232112,2305cyclictest2530833-21kworker/0:1+events21:03:410
249878699231812,2302cyclictest2516301-21kworker/3:1+events20:27:233
249878699231612,2301cyclictest2517935-21kworker/3:2+events20:10:413
249877699231511,2301cyclictest2580776-21kworker/0:0+events23:35:200
249877699231312,2298cyclictest2586822-21kworker/0:2+events23:54:190
249877699231212,2296cyclictest2564725-21kworker/0:0+events22:33:000
249878699230712,2293cyclictest2564903-21kworker/3:1+events22:36:023
249878699230512,2290cyclictest2561279-21kworker/3:1+events22:26:073
249877699230312,2288cyclictest2500008-21kworker/0:1+events19:29:090
249877999229910,2284cyclictest2535558-21kworker/1:1+events21:18:321
249877699229412,2279cyclictest2577487-21kworker/0:1+events23:27:180
249877999227511,2261cyclictest2511331-21kworker/1:1+events19:54:461
249877699227411,2260cyclictest2551634-21kworker/0:1+events22:27:150
249877999226911,2255cyclictest2596708-21kworker/1:0+events00:13:201
249878699225511,2240cyclictest2598464-21kworker/3:2+events00:21:433
249877699225510,2241cyclictest2542279-21kworker/0:0+events21:26:290
249878699225412,2239cyclictest2571127-21kworker/3:2+events22:53:583
249877999225312,2238cyclictest2542010-21kworker/1:2+events21:50:411
249877699225210,2239cyclictest2529163-21kworker/0:0+events20:48:500
249878699224912,2233cyclictest2590165-21kworker/3:0+events23:52:053
249877999224911,2235cyclictest2583681-21kworker/1:2+events23:46:211
249878699224512,2230cyclictest2532192-21kworker/3:0+events20:52:343
249878699224011,2226cyclictest2559647-21kworker/3:2+events22:21:513
249877999223811,2224cyclictest2581270-21kworker/1:1+events23:29:341
249878699222911,2215cyclictest2532192-21kworker/3:0+events21:08:393
249878699222811,2214cyclictest2563004-21kworker/3:0+events23:01:333
249877699222711,2213cyclictest2557034-21kworker/0:0+events22:15:210
249878699222010,2206cyclictest2537422-21kworker/3:1+events21:24:383
249878199222012,2206cyclictest2540624-21kworker/2:1+events21:40:172
249878699221511,2201cyclictest2583800-21kworker/3:1+events23:39:523
249878199221311,2199cyclictest2587089-21kworker/2:1+events23:45:592
249877999221212,2197cyclictest2574293-21kworker/1:0+events23:04:131
249878199220713,2190cyclictest2500188-21kworker/2:2+events19:34:132
249877999220310,2189cyclictest2492092-21kworker/1:1+events19:24:141
24987819922019,2188cyclictest2511733-21kworker/2:2+events19:54:242
249878199220111,2187cyclictest2521132-21kworker/2:2+events20:17:082
249878199220110,2188cyclictest2587089-21kworker/2:1+events23:51:172
24987819922009,2188cyclictest2561460-21kworker/2:1+events22:30:412
249878199220010,2186cyclictest2503565-21kworker/2:1+events19:23:502
249878199219911,2185cyclictest2582227-21kworker/2:1+events23:32:592
249878199219811,2185cyclictest2510028-21kworker/2:0+events19:55:082
249878199219810,2185cyclictest2540624-21kworker/2:1+events21:34:332
24987819921979,2185cyclictest2500188-21kworker/2:2+events19:41:492
249878199219711,2183cyclictest2540624-21kworker/2:1+events21:49:362
249878199219710,2184cyclictest2585278-21kworker/2:0+events00:02:592
249877999219710,2183cyclictest2596708-21kworker/1:0+events00:17:091
249877699219711,2183cyclictest2543950-21kworker/0:1+events21:34:100
24987819921959,2182cyclictest2511733-21kworker/2:2+events20:04:102
249878199219510,2181cyclictest2561460-21kworker/2:1+events22:26:532
24987819921949,2181cyclictest2556613-21kworker/2:2+events22:13:462
249878199219411,2179cyclictest2558253-21kworker/2:0+events22:24:102
249877999219110,2177cyclictest2567954-21kworker/1:2+events22:44:531
249878199218910,2176cyclictest2571276-21kworker/2:2+events23:08:442
249877999218811,2174cyclictest2590813-21kworker/1:1+events23:56:341
249878199218711,2173cyclictest2571276-21kworker/2:2+events23:02:172
249878199218510,2172cyclictest2585278-21kworker/2:0+events00:13:432
249877699218310,2169cyclictest2503743-21kworker/0:0+events19:35:460
24987819921779,2166cyclictest2550154-21kworker/2:2+events21:50:212
24987819921779,2165cyclictest2538990-21kworker/2:0+events21:19:172
249877699217410,2161cyclictest2598193-21kworker/0:0+events00:35:380
249877999217111,2156cyclictest2596708-21kworker/1:0+events00:20:561
249877999216910,2156cyclictest2556643-21kworker/1:2+events22:11:261
249878699216811,2154cyclictest2546827-21kworker/3:2+events21:59:523
249877999216811,2154cyclictest2583681-21kworker/1:2+events00:35:151
249877999216711,2152cyclictest2579296-21kworker/1:0+events23:31:511
249877999216610,2153cyclictest2587160-21kworker/1:0+events23:53:131
249877999216511,2151cyclictest2572274-21kworker/1:2+events23:20:251
249877999216511,2151cyclictest2506806-21kworker/1:2+events19:44:261
249877999216510,2152cyclictest2547003-21kworker/1:0+events21:48:261
249878699216411,2150cyclictest2579001-21kworker/3:0+events23:26:553
24987799921648,2153cyclictest2553013-21kworker/1:0+events21:56:481
24987799921648,2152cyclictest2566233-21kworker/1:0+events22:46:241
249877999216210,2148cyclictest2556643-21kworker/1:2+events22:16:531
24987799921619,2149cyclictest2527714-21kworker/1:2+events20:56:241
24987799921599,2147cyclictest2492092-21kworker/1:1+events19:15:251
24987799921596,2150cyclictest2518059-21kworker/1:1+events20:16:001
249877999215811,2144cyclictest2529344-21kworker/1:1+events20:50:411
249877699215711,2143cyclictest2575801-21kworker/0:2+events23:10:590
249877999215611,2142cyclictest2572274-21kworker/1:2+events22:58:101
249878699215511,2141cyclictest2537422-21kworker/3:1+events21:17:223
249877999215411,2140cyclictest2524422-21kworker/1:1+events20:29:431
249878699215111,2136cyclictest2537422-21kworker/3:1+events21:12:023
249877999214411,2130cyclictest2555005-21kworker/1:1+events22:08:191
249878199214311,2129cyclictest2522762-21kworker/2:1+events20:23:132
249878699214211,2128cyclictest2563004-21kworker/3:0+events22:59:183
249878699214011,2125cyclictest2590165-21kworker/3:0+events23:56:093
249878699214010,2127cyclictest2563004-21kworker/3:0+events22:34:313
249878699213911,2126cyclictest2514592-21kworker/3:2+events20:00:243
249878699213810,2125cyclictest2603020-21kworker/3:1+events00:39:483
249878699213711,2123cyclictest2524391-21kworker/3:0+events20:34:333
24987869921358,2124cyclictest2595014-21kworker/3:1+events00:11:463
249877699213511,2121cyclictest2574203-21kworker/0:1+events23:02:400
249878699213211,2118cyclictest2575742-21kworker/3:2+events23:07:363
249878699213211,2118cyclictest2535499-21kworker/3:2+events21:04:273
249878699213011,2116cyclictest2510157-21kworker/3:0+events19:59:173
249878699213010,2117cyclictest2510157-21kworker/3:0+events19:50:343
249877699213011,2115cyclictest2522700-21kworker/0:2+events20:24:010
249878699212911,2115cyclictest2595014-21kworker/3:1+events00:19:243
249878699212910,2115cyclictest2543635-21kworker/3:0+events21:43:243
249877699212911,2115cyclictest2534065-21kworker/0:0+events21:09:010
249878699212812,2113cyclictest2600128-21kworker/3:0+events00:26:373
249878699212811,2114cyclictest2575742-21kworker/3:2+events23:13:563
249878699212810,2115cyclictest2590165-21kworker/3:0+events00:03:223
249877699212811,2114cyclictest2550005-21kworker/0:2+events21:51:020
249878699212710,2113cyclictest2500098-21kworker/3:1+events19:23:063
249878699212611,2112cyclictest2585494-21kworker/3:0+events23:40:393
249877699212511,2111cyclictest2538957-21kworker/0:1+events21:23:280
249878699212411,2110cyclictest2537422-21kworker/3:1+events21:36:513
249877999212110,2108cyclictest2583681-21kworker/1:2+events00:31:271
24987769921206,2111cyclictest2500008-21kworker/0:1+events19:44:490
249877699212010,2106cyclictest2551634-21kworker/0:1+events21:57:110
249877699211911,2105cyclictest2598193-21kworker/0:0+events00:34:080
249877699211911,2104cyclictest2555154-21kworker/0:2+events22:09:060
249877699211911,2104cyclictest2548388-21kworker/0:1+events21:43:010
249877699211910,2106cyclictest2574203-21kworker/0:1+events23:05:440
249877699211910,2106cyclictest2551634-21kworker/0:1+events22:23:000
249877699211910,2106cyclictest2520099-21kworker/0:1+events20:27:030
249877699211811,2104cyclictest2509913-21kworker/0:2+events20:14:300
249877699211811,2103cyclictest2538957-21kworker/0:1+events21:19:390
249877699211811,2103cyclictest2511511-21kworker/0:0+events19:49:460
249877699211811,2103cyclictest2509913-21kworker/0:2+events19:58:070
24987769921178,2106cyclictest2599878-21kworker/0:1+events00:25:280
249877699211711,2103cyclictest2550005-21kworker/0:2+events21:48:490
249878699211611,2101cyclictest2503773-21kworker/3:0+events19:31:063
24987769921169,2104cyclictest2577487-21kworker/0:1+events23:43:400
249878699211510,2102cyclictest2595014-21kworker/3:1+events00:06:253
249877699211511,2100cyclictest2509913-21kworker/0:2+events20:03:480
249877699211411,2100cyclictest2579150-21kworker/0:2+events23:23:530
249877699211411,2100cyclictest2566448-21kworker/0:2+events22:56:160
24987869921103,2104cyclictest2553327-21kworker/3:1+events22:05:393
249877699210611,2091cyclictest2520099-21kworker/0:1+events20:34:540
24987769921057,2095cyclictest2586822-21kworker/0:2+events23:55:490
249877699210311,2089cyclictest2503743-21kworker/0:0+events19:33:490
249877699210111,2087cyclictest2586822-21kworker/0:2+events23:47:070
24987799920959,2083cyclictest2511331-21kworker/1:1+events19:58:291
249878699209011,2076cyclictest2521075-21kworker/3:0+events20:20:123
249877999207910,2065cyclictest2516390-21kworker/1:2+events20:05:421
249878699207510,2062cyclictest2546827-21kworker/3:2+events22:02:573
249878699207510,2062cyclictest2546827-21kworker/3:2+events22:02:563
24987819920605,2052cyclictest2516157-21kworker/2:0+events20:11:262
249878199204510,2032cyclictest2500188-21kworker/2:2+events19:35:232
249878199204310,2029cyclictest2585278-21kworker/2:0+events23:44:512
24987819920417,2030cyclictest2516157-21kworker/2:0+events20:08:222
24987869920409,2028cyclictest2506620-21kworker/3:1+events19:36:513
249878199204010,2027cyclictest2543520-21kworker/2:2+events21:26:522
24987799920405,2032cyclictest2514712-21kworker/1:0+events20:04:321
24987819920385,2030cyclictest2525995-21kworker/2:0+events20:36:502
24987819920379,2024cyclictest2598163-21kworker/2:2+events00:36:232
24987819920338,2022cyclictest2603079-21kworker/2:0+events00:33:232
249878199202810,2015cyclictest2573367-21kworker/2:0+events23:21:112
24987799920133,2007cyclictest2521102-21kworker/1:2+events20:22:271
24987799920117,2001cyclictest2511331-21kworker/1:1+events19:49:241
24987819920109,1998cyclictest2577575-21kworker/2:1+events23:18:562
24987869920088,1997cyclictest2555251-21kworker/3:0+events22:13:243
249877999200710,1994cyclictest2583681-21kworker/1:2+events00:09:521
249877999200610,1993cyclictest2527714-21kworker/1:2+events20:49:121
24987819920013,1994cyclictest2490604-21kworker/2:1+events19:13:072
249878199200110,1989cyclictest2485721-21kworker/2:0+events19:15:032
249877999199910,1987cyclictest2495289-21kworker/1:2+events19:13:291
249878699198310,1970cyclictest2516301-21kworker/3:1+events20:40:423
24987869919808,1969cyclictest2496839-21kworker/3:2+events19:16:583
24987819919779,1965cyclictest2593634-21kworker/2:1+events00:06:472
24987769919697,1959cyclictest2493720-21kworker/0:0+events19:15:500
249877699196710,1954cyclictest2566448-21kworker/0:2+events22:40:150
249877699196410,1951cyclictest2538957-21kworker/0:1+events21:13:570
24987869919386,1929cyclictest2496839-21kworker/3:2+events19:13:533
24987769918988,1887cyclictest2500008-21kworker/0:1+events19:14:170
24987769918848,1874cyclictest2529163-21kworker/0:0+events20:43:470
24983902166142,20sleep20-21swapper/219:08:042
24985032156114,25sleep00-21swapper/019:09:300
2498418215496,25sleep30-21swapper/319:08:263
24982092137103,29sleep10-21swapper/119:05:471
2498781991710,5cyclictest2601401-21seq00:26:092
249877999160,3cyclictest2593054-21/usr/sbin/munin00:00:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional