You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 17:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Jun 18, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225623599316115,3140cyclictest2278989-21kworker/1:2+events20:45:111
225623599314515,3125cyclictest2262788-21kworker/1:0+events20:00:181
225623599312415,3106cyclictest2355985-21kworker/1:0+events00:20:161
22562359929545,2944cyclictest2267854-21kworker/1:1+events19:50:031
225624199291313,2896cyclictest2334862-21kworker/3:2+events23:45:203
225624199282013,2803cyclictest2306355-21kworker/3:0+events21:55:173
225624199278313,2766cyclictest2296843-21kworker/3:2+events22:08:583
225623899277613,2759cyclictest2285465-21kworker/2:0+events20:59:182
225624199277011,2755cyclictest2346398-21kworker/3:0+events00:00:153
225624199276613,2749cyclictest2339975-21kworker/3:0+events23:33:593
225624199276612,2752cyclictest2296843-21kworker/3:2+events21:30:103
225624199276413,2747cyclictest2286824-21kworker/3:0+events20:44:263
225624199276411,2749cyclictest2318861-21kworker/3:0+events22:28:213
225624199276213,2746cyclictest2322099-21kworker/3:1+events22:34:483
225624199276013,2743cyclictest2296843-21kworker/3:2+events22:21:293
225624199275813,2742cyclictest2277623-21kworker/3:2+events20:17:583
225624199275811,2743cyclictest2323695-21kworker/3:0+events22:41:123
225623599275711,2742cyclictest2283925-21kworker/1:0+events20:34:571
225624199275513,2738cyclictest2293607-21kworker/3:0+events21:18:473
225624199275511,2740cyclictest2275995-21kworker/3:0+events20:22:513
225624199275412,2740cyclictest2346398-21kworker/3:0+events00:15:023
225624199273912,2723cyclictest2288717-21kworker/3:1+events21:00:493
225623599273713,2722cyclictest2331805-21kworker/1:2+events23:10:091
225624199273212,2716cyclictest2288717-21kworker/3:1+events20:55:493
225623599272513,2708cyclictest2293429-21kworker/1:1+events21:03:531
225623599272212,2706cyclictest2262788-21kworker/1:0+events19:46:141
225623599272112,2705cyclictest2310832-21kworker/1:1+events22:03:171
225623599272013,2703cyclictest2303128-21kworker/1:1+events21:38:321
225623599272013,2703cyclictest2278989-21kworker/1:2+events20:23:341
225623599272012,2704cyclictest2291369-21kworker/1:0+events21:08:051
225623599271713,2700cyclictest2317414-21kworker/1:0+events22:26:521
225623599271613,2699cyclictest2283925-21kworker/1:0+events20:37:091
225623599271513,2698cyclictest2303128-21kworker/1:1+events21:41:371
225623599271411,2699cyclictest2309236-21kworker/1:0+events21:56:221
225623599270111,2686cyclictest2323460-21kworker/1:0+events22:39:181
225623199269113,2674cyclictest2263383-21kworker/0:0+events19:42:030
225623599268912,2675cyclictest2306383-21kworker/1:2+events21:51:071
225623899267213,2655cyclictest2292072-21kworker/2:1+events21:10:012
225624199266712,2652cyclictest2304704-21kworker/3:1+events21:39:433
225623599266613,2650cyclictest2347820-21kworker/1:0+events00:08:131
225623199263913,2622cyclictest2285201-21kworker/0:1+events20:42:520
225623199263813,2621cyclictest2271812-21kworker/0:2+events20:35:400
225623899263213,2615cyclictest2355957-21kworker/2:1+events00:35:232
225624199262511,2610cyclictest2326954-21kworker/3:2+events23:05:143
225624199262413,2607cyclictest2288717-21kworker/3:1+events20:47:273
225624199261814,2601cyclictest2296843-21kworker/3:2+events21:51:533
225623199261612,2600cyclictest2293810-21kworker/0:0+events21:28:380
225623599259113,2574cyclictest2325138-21kworker/1:1+events22:42:411
22562389925805,2571cyclictest2335041-21kworker/2:0+events23:26:002
225623899257615,2559cyclictest2270245-21kworker/2:2+events19:55:022
22562419925643,2558cyclictest2284015-21kworker/3:3+events20:38:183
225623599256313,2546cyclictest2261158-21kworker/1:2+events19:41:171
225623599255913,2542cyclictest2278989-21kworker/1:2+events20:54:181
225623899255612,2541cyclictest2355957-21kworker/2:1+events00:33:072
22562359925569,2543cyclictest2262788-21kworker/1:0+events20:07:461
225624199255311,2538cyclictest2314004-21kworker/3:1+events22:10:563
225623899255112,2536cyclictest2292072-21kworker/2:1+events21:00:272
225624199254813,2530cyclictest2267938-21kworker/3:3+events19:45:503
225623899254412,2528cyclictest2309382-21kworker/2:2+events21:59:052
225624199254112,2525cyclictest2296843-21kworker/3:2+events21:46:303
225624199254012,2524cyclictest2284015-21kworker/3:3+events20:51:133
225624199253812,2523cyclictest2293607-21kworker/3:0+events21:20:163
225624199253712,2521cyclictest2301464-21kworker/3:0+events21:29:003
225624199253712,2521cyclictest2266113-21kworker/3:1+events19:52:203
225624199253612,2520cyclictest2275995-21kworker/3:0+events20:32:163
225624199253512,2520cyclictest2317203-21kworker/3:1+events22:17:193
225624199253512,2519cyclictest2334862-21kworker/3:2+events23:21:053
225624199253512,2519cyclictest2326954-21kworker/3:2+events23:04:073
225624199253512,2519cyclictest2326954-21kworker/3:2+events22:55:223
225624199253512,2519cyclictest2296843-21kworker/3:2+events22:04:483
225624199253412,2518cyclictest2255924-21kworker/3:2+events19:18:543
225624199253312,2517cyclictest2266113-21kworker/3:1+events19:40:553
22562419925319,2519cyclictest2320492-21kworker/3:2+events22:37:493
225624199253112,2515cyclictest2358971-21kworker/3:1+events00:27:303
225624199253012,2515cyclictest2272663-21kworker/3:2+events19:59:323
225624199252911,2514cyclictest2346398-21kworker/3:0+events23:58:213
225624199252812,2512cyclictest2339975-21kworker/3:0+events23:41:123
225624199252810,2515cyclictest2346398-21kworker/3:0+events00:13:323
225623599252613,2509cyclictest2275756-21kworker/1:1+events20:17:131
225623899252512,2510cyclictest2328004-21kworker/2:1+events22:58:022
22562419925241,2519cyclictest2293607-21kworker/3:0+events21:06:103
225624199252412,2508cyclictest2304704-21kworker/3:1+events21:42:223
225624199252312,2507cyclictest2272663-21kworker/3:2+events20:07:223
225624199252111,2506cyclictest2360595-21kworker/3:0+events00:39:333
225623599251912,2503cyclictest2347820-21kworker/1:0+events23:52:581
225624199251211,2497cyclictest2360595-21kworker/3:0+events00:34:383
225623599250911,2494cyclictest2340150-21kworker/1:1+events23:30:331
22562359925079,2494cyclictest2326744-21kworker/1:0+events23:19:341
225623599250312,2488cyclictest2296666-21kworker/1:1+events21:26:221
225624199250212,2486cyclictest2270974-21kworker/3:0+events20:00:393
225623899250112,2487cyclictest2309382-21kworker/2:2+events22:05:352
225623599249812,2482cyclictest2291369-21kworker/1:0+events20:56:141
225623599249612,2480cyclictest2315782-21kworker/1:1+events22:19:341
225623599249512,2479cyclictest2296666-21kworker/1:1+events21:20:411
22562359924949,2481cyclictest2280693-21kworker/1:0+events20:27:411
225623599249312,2477cyclictest2315782-21kworker/1:1+events22:23:001
22562359924927,2481cyclictest2295061-21kworker/1:2+events21:18:251
225623599249212,2476cyclictest2326744-21kworker/1:0+events22:59:551
22562359924914,2483cyclictest2285524-21kworker/1:1+events20:40:351
22562359924913,2484cyclictest2331805-21kworker/1:2+events23:07:081
225623599249112,2475cyclictest2312492-21kworker/1:2+events22:13:571
225623899249012,2475cyclictest2267824-21kworker/2:1+events20:04:222
22562359924905,2481cyclictest2319040-21kworker/1:2+events22:34:281
225623599249012,2475cyclictest2299893-21kworker/1:0+events21:30:321
22562359924899,2477cyclictest2344654-21kworker/1:2+events23:49:321
22562359924896,2479cyclictest2262788-21kworker/1:0+events19:37:041
225623599248912,2473cyclictest2314121-21kworker/1:0+events22:08:361
225624199248810,2475cyclictest2255924-21kworker/3:2+events19:23:473
225624199248712,2470cyclictest2346398-21kworker/3:0+events23:50:193
225623899248712,2471cyclictest2313942-21kworker/2:1+events22:10:332
225624199248611,2472cyclictest2333261-21kworker/3:1+events23:11:423
225623599248612,2471cyclictest2261158-21kworker/1:2+events19:24:331
225623599248612,2470cyclictest2344654-21kworker/1:2+events23:44:111
225623599248512,2469cyclictest2319040-21kworker/1:2+events22:51:351
225623599248511,2471cyclictest2336664-21kworker/1:2+events23:26:241
22562319924857,2474cyclictest2340062-21kworker/0:2+events23:37:010
225623899248412,2468cyclictest2335041-21kworker/2:0+events23:55:392
225623899248412,2468cyclictest2264687-21kworker/2:2+events19:36:422
225623599248411,2469cyclictest2275756-21kworker/1:1+events20:10:271
225623899248312,2468cyclictest2307721-21kworker/2:1+events21:53:002
225623599248312,2467cyclictest2340150-21kworker/1:1+events23:56:481
225623599248312,2467cyclictest2262788-21kworker/1:0+events19:33:171
225624199248011,2467cyclictest2334862-21kworker/3:2+events23:15:073
22562359924808,2468cyclictest2326744-21kworker/1:0+events22:48:061
225623599247911,2465cyclictest2340150-21kworker/1:1+events23:38:331
225624199247510,2462cyclictest2323695-21kworker/3:0+events22:53:283
225623599247412,2458cyclictest2351156-21kworker/1:1+events00:16:531
225623599246511,2451cyclictest2357610-21kworker/1:1+events00:28:361
225624199246312,2447cyclictest2262548-21kworker/3:0+events19:35:133
225624199246311,2448cyclictest2325346-21kworker/3:1+events22:45:243
225624199245610,2443cyclictest2275995-21kworker/3:0+events20:27:193
225624199245511,2441cyclictest2334862-21kworker/3:2+events23:29:473
225624199245212,2436cyclictest2346398-21kworker/3:0+events00:21:273
225624199244911,2435cyclictest2255924-21kworker/3:2+events19:27:573
225624199244712,2432cyclictest2339975-21kworker/3:0+events23:39:433
225624199244712,2432cyclictest2262548-21kworker/3:0+events19:32:093
225624199244712,2431cyclictest2295211-21kworker/3:1+events21:12:413
225624199244312,2428cyclictest2275995-21kworker/3:0+events20:11:313
225623899244312,2428cyclictest2262758-21kworker/2:0+events19:29:302
22562319924409,2427cyclictest2319011-21kworker/0:0+events22:30:390
225623899242711,2413cyclictest2296979-21kworker/2:0+events21:25:372
225623899242412,2409cyclictest2335041-21kworker/2:0+events23:32:512
225624199242212,2407cyclictest2351552-21kworker/3:1+events00:05:533
225623599242212,2406cyclictest2267854-21kworker/1:1+events19:56:101
225623599242112,2406cyclictest2259510-21kworker/1:0+events19:18:311
225623599242112,2405cyclictest2336664-21kworker/1:2+events23:21:291
225623199241511,2400cyclictest2271812-21kworker/0:2+events20:30:230
225623899241412,2399cyclictest2280466-21kworker/2:2+events20:21:432
225623899241312,2397cyclictest2270245-21kworker/2:2+events19:51:112
225623599241312,2397cyclictest2296666-21kworker/1:1+events21:13:031
225623899241212,2397cyclictest2320677-21kworker/2:1+events22:37:042
225623899241110,2398cyclictest2323548-21kworker/2:2+events22:43:062
225623199241112,2397cyclictest2357676-21kworker/0:1+events00:30:080
225623199241112,2396cyclictest2293810-21kworker/0:0+events21:09:130
225623199241112,2395cyclictest2330302-21kworker/0:2+events23:13:140
225623199241112,2395cyclictest2271812-21kworker/0:2+events20:16:050
225623899241011,2396cyclictest2337244-21kworker/2:1+events23:24:522
225623899240911,2395cyclictest2296979-21kworker/2:0+events21:46:552
225623899240910,2395cyclictest2285465-21kworker/2:0+events20:45:332
225623199240912,2393cyclictest2290637-21kworker/0:2+events21:38:100
225623599240812,2392cyclictest2255768-21kworker/1:1+events19:27:351
225623599240711,2393cyclictest2347820-21kworker/1:0+events00:04:471
225623899240612,2390cyclictest2343209-21kworker/2:2+events23:43:062
225623899240612,2390cyclictest2335041-21kworker/2:0+events23:38:552
225623599240511,2391cyclictest2354357-21kworker/1:2+events00:38:271
225623899240410,2391cyclictest2274423-21kworker/2:0+events20:05:282
22562359924019,2388cyclictest2326744-21kworker/1:0+events23:02:571
225623599239712,2382cyclictest2354357-21kworker/1:2+events00:14:411
225623899239212,2377cyclictest2323548-21kworker/2:2+events22:50:262
225623899238812,2374cyclictest2282292-21kworker/2:1+events20:39:062
225623599238512,2369cyclictest2303128-21kworker/1:1+events21:47:411
225623899237112,2356cyclictest2335041-21kworker/2:0+events23:14:462
225623899236512,2349cyclictest2313942-21kworker/2:1+events22:16:322
225623899236212,2347cyclictest2317173-21kworker/2:0+events22:21:512
22562389923549,2343cyclictest2287399-21kworker/2:2+events20:50:042
225623199235412,2339cyclictest2360715-21kworker/0:0+events00:39:540
225623599234911,2335cyclictest2255768-21kworker/1:1+events19:13:111
225623899233812,2323cyclictest2320677-21kworker/2:1+events22:32:562
225623199233811,2324cyclictest2263383-21kworker/0:0+events19:49:180
225623899233711,2322cyclictest2354237-21kworker/2:0+events00:19:092
225623899233611,2322cyclictest2325227-21kworker/2:0+events22:46:332
225623899233212,2317cyclictest2267824-21kworker/2:1+events20:18:222
225623199233112,2316cyclictest2333597-21kworker/0:1+events23:20:430
225623899232912,2313cyclictest2260981-21kworker/2:2+events19:22:382
225623899232910,2315cyclictest2304425-21kworker/2:2+events21:40:292
225623199232911,2315cyclictest2304642-21kworker/0:1+events21:45:230
225623199232910,2315cyclictest2269401-21kworker/0:1+events19:55:240
225623899232712,2311cyclictest2355957-21kworker/2:1+events00:21:502
225623199232712,2311cyclictest2271812-21kworker/0:2+events20:11:550
225623899232612,2311cyclictest2333198-21kworker/2:2+events23:15:302
225623899232412,2309cyclictest2280466-21kworker/2:2+events20:28:522
225623899232312,2307cyclictest2348095-21kworker/2:2+events00:07:042
225623899232312,2307cyclictest2254407-21kworker/2:0+events19:13:562
225623899232311,2308cyclictest2354237-21kworker/2:0+events00:13:112
225623199232311,2309cyclictest2338223-21kworker/0:0+events23:29:020
225623199232311,2309cyclictest2315669-21kworker/0:2+events22:24:340
225623899232012,2305cyclictest2262758-21kworker/2:0+events19:34:492
225623199231812,2302cyclictest2293810-21kworker/0:0+events21:31:400
225623199231611,2302cyclictest2290637-21kworker/0:2+events21:52:140
225623199231512,2300cyclictest2344971-21kworker/0:0+events23:53:450
225623899230811,2294cyclictest2262758-21kworker/2:0+events19:44:172
225624199227610,2262cyclictest2254322-21kworker/3:1+events19:12:493
225623899227511,2260cyclictest2335041-21kworker/2:0+events23:46:052
225623199226512,2250cyclictest2285201-21kworker/0:1+events20:57:240
225623199224712,2232cyclictest2343058-21kworker/0:1+events23:46:290
225623899222810,2216cyclictest2296979-21kworker/2:0+events21:35:302
225623199220411,2190cyclictest2330302-21kworker/0:2+events23:04:290
225623599217311,2159cyclictest2357610-21kworker/1:1+events00:33:301
225623199217110,2158cyclictest2323665-21kworker/0:1+events22:59:110
225623199213510,2122cyclictest2312371-21kworker/0:1+events22:12:270
225623899212711,2113cyclictest2318801-21kworker/2:2+events22:25:422
225623899212010,2107cyclictest2328004-21kworker/2:1+events23:05:382
225623199211810,2105cyclictest2234230-21kworker/0:1+events19:24:540
225623199211710,2104cyclictest2309323-21kworker/0:0+events22:00:370
225623899211411,2100cyclictest2346158-21kworker/2:1+events23:50:422
225623199210211,2088cyclictest2331927-21kworker/0:0+events23:08:390
225623899209711,2082cyclictest2311043-21kworker/2:0+events22:03:402
225623199209711,2083cyclictest2349733-21kworker/0:3+events00:01:000
225623899201810,2004cyclictest2330213-21kworker/2:0+events23:01:242
22562319919976,1988cyclictest2315669-21kworker/0:2+events22:38:310
225623199196310,1949cyclictest2254146-21kworker/0:0+events19:11:180
22562389919598,1948cyclictest2294971-21kworker/2:2+events21:16:042
22562319919499,1936cyclictest2261273-21kworker/0:2+events19:30:150
22547142191164,22sleep00-21swapper/019:05:020
22559102157126,25sleep30-21swapper/319:08:143
22558412150105,26sleep10-21swapper/119:07:191
22557262142106,29sleep20-21swapper/219:05:532
225623199311,22cyclictest2311141-21munin-run22:00:000
225623899272,23cyclictest2276734-21runrttasks20:10:162
2256231992715,10cyclictest2296909-21/usr/sbin/munin21:15:010
225623199251,19cyclictest0-21swapper/020:45:010
225623899248,11cyclictest2269269-21taskset19:47:252
225623899240,21cyclictest2302150-21smartctl21:30:152
2256231992416,7cyclictest2293737-21cron21:05:000
225623199241,20cyclictest2326975-21idleruntime-cro22:50:000
225623199241,18cyclictest2320654-21idleruntime-cro22:30:000
225623199240,21cyclictest0-21swapper/000:05:200
225623199239,11cyclictest2266331-21sendmail19:40:000
2256231992313,6cyclictest2348333-21apt-get23:55:120
225623199230,19cyclictest2263073-21sort19:30:000
225623899225,14cyclictest2287175-21awk20:45:002
225623899221,17cyclictest2259716-21munin-run19:20:002
225623199223,16cyclictest2359241-21basename00:30:000
2256231992216,4cyclictest2317474-21idleruntime-cro22:19:590
225623199221,18cyclictest2336755-21sendmail23:20:010
225623199221,18cyclictest2259745-21basename19:20:000
225623199221,17cyclictest607-21rs:main0
225623899211,17cyclictest2359242-21awk00:29:592
225623899211,17cyclictest2351329-21basename00:04:592
225623199211,18cyclictest2282424-21idleruntime-cro20:30:000
225623199211,17cyclictest2355286-21awk00:15:170
225623199211,17cyclictest2344921-21idleruntime-cro23:45:010
225623199211,17cyclictest2298512-21idleruntime-cro21:20:010
2256231992111,6cyclictest558333-21systemd-journal22:40:160
225623199211,16cyclictest2357654-21munin-run00:25:000
225623199201,16cyclictest2327736-21hddtemp_smartct22:50:140
225623199201,16cyclictest2306429-21awk21:45:010
225623899191,16cyclictest2284001-21perf-exec20:35:002
225623199191,14cyclictest2280234-21ps20:20:190
225623199190,10cyclictest2290534-21chrt20:54:390
225623899183,12cyclictest2296920-21awk21:15:002
2256231991812,3cyclictest2269516-21gpgv19:50:010
225623199181,14cyclictest609-21NetworkManager21:20:180
225623199181,14cyclictest2354482-21awk00:14:590
225623199180,8cyclictest2273163-21/usr/sbin/munin20:00:200
225623199180,15cyclictest2274739-21/usr/sbin/munin20:05:200
225623199180,10cyclictest2340403-21/usr/sbin/munin23:30:150
225623899171,13cyclictest2299295-21sshd21:20:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional