You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 19:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sun Sep 06, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
240552499332615,3307cyclictest2415134-21kworker/0:1+events19:45:010
240553399289114,2872cyclictest2446984-21kworker/3:1+events21:20:023
240553399281213,2796cyclictest2506687-21kworker/3:1+events00:25:133
240553399278613,2769cyclictest2431307-21kworker/3:0+events20:43:213
240553399268813,2671cyclictest2452150-21kworker/3:1+events21:35:143
240552999267813,2661cyclictest2490882-21kworker/2:1+events23:35:192
240552999267711,2662cyclictest2432687-21kworker/2:1+events20:54:502
240552799267313,2657cyclictest2469872-21kworker/1:1+events22:40:131
240552799266013,2643cyclictest2450523-21kworker/1:2+events21:51:291
240552799265213,2635cyclictest2479288-21kworker/1:1+events22:57:551
240553399264613,2628cyclictest2434569-21kworker/3:1+events20:50:143
240552799264613,2629cyclictest2445319-21kworker/1:1+events21:15:461
240552499263513,2618cyclictest2421580-21kworker/0:1+events20:30:000
240552999262111,2606cyclictest2454173-21kworker/2:2+events21:55:172
240553399261611,2601cyclictest2471654-21kworker/3:2+events22:55:123
240552499260312,2587cyclictest2469831-21kworker/0:1+events22:26:510
240552999257812,2562cyclictest2403334-21kworker/2:0+events19:24:002
240553399257312,2557cyclictest2503833-21kworker/3:0+events00:19:593
240552499257312,2558cyclictest2506988-21kworker/0:3+events00:33:260
240552499256912,2553cyclictest2503716-21kworker/0:2+events00:28:570
240553399256710,2553cyclictest2402058-21kworker/3:0+events19:20:573
240553399256611,2551cyclictest2471654-21kworker/3:2+events23:21:353
240552499256612,2551cyclictest2463773-21kworker/0:2+events22:13:490
24055249925658,2554cyclictest2410194-21kworker/0:2+events19:23:380
240552499256512,2549cyclictest2443870-21kworker/0:0+events21:13:550
240553399256412,2548cyclictest2424662-21kworker/3:0+events20:22:003
240553399256412,2548cyclictest2424662-21kworker/3:0+events20:12:293
24055339925588,2546cyclictest2402058-21kworker/3:0+events19:58:183
24055249925570,2553cyclictest2458962-21kworker/0:1+events22:00:580
240553399255412,2539cyclictest2458921-21kworker/3:1+events22:16:293
240552499255210,2538cyclictest2421580-21kworker/0:1+events19:59:490
240553399255012,2534cyclictest2405597-21kworker/3:1+events19:11:263
240552999255012,2535cyclictest2423685-21kworker/2:2+events20:16:442
240552499254912,2534cyclictest2449043-21kworker/0:2+events21:26:300
240552999254812,2533cyclictest2431095-21kworker/2:2+events20:31:542
240552499254811,2533cyclictest2489328-21kworker/0:0+events23:36:060
240553399254312,2527cyclictest2440733-21kworker/3:1+events21:04:003
24055249925409,2528cyclictest2434205-21kworker/0:2+events21:05:120
240552799253713,2520cyclictest2423389-21kworker/1:0+events20:15:141
240552499253611,2521cyclictest2421580-21kworker/0:1+events20:38:260
240553399253411,2519cyclictest2458921-21kworker/3:1+events22:34:033
240552799253110,2518cyclictest2423389-21kworker/1:0+events20:45:161
240553399252012,2505cyclictest2471654-21kworker/3:2+events23:28:263
240553399251612,2500cyclictest2402058-21kworker/3:0+events19:40:493
240552499251212,2496cyclictest2485848-21kworker/0:1+events23:27:190
240552499251012,2495cyclictest2485848-21kworker/0:1+events00:13:280
240552499250712,2491cyclictest2463773-21kworker/0:2+events22:18:230
240553399250112,2485cyclictest2458921-21kworker/3:1+events21:59:273
240552499250112,2486cyclictest2443870-21kworker/0:0+events21:15:230
240552499250111,2486cyclictest2435811-21kworker/0:0+events20:42:350
240553399250011,2485cyclictest2418529-21kworker/3:1+events19:52:133
240552999249911,2485cyclictest2443775-21kworker/2:2+events21:12:452
240553399249812,2482cyclictest2481488-21kworker/3:0+events23:09:013
240553399249812,2482cyclictest2468322-21kworker/3:2+events22:23:013
240553399249812,2482cyclictest2468322-21kworker/3:2+events22:23:013
240553399249712,2482cyclictest2471654-21kworker/3:2+events23:15:503
240553399249712,2481cyclictest2420217-21kworker/3:2+events20:05:343
240552999249712,2481cyclictest2460343-21kworker/2:0+events22:01:212
240552499249712,2481cyclictest2445497-21kworker/0:1+events21:23:490
240553399249612,2480cyclictest2460584-21kworker/3:2+events22:00:363
240553399249612,2480cyclictest2448976-21kworker/3:2+events21:34:073
240552499249612,2480cyclictest2511361-21kworker/0:1+events00:39:130
240553399249512,2479cyclictest2471654-21kworker/3:2+events23:42:573
240552499249512,2480cyclictest2485848-21kworker/0:1+events23:30:430
240553399249411,2480cyclictest2420217-21kworker/3:2+events20:00:363
240552999249412,2479cyclictest2414943-21kworker/2:0+events19:51:272
240552499249412,2479cyclictest2474862-21kworker/0:0+events23:00:350
240552499249412,2479cyclictest2440640-21kworker/0:0+events20:59:500
240552499249412,2479cyclictest2434205-21kworker/0:2+events21:01:220
240553399249312,2479cyclictest2500447-21kworker/3:1+events00:10:023
240553399249312,2478cyclictest2454064-21kworker/3:0+events21:43:583
240552499249212,2478cyclictest2484164-21kworker/0:0+events23:15:040
240552499249212,2477cyclictest2405321-21kworker/0:1+events19:18:200
240552499249211,2478cyclictest2421580-21kworker/0:1+events20:18:170
240553399249112,2475cyclictest2439081-21kworker/3:0+events20:57:333
240552499249112,2476cyclictest2408582-21kworker/0:0+events19:38:540
24055249924909,2477cyclictest2480967-21kworker/0:2+events23:09:440
240552499248912,2474cyclictest2408582-21kworker/0:0+events19:33:340
240553399248712,2472cyclictest2455811-21kworker/3:2+events21:48:043
240552499248712,2471cyclictest2482579-21kworker/0:1+events23:10:500
240553399248612,2471cyclictest2431307-21kworker/3:0+events20:34:373
240553399248612,2470cyclictest2427969-21kworker/3:2+events20:19:023
240552999248611,2471cyclictest2413346-21kworker/2:2+events19:32:272
240553399248512,2470cyclictest2490971-21kworker/3:1+events23:36:283
240552499248511,2470cyclictest2469831-21kworker/0:1+events22:33:170
240553399248312,2467cyclictest2492605-21kworker/3:0+events23:57:003
240553399248312,2467cyclictest2492605-21kworker/3:0+events23:57:003
240552999248311,2468cyclictest2495473-21kworker/2:1+events23:50:132
240553399248210,2468cyclictest2502172-21kworker/3:2+events00:33:053
240553399248111,2467cyclictest2510083-21kworker/3:1+events00:35:453
240553399248012,2464cyclictest2471654-21kworker/3:2+events22:53:173
240552499247912,2463cyclictest2476539-21kworker/0:2+events22:52:080
240552499247910,2465cyclictest2416912-21kworker/0:3+events19:46:090
240553399247812,2464cyclictest2431307-21kworker/3:0+events20:35:193
240552499247812,2462cyclictest2457293-21kworker/0:0+events21:48:510
240553399247712,2462cyclictest2402058-21kworker/3:0+events19:34:213
240553399247712,2461cyclictest2462809-21kworker/3:0+events22:08:513
240553399247711,2463cyclictest2495506-21kworker/3:1+events23:50:363
240553399247710,2464cyclictest2437324-21kworker/3:2+events20:46:253
240552799247713,2461cyclictest2455603-21kworker/1:1+events21:49:151
240552499247612,2460cyclictest2428126-21kworker/0:2+events20:20:310
240552499247512,2459cyclictest2454056-21kworker/0:2+events21:39:250
240553399247412,2459cyclictest2402058-21kworker/3:0+events19:38:073
240552999247412,2459cyclictest2454173-21kworker/2:2+events21:42:272
240552499247412,2458cyclictest2416912-21kworker/0:3+events19:52:340
240552799246512,2451cyclictest2482644-21kworker/1:1+events23:10:071
240552499246512,2449cyclictest2421580-21kworker/0:1+events20:32:190
240552499245810,2444cyclictest2471511-21kworker/0:0+events22:35:580
240552799245212,2437cyclictest2508248-21kworker/1:1+events00:32:201
240552499245212,2437cyclictest2474862-21kworker/0:0+events22:47:310
240552999244612,2431cyclictest2485699-21kworker/2:1+events23:17:232
240553399244512,2430cyclictest2492605-21kworker/3:0+events00:03:123
240552999244512,2429cyclictest2501818-21kworker/2:2+events00:06:162
240552999244512,2429cyclictest2501818-21kworker/2:2+events00:06:162
240552799244511,2430cyclictest2509876-21kworker/1:2+events00:39:351
240552799244111,2427cyclictest2485165-21kworker/1:0+events23:26:121
240552499244111,2427cyclictest2421580-21kworker/0:1+events20:04:500
240552499243812,2423cyclictest2452120-21kworker/0:1+events21:31:250
240552799242911,2414cyclictest2410564-21kworker/1:1+events20:04:251
24055279924259,2412cyclictest2498861-21kworker/1:1+events00:08:101
24055279924259,2412cyclictest2498861-21kworker/1:1+events00:08:101
240552499242512,2410cyclictest2497103-21kworker/0:2+events23:51:450
24055279924228,2411cyclictest2463653-21kworker/1:2+events22:09:141
240552799242112,2405cyclictest2418500-21kworker/1:2+events19:50:201
240552799242111,2407cyclictest2492546-21kworker/1:0+events00:00:531
240552799241711,2403cyclictest2506628-21kworker/1:0+events00:27:481
240552999241412,2399cyclictest2473429-21kworker/2:1+events22:45:132
240552799241412,2399cyclictest2423389-21kworker/1:0+events20:59:261
240552799241312,2397cyclictest2423389-21kworker/1:0+events20:39:341
240552799241212,2397cyclictest2461993-21kworker/1:1+events22:18:461
240553399241111,2396cyclictest2429705-21kworker/3:1+events20:27:423
240552499241111,2396cyclictest2452120-21kworker/0:1+events21:42:050
240552999240912,2394cyclictest2452330-21kworker/2:1+events21:39:472
24055279924089,2396cyclictest2497050-21kworker/1:2+events23:55:301
24055279924089,2396cyclictest2497050-21kworker/1:2+events23:55:301
240552799240812,2392cyclictest2423389-21kworker/1:0+events20:08:151
240552799240810,2395cyclictest2410564-21kworker/1:1+events19:31:191
240552999240610,2392cyclictest2477743-21kworker/2:0+events23:00:582
240552799240612,2390cyclictest2463653-21kworker/1:2+events22:29:091
240552799240612,2390cyclictest2461993-21kworker/1:1+events22:11:111
240552999240012,2385cyclictest2481040-21kworker/2:2+events23:34:342
240552999239810,2384cyclictest2432687-21kworker/2:1+events20:38:022
24055249923987,2387cyclictest2469831-21kworker/0:1+events22:44:280
240552799239310,2380cyclictest2434460-21kworker/1:1+events20:40:191
240553399238911,2374cyclictest2471654-21kworker/3:2+events23:10:293
240552799238511,2371cyclictest2410564-21kworker/1:1+events19:45:461
240553399238310,2369cyclictest2489287-21kworker/3:0+events23:32:153
240553399237411,2359cyclictest2407074-21kworker/3:3+events19:15:393
240552799237311,2358cyclictest2463653-21kworker/1:2+events22:30:421
240552999237111,2356cyclictest2481040-21kworker/2:2+events23:40:152
240552999236812,2352cyclictest2426483-21kworker/2:0+events20:14:512
240553399236512,2350cyclictest2440733-21kworker/3:1+events21:08:133
240552999235411,2339cyclictest2463803-21kworker/2:0+events22:32:562
240552799235312,2337cyclictest2492546-21kworker/1:0+events23:48:421
240552799235212,2336cyclictest2461993-21kworker/1:1+events22:04:371
240552799235211,2337cyclictest2440608-21kworker/1:2+events21:22:411
240552999235112,2337cyclictest2505081-21kworker/2:0+events00:28:322
240552499235111,2336cyclictest2498766-21kworker/0:0+events00:19:120
240552799234912,2334cyclictest2423389-21kworker/1:0+events21:07:291
240552799234811,2334cyclictest2463653-21kworker/1:2+events22:20:411
240552799234811,2334cyclictest2463653-21kworker/1:2+events22:20:411
240552499234810,2334cyclictest2485848-21kworker/0:1+events23:45:130
240552799234712,2331cyclictest2420127-21kworker/1:0+events19:57:101
240552999234411,2330cyclictest2508398-21kworker/2:2+events00:36:092
240552999234311,2330cyclictest2481040-21kworker/2:2+events23:26:332
240552799234312,2328cyclictest2489225-21kworker/1:1+events23:31:061
240552999234212,2326cyclictest2505081-21kworker/2:0+events00:17:402
240552999234210,2329cyclictest2458739-21kworker/2:1+events22:14:562
240552999234111,2326cyclictest2445408-21kworker/2:0+events21:16:342
240552799234012,2324cyclictest2452420-21kworker/1:0+events21:35:371
240552999233910,2325cyclictest2454173-21kworker/2:2+events21:52:582
240552799233911,2325cyclictest2410564-21kworker/1:1+events19:43:271
240552999233811,2323cyclictest2432687-21kworker/2:1+events21:08:582
240552799233812,2322cyclictest2469872-21kworker/1:1+events22:38:391
240553399233712,2322cyclictest2402058-21kworker/3:0+events19:48:023
240552999233510,2322cyclictest2492724-21kworker/2:0+events23:45:592
240553399233412,2318cyclictest2454064-21kworker/3:0+events21:53:223
240552799233312,2318cyclictest2474893-21kworker/1:0+events22:54:491
240552799233212,2317cyclictest2450523-21kworker/1:2+events21:32:331
24055299923317,2320cyclictest2492724-21kworker/2:0+events23:56:372
24055299923317,2320cyclictest2492724-21kworker/2:0+events23:56:372
240552799233112,2315cyclictest2406657-21kworker/1:1+events19:14:091
240552499233112,2316cyclictest2505448-21kworker/0:1+events00:20:440
240552799233011,2315cyclictest2415002-21kworker/1:0+events19:37:421
240553399232912,2313cyclictest2502172-21kworker/3:2+events00:21:523
240552999232912,2314cyclictest2432687-21kworker/2:1+events21:02:532
240552799232911,2314cyclictest2504263-21kworker/1:2+events00:23:431
240552799232812,2312cyclictest2498861-21kworker/1:1+events00:17:191
240552799232812,2312cyclictest2497050-21kworker/1:2+events23:52:081
240552799232811,2313cyclictest2473202-21kworker/1:2+events23:07:501
240552799232810,2315cyclictest2423389-21kworker/1:0+events20:33:271
240552799232712,2312cyclictest2492546-21kworker/1:0+events23:39:321
240552799232712,2312cyclictest2450523-21kworker/1:2+events21:56:491
240552799232712,2312cyclictest2440608-21kworker/1:2+events21:13:081
240552999232612,2311cyclictest2463803-21kworker/2:0+events22:24:562
240552999232612,2311cyclictest2463803-21kworker/2:0+events22:24:562
240552799232612,2311cyclictest2450523-21kworker/1:2+events21:41:181
240553399232512,2309cyclictest2471654-21kworker/3:2+events22:36:453
240552999232510,2312cyclictest2473429-21kworker/2:1+events22:50:132
240552799232511,2310cyclictest2423389-21kworker/1:0+events20:29:121
240552999232412,2309cyclictest2418408-21kworker/2:1+events20:05:102
24055279923249,2312cyclictest2474893-21kworker/1:0+events22:49:501
240552499232012,2305cyclictest2485848-21kworker/0:1+events00:07:010
240552499232012,2305cyclictest2485848-21kworker/0:1+events00:07:000
240553399231812,2302cyclictest2458921-21kworker/3:1+events22:28:013
240552999231712,2301cyclictest2432687-21kworker/2:1+events20:49:522
240552999231611,2302cyclictest2426483-21kworker/2:0+events20:20:532
240552499231412,2299cyclictest2457293-21kworker/0:0+events22:09:380
240552999231212,2297cyclictest2473429-21kworker/2:1+events22:41:472
240552799231211,2297cyclictest2480950-21kworker/1:0+events23:03:401
240552499231212,2296cyclictest2457293-21kworker/0:0+events21:59:040
240552999231112,2295cyclictest2458739-21kworker/2:1+events22:06:342
240552999231112,2295cyclictest2421762-21kworker/2:0+events20:02:302
240552999231012,2295cyclictest2432687-21kworker/2:1+events20:59:022
240552999231011,2296cyclictest2443775-21kworker/2:2+events21:21:332
240552799230912,2294cyclictest2410564-21kworker/1:1+events20:14:041
240552999230812,2293cyclictest2418408-21kworker/2:1+events19:56:002
240552999230811,2294cyclictest2458739-21kworker/2:1+events22:16:522
240552999230810,2295cyclictest2481040-21kworker/2:2+events23:11:132
24055249923089,2295cyclictest2423289-21kworker/0:0+events20:05:580
240552799230611,2289cyclictest2447014-21kworker/1:0+events21:26:531
240552999230411,2289cyclictest2479380-21kworker/2:1+events23:06:422
240552799230310,2290cyclictest2423389-21kworker/1:0+events20:54:271
240553399230111,2287cyclictest2442354-21kworker/3:0+events21:17:443
240552499229910,2286cyclictest2457293-21kworker/0:0+events21:54:530
240552499228511,2271cyclictest2410194-21kworker/0:2+events19:25:340
240552999228311,2268cyclictest2431095-21kworker/2:2+events20:28:512
240553399227410,2261cyclictest2465108-21kworker/3:2+events22:13:263
240552499227411,2261cyclictest2485848-21kworker/0:1+events00:00:060
240553399227211,2258cyclictest2492605-21kworker/3:0+events00:07:473
240553399227211,2258cyclictest2492605-21kworker/3:0+events00:07:473
240552499227211,2257cyclictest2434205-21kworker/0:2+events20:53:190
240552499227210,2259cyclictest2485848-21kworker/0:1+events23:21:580
240553399227110,2257cyclictest2448976-21kworker/3:2+events21:28:223
240553399226911,2255cyclictest2473294-21kworker/3:0+events22:41:233
240552799226911,2254cyclictest2408675-21kworker/1:2+events19:20:361
240552499226811,2253cyclictest2405321-21kworker/0:1+events19:12:110
240552499226810,2254cyclictest2479316-21kworker/0:1+events22:58:190
24055249922679,2254cyclictest2489328-21kworker/0:0+events23:44:050
240552499226710,2253cyclictest2421580-21kworker/0:1+events20:10:350
240553399226510,2252cyclictest2410177-21kworker/3:1+events19:28:163
24055339922639,2251cyclictest2495506-21kworker/3:1+events23:49:063
240552999226311,2249cyclictest2468262-21kworker/2:2+events22:25:412
240552999226211,2248cyclictest2505081-21kworker/2:0+events00:22:592
240553399226110,2248cyclictest2479594-21kworker/3:1+events23:00:133
240552999225111,2236cyclictest2455980-21kworker/2:0+events21:46:582
240552999224412,2228cyclictest2498798-21kworker/2:1+events00:01:162
240552999221811,2204cyclictest2410432-21kworker/2:1+events19:27:542
240552999221010,2196cyclictest2406750-21kworker/2:2+events19:17:552
240552799220611,2193cyclictest2440608-21kworker/1:2+events21:00:591
240552999219512,2180cyclictest2413346-21kworker/2:2+events19:41:112
240552799217411,2159cyclictest2408675-21kworker/1:2+events19:27:071
240552999215912,2143cyclictest2498798-21kworker/2:1+events00:13:522
240552999213412,2119cyclictest2418408-21kworker/2:1+events19:47:172
24055249921336,2124cyclictest2485848-21kworker/0:1+events23:57:450
24055249921336,2124cyclictest2485848-21kworker/0:1+events23:57:450
24055279921317,2120cyclictest2429611-21kworker/1:1+events20:24:381
240552799213111,2116cyclictest2408675-21kworker/1:2+events19:18:421
240552799212811,2115cyclictest2490913-21kworker/1:2+events23:41:001
240552999212712,2112cyclictest2471687-21kworker/2:2+events22:35:122
240552799212711,2113cyclictest2482644-21kworker/1:1+events23:15:271
24055299921219,2109cyclictest2450434-21kworker/2:0+events21:30:182
240552999212011,2106cyclictest2432687-21kworker/2:1+events20:44:312
240552999212010,2106cyclictest2450434-21kworker/2:0+events21:28:002
240552799211910,2106cyclictest2485165-21kworker/1:0+events23:22:221
240552999211811,2103cyclictest2485699-21kworker/2:1+events23:20:272
240553399211310,2099cyclictest2471654-21kworker/3:2+events22:47:083
24055249921089,2096cyclictest2437451-21kworker/0:1+events20:47:320
24055299921058,2093cyclictest2505081-21kworker/2:0+events00:32:412
24055339920985,2090cyclictest2442354-21kworker/3:0+events21:10:523
240552999208310,2070cyclictest2413346-21kworker/2:2+events19:36:142
240552999200711,1993cyclictest2477743-21kworker/2:0+events22:56:452
24055279919638,1952cyclictest2502141-21kworker/1:0+events00:11:331
240552999195910,1946cyclictest2406750-21kworker/2:2+events19:14:302
24039292156112,26sleep00-21swapper/019:05:030
24050532152103,43sleep30-21swapper/319:07:193
24051982140112,23sleep20-21swapper/219:09:102
24050062140108,26sleep10-21swapper/119:06:451
240552499146,5cyclictest2467469-21df22:20:140
240552499146,5cyclictest2467469-21df22:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional