You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 08:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Mon Mar 23, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292575599405817,4035cyclictest3009652-21kworker/3:1+events00:05:003
292575299357218,3548cyclictest2932284-21kworker/2:0+events19:30:132
292575299305815,3038cyclictest2967957-21kworker/2:1+events21:30:132
292575599305315,3032cyclictest2929415-21kworker/3:0+events19:35:123
292575599305211,3038cyclictest2967986-21kworker/3:1+events21:45:013
292575099279412,2777cyclictest2967837-21kworker/1:1+events21:25:171
292575299278613,2769cyclictest2995204-21kworker/2:1+events22:50:192
292574599272413,2707cyclictest2989071-21kworker/0:2+events22:25:170
292575299269113,2674cyclictest2949936-21kworker/2:1+events20:30:162
292575099267712,2661cyclictest3014392-21kworker/1:2+events23:45:571
292574599262913,2612cyclictest2943702-21kworker/0:1+events20:27:090
292575299262013,2604cyclictest2945458-21kworker/2:2+events20:25:152
292575099257712,2561cyclictest3022893-21kworker/1:1+events00:38:181
292575099257411,2559cyclictest2992272-21kworker/1:2+events22:48:481
292575299257312,2558cyclictest3003403-21kworker/2:2+events23:24:182
292575299256012,2544cyclictest3020948-21kworker/2:1+events00:09:132
292575599254812,2532cyclictest3009652-21kworker/3:1+events23:32:393
292575099254711,2533cyclictest2930746-21kworker/1:1+events19:32:561
29257529925459,2532cyclictest2996896-21kworker/2:0+events23:04:472
292575099254412,2528cyclictest3018942-21kworker/1:2+events00:04:371
292575599254011,2525cyclictest3029176-21kworker/3:0+events00:34:273
292575599253712,2522cyclictest3003353-21kworker/3:1+events23:16:393
29257559925227,2512cyclictest2967986-21kworker/3:1+events21:22:143
292575299252210,2508cyclictest2961354-21kworker/2:2+events21:02:542
292575299252210,2508cyclictest2961354-21kworker/2:2+events21:02:532
29257529925199,2506cyclictest3012827-21kworker/2:1+events23:41:012
292575299251612,2500cyclictest2949936-21kworker/2:1+events20:35:132
292575599250212,2486cyclictest2951723-21kworker/3:2+events20:46:573
292575099249612,2480cyclictest3000097-21kworker/1:1+events23:00:131
292575299249512,2480cyclictest2979070-21kworker/2:1+events21:57:382
292575099249412,2478cyclictest2958444-21kworker/1:2+events20:50:461
292575299249312,2477cyclictest3012827-21kworker/2:1+events23:47:052
292575299249311,2479cyclictest3003403-21kworker/2:2+events23:26:592
292575299249112,2476cyclictest3001752-21kworker/2:1+events23:12:022
292575299249112,2476cyclictest2973973-21kworker/2:2+events21:53:502
292575099249111,2478cyclictest2972700-21kworker/1:0+events21:40:061
29257529924909,2478cyclictest2945458-21kworker/2:2+events20:13:032
292575299249012,2475cyclictest3020948-21kworker/2:1+events00:11:272
292575299249011,2476cyclictest2940529-21kworker/2:1+events20:00:472
292575299248912,2473cyclictest2967957-21kworker/2:1+events21:21:512
292575099248612,2472cyclictest2956730-21kworker/1:0+events21:05:111
292575099248511,2471cyclictest3000097-21kworker/1:1+events23:16:591
292575099248410,2470cyclictest3022893-21kworker/1:1+events00:10:421
292575099248312,2467cyclictest3012710-21kworker/1:0+events23:42:091
29257509924819,2466cyclictest2958444-21kworker/1:2+events21:00:131
29257509924819,2466cyclictest2958444-21kworker/1:2+events21:00:131
292574599248112,2466cyclictest2948517-21kworker/0:0+events20:22:560
292575099247812,2462cyclictest3024575-21kworker/1:2+events00:19:571
292574599247812,2463cyclictest2932682-21kworker/0:3+events20:00:000
292575299247712,2462cyclictest2980993-21kworker/2:0+events22:02:172
29257459924779,2465cyclictest2956875-21kworker/0:1+events20:51:280
292574599247711,2462cyclictest3019157-21kworker/0:1+events00:01:580
292575099247611,2461cyclictest2937474-21kworker/1:0+events20:03:271
292575099247511,2461cyclictest2951539-21kworker/1:2+events20:37:311
292575099247312,2457cyclictest2996717-21kworker/1:1+events22:50:441
292575299247012,2455cyclictest2955111-21kworker/2:0+events20:47:432
292575099246912,2454cyclictest2967837-21kworker/1:1+events21:18:491
292575099246810,2455cyclictest3016129-21kworker/1:0+events23:52:441
292575099246712,2451cyclictest2925514-21kworker/1:2+events19:21:311
292575099246711,2452cyclictest3020885-21kworker/1:0+events00:09:561
292575299246612,2450cyclictest2993547-21kworker/2:0+events22:40:502
292575099246612,2451cyclictest3022893-21kworker/1:1+events00:24:561
292575099246611,2452cyclictest2985901-21kworker/1:1+events22:16:561
292575299246510,2452cyclictest3011135-21kworker/2:0+events23:36:502
292575599246411,2449cyclictest2967986-21kworker/3:1+events21:50:263
29257529924647,2453cyclictest3017397-21kworker/2:2+events23:59:162
292575299246311,2449cyclictest2926874-21kworker/2:1+events19:20:452
292575099246312,2447cyclictest2976478-21kworker/1:1+events22:03:491
292575099246311,2449cyclictest3006147-21kworker/1:2+events23:32:171
292575099246212,2447cyclictest3018942-21kworker/1:2+events23:58:071
292575299245912,2444cyclictest2955111-21kworker/2:0+events20:44:432
292575299245912,2443cyclictest2967957-21kworker/2:1+events21:35:342
292575299245712,2443cyclictest2926874-21kworker/2:1+events19:40:092
292575299245711,2443cyclictest2989099-21kworker/2:1+events22:33:132
292574599245712,2441cyclictest3008783-21kworker/0:0+events23:31:540
29257559924569,2443cyclictest2929415-21kworker/3:0+events19:23:053
292575599245612,2440cyclictest2940711-21kworker/3:0+events20:00:243
292575599245512,2441cyclictest2990615-21kworker/3:0+events22:40:043
29257559924548,2442cyclictest2949964-21kworker/3:0+events20:23:203
292575599245412,2438cyclictest2992215-21kworker/3:2+events22:35:293
292575599245312,2438cyclictest3024313-21kworker/3:1+events00:23:453
292575599245212,2437cyclictest2953390-21kworker/3:0+events20:39:273
292575299245212,2436cyclictest3028961-21kworker/2:0+events00:31:252
292575599245112,2435cyclictest3009652-21kworker/3:1+events23:40:383
292575599245011,2436cyclictest2967986-21kworker/3:1+events21:27:573
292575599245010,2437cyclictest2929415-21kworker/3:0+events19:28:193
292575599244612,2430cyclictest2961474-21kworker/3:1+events21:06:193
292575299244512,2429cyclictest2989099-21kworker/2:1+events22:28:182
292575599244412,2429cyclictest2948336-21kworker/3:2+events20:17:343
29257559924288,2417cyclictest2958210-21kworker/3:1+events20:50:223
292575599242812,2412cyclictest2987239-21kworker/3:1+events22:25:403
29257459924279,2414cyclictest2971037-21kworker/0:2+events21:55:220
292575599242510,2412cyclictest2937414-21kworker/3:0+events19:42:503
292575599242410,2411cyclictest2999979-21kworker/3:0+events22:58:193
292575599242212,2407cyclictest2959841-21kworker/3:0+events20:56:263
292574599242212,2407cyclictest3030624-21kworker/0:2+events00:39:490
292575099242010,2406cyclictest2930746-21kworker/1:1+events19:37:531
292575599241711,2403cyclictest2953390-21kworker/3:0+events20:42:483
292575099241112,2396cyclictest3022893-21kworker/1:1+events00:28:221
29257559924078,2395cyclictest2935785-21kworker/3:1+events19:51:353
292574599240612,2391cyclictest3012677-21kworker/0:2+events23:45:140
292575099240310,2389cyclictest2937474-21kworker/1:0+events19:49:151
29257529924018,2390cyclictest2945458-21kworker/2:2+events20:09:572
292574599239912,2384cyclictest3006451-21kworker/0:1+events23:28:300
292574599239912,2383cyclictest2958504-21kworker/0:0+events20:55:170
292574599239712,2382cyclictest2943702-21kworker/0:1+events20:32:350
292574599239710,2383cyclictest2942072-21kworker/0:0+events20:01:550
292574599239611,2381cyclictest3024377-21kworker/0:1+events00:20:420
292575099239512,2380cyclictest2956730-21kworker/1:0+events20:59:061
292574599239512,2380cyclictest2998285-21kworker/0:0+events22:55:400
292574599239212,2377cyclictest2932682-21kworker/0:3+events19:49:380
292574599239211,2377cyclictest2958504-21kworker/0:0+events21:07:510
292574599239111,2378cyclictest2955199-21kworker/0:2+events20:45:040
292575299239011,2375cyclictest3032168-21kworker/2:2+events00:37:542
29257459923898,2377cyclictest2964612-21kworker/0:1+events21:17:410
292574599238912,2373cyclictest3015922-21kworker/0:0+events00:08:030
292575599238212,2367cyclictest2935785-21kworker/3:1+events19:46:143
292574599237711,2363cyclictest3030624-21kworker/0:2+events00:33:170
292575099237112,2355cyclictest2982536-21kworker/1:0+events22:20:181
292575099237111,2357cyclictest2972700-21kworker/1:0+events21:35:571
29257459923709,2357cyclictest2955199-21kworker/0:2+events20:39:480
292575299236912,2355cyclictest3001752-21kworker/2:1+events23:05:112
292575299236912,2355cyclictest3001752-21kworker/2:1+events23:05:112
292574599236811,2352cyclictest2992320-21kworker/0:1+events22:47:440
292575599234912,2334cyclictest2970883-21kworker/3:2+events21:35:113
292574599234811,2333cyclictest3015922-21kworker/0:0+events00:13:460
292574599234710,2333cyclictest2969432-21kworker/0:0+events21:24:550
292574599233812,2322cyclictest2974096-21kworker/0:0+events21:40:280
292575099232811,2314cyclictest2943820-21kworker/1:1+events20:22:101
292574599232812,2313cyclictest2984076-21kworker/0:2+events22:13:310
292575599232512,2310cyclictest3017278-21kworker/3:2+events23:51:573
292575599232110,2309cyclictest2940711-21kworker/3:0+events19:55:033
292575599231911,2304cyclictest3024313-21kworker/3:1+events00:29:093
292575299231810,2304cyclictest2945458-21kworker/2:2+events20:17:112
292575299231111,2297cyclictest2982654-21kworker/2:2+events22:09:032
292575099230911,2294cyclictest3001721-21kworker/1:2+events23:07:501
292575099230911,2294cyclictest3001721-21kworker/1:2+events23:07:491
292574599230011,2285cyclictest2982443-21kworker/0:0+events22:06:290
292575599229412,2278cyclictest2963095-21kworker/3:2+events21:17:203
292575099228811,2274cyclictest2934489-21kworker/1:2+events19:43:131
292574599228211,2268cyclictest2974096-21kworker/0:0+events21:38:140
292575299227811,2264cyclictest2935877-21kworker/2:0+events19:56:572
29257529922777,2267cyclictest2967957-21kworker/2:1+events21:27:332
292575099227711,2262cyclictest2990585-21kworker/1:1+events22:32:501
292574599227612,2260cyclictest2943702-21kworker/0:1+events20:09:340
292575599227311,2258cyclictest3018855-21kworker/3:0+events00:09:353
292575299227311,2259cyclictest2963037-21kworker/2:0+events21:08:122
292575099227311,2260cyclictest2982536-21kworker/1:0+events22:28:431
292575099227311,2258cyclictest2976478-21kworker/1:1+events21:56:541
292575599227110,2257cyclictest2985405-21kworker/3:2+events22:21:283
292575299227111,2257cyclictest2932284-21kworker/2:0+events19:26:512
292575099227111,2256cyclictest2982536-21kworker/1:0+events22:39:421
292575599227010,2256cyclictest3011314-21kworker/3:2+events23:39:063
292575099226911,2254cyclictest2932374-21kworker/1:0+events19:27:581
292575599226811,2254cyclictest2945576-21kworker/3:0+events20:14:563
29257529922689,2255cyclictest2966269-21kworker/2:2+events21:18:262
292575299226811,2254cyclictest2959722-21kworker/2:1+events20:53:452
292575299226811,2253cyclictest2973973-21kworker/2:2+events21:40:522
292575299226810,2255cyclictest3006177-21kworker/2:0+events23:18:552
292575299226810,2255cyclictest2996896-21kworker/2:0+events22:55:182
292575299226810,2255cyclictest2964643-21kworker/2:1+events21:13:072
292575599226610,2252cyclictest2923680-21kworker/3:2+events19:16:313
292575299226611,2251cyclictest2937528-21kworker/2:2+events19:48:072
292575099226611,2252cyclictest2939131-21kworker/1:1+events19:53:551
292575099226610,2252cyclictest2955078-21kworker/1:1+events20:41:391
292575599226511,2251cyclictest2990615-21kworker/3:0+events22:30:133
292575299226511,2251cyclictest3012827-21kworker/2:1+events23:52:212
292575299226411,2250cyclictest3022838-21kworker/2:2+events00:21:062
292575299226411,2250cyclictest3011135-21kworker/2:0+events23:34:322
292575299226411,2249cyclictest2987475-21kworker/2:2+events22:21:052
292575299226311,2249cyclictest2990796-21kworker/2:2+events22:45:482
292575299226210,2249cyclictest3022838-21kworker/2:2+events00:16:282
292575299226210,2248cyclictest2984276-21kworker/2:0+events22:11:392
292574599226210,2248cyclictest2990676-21kworker/0:0+events22:38:090
29257529922618,2249cyclictest2990796-21kworker/2:2+events22:36:132
29257529922608,2249cyclictest2924094-21kworker/2:0+events19:19:372
292575099226011,2246cyclictest2943820-21kworker/1:1+events20:07:161
292575599225910,2246cyclictest2990615-21kworker/3:0+events22:49:123
292575299225910,2246cyclictest2926874-21kworker/2:1+events19:38:152
292575299225810,2245cyclictest3027347-21kworker/2:1+events00:29:552
292575299225710,2244cyclictest2955111-21kworker/2:0+events20:55:402
292575299225610,2243cyclictest2940529-21kworker/2:1+events19:52:442
292575099225610,2242cyclictest2976478-21kworker/1:1+events21:47:431
292575099225510,2242cyclictest2966121-21kworker/1:0+events21:12:461
292574599225410,2240cyclictest2953246-21kworker/0:0+events20:43:560
29257509922536,2244cyclictest3009473-21kworker/1:1+events23:38:211
29257559922496,2239cyclictest2977644-21kworker/3:0+events21:49:153
29257509922499,2236cyclictest2976478-21kworker/1:1+events21:54:581
292574599224911,2235cyclictest2992320-21kworker/0:1+events23:10:290
29257509922489,2235cyclictest2953184-21kworker/1:0+events20:33:191
292575099224811,2235cyclictest2945426-21kworker/1:2+events20:11:301
292575099224810,2235cyclictest3022893-21kworker/1:1+events00:31:461
292574599224712,2232cyclictest2945485-21kworker/0:2+events20:16:480
29257529922439,2231cyclictest3017397-21kworker/2:2+events00:01:152
29257509922419,2229cyclictest2955078-21kworker/1:1+events20:46:331
29257559922349,2222cyclictest2985405-21kworker/3:2+events22:16:353
29257559922329,2220cyclictest2917554-21kworker/3:1+events19:14:203
292575299223211,2218cyclictest2926874-21kworker/2:1+events19:13:572
292574599223211,2217cyclictest3006451-21kworker/0:1+events23:39:290
29257559922319,2218cyclictest3004979-21kworker/3:2+events23:21:163
29257559922317,2221cyclictest2943938-21kworker/3:1+events20:05:453
292575599223010,2217cyclictest3009652-21kworker/3:1+events23:45:353
292574599223010,2217cyclictest2985814-21kworker/0:1+events22:21:510
29257559922299,2217cyclictest2999979-21kworker/3:0+events23:02:533
29257559922299,2217cyclictest2967986-21kworker/3:1+events21:30:373
292575599222911,2215cyclictest3022595-21kworker/3:2+events00:14:553
292575599222910,2216cyclictest2977644-21kworker/3:0+events22:12:033
29257559922287,2218cyclictest3003353-21kworker/3:1+events23:11:143
292575599222811,2213cyclictest2981115-21kworker/3:2+events22:01:093
292575599222811,2213cyclictest2929415-21kworker/3:0+events19:30:583
292575599222810,2214cyclictest2967986-21kworker/3:1+events21:56:303
292575599222711,2213cyclictest2993847-21kworker/3:1+events22:51:503
292575599222711,2212cyclictest3009652-21kworker/3:1+events23:55:513
292575599222710,2214cyclictest3024313-21kworker/3:1+events00:16:053
29257559922259,2212cyclictest2951723-21kworker/3:2+events20:28:423
29257559922249,2212cyclictest2963095-21kworker/3:2+events21:14:163
292575599222211,2207cyclictest3030774-21kworker/3:2+events00:36:223
292575299222011,2206cyclictest2975595-21kworker/2:0+events21:46:562
29257559922189,2206cyclictest2982770-21kworker/3:1+events22:06:053
29257459922038,2191cyclictest2975774-21kworker/0:1+events21:46:090
292574599220212,2187cyclictest2932518-21kworker/0:2+events19:50:480
292574599219910,2186cyclictest2979867-21kworker/0:1+events22:00:450
292574599219710,2184cyclictest2977673-21kworker/0:0+events21:51:100
292574599219510,2182cyclictest2998285-21kworker/0:0+events22:52:140
29257459921939,2180cyclictest2962979-21kworker/0:2+events21:04:240
29257459921939,2180cyclictest2962979-21kworker/0:2+events21:04:240
29257459921929,2180cyclictest2932518-21kworker/0:2+events19:42:050
29257509921909,2178cyclictest2923829-21kworker/1:0+events19:15:031
29257459921859,2173cyclictest2932682-21kworker/0:3+events19:32:090
292574599218510,2172cyclictest3012677-21kworker/0:2+events23:56:370
29257459921849,2172cyclictest3012677-21kworker/0:2+events23:41:250
292574599218111,2166cyclictest3001423-21kworker/0:2+events23:09:200
292574599218111,2166cyclictest3001423-21kworker/0:2+events23:09:190
29257459921726,2163cyclictest2958504-21kworker/0:0+events21:11:360
292574599217210,2160cyclictest3027316-21kworker/0:2+events00:25:180
292574599217011,2157cyclictest2992320-21kworker/0:1+events23:00:350
292574599216911,2155cyclictest2984076-21kworker/0:2+events22:15:490
292574599216711,2153cyclictest3015922-21kworker/0:0+events23:53:310
292574599216511,2151cyclictest3006451-21kworker/0:1+events23:22:450
292574599216511,2151cyclictest2989071-21kworker/0:2+events22:31:190
292574599216211,2148cyclictest2990676-21kworker/0:0+events22:40:270
292574599215412,2139cyclictest3001423-21kworker/0:2+events23:19:180
292575599215311,2139cyclictest3007809-21kworker/3:0+events23:29:383
29257509921417,2132cyclictest3003321-21kworker/1:0+events23:11:381
29257509921288,2117cyclictest3007838-21kworker/1:0+events23:26:131
29257509921259,2113cyclictest2992272-21kworker/1:2+events22:56:011
292574599212311,2109cyclictest2929265-21kworker/0:1+events19:27:350
292575099212210,2108cyclictest3006147-21kworker/1:2+events23:21:371
292575099211310,2100cyclictest2984307-21kworker/1:2+events22:10:541
29257509921096,2100cyclictest2951539-21kworker/1:2+events20:29:531
292575299210610,2093cyclictest2949936-21kworker/2:1+events20:23:422
29257509921069,2093cyclictest2967837-21kworker/1:1+events21:34:271
29257509921059,2093cyclictest2966121-21kworker/1:0+events21:22:381
29257459921058,2094cyclictest2964612-21kworker/0:1+events21:32:070
29257529921049,2092cyclictest2985874-21kworker/2:1+events22:16:122
29257459921029,2090cyclictest2945485-21kworker/0:2+events20:10:210
292575099209910,2085cyclictest2937474-21kworker/1:0+events19:57:431
292575599209811,2084cyclictest2961474-21kworker/3:1+events21:03:373
292575599209811,2084cyclictest2961474-21kworker/3:1+events21:03:373
292575099209310,2080cyclictest2947060-21kworker/1:0+events20:16:041
292575099208910,2076cyclictest2982536-21kworker/1:0+events22:44:411
292574599208110,2068cyclictest3015922-21kworker/0:0+events00:17:380
29257459920588,2047cyclictest2932682-21kworker/0:3+events19:39:250
292574599205010,2037cyclictest2971037-21kworker/0:2+events21:29:060
29257459920375,2029cyclictest2926903-21kworker/0:2+events19:18:030
292575599203510,2022cyclictest2943938-21kworker/3:1+events20:31:253
29257459920308,2019cyclictest2929265-21kworker/0:1+events19:23:270
29257509920129,2000cyclictest2925514-21kworker/1:2+events19:13:341
29257459919979,1985cyclictest2915966-21kworker/0:0+events19:11:370
29257509919457,1934cyclictest2982536-21kworker/1:0+events22:09:231
29253532160131,25sleep10-21swapper/119:07:521
29252622144101,37sleep00-21swapper/019:06:420
29251972144111,27sleep20-21swapper/219:05:522
29254322142110,27sleep30-21swapper/319:08:543
2925755994745,1cyclictest2999979-21kworker/3:0+pm23:09:553
2925755994745,1cyclictest2999979-21kworker/3:0+pm23:09:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional