You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 22:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Apr 15, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122470499315316,3134cyclictest1240643-21kworker/3:0+events20:10:173
122469299312113,3104cyclictest1253196-21kworker/0:0+events20:50:010
122469299309713,3081cyclictest1253196-21kworker/0:0+events20:55:180
122470499300114,2985cyclictest1267992-21kworker/3:0+events21:30:223
122470199282413,2808cyclictest1224789-21kworker/2:2+events19:40:162
122470499277813,2763cyclictest1277697-21kworker/3:0+events21:55:183
122470499277611,2762cyclictest1322124-21kworker/3:1+events00:30:133
122470499277611,2762cyclictest1322124-21kworker/3:1+events00:30:133
122469299276613,2750cyclictest1258984-21kworker/0:2+events21:00:170
122470199275713,2742cyclictest1318406-21kworker/2:1+events00:11:552
122469699275513,2738cyclictest1325568-21kworker/1:2+events00:35:111
122470199274713,2732cyclictest1290907-21kworker/2:2+events22:45:072
122469699272710,2712cyclictest1221006-21kworker/1:2+events19:30:181
122470199271113,2693cyclictest1277901-21kworker/2:2+events22:00:172
122469299269711,2682cyclictest1264825-21kworker/0:2+events21:25:210
122470199263413,2617cyclictest1326946-21kworker/2:1+events00:25:182
122470499257412,2559cyclictest1263435-21kworker/3:0+events21:10:143
122469699257111,2556cyclictest1282788-21kworker/1:2+events22:13:331
12246969925687,2557cyclictest1322030-21kworker/1:1+events00:20:431
12247019925389,2526cyclictest1302621-21kworker/2:0+events23:30:222
122470499252712,2511cyclictest1246825-21kworker/3:0+events20:21:223
122470199252012,2506cyclictest1282436-21kworker/2:1+events22:30:062
122470499251811,2504cyclictest1277697-21kworker/3:0+events22:07:553
122470499251312,2498cyclictest1229574-21kworker/3:0+events19:25:433
122470199250812,2492cyclictest1249997-21kworker/2:2+events20:27:272
122470499250612,2490cyclictest1267992-21kworker/3:0+events21:26:073
122470499249112,2476cyclictest1299449-21kworker/3:2+events23:05:493
122469699249110,2477cyclictest1310466-21kworker/1:2+events23:33:041
122469299247912,2464cyclictest1318467-21kworker/0:1+events00:10:220
12246969924789,2466cyclictest1248542-21kworker/1:0+events20:34:191
122470499247711,2463cyclictest1258398-21kworker/3:1+events20:59:303
122470499247612,2461cyclictest1297498-21kworker/3:0+events23:01:353
122469699247611,2461cyclictest1292748-21kworker/1:0+events22:47:501
122470499247411,2460cyclictest1273145-21kworker/3:2+events21:51:303
122469699247312,2457cyclictest1261743-21kworker/1:1+events21:03:451
122469699247212,2457cyclictest1253223-21kworker/1:1+events20:40:251
122469299247210,2457cyclictest1322603-21kworker/0:0+events00:24:560
122470499247011,2456cyclictest1267992-21kworker/3:0+events21:41:563
122470499246712,2452cyclictest1304372-21kworker/3:2+events23:15:253
12247049924609,2447cyclictest1315351-21kworker/3:1+events23:49:403
122470499246012,2444cyclictest1327065-21kworker/3:2+events00:27:143
12247019924588,2445cyclictest1224789-21kworker/2:2+events19:15:172
122469699245812,2442cyclictest1302560-21kworker/1:2+events23:11:361
122470199245412,2439cyclictest1271405-21kworker/2:0+events21:32:412
122469699245410,2441cyclictest1259996-21kworker/1:0+events21:05:171
122470499245312,2437cyclictest1322124-21kworker/3:1+events00:09:583
122470499245311,2439cyclictest1325427-21kworker/3:0+events00:19:573
122470499245212,2436cyclictest1246825-21kworker/3:0+events20:25:343
122470499245112,2437cyclictest1315351-21kworker/3:1+events23:55:013
122470499245112,2436cyclictest1246825-21kworker/3:0+events20:45:473
122470499245112,2435cyclictest1294316-21kworker/3:1+events22:48:123
122470499245111,2437cyclictest1246825-21kworker/3:0+events20:17:563
122470499245012,2435cyclictest1253460-21kworker/3:2+events20:42:223
122470499245011,2435cyclictest1224112-21kworker/3:1+events19:21:323
122470499244912,2433cyclictest1261829-21kworker/3:2+events21:09:283
122470199244912,2434cyclictest1279621-21kworker/2:0+events22:05:152
122470499244512,2430cyclictest1273145-21kworker/3:2+events21:48:283
122470199244512,2431cyclictest1290907-21kworker/2:2+events22:40:052
122470199244512,2431cyclictest1264945-21kworker/2:0+events21:20:092
122470499244412,2428cyclictest1301163-21kworker/3:1+events23:12:453
122470499244411,2430cyclictest1325427-21kworker/3:0+events00:22:373
122470499244411,2430cyclictest1306621-21kworker/3:0+events23:34:133
122470499244411,2430cyclictest1243035-21kworker/3:1+events20:38:533
122469299244412,2429cyclictest1274610-21kworker/0:0+events21:45:010
122470199244312,2429cyclictest1302621-21kworker/2:0+events23:20:022
122470499244211,2427cyclictest1231267-21kworker/3:2+events19:58:363
122470199244011,2423cyclictest1302621-21kworker/2:0+events23:13:312
122470199243311,2419cyclictest1308865-21kworker/2:2+events23:29:382
12247019924303,2424cyclictest1282436-21kworker/2:1+events22:12:012
122470499242912,2413cyclictest1260145-21kworker/3:0+events21:02:143
122470499242810,2415cyclictest1267992-21kworker/3:0+events21:23:063
122470199242710,2413cyclictest1318406-21kworker/2:1+events00:05:212
122470199242612,2410cyclictest1312188-21kworker/2:0+events23:40:392
122470199242512,2410cyclictest1239037-21kworker/2:0+events20:04:402
122470199242512,2409cyclictest1326946-21kworker/2:1+events00:35:332
122470199242512,2409cyclictest1245494-21kworker/2:0+events20:41:342
122470499242012,2404cyclictest1271554-21kworker/3:1+events21:38:053
122469699241712,2402cyclictest1241990-21kworker/1:1+events20:03:321
122470199241111,2396cyclictest1287626-21kworker/2:2+events22:27:262
122470199241110,2398cyclictest1282436-21kworker/2:1+events22:18:592
122469699240911,2394cyclictest1312099-21kworker/1:1+events23:40:161
122470199240812,2393cyclictest1253255-21kworker/2:1+events20:51:512
122470199240811,2394cyclictest1313837-21kworker/2:1+events23:45:522
12247019924079,2395cyclictest1240762-21kworker/2:2+events20:17:102
122470199240612,2390cyclictest1318406-21kworker/2:1+events00:03:012
122469699240212,2387cyclictest1269622-21kworker/1:0+events22:16:161
122470499240012,2385cyclictest1308391-21kworker/3:1+events23:27:233
12247019923999,2388cyclictest1292779-21kworker/2:0+events22:55:062
122469699239912,2383cyclictest1243624-21kworker/1:2+events20:17:331
122469699239712,2381cyclictest1300923-21kworker/1:1+events23:26:141
122469699239510,2381cyclictest1285841-21kworker/1:1+events22:35:281
122469699239112,2377cyclictest1290880-21kworker/1:2+events23:00:031
122469699239112,2376cyclictest1267867-21kworker/1:2+events21:27:411
122469699239112,2375cyclictest1315379-21kworker/1:1+events23:54:161
122469699239012,2375cyclictest1261743-21kworker/1:1+events21:22:221
122469299239012,2375cyclictest1263166-21kworker/0:1+events21:35:460
122469299239012,2374cyclictest1239129-21kworker/0:2+events19:58:580
122469299239010,2376cyclictest1316802-21kworker/0:0+events23:58:020
122470199238910,2375cyclictest1273040-21kworker/2:1+events21:46:112
122469699238911,2375cyclictest1287475-21kworker/1:2+events22:22:491
122470199238811,2373cyclictest1245494-21kworker/2:0+events20:24:252
122469699238812,2373cyclictest1277786-21kworker/1:2+events21:54:561
122469699238810,2374cyclictest1316981-21kworker/1:0+events00:04:111
122469699238711,2373cyclictest1292748-21kworker/1:0+events22:44:441
122469699238711,2373cyclictest1272918-21kworker/1:1+events21:38:291
122470199238612,2370cyclictest1295685-21kworker/2:1+events22:53:132
122469699238610,2373cyclictest1261743-21kworker/1:1+events21:18:361
122469699238512,2370cyclictest1269622-21kworker/1:0+events21:41:331
122469299238511,2371cyclictest1227816-21kworker/0:1+events19:33:470
122469299238511,2370cyclictest1263166-21kworker/0:1+events21:30:460
122470199238411,2369cyclictest1232604-21kworker/2:0+events19:34:582
122469699238412,2369cyclictest1318718-21kworker/1:2+events00:09:141
122469699238410,2371cyclictest1234329-21kworker/1:1+events19:43:151
12247049923799,2368cyclictest1285808-21kworker/3:0+events22:20:073
122470199237910,2365cyclictest1234207-21kworker/2:1+events19:38:212
122470499237811,2363cyclictest1253460-21kworker/3:2+events20:54:553
12247019923789,2365cyclictest1253255-21kworker/2:1+events21:06:492
122469299237712,2361cyclictest1297859-21kworker/0:2+events23:15:490
122469699237211,2357cyclictest1232726-21kworker/1:0+events19:38:431
122469299237112,2356cyclictest1287878-21kworker/0:0+events22:29:430
122470199236412,2349cyclictest1325245-21kworker/2:2+events00:17:372
122469299236312,2349cyclictest1318467-21kworker/0:1+events00:04:580
122469299236212,2347cyclictest1282525-21kworker/0:0+events22:18:130
122469299236112,2345cyclictest1227816-21kworker/0:1+events19:28:490
122469299235812,2344cyclictest1284474-21kworker/0:1+events22:35:050
122469299235811,2344cyclictest1284474-21kworker/0:1+events22:33:090
122469299235712,2342cyclictest1235801-21kworker/0:1+events19:44:260
122469299235510,2342cyclictest1308895-21kworker/0:2+events23:32:170
122469299235310,2340cyclictest1232545-21kworker/0:0+events19:36:250
122469299235210,2338cyclictest1253196-21kworker/0:0+events20:43:300
12247049923517,2340cyclictest1281012-21kworker/3:2+events22:15:533
122470499235112,2336cyclictest1224112-21kworker/3:1+events19:18:003
122469299235012,2335cyclictest1328547-21kworker/0:1+events00:29:050
122469299235011,2336cyclictest1297859-21kworker/0:2+events23:09:170
122469699234911,2335cyclictest1279448-21kworker/1:1+events22:06:451
122469299234911,2335cyclictest1307289-21kworker/0:0+events23:25:500
12247049923479,2335cyclictest1313750-21kworker/3:0+events23:52:423
122469299234612,2331cyclictest1318467-21kworker/0:1+events00:06:310
122470499233912,2324cyclictest1317042-21kworker/3:2+events00:11:073
122469299233812,2322cyclictest1312276-21kworker/0:1+events23:43:590
12246929923345,2325cyclictest1253196-21kworker/0:0+events20:54:080
122470199233311,2319cyclictest1234207-21kworker/2:1+events19:45:352
122469299232811,2314cyclictest1232545-21kworker/0:0+events19:45:130
122470499231712,2303cyclictest1322124-21kworker/3:1+events00:36:193
12246969923168,2304cyclictest1318718-21kworker/1:2+events00:10:451
122469299231510,2302cyclictest1292566-21kworker/0:0+events22:43:110
122470499229412,2279cyclictest1284210-21kworker/3:1+events22:11:403
122470199229411,2280cyclictest1273040-21kworker/2:1+events21:52:152
122470499228011,2266cyclictest1290756-21kworker/3:2+events22:33:563
122469299227812,2262cyclictest1247039-21kworker/0:2+events20:33:330
122469699227611,2262cyclictest1290880-21kworker/1:2+events22:57:011
122470499227111,2257cyclictest1240643-21kworker/3:0+events20:05:263
122469699226611,2252cyclictest1315379-21kworker/1:1+events23:58:491
12246929922635,2254cyclictest1300984-21kworker/0:1+events23:04:420
122470199226211,2248cyclictest1219673-21kworker/2:0+events19:23:042
122470199226110,2247cyclictest1308865-21kworker/2:2+events23:53:512
122469299225812,2243cyclictest1274610-21kworker/0:0+events21:49:370
122469699225511,2240cyclictest1237558-21kworker/1:2+events19:51:001
122469299225010,2236cyclictest1322603-21kworker/0:0+events00:15:240
122470499224810,2234cyclictest1237346-21kworker/3:0+events19:49:483
122470499224711,2233cyclictest1287443-21kworker/3:1+events22:28:573
122470199224510,2231cyclictest1290907-21kworker/2:2+events22:37:462
122469299224511,2231cyclictest1274610-21kworker/0:0+events21:53:470
122469699223710,2224cyclictest1255029-21kworker/1:2+events20:56:051
122470499223611,2222cyclictest1290756-21kworker/3:2+events22:38:323
122470199223410,2220cyclictest1273040-21kworker/2:1+events21:43:072
122470499223311,2219cyclictest1317042-21kworker/3:2+events00:00:453
122470199223310,2220cyclictest1271405-21kworker/2:0+events21:35:232
122470199223211,2218cyclictest1264945-21kworker/2:0+events21:14:262
122470499223112,2216cyclictest1312068-21kworker/3:1+events23:38:013
122470199223110,2217cyclictest1326946-21kworker/2:1+events00:32:052
122470199223110,2217cyclictest1326946-21kworker/2:1+events00:32:052
122470199223010,2216cyclictest1253255-21kworker/2:1+events20:49:162
122470199222910,2216cyclictest1253255-21kworker/2:1+events21:15:352
12247049922287,2218cyclictest1231267-21kworker/3:2+events19:30:423
122470199222810,2215cyclictest1310526-21kworker/2:1+events23:36:282
122470499222711,2212cyclictest1261829-21kworker/3:2+events21:18:593
122470499222710,2215cyclictest1231267-21kworker/3:2+events19:50:363
122470499222611,2211cyclictest1281012-21kworker/3:2+events22:04:513
122470199222611,2211cyclictest1240762-21kworker/2:2+events20:14:542
12247049922259,2212cyclictest1304372-21kworker/3:2+events23:20:263
122470499222511,2211cyclictest1310403-21kworker/3:2+events23:43:153
122470499222510,2211cyclictest1231267-21kworker/3:2+events19:36:043
122470499222411,2210cyclictest1246825-21kworker/3:0+events20:32:453
122470499222210,2208cyclictest1231267-21kworker/3:2+events19:42:533
122470499222111,2207cyclictest1294316-21kworker/3:1+events22:55:283
122469699222011,2205cyclictest1304226-21kworker/1:0+events23:16:121
122470199221610,2203cyclictest1295685-21kworker/2:1+events23:07:452
122470499221410,2201cyclictest1231267-21kworker/3:2+events20:03:113
12247019922097,2199cyclictest1245494-21kworker/2:0+events20:37:232
122470499220010,2187cyclictest1292657-21kworker/3:0+events22:40:523
122470199219910,2186cyclictest1230999-21kworker/2:1+events19:29:342
122469699219910,2186cyclictest1269622-21kworker/1:0+events21:58:461
122470199219810,2184cyclictest1304256-21kworker/2:2+events23:18:092
122469299219612,2181cyclictest1328547-21kworker/0:1+events00:38:360
12246969921949,2182cyclictest1239159-21kworker/1:0+events20:06:081
12246969921919,2178cyclictest1308830-21kworker/1:0+events23:37:371
122470199218911,2176cyclictest1234207-21kworker/2:1+events19:53:132
12246969921899,2177cyclictest1325568-21kworker/1:2+events00:32:521
12246969921899,2177cyclictest1325568-21kworker/1:2+events00:32:521
122469699218911,2174cyclictest1269622-21kworker/1:0+events21:49:581
122469699218810,2175cyclictest1328431-21kworker/1:0+events00:27:351
122469699218711,2173cyclictest1295956-21kworker/1:1+events22:54:421
122469699218710,2175cyclictest1239159-21kworker/1:0+events19:56:441
12246969921849,2171cyclictest1302560-21kworker/1:2+events23:08:091
122469699218310,2171cyclictest1287475-21kworker/1:2+events22:25:071
122470199218210,2170cyclictest1266640-21kworker/2:2+events21:26:302
122469299218211,2167cyclictest1245195-21kworker/0:1+events20:19:270
122469699217711,2163cyclictest1289181-21kworker/1:0+events22:31:161
122469699217511,2161cyclictest1232726-21kworker/1:0+events19:48:391
12246929921728,2160cyclictest1253196-21kworker/0:0+events21:09:070
122469699216810,2155cyclictest1255029-21kworker/1:2+events20:50:241
122469299216811,2154cyclictest1263166-21kworker/0:1+events21:12:060
122469299216811,2153cyclictest1315169-21kworker/0:2+events23:47:230
122470199216711,2153cyclictest1318406-21kworker/2:1+events23:59:582
122469699216611,2151cyclictest1308830-21kworker/1:0+events23:45:281
122469699216610,2153cyclictest1248542-21kworker/1:0+events20:37:001
122469299216611,2152cyclictest1276363-21kworker/0:1+events22:00:400
122469299216611,2151cyclictest1232545-21kworker/0:0+events20:02:260
122469699216511,2151cyclictest1305868-21kworker/1:2+events23:22:441
122469699216511,2151cyclictest1224437-21kworker/1:0+events19:13:431
122469699216510,2152cyclictest1243624-21kworker/1:2+events20:14:071
12246929921637,2153cyclictest1263166-21kworker/0:1+events21:24:360
12246929921635,2154cyclictest1276363-21kworker/0:1+events21:56:290
122469299216311,2149cyclictest1284474-21kworker/0:1+events22:22:030
122469299216311,2149cyclictest1247039-21kworker/0:2+events20:20:370
122469699216211,2147cyclictest1248542-21kworker/1:0+events20:48:541
122469299216211,2148cyclictest1245195-21kworker/0:1+events20:11:490
122469299216110,2147cyclictest1295896-21kworker/0:1+events22:54:190
122469299216011,2146cyclictest1308895-21kworker/0:2+events23:36:510
122469299216011,2146cyclictest1292566-21kworker/0:0+events22:58:540
122469299215711,2144cyclictest1225797-21kworker/0:2+events19:16:270
122469699215511,2141cyclictest1269622-21kworker/1:0+events22:02:121
122469299215511,2141cyclictest1247039-21kworker/0:2+events20:25:570
122469299215510,2142cyclictest1232545-21kworker/0:0+events19:54:230
12246929921509,2138cyclictest1316802-21kworker/0:0+events23:53:270
122469299214111,2127cyclictest1232545-21kworker/0:0+events20:05:470
12246929921409,2128cyclictest1307289-21kworker/0:0+events23:22:210
122470199213910,2127cyclictest1239037-21kworker/2:0+events19:55:092
122469299213711,2124cyclictest1302740-21kworker/0:0+events23:12:230
122469299213011,2116cyclictest1290606-21kworker/0:2+events22:47:030
122469699212910,2116cyclictest1245313-21kworker/1:1+events20:23:151
122470199210610,2093cyclictest1253255-21kworker/2:1+events20:57:142
12246929920929,2080cyclictest1253196-21kworker/0:0+events20:39:400
122470499207410,2061cyclictest1294316-21kworker/3:1+events22:51:173
122470199207310,2060cyclictest1322388-21kworker/2:0+events00:23:022
12247019920718,2060cyclictest1219673-21kworker/2:0+events19:14:072
122469699206611,2052cyclictest1267867-21kworker/1:2+events21:31:331
12247019920648,2053cyclictest1295685-21kworker/2:1+events23:02:222
122469699205511,2041cyclictest1229454-21kworker/1:0+events19:25:231
12247019920496,2040cyclictest1240762-21kworker/2:2+events20:08:212
12246969920437,2033cyclictest1226096-21kworker/1:1+events19:19:341
122469299204211,2028cyclictest1280805-21kworker/0:2+events22:07:310
12246969920377,2027cyclictest1229454-21kworker/1:0+events19:23:521
12246969920359,2024cyclictest1263378-21kworker/1:2+events21:11:451
12246929920316,2022cyclictest1225797-21kworker/0:2+events19:12:110
122469699202910,2016cyclictest1323849-21kworker/1:0+events00:18:251
122469299201810,2005cyclictest1264825-21kworker/0:2+events21:19:220
122469299201110,1997cyclictest1326785-21kworker/0:2+events00:31:440
122469299201110,1997cyclictest1326785-21kworker/0:2+events00:31:430
122470499200910,1995cyclictest1225780-21kworker/3:0+events19:11:253
12246929920096,2000cyclictest1282525-21kworker/0:0+events22:13:570
12247019920058,1994cyclictest1282436-21kworker/2:1+events22:23:352
12241622186159,21sleep20-21swapper/219:06:102
12242222161132,25sleep00-21swapper/019:06:560
12242712146113,28sleep10-21swapper/119:07:331
12242942140114,21sleep30-21swapper/319:07:503
1224696998582,2cyclictest1248542-21kworker/1:0+pm20:29:551
1224701991810,6cyclictest1251921-21awk20:35:002
1224701991615,1cyclictest1277901-21kworker/2:2+events21:55:182
122469299160,15cyclictest1229079-21/usr/sbin/munin19:20:190
122470199140,12cyclictest1261619-21taskset21:01:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional