You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Fri Apr 24, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133285999316015,3139cyclictest1365241-21kworker/1:1+events20:55:171
133286499297010,2955cyclictest1354133-21kworker/3:1+events20:15:213
133286199290714,2889cyclictest1397213-21kworker/2:0+events22:35:182
133285499285213,2834cyclictest1384221-21kworker/0:1+events22:05:110
133285499281713,2800cyclictest1347564-21kworker/0:2+events20:20:180
133285499278711,2772cyclictest1342630-21kworker/0:2+events19:45:000
133285999276610,2753cyclictest1381022-21kworker/1:0+events21:45:001
133285999275811,2742cyclictest1326216-21kworker/1:0+events19:25:111
133286199273012,2714cyclictest1316100-21kworker/2:0+events19:20:012
133285999272613,2709cyclictest1363607-21kworker/1:2+events20:45:191
133286199271113,2693cyclictest1384066-21kworker/2:1+events22:00:132
13328649926297,2618cyclictest1358901-21kworker/3:0+events20:50:143
133286499260313,2586cyclictest1396411-21kworker/3:2+events22:38:423
133286499258913,2574cyclictest1368326-21kworker/3:2+events21:05:133
133285499257112,2554cyclictest1429408-21kworker/0:1+events00:10:210
133286499253912,2523cyclictest1398206-21kworker/3:0+events23:20:113
133285499253912,2523cyclictest1365090-21kworker/0:0+events21:14:370
133285499253312,2517cyclictest1339160-21kworker/0:2+events19:27:280
133285499252611,2511cyclictest1374661-21kworker/0:2+events21:48:490
133285499252212,2506cyclictest1392183-21kworker/0:2+events22:34:330
13328549925177,2506cyclictest1423088-21kworker/0:2+events00:04:380
133285999251311,2498cyclictest1437376-21kworker/1:1+events00:35:181
13328649925117,2500cyclictest1336212-21kworker/3:2+events19:41:103
133286499250912,2493cyclictest1379365-21kworker/3:2+events21:48:273
133286499250711,2492cyclictest1418058-21kworker/3:1+events23:56:433
133286499250612,2491cyclictest1403311-21kworker/3:1+events22:50:583
13328599925063,2500cyclictest1377729-21kworker/1:1+events21:46:321
13328649925049,2491cyclictest1387332-21kworker/3:2+events22:05:333
133285999250412,2488cyclictest1339431-21kworker/1:1+events19:33:361
133286199248712,2472cyclictest1419929-21kworker/2:0+events23:49:242
133286199248712,2472cyclictest1419929-21kworker/2:0+events23:49:242
133285999248312,2466cyclictest1368766-21kworker/1:2+events21:01:001
133285999248311,2468cyclictest1368766-21kworker/1:2+events21:07:051
133285999248212,2466cyclictest1396976-21kworker/1:2+events22:28:511
133285499248212,2466cyclictest1423088-21kworker/0:2+events23:54:480
133285499248212,2466cyclictest1416633-21kworker/0:0+events23:32:020
133285999248112,2465cyclictest1423116-21kworker/1:2+events23:56:211
133285499247612,2461cyclictest1371661-21kworker/0:1+events21:26:240
133285499247612,2460cyclictest1397271-21kworker/0:1+events23:01:300
133285999247512,2460cyclictest1347667-21kworker/1:2+events19:55:571
133285499247411,2459cyclictest1360438-21kworker/0:0+events20:34:370
133286199247312,2456cyclictest1349062-21kworker/2:1+events20:31:372
133286499245911,2445cyclictest1398206-21kworker/3:0+events23:26:133
13328599924568,2445cyclictest1411864-21kworker/1:2+events23:14:031
133285499245510,2443cyclictest1400206-21kworker/0:0+events22:40:130
133285999244912,2433cyclictest1368766-21kworker/1:2+events21:25:141
133286199244812,2432cyclictest1377876-21kworker/2:2+events21:45:242
133286499244712,2431cyclictest1436009-21kworker/3:0+events00:30:183
133286199244712,2431cyclictest1365444-21kworker/2:1+events20:52:582
133286199244710,2435cyclictest1349062-21kworker/2:1+events20:06:352
133285499244711,2433cyclictest1351109-21kworker/0:0+events20:06:130
133285499244212,2428cyclictest1377936-21kworker/0:0+events21:30:090
133285499244212,2428cyclictest1377936-21kworker/0:0+events21:30:090
133286499244112,2426cyclictest1372935-21kworker/3:1+events21:26:013
133285499244112,2426cyclictest1434444-21kworker/0:0+events00:37:340
133285499244012,2426cyclictest1344244-21kworker/0:1+events19:55:110
133286499243911,2424cyclictest1372935-21kworker/3:1+events21:22:103
133285499243311,2418cyclictest1384221-21kworker/0:1+events21:59:490
133285499243212,2417cyclictest1366815-21kworker/0:2+events21:05:350
133285499243012,2414cyclictest1347564-21kworker/0:2+events20:12:420
133285499243011,2415cyclictest1366815-21kworker/0:2+events21:02:300
133285999242912,2413cyclictest1365241-21kworker/1:1+events20:52:121
133285499242912,2413cyclictest1421498-21kworker/0:1+events23:49:020
133285499242912,2413cyclictest1421498-21kworker/0:1+events23:49:020
133285499242712,2411cyclictest1344244-21kworker/0:1+events20:01:420
133286499242611,2412cyclictest1336212-21kworker/3:2+events19:28:373
133286499242512,2410cyclictest1398206-21kworker/3:0+events22:44:023
133286499242511,2410cyclictest1354133-21kworker/3:1+events20:25:123
133285499242511,2411cyclictest1347564-21kworker/0:2+events20:35:470
133286499242411,2410cyclictest1372935-21kworker/3:1+events21:32:473
133286499242411,2410cyclictest1372935-21kworker/3:1+events21:32:463
133286499242312,2407cyclictest1436009-21kworker/3:0+events00:39:053
133285499242212,2407cyclictest1366815-21kworker/0:2+events20:54:320
133286499242112,2406cyclictest1418058-21kworker/3:1+events23:32:263
133286499242112,2406cyclictest1412278-21kworker/3:2+events23:15:353
13328649924208,2408cyclictest1358901-21kworker/3:0+events20:35:233
13328619924199,2406cyclictest1349062-21kworker/2:1+events20:29:202
133285499241412,2398cyclictest1397271-21kworker/0:1+events23:13:190
13328649924108,2398cyclictest1372935-21kworker/3:1+events21:16:533
133286199240911,2395cyclictest1337831-21kworker/2:2+events19:55:332
133285499240711,2392cyclictest1416633-21kworker/0:0+events00:06:100
133285999240612,2391cyclictest1409934-21kworker/1:1+events23:07:331
133286499240311,2388cyclictest1396411-21kworker/3:2+events22:30:193
133286499240310,2390cyclictest1358901-21kworker/3:0+events20:41:553
133285999240312,2389cyclictest1392307-21kworker/1:0+events22:17:011
133285999240210,2389cyclictest1363607-21kworker/1:2+events20:43:261
133285499240211,2388cyclictest1397271-21kworker/0:1+events22:37:120
133285999240012,2385cyclictest1413529-21kworker/1:1+events23:19:491
133285999239912,2383cyclictest1413529-21kworker/1:1+events23:23:111
133285999239912,2383cyclictest1407538-21kworker/1:0+events23:25:501
133285999239911,2385cyclictest1421457-21kworker/1:0+events00:05:241
133285999239812,2382cyclictest1390640-21kworker/1:1+events22:10:331
133285999239812,2382cyclictest1386149-21kworker/1:1+events21:56:021
133285999239812,2382cyclictest1358808-21kworker/1:0+events20:31:141
133285999239812,2382cyclictest1344429-21kworker/1:1+events19:52:081
133286199239712,2381cyclictest1424449-21kworker/2:2+events00:02:222
133285999239712,2382cyclictest1347667-21kworker/1:2+events20:17:151
133285999239712,2381cyclictest1376102-21kworker/1:0+events21:21:481
133285999239712,2381cyclictest1358808-21kworker/1:0+events20:36:101
133285999239710,2384cyclictest1432550-21kworker/1:1+events00:20:571
133285499239712,2378cyclictest1355528-21kworker/0:0+events20:17:390
133285999239612,2380cyclictest1390640-21kworker/1:1+events22:09:241
133285999239412,2379cyclictest1384251-21kworker/1:2+events22:04:471
133286199239312,2378cyclictest1369741-21kworker/2:2+events21:02:552
133286199239212,2377cyclictest1427926-21kworker/2:0+events00:33:462
133286199239012,2375cyclictest1345014-21kworker/2:1+events19:47:172
133286199239010,2376cyclictest1332696-21kworker/2:1+events19:28:142
133286199238812,2374cyclictest1408485-21kworker/2:1+events23:12:332
133286199238812,2372cyclictest1418330-21kworker/2:1+events23:36:112
133286199238512,2371cyclictest1380357-21kworker/2:1+events21:40:032
133286199238312,2367cyclictest1372963-21kworker/2:1+events21:18:252
133286199238312,2367cyclictest1361986-21kworker/2:1+events20:42:172
133285499238311,2369cyclictest1365090-21kworker/0:0+events20:47:380
133286199238212,2367cyclictest1339490-21kworker/2:0+events19:31:422
133286199238210,2368cyclictest1369741-21kworker/2:2+events21:09:192
133286199238112,2365cyclictest1429531-21kworker/2:1+events00:27:172
133286199237812,2364cyclictest1419929-21kworker/2:0+events23:42:342
133286199237811,2363cyclictest1365444-21kworker/2:1+events20:59:072
133286199237713,2361cyclictest1384066-21kworker/2:1+events22:21:402
133286199237310,2360cyclictest1339490-21kworker/2:0+events19:39:412
133286199237212,2358cyclictest1427926-21kworker/2:0+events00:15:392
133286499237011,2356cyclictest1429438-21kworker/3:1+events00:11:083
13328549923709,2358cyclictest1347564-21kworker/0:2+events19:54:240
133286199236510,2352cyclictest1424449-21kworker/2:2+events23:58:372
133286199236412,2349cyclictest1427926-21kworker/2:0+events00:07:422
133286199236411,2350cyclictest1408485-21kworker/2:1+events23:07:572
133286199236411,2349cyclictest1382435-21kworker/2:0+events21:50:442
133285999236311,2348cyclictest1396976-21kworker/1:2+events22:36:051
133286199236212,2346cyclictest1371342-21kworker/2:0+events21:13:502
133286499235412,2338cyclictest1380993-21kworker/3:0+events21:43:073
13328649923519,2339cyclictest1419811-21kworker/3:2+events00:02:443
133285999235011,2336cyclictest1421457-21kworker/1:0+events00:00:531
13328649923499,2336cyclictest1336212-21kworker/3:2+events19:46:103
133286199234812,2333cyclictest1382435-21kworker/2:0+events22:07:292
133285499234612,2331cyclictest1416633-21kworker/0:0+events23:40:210
133285499234111,2328cyclictest1384221-21kworker/0:1+events22:20:070
133286199233912,2325cyclictest1414856-21kworker/2:1+events23:25:042
133286199233711,2322cyclictest1427926-21kworker/2:0+events00:36:232
133285499233411,2319cyclictest1431189-21kworker/0:2+events00:28:450
133286499232612,2310cyclictest1398206-21kworker/3:0+events23:12:103
133285999232012,2305cyclictest1400237-21kworker/1:1+events22:45:571
133285999231711,2303cyclictest1344429-21kworker/1:1+events19:44:381
13328599923139,2300cyclictest1430953-21kworker/1:2+events00:13:211
133286499231110,2299cyclictest1329179-21kworker/3:1+events19:35:083
133285499231110,2299cyclictest1374661-21kworker/0:2+events21:35:040
133286199230912,2295cyclictest1372963-21kworker/2:1+events21:25:382
133286199230911,2294cyclictest1405697-21kworker/2:2+events23:03:232
133285999230110,2288cyclictest1358808-21kworker/1:0+events20:28:121
133286199229912,2284cyclictest1416567-21kworker/2:0+events23:30:532
133285499229712,2282cyclictest1374661-21kworker/0:2+events21:21:260
133285499228510,2271cyclictest1347564-21kworker/0:2+events20:43:470
133285499227411,2257cyclictest1384221-21kworker/0:1+events22:02:320
133286499226610,2252cyclictest1358901-21kworker/3:0+events21:15:003
13328549922668,2255cyclictest1384221-21kworker/0:1+events21:52:380
13328599922619,2249cyclictest1403585-21kworker/1:0+events22:53:371
133286499225811,2244cyclictest1418058-21kworker/3:1+events23:38:293
133286199225810,2245cyclictest1380357-21kworker/2:1+events21:36:582
133286499225711,2243cyclictest1398206-21kworker/3:0+events22:46:193
133286499224611,2231cyclictest1408454-21kworker/3:2+events23:04:083
133286499224410,2231cyclictest1336212-21kworker/3:2+events20:08:073
133285499224412,2229cyclictest1395558-21kworker/0:0+events22:27:420
133286499224312,2228cyclictest1426588-21kworker/3:0+events00:06:343
133286199224211,2228cyclictest1360379-21kworker/2:2+events20:37:422
133285499224210,2229cyclictest1384221-21kworker/0:1+events22:17:240
13328549922419,2228cyclictest1431189-21kworker/0:2+events00:16:490
13328649922409,2227cyclictest1403311-21kworker/3:1+events22:59:363
133285999223710,2223cyclictest1326216-21kworker/1:0+events19:37:481
133285499223610,2223cyclictest1400206-21kworker/0:0+events22:52:070
133286499223211,2217cyclictest1336212-21kworker/3:2+events19:34:223
133286499223210,2219cyclictest1336212-21kworker/3:2+events20:01:173
13328549922329,2220cyclictest1334347-21kworker/0:0+events19:34:000
13328549922329,2219cyclictest1432790-21kworker/0:1+events00:22:470
13328649922319,2218cyclictest1329179-21kworker/3:1+events19:21:093
133285499223111,2216cyclictest1355528-21kworker/0:0+events20:25:360
133285499223011,2216cyclictest1397271-21kworker/0:1+events23:15:580
133285499223011,2216cyclictest1336907-21kworker/0:1+events19:21:310
133285499222911,2216cyclictest1389576-21kworker/0:0+events22:10:100
13328549922289,2215cyclictest1366815-21kworker/0:2+events20:57:100
133285499222810,2215cyclictest1416633-21kworker/0:0+events23:29:210
133286499222711,2213cyclictest1418058-21kworker/3:1+events23:47:303
133286499222711,2213cyclictest1418058-21kworker/3:1+events23:47:293
133285499222711,2212cyclictest1414999-21kworker/0:2+events23:24:400
133286499222610,2213cyclictest1392275-21kworker/3:1+events22:14:223
133286499222610,2212cyclictest1346356-21kworker/3:1+events19:51:243
133286499222511,2210cyclictest1384579-21kworker/3:0+events21:54:543
133286499222411,2209cyclictest1379365-21kworker/3:2+events21:38:073
133286499222410,2211cyclictest1426588-21kworker/3:0+events00:18:393
133286499222410,2210cyclictest1354133-21kworker/3:1+events20:23:213
13328549922249,2212cyclictest1397271-21kworker/0:1+events22:56:170
133285499222411,2210cyclictest1334347-21kworker/0:0+events19:36:180
133285999222310,2209cyclictest1351161-21kworker/1:3+events20:09:151
133286499222111,2207cyclictest1419811-21kworker/3:2+events23:50:563
133286499222111,2207cyclictest1352534-21kworker/3:0+events20:13:263
133285499222111,2207cyclictest1345851-21kworker/0:0+events19:47:370
13328619922189,2205cyclictest1427926-21kworker/2:0+events00:23:082
13328549922188,2207cyclictest1418298-21kworker/0:2+events23:35:490
133286499221711,2203cyclictest1334051-21kworker/3:0+events19:14:413
133286499221710,2204cyclictest1358901-21kworker/3:0+events20:45:423
133285999221712,2202cyclictest1401863-21kworker/1:2+events22:44:251
133285499221710,2203cyclictest1400206-21kworker/0:0+events22:45:120
13328649922149,2201cyclictest1382651-21kworker/3:1+events21:58:183
133286499221110,2198cyclictest1358901-21kworker/3:0+events21:04:273
133285999220910,2195cyclictest1430953-21kworker/1:2+events00:15:171
13328599922077,2196cyclictest1423116-21kworker/1:2+events23:54:011
133285999220711,2193cyclictest1418091-21kworker/1:1+events23:41:281
133286499220610,2193cyclictest1418058-21kworker/3:1+events23:43:203
13328619922069,2193cyclictest1401769-21kworker/2:1+events22:46:412
13328599922068,2195cyclictest1353181-21kworker/1:0+events20:13:041
133286499220510,2191cyclictest1392275-21kworker/3:1+events22:21:183
133285999220511,2191cyclictest1418091-21kworker/1:1+events23:37:191
13328599922039,2190cyclictest1418091-21kworker/1:1+events23:47:531
13328599922039,2190cyclictest1418091-21kworker/1:1+events23:47:531
133285999220311,2189cyclictest1368766-21kworker/1:2+events21:11:561
133286499220210,2190cyclictest1398206-21kworker/3:0+events23:05:153
13328599922029,2190cyclictest1396976-21kworker/1:2+events22:31:511
133285999220211,2188cyclictest1337596-21kworker/1:2+events19:24:291
133285999220011,2186cyclictest1392307-21kworker/1:0+events22:22:031
13328549922008,2189cyclictest1382497-21kworker/0:0+events21:42:430
133286499219911,2186cyclictest1392275-21kworker/3:1+events22:25:273
13328599921999,2186cyclictest1418091-21kworker/1:1+events23:33:351
133285999219910,2186cyclictest1421457-21kworker/1:0+events00:31:041
133285999219710,2184cyclictest1401863-21kworker/1:2+events22:58:071
133285999219610,2182cyclictest1407538-21kworker/1:0+events23:02:381
13328599921958,2184cyclictest1344429-21kworker/1:1+events19:46:321
133285999219510,2181cyclictest1347667-21kworker/1:2+events20:24:491
133286499219411,2180cyclictest1432763-21kworker/3:1+events00:29:313
133286199219411,2180cyclictest1360379-21kworker/2:2+events20:49:312
13328599921947,2184cyclictest1347667-21kworker/1:2+events20:00:561
133285999219010,2177cyclictest1376102-21kworker/1:0+events21:31:171
133285999219010,2177cyclictest1376102-21kworker/1:0+events21:31:171
133286499218110,2168cyclictest1368326-21kworker/3:2+events20:58:433
133285999218111,2167cyclictest1432550-21kworker/1:1+events00:25:221
133285999217511,2161cyclictest1379421-21kworker/1:2+events21:37:441
133285499217211,2157cyclictest1371661-21kworker/0:1+events21:18:020
133286199216810,2154cyclictest1349062-21kworker/2:1+events20:14:572
133286499216711,2153cyclictest1357095-21kworker/3:2+events20:30:303
133286199216511,2150cyclictest1401769-21kworker/2:1+events22:50:352
133286199216510,2151cyclictest1384066-21kworker/2:1+events22:29:132
133286199216311,2149cyclictest1397213-21kworker/2:0+events22:41:432
133286199216311,2149cyclictest1397213-21kworker/2:0+events22:30:422
133286199216311,2149cyclictest1384066-21kworker/2:1+events22:18:102
133285499216310,2150cyclictest1434444-21kworker/0:0+events00:31:280
133286199216111,2148cyclictest1372963-21kworker/2:1+events21:23:192
13328619921599,2147cyclictest1397213-21kworker/2:0+events22:59:592
13328619921598,2147cyclictest1418330-21kworker/2:1+events23:52:062
133286199215910,2145cyclictest1347477-21kworker/2:0+events19:54:012
13328619921588,2147cyclictest1371342-21kworker/2:0+events21:32:252
13328619921588,2147cyclictest1371342-21kworker/2:0+events21:32:242
133286199215711,2143cyclictest1332696-21kworker/2:1+events19:23:452
13328619921559,2143cyclictest1405697-21kworker/2:2+events23:23:562
133286199215510,2141cyclictest1405697-21kworker/2:2+events23:18:412
13328649921469,2134cyclictest1426588-21kworker/3:0+events00:22:253
13328619921446,2135cyclictest1382435-21kworker/2:0+events21:57:112
133286199213110,2117cyclictest1382435-21kworker/2:0+events22:12:052
133286199212911,2115cyclictest1427926-21kworker/2:0+events00:14:072
133285999212210,2109cyclictest1331056-21kworker/1:1+events19:15:261
133286499211711,2103cyclictest1382651-21kworker/3:1+events22:01:463
13328599921167,2106cyclictest1326216-21kworker/1:0+events19:13:541
133286199210811,2094cyclictest1349062-21kworker/2:1+events20:15:442
133285499210810,2095cyclictest1334347-21kworker/0:0+events19:16:330
13328649920897,2079cyclictest1336212-21kworker/3:2+events19:59:463
133285499207810,2065cyclictest1416633-21kworker/0:0+events23:55:580
13328549920764,2069cyclictest1406925-21kworker/0:0+events23:06:240
13328649920718,2060cyclictest1392275-21kworker/3:1+events22:18:583
13328649920577,2047cyclictest1336212-21kworker/3:2+events19:19:153
13328599920435,2035cyclictest1381022-21kworker/1:0+events21:53:021
13328599920423,2036cyclictest1368766-21kworker/1:2+events21:15:451
133286199203511,2021cyclictest1349062-21kworker/2:1+events20:21:512
13328619920032,1998cyclictest1337831-21kworker/2:2+events20:04:202
13328619920009,1987cyclictest1332696-21kworker/2:1+events19:12:442
13326652142108,29sleep20-21swapper/219:09:332
13326232142107,29sleep30-21swapper/319:09:023
13313642141112,25sleep00-21swapper/019:05:030
13325082139107,27sleep10-21swapper/119:07:311
1332854996158,2cyclictest1330795-21kworker/0:2+pm19:14:530
133286199140,5cyclictest1343441-21runrttasks19:40:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional