You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 20:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Jul 30, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12581609931046,3092cyclictest1287244-21kworker/2:2+events20:40:152
125815399309515,3075cyclictest1303191-21kworker/0:1+events21:40:160
125815399304910,3033cyclictest1336663-21kworker/0:1+events23:15:110
125815699295114,2932cyclictest1285652-21kworker/1:0+events20:35:151
125815699292413,2907cyclictest1285652-21kworker/1:0+events20:50:321
125816099291913,2902cyclictest1326243-21kworker/2:1+events23:08:212
125815399289814,2881cyclictest1340261-21kworker/0:0+events23:35:010
125815399288011,2866cyclictest1352954-21kworker/0:1+events00:15:160
125815399288011,2866cyclictest1352954-21kworker/0:1+events00:15:160
125815699287012,2854cyclictest1303111-21kworker/1:1+events21:30:011
125816099286913,2852cyclictest1277199-21kworker/2:2+events20:20:182
125815399286014,2842cyclictest1309368-21kworker/0:1+events22:05:160
125816099283514,2816cyclictest1354375-21kworker/2:2+events00:10:192
125816099283011,2815cyclictest1270832-21kworker/2:0+events19:55:562
125816099282212,2806cyclictest1278984-21kworker/2:1+events20:19:322
125815699281813,2803cyclictest1275830-21kworker/1:2+events20:21:041
125816099280513,2788cyclictest1343183-21kworker/2:2+events23:44:142
125816099280413,2787cyclictest1351105-21kworker/2:0+events00:01:412
125816099279913,2784cyclictest1354375-21kworker/2:2+events00:19:042
125816099279913,2784cyclictest1354375-21kworker/2:2+events00:19:042
125816099279713,2780cyclictest1307798-21kworker/2:0+events21:43:392
125816399279412,2778cyclictest1317602-21kworker/3:0+events22:16:213
125815699278713,2770cyclictest1327588-21kworker/1:2+events22:50:141
125816099278013,2763cyclictest1331907-21kworker/2:0+events23:12:112
125815399278011,2766cyclictest1295112-21kworker/0:0+events21:03:550
125816099277913,2762cyclictest1311025-21kworker/2:0+events22:00:142
125816099277513,2758cyclictest1290671-21kworker/2:0+events21:25:292
125816099277412,2760cyclictest1293425-21kworker/2:2+events21:00:102
125816099276913,2752cyclictest1328715-21kworker/2:2+events22:56:592
125816099276913,2752cyclictest1285508-21kworker/2:1+events20:31:502
125815699276713,2750cyclictest1275830-21kworker/1:2+events20:25:171
125816099276213,2745cyclictest1270832-21kworker/2:0+events19:51:472
125816399276112,2745cyclictest1296681-21kworker/3:1+events21:10:273
125815699276113,2746cyclictest1275830-21kworker/1:2+events20:16:051
125815699276013,2743cyclictest1285652-21kworker/1:0+events21:02:501
125815699275812,2742cyclictest1312738-21kworker/1:0+events21:56:521
125815699275811,2743cyclictest1327588-21kworker/1:2+events23:02:421
125816399275713,2740cyclictest1325668-21kworker/3:2+events22:57:453
12581639927568,2744cyclictest1275801-21kworker/3:2+events20:05:223
125816399275613,2739cyclictest1298430-21kworker/3:0+events21:31:313
12581639927559,2741cyclictest1351414-21kworker/3:1+events00:05:233
125816399275313,2736cyclictest1320880-21kworker/3:0+events22:38:093
125816399275313,2736cyclictest1267809-21kworker/3:0+events19:45:413
125816399275213,2735cyclictest1285629-21kworker/3:2+events20:35:373
12581639927518,2738cyclictest1357401-21kworker/3:1+events00:38:313
125815699275013,2733cyclictest1296617-21kworker/1:1+events21:20:581
125815699274911,2736cyclictest1323819-21kworker/1:0+events22:45:201
125816399274813,2731cyclictest1334981-21kworker/3:0+events23:12:333
125816099274213,2726cyclictest1251479-21kworker/2:2+events19:19:542
125815399274213,2725cyclictest1344820-21kworker/0:2+events00:09:120
125815399274213,2724cyclictest1283927-21kworker/0:1+events20:31:270
125816399274113,2724cyclictest1298430-21kworker/3:0+events21:27:463
125815699274113,2724cyclictest1274043-21kworker/1:0+events20:03:041
125816099274013,2724cyclictest1343183-21kworker/2:2+events23:47:372
125816399273813,2721cyclictest1311173-21kworker/3:1+events22:02:093
125815699272713,2710cyclictest1309267-21kworker/1:1+events21:47:261
125815399272713,2710cyclictest1267103-21kworker/0:2+events19:54:030
125815699272613,2709cyclictest1351047-21kworker/1:1+events00:02:261
125816399272411,2709cyclictest1277675-21kworker/3:0+events20:19:553
125815399272413,2707cyclictest1295112-21kworker/0:0+events21:06:110
12581639927236,2713cyclictest1290537-21kworker/3:1+events20:51:423
125816399272213,2705cyclictest1287307-21kworker/3:0+events20:43:423
125816399271911,2704cyclictest1341695-21kworker/3:2+events23:28:523
125815699271913,2702cyclictest1274043-21kworker/1:0+events20:14:121
125815699271913,2702cyclictest1274043-21kworker/1:0+events20:08:251
125815699271713,2699cyclictest1252979-21kworker/1:0+events19:20:161
125815399271713,2699cyclictest1263017-21kworker/0:0+events19:37:420
125816399271613,2699cyclictest1338207-21kworker/3:2+events23:22:053
125816399271512,2699cyclictest1348082-21kworker/3:0+events23:49:563
125815699271313,2696cyclictest1327588-21kworker/1:2+events23:09:531
125815699271313,2696cyclictest1285652-21kworker/1:0+events20:41:011
125815699271313,2696cyclictest1252979-21kworker/1:0+events19:15:201
125816399271213,2697cyclictest1295047-21kworker/3:0+events21:05:063
125816399271213,2695cyclictest1304586-21kworker/3:1+events21:36:473
125815699271213,2695cyclictest1303111-21kworker/1:1+events21:35:401
125815699271213,2695cyclictest1252979-21kworker/1:0+events19:38:031
125815399271210,2698cyclictest1305122-21kworker/0:0+events21:39:070
125816399271113,2694cyclictest1290537-21kworker/3:1+events20:55:103
125815699271113,2694cyclictest1349414-21kworker/1:0+events23:55:401
125815699271113,2694cyclictest1339999-21kworker/1:0+events23:35:231
125815699271112,2696cyclictest1272443-21kworker/1:2+events19:54:261
125815699271012,2694cyclictest1319342-21kworker/1:1+events22:30:481
125816399270913,2692cyclictest1307973-21kworker/3:0+events21:59:533
125815699270913,2692cyclictest1355946-21kworker/1:2+events00:16:471
125815699270913,2692cyclictest1355946-21kworker/1:2+events00:16:461
125816399270813,2691cyclictest1360692-21kworker/3:2+events00:32:463
125816399270813,2691cyclictest1272467-21kworker/3:1+events20:04:363
125815699270813,2691cyclictest1285652-21kworker/1:0+events20:59:461
125815399270813,2691cyclictest1344820-21kworker/0:2+events23:52:140
12581639927078,2695cyclictest1292248-21kworker/3:3+events21:00:543
125816399270613,2689cyclictest1272467-21kworker/3:1+events19:53:163
125815399270613,2689cyclictest1307768-21kworker/0:2+events21:46:400
125816399270513,2688cyclictest1344694-21kworker/3:1+events23:42:433
125816399270513,2688cyclictest1341695-21kworker/3:2+events23:31:313
125816399270513,2688cyclictest1284018-21kworker/3:1+events20:34:523
125816399270513,2688cyclictest1284018-21kworker/3:1+events20:28:213
125816399270513,2688cyclictest1280550-21kworker/3:2+events20:24:543
125816399270513,2688cyclictest1272467-21kworker/3:1+events20:10:193
125816399270512,2689cyclictest1287307-21kworker/3:0+events20:47:293
125815699270513,2688cyclictest1319342-21kworker/1:1+events22:27:441
125816399270313,2687cyclictest1254468-21kworker/3:2+events19:31:383
125816399270313,2686cyclictest1311173-21kworker/3:1+events22:09:253
125815699270312,2687cyclictest1285652-21kworker/1:0+events20:45:111
125815399270313,2686cyclictest1317479-21kworker/0:0+events22:15:560
125815699270213,2685cyclictest1335045-21kworker/1:1+events23:43:061
125815699270213,2685cyclictest1335045-21kworker/1:1+events23:26:581
125815699270211,2687cyclictest1327588-21kworker/1:2+events22:57:211
125815399270213,2687cyclictest1263017-21kworker/0:0+events19:25:090
125815399270213,2685cyclictest1344820-21kworker/0:2+events23:57:550
12581639927019,2688cyclictest1309570-21kworker/3:2+events21:53:513
125816399270011,2685cyclictest1254468-21kworker/3:2+events19:23:393
125816099269812,2682cyclictest1338325-21kworker/2:1+events23:24:422
125815399269813,2681cyclictest1285915-21kworker/0:3+events20:39:290
125815399269812,2682cyclictest1324833-21kworker/0:1+events22:36:130
125815399269513,2678cyclictest1311759-21kworker/0:0+events21:59:300
125815699269212,2676cyclictest1355946-21kworker/1:2+events00:28:131
125815399269213,2675cyclictest1267103-21kworker/0:2+events20:05:450
125815699269111,2676cyclictest1285652-21kworker/1:0+events21:11:111
125815699269013,2673cyclictest1266001-21kworker/1:2+events19:32:021
125815399269012,2674cyclictest1344820-21kworker/0:2+events00:11:040
125815699268912,2673cyclictest1339999-21kworker/1:0+events23:33:501
125816099268813,2671cyclictest1316118-21kworker/2:0+events22:11:212
125815699268813,2671cyclictest1285652-21kworker/1:0+events21:05:491
125816099268112,2665cyclictest1290671-21kworker/2:0+events21:22:502
125815699268013,2663cyclictest1309267-21kworker/1:1+events22:04:531
125816099267713,2660cyclictest1290671-21kworker/2:0+events21:15:162
125815399267713,2660cyclictest1290570-21kworker/0:1+events20:54:480
125816099267512,2659cyclictest1281114-21kworker/2:0+events20:37:312
125815399267411,2659cyclictest1328628-21kworker/0:2+events22:51:430
12581539926737,2662cyclictest1352954-21kworker/0:1+events00:24:300
125815399267213,2655cyclictest1340261-21kworker/0:0+events23:26:340
125815399267212,2657cyclictest1256336-21kworker/0:2+events19:20:380
125816099266213,2645cyclictest1311025-21kworker/2:0+events21:53:052
125816399265711,2642cyclictest1267809-21kworker/3:0+events19:42:163
125816099265611,2643cyclictest1317768-21kworker/2:2+events22:20:522
125815399264713,2630cyclictest1301590-21kworker/0:0+events21:26:140
125815699264611,2631cyclictest1319342-21kworker/1:1+events22:24:401
125816099264513,2628cyclictest1267898-21kworker/2:2+events19:42:382
125816099264311,2628cyclictest1312887-21kworker/2:2+events21:58:452
125815699264313,2627cyclictest1336657-21kworker/1:0+events23:14:501
125816099264013,2623cyclictest1290671-21kworker/2:0+events21:05:272
125815399264013,2624cyclictest1307768-21kworker/0:2+events21:51:090
12581639926315,2622cyclictest1355770-21kworker/3:2+events00:17:343
12581639926315,2622cyclictest1355770-21kworker/3:2+events00:17:333
125815399263013,2613cyclictest1290570-21kworker/0:1+events21:13:050
125815699262413,2608cyclictest1284023-21kworker/1:1+events20:33:421
125816399261813,2601cyclictest1259441-21kworker/3:0+events19:19:103
125815399261812,2602cyclictest1267103-21kworker/0:2+events19:57:040
12581639926159,2602cyclictest1304586-21kworker/3:1+events21:44:003
125816399261312,2597cyclictest1300059-21kworker/3:1+events21:23:113
125816099261212,2597cyclictest1262872-21kworker/2:1+events19:26:172
12581569926109,2600cyclictest1301474-21kworker/1:0+events21:31:511
125816399260912,2593cyclictest1259441-21kworker/3:0+events19:26:403
12581569926088,2596cyclictest1299820-21kworker/1:2+events21:19:051
125816399259313,2576cyclictest1331073-21kworker/3:1+events23:06:533
125815399258510,2571cyclictest1309368-21kworker/0:1+events22:01:230
12581569925838,2572cyclictest1314369-21kworker/1:2+events22:17:061
12581609925817,2570cyclictest1267898-21kworker/2:2+events19:46:502
125815399258011,2565cyclictest1320701-21kworker/0:2+events22:22:020
125816099257612,2560cyclictest1312887-21kworker/2:2+events22:07:532
125815399257412,2558cyclictest1267103-21kworker/0:2+events19:41:060
125816099257311,2558cyclictest1290671-21kworker/2:0+events21:31:092
12581569925616,2549cyclictest1306726-21kworker/1:0+events21:41:011
125815699256013,2544cyclictest1252979-21kworker/1:0+events19:28:581
125816099255810,2544cyclictest1304823-21kworker/2:1+events21:47:472
125816099255712,2541cyclictest1270832-21kworker/2:0+events20:07:172
125816099255612,2540cyclictest1259619-21kworker/2:0+events19:24:472
125815399255512,2541cyclictest1263017-21kworker/0:0+events19:30:080
125816099255411,2539cyclictest1289027-21kworker/2:1+events20:50:552
125815699255312,2537cyclictest1319342-21kworker/1:1+events22:42:431
125815399255211,2537cyclictest1360663-21kworker/0:0+events00:33:320
12581609925466,2537cyclictest1324153-21kworker/2:0+events22:37:452
125816099254412,2529cyclictest1343183-21kworker/2:2+events23:35:432
125815699254413,2527cyclictest1309267-21kworker/1:1+events21:54:131
12581609925428,2530cyclictest1273917-21kworker/2:1+events20:00:492
125816099254211,2527cyclictest1324153-21kworker/2:0+events22:40:242
125816099254012,2526cyclictest1357615-21kworker/2:1+events00:35:042
125816099253811,2524cyclictest1264453-21kworker/2:2+events19:31:152
125816099253811,2523cyclictest1317768-21kworker/2:2+events22:31:582
125816099253810,2524cyclictest1320669-21kworker/2:0+events22:25:262
125816099253612,2520cyclictest1348270-21kworker/2:1+events23:52:592
125816099253512,2521cyclictest1295952-21kworker/2:1+events21:10:022
125816099253512,2519cyclictest1338325-21kworker/2:1+events23:28:272
125816099253412,2518cyclictest1362379-21kworker/2:2+events00:31:152
12581609925329,2519cyclictest1338325-21kworker/2:1+events23:31:542
125816099253212,2518cyclictest1326243-21kworker/2:1+events22:47:362
125816099253212,2516cyclictest1326243-21kworker/2:1+events23:01:092
12581609925283,2521cyclictest1348270-21kworker/2:1+events00:08:032
125816099252812,2512cyclictest1290671-21kworker/2:0+events20:55:342
125816099252112,2505cyclictest1304823-21kworker/2:1+events21:37:582
125816399251212,2496cyclictest1298430-21kworker/3:0+events21:17:573
125816099251210,2498cyclictest1357615-21kworker/2:1+events00:25:362
125816399251111,2496cyclictest1349684-21kworker/3:2+events00:00:353
125815699250812,2492cyclictest1355946-21kworker/1:2+events00:33:091
12581539924998,2487cyclictest1274182-21kworker/0:0+events20:03:490
125816399249812,2482cyclictest1339834-21kworker/3:0+events23:36:073
12581639924967,2486cyclictest1331073-21kworker/3:1+events23:03:503
125815399249212,2476cyclictest1299973-21kworker/0:2+events21:19:500
125816399249112,2476cyclictest1322484-21kworker/3:1+events22:33:523
125815699249012,2475cyclictest1346266-21kworker/1:2+events23:45:201
125815699249012,2474cyclictest1335045-21kworker/1:1+events23:19:231
125815699248912,2474cyclictest1351047-21kworker/1:1+events00:07:411
125815399248712,2471cyclictest1336663-21kworker/0:1+events23:21:410
125815699248612,2471cyclictest1355946-21kworker/1:2+events00:24:061
12581569924855,2476cyclictest1325470-21kworker/1:2+events22:38:291
125815699248412,2468cyclictest1349414-21kworker/1:0+events23:51:281
125815699248411,2470cyclictest1269230-21kworker/1:1+events19:56:411
125815699248411,2469cyclictest1269230-21kworker/1:1+events19:49:061
125816399248112,2465cyclictest1325668-21kworker/3:2+events22:43:073
125816399247912,2463cyclictest1320880-21kworker/3:0+events22:25:503
125816399247910,2466cyclictest1334981-21kworker/3:0+events23:16:193
125816099247912,2463cyclictest1326243-21kworker/2:1+events22:52:502
125815699247912,2464cyclictest1266001-21kworker/1:2+events19:41:291
12581639924784,2470cyclictest1355770-21kworker/3:2+events00:21:003
125815699247812,2463cyclictest1355946-21kworker/1:2+events00:13:421
125815399247811,2463cyclictest1309368-21kworker/0:1+events22:10:570
125815699247712,2461cyclictest1309267-21kworker/1:1+events22:06:241
12581569924766,2466cyclictest1336879-21kworker/1:3+events23:24:191
125816399247512,2459cyclictest1269557-21kworker/3:2+events19:57:253
125815399247312,2457cyclictest1332028-21kworker/0:0+events23:08:450
125816399247212,2456cyclictest1353221-21kworker/3:0+events00:10:413
125816399247211,2458cyclictest1344694-21kworker/3:1+events23:53:233
125816399247112,2456cyclictest1314696-21kworker/3:2+events22:23:333
125816399247112,2455cyclictest1327319-21kworker/3:0+events22:45:433
125816399247012,2454cyclictest1349684-21kworker/3:2+events23:56:003
125815699246912,2454cyclictest1355946-21kworker/1:2+events00:36:121
12581539924689,2455cyclictest1288789-21kworker/0:0+events20:42:550
125815399246812,2454cyclictest1344820-21kworker/0:2+events23:40:210
125816399246612,2450cyclictest1266061-21kworker/3:1+events19:38:483
125815399246612,2450cyclictest1330223-21kworker/0:1+events22:55:500
125815399246611,2451cyclictest1278685-21kworker/0:1+events20:12:400
125815399246412,2448cyclictest1285569-21kworker/0:2+events20:46:410
125815399246411,2449cyclictest1278685-21kworker/0:1+events20:15:200
125816099245912,2443cyclictest1348270-21kworker/2:1+events23:57:082
125815399245012,2435cyclictest1320701-21kworker/0:2+events22:30:260
125815399244912,2433cyclictest1359005-21kworker/0:2+events00:29:180
125816399244812,2433cyclictest1304586-21kworker/3:1+events21:47:033
125815399244812,2432cyclictest1327026-21kworker/0:0+events22:41:570
125815399244712,2431cyclictest1332028-21kworker/0:0+events23:12:560
125815399244712,2431cyclictest1299973-21kworker/0:2+events21:23:340
125816099244612,2430cyclictest1266212-21kworker/2:0+events19:36:372
125815399244612,2431cyclictest1299973-21kworker/0:2+events21:30:450
125816099244512,2429cyclictest1354375-21kworker/2:2+events00:23:192
125815399244511,2430cyclictest1283927-21kworker/0:1+events20:26:260
125815399244411,2429cyclictest1256336-21kworker/0:2+events19:17:370
125816099243912,2423cyclictest1335993-21kworker/2:2+events23:19:002
125815399243812,2422cyclictest1344820-21kworker/0:2+events23:48:000
125815399243611,2422cyclictest1360663-21kworker/0:0+events00:35:290
125815399243311,2419cyclictest1292175-21kworker/0:2+events20:57:070
125815399243012,2414cyclictest1317479-21kworker/0:0+events22:29:150
125815399242112,2405cyclictest1259320-21kworker/0:0+events19:14:560
125816399239912,2383cyclictest1360692-21kworker/3:2+events00:28:573
125815699239212,2376cyclictest1314369-21kworker/1:2+events22:13:401
125815399239212,2376cyclictest1267103-21kworker/0:2+events19:45:180
125815699238912,2373cyclictest1256325-21kworker/1:2+events19:14:321
125816399238612,2370cyclictest1317602-21kworker/3:0+events22:13:163
125815399237514,2357cyclictest1332028-21kworker/0:0+events23:02:190
125815399237311,2358cyclictest1327026-21kworker/0:0+events22:46:290
125816099236012,2346cyclictest1277199-21kworker/2:2+events20:14:582
125816399235212,2336cyclictest1259441-21kworker/3:0+events19:14:093
125816399217311,2159cyclictest1327319-21kworker/3:0+events22:54:443
12581609920589,2046cyclictest1256275-21kworker/2:1+events19:10:462
12581539920069,1994cyclictest1342106-21kworker/0:1+events23:37:420
12578312178148,25sleep30-21swapper/319:08:523
125815399150146,2cyclictest1344820-21kworker/0:2+pm00:04:510
12578702147102,40sleep00-21swapper/019:09:210
12578402144110,29sleep20-21swapper/219:08:592
12575852140104,32sleep10-21swapper/119:05:421
1258153992721,4cyclictest607-21rs:main0
1258160991911,6cyclictest1283642-21awk20:25:192
125816099187,5cyclictest1318611-10ld22:15:172
125816099167,6cyclictest1289052-21cron20:45:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional