You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 17:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Fri May 29, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
118172299477825,4748cyclictest1262080-21kworker/3:1+events23:30:163
118172299358613,3564cyclictest1270165-21kworker/3:2+events23:55:163
118171899347617,3456cyclictest1210173-21kworker/2:2+events20:45:162
118172299310015,3081cyclictest1205685-21kworker/3:0+events20:40:163
118171899309414,3075cyclictest1249008-21kworker/2:2+events22:45:162
118171899308715,3068cyclictest1286122-21kworker/2:2+events00:35:222
118171299308314,3062cyclictest1233668-21kworker/0:1+events21:55:190
118171699305514,3037cyclictest1183845-21kworker/1:0+events19:25:121
11817169930236,3012cyclictest1224993-21kworker/1:0+events21:30:181
118171699301113,2996cyclictest1257381-21kworker/1:0+events23:15:221
118171899301014,2993cyclictest1241389-21kworker/2:2+events22:25:092
118171699291414,2895cyclictest1211738-21kworker/1:0+events20:50:111
118171299280313,2787cyclictest1216576-21kworker/0:1+events21:15:010
118171699277113,2754cyclictest1276588-21kworker/1:1+events00:09:231
118171699277013,2753cyclictest1284575-21kworker/1:0+events00:33:291
118171699276512,2749cyclictest1234661-21kworker/1:1+events22:02:351
118171699276313,2746cyclictest1260914-21kworker/1:1+events23:31:501
118171899274912,2733cyclictest1219776-21kworker/2:0+events21:18:052
11817189927306,2720cyclictest1241389-21kworker/2:2+events22:16:232
118171899272113,2704cyclictest1261949-21kworker/2:0+events23:21:102
118171299271413,2697cyclictest1197822-21kworker/0:1+events20:01:180
118171899271213,2695cyclictest1247258-21kworker/2:1+events22:33:062
118171299271212,2696cyclictest1281368-21kworker/0:2+events00:27:210
118171899271113,2695cyclictest1181130-21kworker/2:1+events19:20:162
118171899270913,2692cyclictest1181130-21kworker/2:1+events19:40:202
118171899270712,2691cyclictest1245622-21kworker/2:0+events22:44:312
118171899270513,2688cyclictest1231430-21kworker/2:1+events21:45:512
118171899270313,2686cyclictest1244016-21kworker/2:1+events22:22:512
118171899270313,2686cyclictest1194581-21kworker/2:2+events19:50:102
118171899270213,2685cyclictest1273278-21kworker/2:0+events23:52:172
118171899270213,2685cyclictest1251159-21kworker/2:1+events22:57:052
118171899270213,2685cyclictest1233027-21kworker/2:2+events21:54:132
118171899270212,2687cyclictest1226240-21kworker/2:1+events21:34:502
118171899270113,2685cyclictest1202334-21kworker/2:2+events20:16:382
118171899270113,2683cyclictest1196244-21kworker/2:1+events20:09:222
118171699269210,2678cyclictest1215092-21kworker/1:2+events21:15:461
118172299269113,2674cyclictest1237877-21kworker/3:0+events22:17:093
118172299269013,2673cyclictest1231275-21kworker/3:0+events21:50:003
118171699268412,2668cyclictest1268599-21kworker/1:2+events23:40:101
118171299267813,2661cyclictest1192864-21kworker/0:2+events19:53:590
118171699267412,2660cyclictest1238031-21kworker/1:2+events22:22:051
118171699266912,2654cyclictest1259011-21kworker/1:2+events23:13:291
118171299266613,2649cyclictest1284606-21kworker/0:1+events00:38:000
118172299266513,2648cyclictest1241088-21kworker/3:1+events22:27:033
118171299266413,2647cyclictest1255606-21kworker/0:0+events22:59:230
118171299266213,2645cyclictest1202302-21kworker/0:1+events20:30:440
118172299265413,2638cyclictest1273835-21kworker/3:0+events00:01:483
118172299265313,2636cyclictest1254372-21kworker/3:3+events22:57:293
118172299265211,2637cyclictest1207317-21kworker/3:2+events20:33:273
118172299265113,2634cyclictest1265665-21kworker/3:2+events23:35:163
118172299265113,2634cyclictest1254244-21kworker/3:1+events22:54:493
118172299264713,2631cyclictest1215061-21kworker/3:0+events20:56:173
118171299263813,2621cyclictest1207080-21kworker/0:2+events20:35:460
118172299263713,2620cyclictest1262080-21kworker/3:1+events23:40:573
118171899263313,2616cyclictest1270401-21kworker/2:2+events23:49:152
118171299262913,2612cyclictest1266912-21kworker/0:0+events00:13:350
118172299262313,2606cyclictest1208992-21kworker/3:1+events21:09:363
118172299262213,2606cyclictest1213311-21kworker/3:2+events20:46:463
118171699262012,2604cyclictest1238031-21kworker/1:2+events22:46:231
118171699261912,2603cyclictest1260914-21kworker/1:1+events23:20:231
118171299261912,2603cyclictest1194465-21kworker/0:1+events19:49:250
11817189926134,2605cyclictest1239544-21kworker/2:1+events22:11:292
118172299259413,2578cyclictest1184850-21kworker/3:2+events19:44:543
11817169925895,2580cyclictest1188301-21kworker/1:1+events19:39:101
118172299258813,2569cyclictest1236226-21kworker/3:2+events22:01:253
118172299258512,2569cyclictest1208992-21kworker/3:1+events21:13:513
118172299257713,2560cyclictest1236226-21kworker/3:2+events21:59:533
11817169925755,2566cyclictest1213427-21kworker/1:1+events20:48:381
118171699256712,2552cyclictest1279938-21kworker/1:0+events00:17:261
118171699256712,2552cyclictest1279938-21kworker/1:0+events00:17:261
118171299256011,2545cyclictest1192864-21kworker/0:2+events19:44:060
118171699255413,2537cyclictest1215092-21kworker/1:2+events21:12:421
118171699255412,2538cyclictest1188301-21kworker/1:1+events19:41:061
118171699254512,2529cyclictest1179328-21kworker/1:1+events19:19:541
118171699254412,2528cyclictest1192772-21kworker/1:2+events19:47:091
118171699254212,2526cyclictest1197610-21kworker/1:2+events20:01:421
118172299254013,2524cyclictest1192834-21kworker/3:0+events19:45:373
118171699254011,2525cyclictest1270315-21kworker/1:1+events23:50:261
118171699253912,2524cyclictest1208952-21kworker/1:3+events20:40:411
118171699253612,2520cyclictest1284575-21kworker/1:0+events00:39:511
118171699253610,2522cyclictest1186579-21kworker/1:2+events19:23:391
11817169925356,2525cyclictest1199327-21kworker/1:1+events20:18:101
118171699253512,2519cyclictest1195944-21kworker/1:0+events19:54:221
118171699253412,2518cyclictest1203436-21kworker/1:0+events20:20:491
118171699253312,2519cyclictest1278304-21kworker/1:2+events00:10:071
118171699253312,2517cyclictest1254579-21kworker/1:1+events23:03:311
118171699253312,2517cyclictest1245716-21kworker/1:1+events22:37:391
118171699253211,2518cyclictest1259011-21kworker/1:2+events23:10:001
118171299253212,2516cyclictest1237816-21kworker/0:1+events22:05:350
11817169925314,2523cyclictest1236257-21kworker/1:0+events22:06:421
118171699253112,2516cyclictest1195944-21kworker/1:0+events20:07:041
11817169925306,2520cyclictest1245716-21kworker/1:1+events22:28:341
118171699253012,2514cyclictest1226843-21kworker/1:2+events21:41:191
11817169925294,2521cyclictest1260914-21kworker/1:1+events23:28:231
118171699252910,2515cyclictest1215092-21kworker/1:2+events20:57:261
118171699252810,2514cyclictest1241121-21kworker/1:1+events22:18:161
118171699252612,2511cyclictest1221641-21kworker/1:1+events21:20:211
118171699252611,2511cyclictest1224993-21kworker/1:0+events21:26:491
118171899252511,2511cyclictest1286122-21kworker/2:2+events00:33:512
118171299252412,2508cyclictest1202302-21kworker/0:1+events20:29:360
11817189925138,2501cyclictest1181130-21kworker/2:1+events19:30:512
118171699251112,2495cyclictest1232965-21kworker/1:0+events21:48:291
118171699251110,2498cyclictest1200966-21kworker/1:2+events20:10:311
118171899250012,2484cyclictest1192982-21kworker/2:0+events19:49:022
118171899249512,2479cyclictest1191241-21kworker/2:2+events19:38:262
118171699249211,2478cyclictest1219654-21kworker/1:0+events21:06:371
118172299249112,2476cyclictest1184850-21kworker/3:2+events19:32:223
118171299248813,2471cyclictest1271274-21kworker/0:1+events23:54:530
118172299248511,2470cyclictest1273835-21kworker/3:0+events00:12:013
118171299248512,2469cyclictest1221821-21kworker/0:0+events21:18:290
118171899248311,2468cyclictest1265154-21kworker/2:1+events23:32:382
118171299248312,2467cyclictest1229571-21kworker/0:0+events22:00:150
118171899248211,2467cyclictest1213516-21kworker/2:1+events21:03:122
118171899247912,2463cyclictest1274903-21kworker/2:2+events00:07:512
118171899247711,2462cyclictest1274903-21kworker/2:2+events00:24:172
11817189924769,2463cyclictest1213516-21kworker/2:1+events21:11:102
11817189924768,2465cyclictest1196244-21kworker/2:1+events20:26:142
118171899247612,2460cyclictest1219776-21kworker/2:0+events21:28:232
118171899247512,2460cyclictest1210173-21kworker/2:2+events20:43:422
118171899247510,2461cyclictest1274903-21kworker/2:2+events23:58:182
118171899247412,2458cyclictest1192982-21kworker/2:0+events19:57:052
118171899247314,2455cyclictest1219776-21kworker/2:0+events21:08:302
118171899247312,2457cyclictest1221759-21kworker/2:2+events21:21:522
11817189924727,2461cyclictest1265154-21kworker/2:1+events23:27:362
118171899247212,2456cyclictest1200723-21kworker/2:0+events20:10:532
118171699247212,2457cyclictest1254579-21kworker/1:1+events22:57:511
118171699247212,2457cyclictest1238031-21kworker/1:2+events22:40:431
11817229924718,2460cyclictest1203905-21kworker/3:1+events20:24:183
11817189924719,2458cyclictest1229449-21kworker/2:0+events21:37:082
118171299247112,2455cyclictest1205443-21kworker/0:0+events20:22:210
118171899247012,2455cyclictest1245622-21kworker/2:0+events22:39:342
118171899246911,2454cyclictest1181130-21kworker/2:1+events19:28:332
118171899246812,2452cyclictest1265154-21kworker/2:1+events23:38:182
118171899246512,2450cyclictest1265154-21kworker/2:1+events00:01:012
118171899246211,2447cyclictest1233027-21kworker/2:2+events21:57:122
11817169924629,2450cyclictest1238031-21kworker/1:2+events22:32:001
118171299246212,2446cyclictest1237816-21kworker/0:1+events22:12:350
118171899246112,2443cyclictest1282854-21kworker/2:0+events00:27:442
118171699245712,2441cyclictest1274842-21kworker/1:2+events00:00:371
118171699245511,2441cyclictest1266732-21kworker/1:0+events23:37:111
118171899245412,2438cyclictest1253973-21kworker/2:0+events22:51:202
118171299245412,2439cyclictest1244228-21kworker/0:1+events22:27:260
118172299245112,2435cyclictest1256877-21kworker/3:0+events23:09:363
118171699245112,2435cyclictest1274842-21kworker/1:2+events23:57:541
118171699244912,2434cyclictest1216756-21kworker/1:1+events21:01:191
118171899244812,2432cyclictest1255666-21kworker/2:2+events23:00:532
118171699244811,2434cyclictest1205412-21kworker/1:2+events20:31:071
118171699244811,2433cyclictest1232965-21kworker/1:0+events21:51:571
118171299244812,2432cyclictest1216576-21kworker/0:1+events21:37:530
118171899244712,2431cyclictest1231430-21kworker/2:1+events21:44:222
118171699244711,2432cyclictest1278304-21kworker/1:2+events00:20:291
118171699244612,2431cyclictest1226843-21kworker/1:2+events21:38:171
118171699244612,2430cyclictest1205412-21kworker/1:2+events20:36:531
118171699244412,2429cyclictest1195944-21kworker/1:0+events19:57:281
118171699244411,2430cyclictest1207140-21kworker/1:1+events20:28:491
118171699244010,2426cyclictest1226843-21kworker/1:2+events21:57:561
11817229924388,2426cyclictest1279878-21kworker/3:1+events00:30:233
118172299243612,2420cyclictest1248916-21kworker/3:1+events22:42:593
118171299243612,2421cyclictest1255606-21kworker/0:0+events23:15:450
118172299243512,2420cyclictest1256877-21kworker/3:0+events23:27:593
118172299243512,2420cyclictest1226482-21kworker/3:2+events21:35:593
118172299243512,2420cyclictest1184850-21kworker/3:2+events20:08:363
118171299243512,2419cyclictest1216576-21kworker/0:1+events21:09:150
118171299243510,2421cyclictest1281368-21kworker/0:2+events00:18:580
118171299243510,2421cyclictest1281368-21kworker/0:2+events00:18:580
118171899243410,2420cyclictest1233027-21kworker/2:2+events22:04:292
118171699243411,2421cyclictest1282376-21kworker/1:1+events00:25:041
11817129924349,2422cyclictest1212065-21kworker/0:2+events20:49:490
118171299243412,2418cyclictest1199670-21kworker/0:2+events20:06:180
118171699243312,2417cyclictest1238031-21kworker/1:2+events22:14:531
11817129924319,2419cyclictest1216576-21kworker/0:1+events21:26:040
11817129924318,2419cyclictest1274871-21kworker/0:2+events00:02:100
118171299243012,2414cyclictest1252738-21kworker/0:1+events22:53:400
118172299242912,2413cyclictest1245650-21kworker/3:2+events22:36:073
118171299242612,2411cyclictest1268811-21kworker/0:2+events23:41:200
118171299242612,2410cyclictest1210440-21kworker/0:0+events20:41:250
118171299242610,2412cyclictest1212065-21kworker/0:2+events21:02:040
118171299242512,2411cyclictest1174888-21kworker/0:2+events19:20:370
118171299242511,2411cyclictest1284606-21kworker/0:1+events00:34:140
118171299242511,2411cyclictest1223525-21kworker/0:2+events21:23:480
118172299242412,2408cyclictest1191178-21kworker/3:1+events19:37:183
118172299242411,2410cyclictest1232934-21kworker/3:1+events21:53:303
118171299242412,2408cyclictest1274871-21kworker/0:2+events00:09:460
118171299242411,2409cyclictest1260562-21kworker/0:2+events23:14:390
118171299242411,2409cyclictest1210440-21kworker/0:0+events20:51:420
118172299242312,2408cyclictest1226482-21kworker/3:2+events21:43:593
118172299242312,2408cyclictest1219953-21kworker/3:0+events21:15:243
118172299242311,2408cyclictest1208992-21kworker/3:1+events20:36:323
118171299242312,2408cyclictest1255606-21kworker/0:0+events23:20:470
118172299242211,2407cyclictest1258800-21kworker/3:1+events23:11:103
118171299242212,2407cyclictest1244228-21kworker/0:1+events22:30:290
118171899242112,2405cyclictest1255666-21kworker/2:2+events23:12:422
118171299242112,2405cyclictest1262359-21kworker/0:1+events23:34:060
118171299242111,2406cyclictest1229571-21kworker/0:0+events21:50:240
11817129924209,2408cyclictest1258862-21kworker/0:1+events23:08:050
118171299242012,2404cyclictest1239413-21kworker/0:0+events22:23:590
118172299241912,2405cyclictest1239475-21kworker/3:2+events22:11:083
118171299241912,2405cyclictest1184989-21kworker/0:1+events19:27:050
118171299241911,2405cyclictest1245976-21kworker/0:2+events23:02:230
11817229924149,2401cyclictest1184850-21kworker/3:2+events19:16:533
118172299241412,2399cyclictest1278216-21kworker/3:2+events00:22:243
118172299241412,2399cyclictest1254372-21kworker/3:3+events23:02:453
118172299241312,2399cyclictest1260407-21kworker/3:2+events23:16:553
118172299241312,2398cyclictest1202270-21kworker/3:0+events20:16:153
118172299241212,2397cyclictest1237877-21kworker/3:0+events22:20:343
118172299241212,2396cyclictest1203905-21kworker/3:1+events20:25:503
118172299241112,2396cyclictest1226482-21kworker/3:2+events21:29:543
118172299241112,2395cyclictest1199462-21kworker/3:3+events20:13:373
118171899241112,2395cyclictest1203968-21kworker/2:0+events20:22:442
11817229924099,2396cyclictest1256877-21kworker/3:0+events23:21:333
118172299240812,2392cyclictest1245650-21kworker/3:2+events22:48:413
118171899240812,2393cyclictest1183078-21kworker/2:0+events19:16:062
118171299240212,2387cyclictest1174888-21kworker/0:2+events19:17:590
118172299239912,2384cyclictest1278216-21kworker/3:2+events00:37:163
118171299239910,2386cyclictest1227968-21kworker/0:2+events21:33:410
118171899239812,2382cyclictest1196244-21kworker/2:1+events20:32:412
118171899239312,2377cyclictest1255666-21kworker/2:2+events23:06:102
118172299239112,2376cyclictest1270165-21kworker/3:2+events23:46:593
118171899239112,2375cyclictest1236287-21kworker/2:0+events22:09:412
118171299239112,2375cyclictest1266912-21kworker/0:0+events00:23:090
118171899239012,2375cyclictest1265154-21kworker/2:1+events23:40:342
118171899238712,2371cyclictest1210173-21kworker/2:2+events20:39:072
118171899238711,2373cyclictest1274903-21kworker/2:2+events00:13:112
118171899238710,2374cyclictest1196244-21kworker/2:1+events20:00:562
118171899238612,2371cyclictest1261949-21kworker/2:0+events23:17:422
118171899238512,2369cyclictest1215211-21kworker/2:0+events20:57:492
118171299238111,2366cyclictest1196152-21kworker/0:0+events19:55:320
118171299237612,2361cyclictest1231649-21kworker/0:2+events21:49:140
118171899237512,2360cyclictest1213516-21kworker/2:1+events20:54:462
118172299237312,2358cyclictest1213311-21kworker/3:2+events20:50:343
118172299236714,2349cyclictest1184850-21kworker/3:2+events19:29:213
118171299236712,2352cyclictest1199670-21kworker/0:2+events20:11:410
118171299236712,2351cyclictest1266912-21kworker/0:0+events23:49:400
118172299236312,2348cyclictest1278216-21kworker/3:2+events00:16:413
118172299236312,2348cyclictest1278216-21kworker/3:2+events00:16:403
118171299236112,2346cyclictest1250834-21kworker/0:0+events22:46:010
118172299236011,2346cyclictest1237877-21kworker/3:0+events22:05:133
118171299235713,2340cyclictest1186667-21kworker/0:0+events19:33:550
118172299235311,2338cyclictest1224787-21kworker/3:1+events21:32:533
118172299235212,2337cyclictest1273835-21kworker/3:0+events00:08:143
118171299235212,2338cyclictest1212065-21kworker/0:2+events20:57:040
118171299235212,2337cyclictest1274871-21kworker/0:2+events23:57:310
118172299235112,2335cyclictest1184850-21kworker/3:2+events20:02:283
118171299235012,2335cyclictest1266912-21kworker/0:0+events23:35:390
118172299234910,2336cyclictest1278216-21kworker/3:2+events00:28:063
118172299234910,2335cyclictest1184850-21kworker/3:2+events19:22:093
118171299234912,2333cyclictest1191209-21kworker/0:1+events19:37:420
118171299234012,2325cyclictest1241029-21kworker/0:2+events22:19:480
118172299233811,2324cyclictest1241088-21kworker/3:1+events22:30:523
118171299233810,2324cyclictest1182902-21kworker/0:0+events19:13:030
118171299233712,2321cyclictest1244228-21kworker/0:1+events22:37:150
118172299233010,2317cyclictest1208992-21kworker/3:1+events21:00:313
118172299232912,2313cyclictest1184850-21kworker/3:2+events19:50:573
118172299231011,2296cyclictest1196213-21kworker/3:1+events19:59:223
118171299230411,2290cyclictest1245976-21kworker/0:2+events22:44:070
118171699224110,2227cyclictest1252464-21kworker/1:0+events22:52:541
11817169922199,2207cyclictest1179328-21kworker/1:1+events19:12:171
118171899220011,2185cyclictest1279787-21kworker/2:1+events00:17:042
118171899220011,2185cyclictest1279787-21kworker/2:1+events00:17:032
11817189921849,2172cyclictest1183078-21kworker/2:0+events19:14:582
118171299212911,2115cyclictest1262359-21kworker/0:1+events23:28:460
118172299212711,2113cyclictest1174767-21kworker/3:1+events19:12:393
118172299212611,2112cyclictest1224787-21kworker/3:1+events21:24:313
118171699211811,2103cyclictest1188301-21kworker/1:1+events19:33:081
118172299210511,2092cyclictest1271762-21kworker/3:1+events23:50:023
11812342154111,38sleep10-21swapper/119:06:371
11813332149120,18sleep20-21swapper/219:07:542
1181469214899,37sleep30-21swapper/319:09:383
11801682146109,33sleep00-21swapper/019:05:070
1181712992212,7cyclictest1231629-21awk21:45:000
118171699170,5cyclictest1271825-21seq23:47:351
118171299155,6cyclictest1203707-21cat20:15:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional