You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Dec 15, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
107557799281314,2794cyclictest1104510-21kworker/1:1+events21:00:121
107557799270213,2685cyclictest1125668-21kworker/1:1+events21:55:161
107557799270213,2685cyclictest1125668-21kworker/1:1+events21:55:161
107557799267213,2654cyclictest1157472-21kworker/1:0+events23:35:121
107558199257612,2558cyclictest1168718-21kworker/2:0+events00:10:182
107557399255212,2536cyclictest1174806-21kworker/0:0+events00:33:310
107557399249512,2479cyclictest1176411-21kworker/0:1+events00:26:130
107558299249012,2476cyclictest1125366-21kworker/3:0+events21:45:413
107558299249012,2476cyclictest1125366-21kworker/3:0+events21:45:413
107558299249012,2475cyclictest1160715-21kworker/3:1+events23:39:263
107557399248312,2468cyclictest1151300-21kworker/0:2+events23:10:460
107558199247812,2462cyclictest1132050-21kworker/2:1+events22:24:572
107557399247712,2461cyclictest1151300-21kworker/0:2+events23:40:110
107558299244511,2432cyclictest1117299-21kworker/3:1+events22:05:323
107558199242912,2413cyclictest1154095-21kworker/2:0+events23:15:192
107558199242412,2409cyclictest1168718-21kworker/2:0+events00:18:172
107558199240911,2394cyclictest1110871-21kworker/2:2+events21:00:362
107558199240311,2388cyclictest1109274-21kworker/2:0+events20:55:152
107558199237812,2363cyclictest1176647-21kworker/2:0+events00:31:572
107557799237811,2364cyclictest1177959-21kworker/1:0+events00:28:091
107557799235912,2344cyclictest1120460-21kworker/1:2+events21:45:191
107557799235912,2344cyclictest1120460-21kworker/1:2+events21:45:181
107557399235811,2343cyclictest1144605-21kworker/0:0+events22:53:510
107557799234812,2334cyclictest1080325-21kworker/1:1+events19:56:351
107557799234212,2327cyclictest1149541-21kworker/1:0+events22:59:481
107557799234212,2327cyclictest1135006-21kworker/1:2+events22:16:381
107557799234110,2327cyclictest1136609-21kworker/1:0+events22:20:201
107557799234011,2326cyclictest1100096-21kworker/1:0+events20:30:531
107557799233912,2324cyclictest1104510-21kworker/1:1+events21:07:451
107558299233711,2323cyclictest1081616-21kworker/3:2+events19:37:023
107557399233511,2321cyclictest1115640-21kworker/0:2+events21:41:350
10755819923259,2312cyclictest1130352-21kworker/2:2+events22:00:132
107558299232111,2308cyclictest1139683-21kworker/3:1+events22:40:153
107558199232012,2304cyclictest1160653-21kworker/2:2+events23:37:542
107558299231711,2303cyclictest1131829-21kworker/3:2+events22:13:343
107557399231611,2302cyclictest1125398-21kworker/0:1+events21:47:150
107557399231611,2302cyclictest1125398-21kworker/0:1+events21:47:150
107558299231511,2301cyclictest1176442-21kworker/3:2+events00:23:543
107557399231510,2302cyclictest1166886-21kworker/0:2+events23:54:200
107558299231411,2300cyclictest1149572-21kworker/3:1+events23:01:433
107557399231410,2301cyclictest1098228-21kworker/0:2+events20:24:460
107558299231312,2298cyclictest1131829-21kworker/3:2+events22:15:513
107557399231211,2298cyclictest1088934-21kworker/0:2+events20:03:060
107557399231111,2297cyclictest1115640-21kworker/0:2+events21:22:550
107557399231011,2296cyclictest1103165-21kworker/0:0+events20:51:290
10755829923079,2295cyclictest1098289-21kworker/3:0+events20:33:583
107557399230610,2293cyclictest1144605-21kworker/0:0+events22:46:140
107557399230511,2290cyclictest1085381-21kworker/0:1+events19:48:330
10755739923038,2292cyclictest1139835-21kworker/0:0+events22:33:000
107557399230311,2289cyclictest1162383-21kworker/0:0+events23:49:210
107558299229810,2285cyclictest1176442-21kworker/3:2+events00:33:543
10755739922948,2283cyclictest1111083-21kworker/0:0+events21:07:230
10755739922938,2282cyclictest1142980-21kworker/0:1+events22:39:300
10755739922929,2279cyclictest1103165-21kworker/0:0+events20:35:310
107557399229111,2278cyclictest1090538-21kworker/0:1+events19:55:030
107557399229011,2276cyclictest1151300-21kworker/0:2+events23:16:480
107557799228612,2271cyclictest1104510-21kworker/1:1+events21:16:511
107558199227512,2260cyclictest1158866-21kworker/2:0+events23:30:332
10755829922729,2260cyclictest1109510-21kworker/3:0+events21:03:363
107557799226410,2251cyclictest1120460-21kworker/1:2+events21:28:581
107558199225811,2244cyclictest1103025-21kworker/2:1+events21:20:162
10755819922439,2231cyclictest1139959-21kworker/2:0+events22:44:432
10755819922408,2229cyclictest1103025-21kworker/2:1+events21:10:252
10755819922399,2226cyclictest1138322-21kworker/2:2+events22:34:322
107558199223911,2225cyclictest1144893-21kworker/2:2+events22:53:042
107558199223811,2223cyclictest1117327-21kworker/2:0+events21:29:222
107558199223810,2224cyclictest1156088-21kworker/2:1+events23:26:222
107557799223810,2225cyclictest1093591-21kworker/1:2+events20:05:501
107558199223711,2223cyclictest1085320-21kworker/2:2+events19:45:502
107558199223711,2222cyclictest1176647-21kworker/2:0+events00:26:372
107558199223711,2222cyclictest1156088-21kworker/2:1+events23:40:572
107558199223711,2222cyclictest1096742-21kworker/2:2+events20:14:382
107558199223611,2222cyclictest1118983-21kworker/2:2+events21:39:202
107557799223512,2220cyclictest1157472-21kworker/1:0+events23:24:271
107558199223411,2220cyclictest1086948-21kworker/2:1+events20:06:572
107557799222910,2216cyclictest1163647-21kworker/1:1+events23:48:591
10755819922278,2216cyclictest1132050-21kworker/2:1+events22:19:142
10755819922259,2214cyclictest1104691-21kworker/2:0+events20:40:072
10755819922258,2214cyclictest1139959-21kworker/2:0+events22:49:152
107558199222511,2211cyclictest1125163-21kworker/2:1+events21:58:162
107558199222511,2211cyclictest1125163-21kworker/2:1+events21:58:162
107558199222510,2211cyclictest1092080-21kworker/2:2+events20:02:432
107557799222410,2211cyclictest1102872-21kworker/1:2+events20:40:291
107558299221811,2203cyclictest1113946-21kworker/3:2+events21:16:063
107558199221411,2200cyclictest1138322-21kworker/2:2+events22:25:412
107558199221410,2200cyclictest1088813-21kworker/2:0+events19:56:112
107558199221111,2197cyclictest1103025-21kworker/2:1+events20:38:592
107558199220710,2195cyclictest1118983-21kworker/2:2+events21:30:082
107557799220212,2187cyclictest1098434-21kworker/1:1+events20:22:321
107557799220011,2186cyclictest1173063-21kworker/1:1+events00:11:241
107557799219411,2179cyclictest1131800-21kworker/1:1+events22:09:211
10755779921939,2181cyclictest1080325-21kworker/1:1+events19:29:211
10755779921939,2180cyclictest1130144-21kworker/1:0+events22:00:571
107557799219211,2178cyclictest1125668-21kworker/1:1+events21:52:121
107557799219210,2179cyclictest1144721-21kworker/1:1+events22:44:001
107557799219210,2178cyclictest1166853-21kworker/1:0+events00:17:551
107557799219111,2176cyclictest1131800-21kworker/1:1+events22:13:111
10755779921909,2177cyclictest1179564-21kworker/1:1+events00:36:111
107557799219010,2177cyclictest1154126-21kworker/1:1+events23:33:381
107557799218511,2170cyclictest1093591-21kworker/1:2+events20:19:551
107557799218310,2169cyclictest1166853-21kworker/1:0+events23:58:511
107557399218210,2169cyclictest1151300-21kworker/0:2+events23:34:250
107557799218110,2167cyclictest1080325-21kworker/1:1+events20:12:421
107557799217910,2165cyclictest1166853-21kworker/1:0+events00:01:111
107557799217811,2164cyclictest1144721-21kworker/1:1+events22:45:501
107557799217811,2164cyclictest1118833-21kworker/1:0+events21:23:401
107557799217611,2162cyclictest1138229-21kworker/1:1+events22:31:511
10755739921759,2163cyclictest1160684-21kworker/0:1+events23:35:350
107557399217510,2162cyclictest1111083-21kworker/0:0+events21:02:510
107557799217411,2161cyclictest1086797-21kworker/1:0+events19:45:281
107557799217411,2160cyclictest1149541-21kworker/1:0+events23:11:331
10755779921726,2162cyclictest1138229-21kworker/1:1+events22:36:491
10755819921719,2159cyclictest1086948-21kworker/2:1+events19:51:392
107557799217111,2156cyclictest1166853-21kworker/1:0+events00:05:241
10755739921686,2159cyclictest1138109-21kworker/0:2+events22:42:520
107558299216311,2150cyclictest1151223-21kworker/3:2+events23:05:273
107557399216110,2148cyclictest1174806-21kworker/0:0+events00:22:470
107557799215910,2146cyclictest1086797-21kworker/1:0+events19:41:391
107558299215810,2145cyclictest1117299-21kworker/3:1+events21:57:083
107558299215810,2145cyclictest1117299-21kworker/3:1+events21:57:083
10755739921579,2145cyclictest1077608-21kworker/0:1+events19:20:310
107558299215511,2141cyclictest1101593-21kworker/3:2+events20:59:033
107558199215511,2141cyclictest1099730-21kworker/2:0+events20:27:462
107557799215511,2141cyclictest1163647-21kworker/1:1+events23:51:391
107557399215410,2141cyclictest1106044-21kworker/0:2+events20:43:090
107558299215310,2139cyclictest1098289-21kworker/3:0+events20:22:103
107557799215210,2139cyclictest1122067-21kworker/1:1+events21:34:201
10755739921518,2140cyclictest1109395-21kworker/0:2+events20:59:490
10755829921498,2138cyclictest1131829-21kworker/3:2+events22:04:023
107558299214711,2133cyclictest1122235-21kworker/3:2+events21:36:403
107558299214511,2130cyclictest1151223-21kworker/3:2+events23:34:483
10755829921447,2134cyclictest1166823-21kworker/3:0+events23:57:433
107558299214311,2129cyclictest1157503-21kworker/3:1+events23:28:153
107558299214311,2129cyclictest1151223-21kworker/3:2+events00:08:453
107558299214311,2129cyclictest1139683-21kworker/3:1+events22:46:353
107558299214311,2129cyclictest1081616-21kworker/3:2+events19:53:533
107557399214310,2131cyclictest1113548-21kworker/0:1+events21:10:040
107558299214211,2128cyclictest1093437-21kworker/3:2+events20:04:393
107558299214211,2127cyclictest1095078-21kworker/3:1+events20:18:033
107557799214211,2128cyclictest1154126-21kworker/1:1+events23:27:291
107558299214011,2126cyclictest1095078-21kworker/3:1+events20:12:183
107558299213911,2125cyclictest1137989-21kworker/3:0+events22:24:113
107558299213911,2125cyclictest1093437-21kworker/3:2+events20:07:203
107558299213510,2122cyclictest1107675-21kworker/3:1+events20:51:063
107558299213311,2119cyclictest1081616-21kworker/3:2+events19:34:203
10755829921329,2119cyclictest1139683-21kworker/3:1+events22:28:013
107557799213210,2119cyclictest1122067-21kworker/1:1+events21:38:121
107558299213011,2116cyclictest1106077-21kworker/3:0+events20:45:253
10755819921248,2112cyclictest1149726-21kworker/2:2+events23:11:092
107558199212111,2107cyclictest1086948-21kworker/2:1+events19:44:432
10755819921208,2109cyclictest1086948-21kworker/2:1+events20:15:452
10755779921199,2107cyclictest1093591-21kworker/1:2+events20:04:151
107557399211810,2105cyclictest1135155-21kworker/0:1+events22:22:140
10755829921178,2105cyclictest1115550-21kworker/3:0+events21:22:113
107558299211611,2102cyclictest1113946-21kworker/3:2+events21:08:553
107557799211611,2102cyclictest1155811-21kworker/1:2+events23:19:041
107557399211610,2103cyclictest1079911-21kworker/0:2+events19:38:110
107557399211610,2103cyclictest1077608-21kworker/0:1+events19:17:060
107557399211510,2102cyclictest1174806-21kworker/0:0+events00:39:150
107557399211510,2102cyclictest1115640-21kworker/0:2+events22:01:440
10755819921148,2103cyclictest1080207-21kworker/2:0+events19:23:332
107557399211310,2101cyclictest1115640-21kworker/0:2+events22:10:070
107557399211310,2100cyclictest1162383-21kworker/0:0+events23:57:210
10755739921129,2100cyclictest1094389-21kworker/0:0+events20:15:230
107557399211210,2099cyclictest1173212-21kworker/0:1+events00:13:440
107557399211210,2099cyclictest1135155-21kworker/0:1+events22:16:140
107557399211210,2099cyclictest1088934-21kworker/0:2+events20:08:510
10755739921118,2100cyclictest1144605-21kworker/0:0+events23:09:590
10755739921107,2100cyclictest1115640-21kworker/0:2+events21:15:430
107557399210910,2096cyclictest1171557-21kworker/0:0+events00:09:080
10755739921085,2100cyclictest1115640-21kworker/0:2+events21:52:590
107557399210610,2093cyclictest1115640-21kworker/0:2+events21:38:570
107557399210310,2090cyclictest1128514-21kworker/0:0+events21:56:000
107557399210310,2090cyclictest1128514-21kworker/0:0+events21:55:590
107557399210310,2090cyclictest1098228-21kworker/0:2+events20:33:130
10755739920966,2087cyclictest1133368-21kworker/0:0+events22:08:590
10755739920948,2084cyclictest1166886-21kworker/0:2+events00:00:010
10755829920883,2082cyclictest1151223-21kworker/3:2+events23:20:383
107558299208811,2074cyclictest1073594-21kworker/3:1+events19:25:273
10755739920889,2076cyclictest1098228-21kworker/0:2+events20:28:320
107557399208510,2072cyclictest1103165-21kworker/0:0+events20:47:200
107558199208411,2071cyclictest1165342-21kworker/2:2+events23:55:052
10755739920817,2070cyclictest1151300-21kworker/0:2+events23:29:000
10755829920806,2070cyclictest1171728-21kworker/3:0+events00:25:043
107557799207811,2064cyclictest1120460-21kworker/1:2+events21:43:251
107558299207710,2064cyclictest1163557-21kworker/3:0+events23:42:053
107557799207711,2063cyclictest1136609-21kworker/1:0+events22:28:241
107558299207310,2060cyclictest1126974-21kworker/3:2+events21:54:513
10755829920726,2063cyclictest1151223-21kworker/3:2+events23:12:173
107558299207111,2056cyclictest1090836-21kworker/3:1+events19:57:443
10755829920649,2052cyclictest1087009-21kworker/3:1+events19:47:233
107558199206410,2051cyclictest1168718-21kworker/2:0+events00:03:512
107557399205810,2045cyclictest1138109-21kworker/0:2+events22:26:050
107557399205510,2042cyclictest1094389-21kworker/0:0+events20:10:460
10755819920525,2045cyclictest1151504-21kworker/2:1+events23:09:362
107558199205210,2039cyclictest1080207-21kworker/2:0+events19:31:162
107558199205110,2038cyclictest1165342-21kworker/2:2+events23:50:312
10755819920488,2037cyclictest1073532-21kworker/2:2+events19:18:592
10755829920458,2034cyclictest1171728-21kworker/3:0+events00:12:113
10755819920458,2034cyclictest1132050-21kworker/2:1+events22:07:042
107558299204411,2030cyclictest1106077-21kworker/3:0+events20:43:563
107558199204410,2031cyclictest1073532-21kworker/2:2+events19:26:382
107557399204410,2031cyclictest1147831-21kworker/0:2+events22:56:270
10755819920439,2031cyclictest1118983-21kworker/2:2+events21:41:562
107558199204210,2029cyclictest1139959-21kworker/2:0+events23:01:212
10755819920417,2031cyclictest1163590-21kworker/2:0+events23:48:142
107558199204110,2028cyclictest1103025-21kworker/2:1+events20:51:522
107558199204110,2028cyclictest1085320-21kworker/2:2+events19:38:582
107558199204010,2027cyclictest1107613-21kworker/2:2+events20:48:532
10755819920388,2027cyclictest1103025-21kworker/2:1+events21:18:452
107558199203810,2026cyclictest1112644-21kworker/2:0+events21:05:072
107558199203710,2024cyclictest1126911-21kworker/2:0+events21:49:322
107558199203710,2024cyclictest1126911-21kworker/2:0+events21:49:312
10755739920373,2031cyclictest1087071-21kworker/0:0+events19:52:450
10755739920349,2022cyclictest1083742-21kworker/0:0+events19:34:420
10755819920309,2018cyclictest1101358-21kworker/2:2+events20:32:502
10755829920298,2018cyclictest1146224-21kworker/3:0+events22:52:223
10755739920279,2016cyclictest1144605-21kworker/0:0+events23:00:340
10755819920243,2017cyclictest1132050-21kworker/2:1+events22:12:242
107558199202410,2011cyclictest1171613-21kworker/2:2+events00:08:002
10755739920219,2009cyclictest1173212-21kworker/0:1+events00:16:230
10755819920119,1999cyclictest1125163-21kworker/2:1+events21:54:072
10755779920109,1998cyclictest1147950-21kworker/1:2+events22:54:341
10755819920079,1995cyclictest1073532-21kworker/2:2+events19:12:532
10755779920067,1996cyclictest1100096-21kworker/1:0+events20:27:041
10755739920068,1995cyclictest1085381-21kworker/0:1+events19:44:220
10755779920055,1997cyclictest1104510-21kworker/1:1+events20:39:431
107557799200510,1991cyclictest1176322-21kworker/1:1+events00:22:231
10755779920013,1995cyclictest1104510-21kworker/1:1+events20:57:311
107557799200010,1987cyclictest1104510-21kworker/1:1+events21:13:481
107557799199910,1986cyclictest1149541-21kworker/1:0+events23:07:441
107557799199910,1986cyclictest1106137-21kworker/1:0+events20:46:101
10755779919987,1987cyclictest1104510-21kworker/1:1+events20:52:161
10755739919988,1987cyclictest1151300-21kworker/0:2+events23:23:190
10755779919979,1985cyclictest1069649-21kworker/1:2+events19:16:421
10755829919967,1986cyclictest1154186-21kworker/3:1+events23:17:113
10755819919959,1983cyclictest1174968-21kworker/2:2+events00:22:022
107558299199311,1979cyclictest1165161-21kworker/3:1+events23:46:433
10755779919919,1979cyclictest1179564-21kworker/1:1+events00:34:411
10755829919885,1980cyclictest1173668-21kworker/3:1+events00:16:463
10755779919879,1975cyclictest1088663-21kworker/1:2+events19:52:231
10755779919849,1972cyclictest1163647-21kworker/1:1+events23:44:001
10755779919846,1975cyclictest1076629-21kworker/1:0+events19:22:241
107557799198410,1971cyclictest1069649-21kworker/1:2+events19:13:391
10755779919839,1971cyclictest1080325-21kworker/1:1+events19:37:481
107557799198210,1969cyclictest1144721-21kworker/1:1+events23:03:381
10755819919789,1966cyclictest1099730-21kworker/2:0+events20:24:252
10755819919788,1967cyclictest1148068-21kworker/2:1+events22:56:502
10755739919705,1962cyclictest1071175-21kworker/0:0+events19:12:060
107558299196010,1947cyclictest1073594-21kworker/3:1+events19:13:163
10755829919598,1948cyclictest1176442-21kworker/3:2+events00:36:343
10755819919586,1949cyclictest1142006-21kworker/2:1+events22:38:212
10755829919539,1941cyclictest1165161-21kworker/3:1+events23:50:533
107558299195310,1940cyclictest1141415-21kworker/3:0+events22:34:553
107558299194910,1936cyclictest1149572-21kworker/3:1+events22:59:253
10755829919488,1937cyclictest1101593-21kworker/3:2+events20:38:133
107558299194810,1934cyclictest1113946-21kworker/3:2+events21:11:113
107558299194710,1934cyclictest1098289-21kworker/3:0+events20:29:423
107557799194710,1934cyclictest1082313-21kworker/1:2+events19:33:581
10755739919479,1935cyclictest1118864-21kworker/0:0+events21:25:590
10755829919469,1934cyclictest1117299-21kworker/3:1+events21:44:323
10755829919458,1934cyclictest1118952-21kworker/3:2+events21:26:433
107558299194410,1931cyclictest1083712-21kworker/3:0+events19:40:303
10755829919397,1929cyclictest1139683-21kworker/3:1+events22:36:263
107558299193710,1924cyclictest1076927-21kworker/3:2+events19:15:363
107557399193110,1918cyclictest1115640-21kworker/0:2+events21:33:100
10755829919137,1903cyclictest1166823-21kworker/3:0+events00:01:573
10755819919039,1891cyclictest1176647-21kworker/2:0+events00:35:472
107558299188310,1870cyclictest1078941-21kworker/3:0+events19:21:373
10755829918549,1842cyclictest1120580-21kworker/3:0+events21:31:153
10750512150103,28sleep10-21swapper/119:06:511
10750212146101,26sleep00-21swapper/019:06:300
10751762141108,27sleep30-21swapper/319:08:283
10749512140109,26sleep20-21swapper/219:05:362
107557399178,6cyclictest1082404-21ls19:30:000
107558199149,4cyclictest1294-21gvfs-afc-volume23:20:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional