You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 20:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Wed Dec 10, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
416586499290514,2885cyclictest50202-21kworker/2:0+events23:15:142
416585699277813,2762cyclictest56873-21kworker/0:2+events23:35:000
416586499275513,2737cyclictest53789-21kworker/2:0+events23:55:162
41658649927189,2705cyclictest4175368-21kworker/2:1+events19:40:142
416586499270713,2691cyclictest4172074-21kworker/2:2+events19:35:152
416586499267013,2653cyclictest58567-21kworker/2:1+events23:50:172
416586499265412,2638cyclictest24534-21kworker/2:0+events21:58:432
416585699256012,2544cyclictest20133-21kworker/0:2+events22:05:140
416585999255912,2543cyclictest4165519-21kworker/1:2+events19:30:201
416585999252712,2512cyclictest64895-21kworker/1:0+events00:20:011
41658649924919,2480cyclictest58567-21kworker/2:1+events23:41:032
416585999248311,2469cyclictest58270-21kworker/1:1+events23:41:481
416585999247612,2460cyclictest2624-21kworker/1:2+events21:02:031
416586699247312,2457cyclictest768-21kworker/3:1+events20:41:103
41658649924709,2458cyclictest39196-21kworker/2:1+events22:45:162
41658599924608,2448cyclictest23025-21kworker/1:2+events21:48:261
416586499245211,2437cyclictest71114-21kworker/2:1+events00:25:182
416585699243111,2417cyclictest4191574-21kworker/0:0+events20:40:010
416586499241912,2403cyclictest39196-21kworker/2:1+events22:43:462
416585999240812,2392cyclictest2624-21kworker/1:2+events20:50:151
416585999240312,2387cyclictest4177055-21kworker/1:2+events19:57:311
416585699240012,2385cyclictest15110-21kworker/0:1+events21:26:260
416586499239712,2381cyclictest55393-21kworker/2:2+events23:31:112
416585699239512,2380cyclictest10243-21kworker/0:2+events21:06:180
416585699239412,2379cyclictest13450-21kworker/0:0+events21:17:450
416585699239012,2375cyclictest72923-21kworker/0:2+events00:31:210
416586499238312,2368cyclictest66273-21kworker/2:0+events00:02:352
416586499238311,2368cyclictest45723-21kworker/2:0+events23:03:002
416586499238212,2367cyclictest4178689-21kworker/2:2+events19:50:112
416586499236412,2348cyclictest4175368-21kworker/2:1+events20:03:172
41658599923638,2352cyclictest59921-21kworker/1:0+events23:51:481
416585999235411,2342cyclictest70534-21kworker/1:2+events00:21:091
416585999235410,2340cyclictest4165519-21kworker/1:2+events19:26:361
416586699234710,2334cyclictest67848-21kworker/3:2+events00:25:413
41658649923409,2328cyclictest24534-21kworker/2:0+events21:53:482
41658669923379,2325cyclictest30961-21kworker/3:2+events22:13:523
416585999233711,2323cyclictest10301-21kworker/1:0+events21:21:311
416586499233312,2317cyclictest26168-21kworker/2:1+events22:01:002
416585999232712,2312cyclictest4193064-21kworker/1:1+events20:38:301
416586499228911,2275cyclictest24534-21kworker/2:0+events22:05:362
416586699228510,2272cyclictest8728-21kworker/3:0+events21:13:573
416585999228010,2266cyclictest59921-21kworker/1:0+events23:45:191
41658669922799,2266cyclictest39104-21kworker/3:0+events22:47:103
416585999226710,2253cyclictest4165519-21kworker/1:2+events19:21:591
416586699226612,2251cyclictest29332-21kworker/3:1+events22:18:483
416585999226511,2251cyclictest46969-21kworker/1:1+events23:02:401
416586699226410,2251cyclictest4189820-21kworker/3:2+events20:26:593
41658599922628,2251cyclictest58270-21kworker/1:1+events00:10:131
416585999225910,2245cyclictest4181664-21kworker/1:0+events20:01:221
41658599922579,2245cyclictest4163874-21kworker/1:0+events19:16:391
41658599922568,2245cyclictest74223-21kworker/1:0+events00:30:111
416585999224610,2233cyclictest64895-21kworker/1:0+events00:04:511
416586499224411,2230cyclictest66273-21kworker/2:0+events00:11:212
416586699224212,2227cyclictest24864-21kworker/3:2+events21:56:493
416586499224112,2226cyclictest4178689-21kworker/2:2+events19:58:182
416585999223910,2226cyclictest34392-21kworker/1:1+events22:25:581
416585999223810,2225cyclictest15227-21kworker/1:1+events21:34:261
416586499223711,2224cyclictest42473-21kworker/2:2+events22:50:322
41658599922367,2225cyclictest21361-21kworker/1:0+events21:43:351
416585999223110,2218cyclictest26317-21kworker/1:0+events22:00:381
416585999223010,2217cyclictest4191423-21kworker/1:0+events20:32:231
416585999223010,2217cyclictest4191423-21kworker/1:0+events20:32:231
416585699223010,2217cyclictest2384-21kworker/0:2+events20:51:030
41658599922267,2216cyclictest46969-21kworker/1:1+events23:18:181
41658599922249,2212cyclictest4173766-21kworker/1:0+events19:36:001
416585999222410,2211cyclictest28096-21kworker/1:2+events22:08:121
416585999222310,2210cyclictest58270-21kworker/1:1+events23:59:521
416585999221410,2200cyclictest70534-21kworker/1:2+events00:27:101
41658599922137,2203cyclictest64895-21kworker/1:0+events00:09:031
416585699221211,2198cyclictest39048-21kworker/0:2+events22:40:000
416585999220511,2191cyclictest7073-21kworker/1:1+events20:56:421
416585699220210,2188cyclictest45407-21kworker/0:1+events23:11:250
416585699220111,2187cyclictest53636-21kworker/0:1+events23:25:510
416585699220011,2186cyclictest67789-21kworker/0:1+events00:08:190
416586699219910,2186cyclictest4183412-21kworker/3:0+events20:08:133
416585699219911,2184cyclictest10243-21kworker/0:2+events21:11:140
416585699219910,2186cyclictest31021-21kworker/0:2+events22:19:590
416585699219810,2185cyclictest51631-21kworker/0:2+events23:16:470
416585699219810,2185cyclictest4181633-21kworker/0:2+events20:32:470
416585699219810,2185cyclictest4181633-21kworker/0:2+events20:32:460
416586699219611,2182cyclictest67848-21kworker/3:2+events00:20:233
41658569921969,2184cyclictest58507-21kworker/0:0+events23:42:350
41658569921966,2187cyclictest4181633-21kworker/0:2+events20:29:160
416585699219610,2183cyclictest53636-21kworker/0:1+events23:39:080
416585699219511,2181cyclictest4167187-21kworker/0:0+events19:25:270
416585699219111,2177cyclictest40906-21kworker/0:0+events22:45:370
41658649921905,2181cyclictest4175368-21kworker/2:1+events20:12:252
416586499218911,2174cyclictest50202-21kworker/2:0+events23:13:192
416585999218911,2175cyclictest4183352-21kworker/1:1+events20:07:051
416585699218710,2174cyclictest4177086-21kworker/0:1+events20:00:580
416585699218710,2174cyclictest18464-21kworker/0:0+events21:36:190
41658649921865,2177cyclictest71114-21kworker/2:1+events00:34:462
416586499218511,2171cyclictest4186498-21kworker/2:0+events20:18:132
416586499218511,2171cyclictest4186498-21kworker/2:0+events20:18:132
416585999218510,2172cyclictest32686-21kworker/1:0+events22:21:521
416585999218510,2172cyclictest28096-21kworker/1:2+events22:19:351
416585699218510,2172cyclictest34215-21kworker/0:1+events22:30:110
416586499218410,2171cyclictest2475-21kworker/2:2+events20:50:392
41658569921849,2172cyclictest4175398-21kworker/0:0+events19:44:270
416586499218311,2169cyclictest37538-21kworker/2:2+events22:33:592
416586499218211,2168cyclictest42473-21kworker/2:2+events22:58:522
416586499218210,2168cyclictest64619-21kworker/2:2+events00:09:502
416585699218210,2169cyclictest8638-21kworker/0:0+events21:02:260
416586499218111,2167cyclictest4191732-21kworker/2:1+events20:47:152
416586499218010,2167cyclictest18733-21kworker/2:2+events21:36:422
416585699218010,2167cyclictest27730-21kworker/0:0+events22:20:430
41658669921788,2167cyclictest40847-21kworker/3:2+events23:00:473
416586499217811,2163cyclictest5768-21kworker/2:1+events20:57:282
416586499217810,2165cyclictest13668-21kworker/2:0+events21:24:352
416586499217711,2162cyclictest10365-21kworker/2:1+events21:11:382
41658649921769,2164cyclictest4172074-21kworker/2:2+events19:26:592
416586499217611,2161cyclictest13668-21kworker/2:0+events21:31:492
41658569921768,2164cyclictest24472-21kworker/0:0+events21:55:200
416586499217311,2158cyclictest53789-21kworker/2:0+events23:26:142
416586499217210,2159cyclictest32797-21kworker/2:0+events22:26:452
41658649921719,2159cyclictest10365-21kworker/2:1+events21:15:282
416586499217111,2157cyclictest21331-21kworker/2:1+events21:46:142
416586499217010,2158cyclictest32797-21kworker/2:0+events22:35:082
416586699216711,2153cyclictest59953-21kworker/3:1+events23:49:543
416586699216610,2153cyclictest768-21kworker/3:1+events20:47:363
416586699216411,2150cyclictest4178447-21kworker/3:2+events19:58:393
416586699216411,2150cyclictest18167-21kworker/3:1+events21:32:103
416586499216411,2150cyclictest4176995-21kworker/2:0+events19:46:202
416586499216410,2151cyclictest32797-21kworker/2:0+events22:22:142
41658669921638,2151cyclictest32624-21kworker/3:0+events22:27:553
416586499216311,2149cyclictest4172074-21kworker/2:2+events19:33:432
416586499216311,2149cyclictest21331-21kworker/2:1+events21:42:032
416586699216211,2148cyclictest8728-21kworker/3:0+events21:24:553
416586699216211,2147cyclictest29332-21kworker/3:1+events22:08:363
416586699216210,2149cyclictest24864-21kworker/3:2+events22:04:533
416585699216111,2147cyclictest4177086-21kworker/0:1+events19:48:180
416586699215910,2145cyclictest64649-21kworker/3:1+events00:00:403
416586699215810,2145cyclictest74253-21kworker/3:0+events00:36:423
416586699215710,2144cyclictest63044-21kworker/3:2+events23:54:053
416586699215610,2143cyclictest34304-21kworker/3:2+events22:35:513
416586699215511,2141cyclictest52266-21kworker/3:0+events00:11:433
416586699215511,2140cyclictest7040-21kworker/3:1+events20:59:243
416586699215411,2140cyclictest64649-21kworker/3:1+events23:57:573
41658649921549,2141cyclictest24534-21kworker/2:0+events22:12:222
41658669921539,2141cyclictest10425-21kworker/3:2+events21:18:073
41658669921529,2140cyclictest52266-21kworker/3:0+events23:27:003
416586699215211,2137cyclictest4170529-21kworker/3:1+events19:23:313
416586499215211,2138cyclictest66273-21kworker/2:0+events00:15:522
41658569921504,2142cyclictest60168-21kworker/0:2+events23:49:080
416585699214910,2136cyclictest4175398-21kworker/0:0+events19:39:060
416585999214810,2135cyclictest46969-21kworker/1:1+events23:20:571
416586699214611,2132cyclictest52266-21kworker/3:0+events23:23:573
41658669921454,2138cyclictest4193094-21kworker/3:0+events20:34:193
41658669921454,2138cyclictest4193094-21kworker/3:0+events20:34:193
416586499213810,2124cyclictest2475-21kworker/2:2+events21:01:182
416585699213810,2125cyclictest67789-21kworker/0:1+events00:18:290
416585999213710,2124cyclictest23025-21kworker/1:2+events21:52:391
41658599921369,2124cyclictest10301-21kworker/1:0+events21:12:471
41658649921339,2121cyclictest4184864-21kworker/2:2+events20:33:552
41658649921339,2121cyclictest4184864-21kworker/2:2+events20:33:552
416586699213111,2117cyclictest4164105-21kworker/3:1+events19:15:333
416585699213110,2117cyclictest4185723-21kworker/0:0+events20:19:210
416585699213110,2117cyclictest4185723-21kworker/0:0+events20:19:200
416586499212911,2115cyclictest4184864-21kworker/2:2+events20:21:162
416585999212910,2116cyclictest4177055-21kworker/1:2+events19:45:591
41658669921278,2116cyclictest37506-21kworker/3:1+events22:42:133
416586499212711,2112cyclictest42473-21kworker/2:2+events23:08:222
416585699212410,2112cyclictest40906-21kworker/0:0+events22:55:070
416585999211410,2101cyclictest15227-21kworker/1:1+events21:29:311
416585999211310,2100cyclictest4193064-21kworker/1:1+events20:44:341
41658599921129,2100cyclictest4188201-21kworker/1:2+events20:20:521
41658599921107,2100cyclictest48552-21kworker/1:0+events23:08:441
416585999211010,2097cyclictest55362-21kworker/1:2+events23:36:081
416586499210911,2095cyclictest4184864-21kworker/2:2+events20:28:532
416585999210910,2095cyclictest10301-21kworker/1:0+events21:18:311
416586499210811,2093cyclictest13668-21kworker/2:0+events21:28:222
41658599921088,2097cyclictest74223-21kworker/1:0+events00:38:121
41658569921072,2102cyclictest4185723-21kworker/0:0+events20:13:110
41658569921069,2094cyclictest45407-21kworker/0:1+events23:05:160
41658669921045,2095cyclictest64649-21kworker/3:1+events00:05:153
41658599921048,2090cyclictest30872-21kworker/1:1+events22:13:071
416585999210410,2091cyclictest16860-21kworker/1:2+events21:38:381
416585999210310,2091cyclictest42415-21kworker/1:1+events22:50:081
41658599921029,2089cyclictest53726-21kworker/1:0+events23:32:201
416585999210210,2089cyclictest37416-21kworker/1:2+events22:35:301
41658599921009,2088cyclictest2624-21kworker/1:2+events20:45:221
41658599921007,2090cyclictest23025-21kworker/1:2+events21:57:341
41658599920967,2086cyclictest4183352-21kworker/1:1+events20:12:491
41658599920914,2084cyclictest37416-21kworker/1:2+events22:33:121
41658569920887,2078cyclictest72923-21kworker/0:2+events00:37:030
41658649920868,2075cyclictest48510-21kworker/2:1+events23:24:212
416585699208611,2072cyclictest62986-21kworker/0:0+events23:55:380
416586699208310,2070cyclictest15316-21kworker/3:2+events21:26:033
41658669920808,2069cyclictest4181754-21kworker/3:1+events20:02:313
41658599920768,2065cyclictest39136-21kworker/1:0+events22:43:231
416585999207210,2060cyclictest2624-21kworker/1:2+events21:06:411
41658599920716,2062cyclictest4177055-21kworker/1:2+events19:51:221
41658669920709,2059cyclictest2655-21kworker/3:2+events21:00:103
416586699207010,2057cyclictest40847-21kworker/3:2+events23:14:513
41658599920705,2061cyclictest44122-21kworker/1:2+events22:59:151
416585999206510,2052cyclictest4183352-21kworker/1:1+events20:15:541
416585999206510,2052cyclictest4183352-21kworker/1:1+events20:15:531
41658669920648,2053cyclictest19827-21kworker/3:2+events21:39:013
41658649920627,2052cyclictest53789-21kworker/2:0+events23:39:552
416586699206111,2047cyclictest10425-21kworker/3:2+events21:09:433
416586699206011,2046cyclictest52266-21kworker/3:0+events23:34:133
41658599920548,2042cyclictest46969-21kworker/1:1+events23:12:091
41658569920528,2041cyclictest20133-21kworker/0:2+events21:45:510
41658569920523,2045cyclictest31021-21kworker/0:2+events22:25:350
41658569920508,2039cyclictest4193219-21kworker/0:1+events20:45:440
416586699204810,2035cyclictest43777-21kworker/3:1+events22:53:373
416586699204710,2033cyclictest67848-21kworker/3:2+events00:17:463
416585699204510,2032cyclictest67789-21kworker/0:1+events00:12:050
41658669920448,2033cyclictest40847-21kworker/3:2+events23:05:383
416585699204310,2030cyclictest24472-21kworker/0:0+events21:51:530
41658569920429,2030cyclictest5906-21kworker/0:1+events20:58:150
41658569920426,2032cyclictest53636-21kworker/0:1+events23:23:110
41658569920419,2029cyclictest4173665-21kworker/0:1+events19:34:060
41658569920418,2030cyclictest4152535-21kworker/0:1+events19:22:200
41658569920399,2027cyclictest4181633-21kworker/0:2+events20:23:560
41658569920396,2030cyclictest67789-21kworker/0:1+events00:28:200
41658569920387,2028cyclictest4177086-21kworker/0:1+events19:54:280
41658599920359,2023cyclictest4175428-21kworker/1:1+events19:42:541
416586499203311,2018cyclictest2475-21kworker/2:2+events20:43:252
416585999203210,2019cyclictest4163874-21kworker/1:0+events19:14:241
41658569920317,2022cyclictest4191574-21kworker/0:0+events20:35:060
41658569920317,2021cyclictest4152535-21kworker/0:1+events19:18:350
41658569920314,2023cyclictest53636-21kworker/0:1+events23:54:520
41658569920312,2026cyclictest39048-21kworker/0:2+events22:41:050
416585699203110,2018cyclictest40906-21kworker/0:0+events22:52:050
416586699203010,2017cyclictest4174008-21kworker/3:2+events19:39:293
41658599920286,2018cyclictest46969-21kworker/1:1+events23:28:091
41658649920269,2014cyclictest4167127-21kworker/2:0+events19:19:222
41658649920262,2021cyclictest4191732-21kworker/2:1+events20:36:142
41658569920265,2017cyclictest20133-21kworker/0:2+events21:41:390
41658669920247,2014cyclictest56723-21kworker/3:2+events23:35:463
416585999202410,2011cyclictest4188201-21kworker/1:2+events20:27:221
416586499202310,2010cyclictest4169148-21kworker/2:1+events19:21:142
41658649920197,2009cyclictest53789-21kworker/2:0+events23:45:422
41658669920189,2006cyclictest19827-21kworker/3:2+events21:47:443
41658569920179,2005cyclictest71143-21kworker/0:0+events00:20:460
416586499201510,2002cyclictest4184864-21kworker/2:2+events20:09:202
416586499201210,1999cyclictest76002-21kworker/2:0+events00:35:562
41658569920109,1998cyclictest64999-21kworker/0:3+events00:04:040
41658669920099,1997cyclictest67848-21kworker/3:2+events00:33:593
41658669920098,1997cyclictest56723-21kworker/3:2+events23:41:263
416586499200910,1997cyclictest2475-21kworker/2:2+events21:05:092
41658569920097,2000cyclictest10243-21kworker/0:2+events21:20:020
41658669920087,1998cyclictest32624-21kworker/3:0+events22:24:503
416586699200810,1995cyclictest4189820-21kworker/3:2+events20:24:423
416585699200810,1995cyclictest20133-21kworker/0:2+events22:01:460
41658669920079,1995cyclictest4193094-21kworker/3:0+events20:38:543
41658569920076,1998cyclictest15110-21kworker/0:1+events21:34:500
416586499200610,1993cyclictest31083-21kworker/2:2+events22:17:192
41658669920059,1993cyclictest2655-21kworker/3:2+events20:53:193
41658669920019,1989cyclictest4178447-21kworker/3:2+events19:52:553
41658669919987,1988cyclictest4170529-21kworker/3:1+events19:29:133
41658669919968,1985cyclictest50386-21kworker/3:1+events23:17:553
41658669919965,1988cyclictest4183412-21kworker/3:0+events20:14:423
416586699199610,1983cyclictest34304-21kworker/3:2+events22:32:043
41658669919957,1985cyclictest4178447-21kworker/3:2+events19:49:023
41658669919928,1982cyclictest4170529-21kworker/3:1+events19:30:423
41658649919898,1978cyclictest71114-21kworker/2:1+events00:24:112
41658569919879,1975cyclictest27730-21kworker/0:0+events22:13:300
416586699197310,1959cyclictest4185011-21kworker/3:1+events20:17:263
416586699197310,1959cyclictest4185011-21kworker/3:1+events20:17:263
41658569919719,1959cyclictest4177086-21kworker/0:1+events19:57:080
41658599919669,1954cyclictest39136-21kworker/1:0+events22:49:021
41658669919569,1944cyclictest4176845-21kworker/3:0+events19:44:503
41658669919444,1937cyclictest23198-21kworker/3:0+events21:51:063
41658669919409,1928cyclictest21571-21kworker/3:1+events21:44:433
41658649919379,1925cyclictest4165432-21kworker/2:2+events19:14:002
41658669919364,1929cyclictest40847-21kworker/3:2+events22:57:453
41658669919332,1928cyclictest4166860-21kworker/3:0+events19:13:143
41658569918929,1880cyclictest4152535-21kworker/0:1+events19:14:460
41652742150108,24sleep30-21swapper/319:06:223
41654102140108,27sleep10-21swapper/119:08:041
4165305214095,41sleep00-21swapper/019:06:430
41652432139108,26sleep20-21swapper/219:05:572
416585699157,5cyclictest4183753-21apt-get20:05:140
416585699141,10cyclictest47283-21awk23:05:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional