You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 09:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Mon Sep 15, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215364599140,12cyclictest0-21swapper/323:55:133
215364599130,8cyclictest0-21swapper/322:40:133
2153645991211,0cyclictest69450irq/121-eno123:50:153
2153645991211,0cyclictest0-21swapper/321:10:153
2153645991210,1cyclictest0-21swapper/323:30:133
215364599120,1cyclictest0-21swapper/320:25:143
215364599120,11cyclictest69450irq/121-eno122:55:133
215364599120,11cyclictest0-21swapper/323:15:153
215364599120,11cyclictest0-21swapper/322:35:013
215364599120,11cyclictest0-21swapper/322:10:163
215364599120,11cyclictest0-21swapper/322:05:173
215364599120,11cyclictest0-21swapper/321:15:143
215364599120,11cyclictest0-21swapper/320:45:133
215364599120,11cyclictest0-21swapper/319:45:013
215364599120,10cyclictest0-21swapper/322:15:113
2153645991111,0cyclictest69450irq/121-eno100:05:203
2153645991111,0cyclictest0-21swapper/322:50:023
2153645991111,0cyclictest0-21swapper/320:10:163
2153645991110,0cyclictest0-21swapper/322:30:013
2153645991110,0cyclictest0-21swapper/321:20:123
2153645991110,0cyclictest0-21swapper/300:10:163
215364599110,10cyclictest69450irq/121-eno123:12:583
215364599110,10cyclictest69450irq/121-eno122:23:563
215364599110,10cyclictest69450irq/121-eno121:45:203
215364599110,10cyclictest0-21swapper/300:25:193
215364599110,0cyclictest0-21swapper/320:20:133
215364599110,0cyclictest0-21swapper/319:50:023
215364599109,1cyclictest69450irq/121-eno120:50:573
215364599109,1cyclictest69450irq/121-eno120:08:163
215364599109,0cyclictest0-21swapper/323:35:123
2153645991010,0cyclictest69450irq/121-eno122:45:193
2153645991010,0cyclictest69450irq/121-eno119:35:023
2153645991010,0cyclictest0-21swapper/319:55:113
2153645991010,0cyclictest0-21swapper/300:35:213
215364599100,9cyclictest69450irq/121-eno121:40:183
215364599100,10cyclictest0-21swapper/300:15:023
215364599100,0cyclictest0-21swapper/323:40:173
215364599100,0cyclictest0-21swapper/322:05:013
215364599100,0cyclictest0-21swapper/321:00:003
215364599100,0cyclictest0-21swapper/320:35:123
215364599100,0cyclictest0-21swapper/319:20:193
215364599100,0cyclictest0-21swapper/300:30:043
21536459999,0cyclictest69450irq/121-eno123:05:133
21536459999,0cyclictest69450irq/121-eno121:59:383
21536459999,0cyclictest69450irq/121-eno121:29:523
21536459999,0cyclictest69450irq/121-eno119:53:173
21536459999,0cyclictest0-21swapper/321:05:203
21536459998,0cyclictest0-21swapper/323:45:153
21536459998,0cyclictest0-21swapper/322:35:173
21536459998,0cyclictest0-21swapper/319:15:013
21536459990,8cyclictest69450irq/121-eno123:25:243
21536459990,8cyclictest69450irq/121-eno123:22:283
21536459990,8cyclictest69450irq/121-eno121:50:143
21536459990,0cyclictest0-21swapper/321:30:213
21536459990,0cyclictest0-21swapper/320:00:173
21536459988,0cyclictest69450irq/121-eno100:20:533
21536459988,0cyclictest0-21swapper/320:35:003
21536459987,0cyclictest0-21swapper/321:05:003
21536459987,0cyclictest0-21swapper/319:25:133
21536459986,1cyclictest0-21swapper/323:00:133
21536459980,7cyclictest69450irq/121-eno120:15:133
21536459977,0cyclictest69450irq/121-eno121:35:133
21536459970,7cyclictest0-21swapper/320:43:173
21536459970,6cyclictest69450irq/121-eno119:35:223
21536459960,5cyclictest69450irq/121-eno119:15:183
21536459955,0cyclictest69450irq/121-eno100:00:163
2152685251,2sleep30-21swapper/319:05:213
2152685251,2sleep30-21swapper/319:05:203
2281525240,2sleep00-21swapper/000:22:450
2221696240,4sleep00-21swapper/022:01:450
2184984240,4sleep10-21swapper/120:26:551
2153072242,1sleep10-21swapper/119:05:221
2153072242,1sleep10-21swapper/119:05:221
2152805240,3sleep02153071-21unixbench_singl19:05:210
2152805240,3sleep02153071-21unixbench_singl19:05:210
2246144230,1sleep12246170-21apt-get23:00:131
2178598230,2sleep02178771-21smartctl20:10:210
2160479230,1sleep22160634-21memory19:25:172
2151824231,1sleep20-21swapper/219:05:122
2151824231,1sleep20-21swapper/219:05:112
2279358220,0sleep00-21swapper/000:17:180
2278280220,1sleep10-21swapper/100:15:181
2274717220,0sleep00-21swapper/000:05:320
2271307220,1sleep22271333-21apt-get00:00:142
2266196220,0sleep00-21swapper/023:45:230
2257414220,1sleep22257484-21processes23:25:202
2236438220,1sleep02236594-21sendmail_mailtr22:35:180
2229135220,0sleep00-21swapper/022:20:130
2228194222,0sleep00-21swapper/022:16:290
2215520220,1sleep12215524-21cron21:50:001
2208253220,1sleep12208361-21/usr/sbin/munin21:30:191
2207725220,1sleep22207996-21df_inode21:30:162
2205570220,1sleep02205670-21aten_r1power_po21:25:140
2205146222,0sleep00-21swapper/021:23:300
2195435220,1sleep02195655-21grep21:00:010
2193348220,0sleep00-21swapper/020:52:480
2192471220,1sleep12192623-21ntp_states20:50:171
2175912220,1sleep10-21swapper/120:05:141
2172780220,0sleep00-21swapper/019:55:160
2169619220,1sleep12169635-21apt-get19:50:011
2164464220,0sleep00-21swapper/019:35:200
2160790220,1sleep02160926-21systemctl19:25:190
2288170210,0sleep10-21swapper/100:38:471
2286480210,0sleep00-21swapper/000:35:140
2284750210,0sleep00-21swapper/000:30:180
2284125210,0sleep20-21swapper/200:30:122
2284115210,0sleep10-21swapper/100:30:071
2282787210,0sleep20-21swapper/200:25:202
2282484210,0sleep00-21swapper/000:25:170
2282025210,0sleep10-21swapper/100:25:061
2280392210,0sleep10-21swapper/100:20:181
2279963210,0sleep20-21swapper/200:20:152
2277640210,0sleep20-21swapper/200:15:032
2276458210,0sleep20-21swapper/200:10:222
2275545210,0sleep00-21swapper/000:10:160
2275034210,0sleep10-21swapper/100:08:211
2273585210,0sleep20-21swapper/200:05:182
2272934210,0sleep10-21swapper/100:03:181
2272651210,0sleep00-21swapper/000:00:440
2270156210,0sleep10-21swapper/123:55:201
2269365210,0sleep00-21swapper/023:55:150
2268599210,0sleep00-21swapper/023:52:150
2267994210,0sleep20-21swapper/223:50:212
2266742210,0sleep20-21swapper/223:49:182
2265060210,0sleep10-21swapper/123:45:161
2263915210,0sleep10-21swapper/123:40:191
2263772210,0sleep00-21swapper/023:40:180
2262904210,0sleep20-21swapper/223:40:122
2261239210,0sleep20-21swapper/223:35:162
2261054210,0sleep10-21swapper/123:35:151
2260908210,0sleep00-21swapper/023:35:140
2260272210,0sleep20-21swapper/223:32:402
2260063210,0sleep10-21swapper/123:30:511
2258449210,0sleep00-21swapper/023:30:020
2257905210,0sleep10-21swapper/123:25:231
2256361210,0sleep00-21swapper/023:25:020
2256042210,0sleep10-21swapper/123:22:141
2255244210,0sleep20-21swapper/223:20:192
2254250210,0sleep00-21swapper/023:20:020
2252570210,0sleep00-21swapper/023:15:170
2252416210,0sleep20-21swapper/223:15:152
2252160210,0sleep10-21swapper/123:15:021
2250712210,0sleep00-21swapper/023:10:170
2250355210,0sleep20-21swapper/223:10:152
2250308210,0sleep10-21swapper/123:10:061
2249317210,0sleep20-21swapper/223:05:232
2249042210,0sleep00-21swapper/023:05:200
2247982210,0sleep10-21swapper/123:05:021
2247970210,0sleep00-21swapper/023:04:560
2246173210,0sleep20-21swapper/223:00:142
2244490210,0sleep10-21swapper/122:55:171
2244020210,1sleep00-21swapper/022:55:050
2243782210,0sleep20-21swapper/222:55:022
2243363210,0sleep00-21swapper/022:51:190
2242726210,0sleep10-21swapper/122:50:201
2242370210,0sleep20-21swapper/222:50:172
2241155210,0sleep00-21swapper/022:45:230
2240296210,0sleep20-21swapper/222:45:172
2240144210,0sleep10-21swapper/122:45:161
2239162210,0sleep00-21swapper/022:41:120
2238204210,0sleep20-21swapper/222:40:172
2238002210,0sleep10-21swapper/122:40:171
2235657210,0sleep20-21swapper/222:35:122
2235223210,0sleep20-21swapper/222:33:282
2234971210,0sleep10-21swapper/122:31:151
2233639210,0sleep00-21swapper/022:30:140
2232844210,0sleep20-21swapper/222:25:572
2232791210,0sleep00-21swapper/022:25:260
2228101210,0sleep10-21swapper/122:15:421
2226746210,0sleep20-21swapper/222:15:072
2225947210,0sleep00-21swapper/022:12:250
2225283210,0sleep10-21swapper/122:10:221
2224858210,1sleep20-21swapper/222:10:192
2223755210,0sleep00-21swapper/022:06:290
2222447210,0sleep20-21swapper/222:05:142
2222344210,0sleep10-21swapper/122:05:131
2220274210,0sleep22220381-21aten_r1power_po22:00:142
2218928210,0sleep00-21swapper/021:55:200
2218129210,0sleep20-21swapper/221:55:142
2217610210,0sleep10-21swapper/121:55:011
2217540210,0sleep10-21swapper/121:54:251
2217347210,0sleep00-21swapper/021:52:440
2216823210,0sleep20-21swapper/221:50:212
2215054210,1sleep00-21swapper/021:45:550
2212110210,0sleep20-21swapper/221:40:172
2212030210,0sleep10-21swapper/121:40:161
2211752210,0sleep00-21swapper/021:40:150
2210460210,0sleep10-21swapper/121:35:201
2209711210,0sleep02209975-21df21:35:160
2209556210,0sleep20-21swapper/221:35:132
2207190210,0sleep20-21swapper/221:28:522
2206304210,0sleep10-21swapper/121:25:191
2203542210,0sleep20-21swapper/221:20:132
2203232210,0sleep10-21swapper/121:19:391
2201597210,0sleep20-21swapper/221:15:152
2200048210,0sleep20-21swapper/221:10:192
2199968210,0sleep10-21swapper/121:10:181
2199281210,1sleep00-21swapper/021:10:010
2198588210,0sleep10-21swapper/121:05:221
2198335210,0sleep20-21swapper/221:05:192
2198049210,0sleep00-21swapper/021:05:170
2197135210,0sleep10-21swapper/121:02:011
2196322210,0sleep20-21swapper/221:00:182
2196071210,0sleep00-21swapper/021:00:160
2194779210,0sleep10-21swapper/120:55:221
2191427210,0sleep00-21swapper/020:47:400
2190073210,0sleep20-21swapper/220:45:092
2189698210,0sleep10-21swapper/120:45:001
2189407210,0sleep20-21swapper/220:41:182
2189376210,0sleep00-21swapper/020:40:550
2189325210,0sleep10-21swapper/120:40:171
2189051210,0sleep10-21swapper/120:40:001
2188687210,0sleep20-21swapper/220:35:212
2186212210,0sleep10-21swapper/120:30:241
2185541210,0sleep00-21swapper/020:30:190
2185127210,1sleep00-21swapper/020:28:460
2183312210,0sleep20-21swapper/220:25:012
2182083210,0sleep20-21swapper/220:20:162
2181707210,0sleep00-21swapper/020:20:140
2180143210,0sleep20-21swapper/220:15:162
2179895210,0sleep10-21swapper/120:15:151
2179707210,0sleep00-21swapper/020:15:110
2178772210,0sleep10-21swapper/120:10:221
2177790210,0sleep20-21swapper/220:10:072
2177209210,0sleep20-21swapper/220:05:392
2175887210,0sleep00-21swapper/020:05:130
2174404210,1sleep20-21swapper/220:00:162
2174157210,0sleep10-21swapper/120:00:151
2174012210,0sleep00-21swapper/020:00:130
2173414210,0sleep10-21swapper/119:56:171
2172478210,0sleep20-21swapper/219:55:142
2170525210,0sleep00-21swapper/019:50:160
2169192210,0sleep10-21swapper/119:45:211
2168931210,0sleep00-21swapper/019:45:200
2167244210,1sleep00-21swapper/019:42:280
2166944210,0sleep10-21swapper/119:40:201
2165837210,0sleep20-21swapper/219:40:132
2163968210,0sleep10-21swapper/119:35:161
2163067210,0sleep20-21swapper/219:30:212
2162064210,0sleep00-21swapper/019:30:150
2158225210,0sleep00-21swapper/019:20:140
2156848210,0sleep10-21swapper/119:15:191
2156322210,0sleep20-21swapper/219:15:162
2156168210,0sleep00-21swapper/019:15:140
2155113210,0sleep20-21swapper/219:10:402
2154832210,0sleep00-21swapper/019:10:220
2153801210,0sleep10-21swapper/119:10:151
2286463200,0sleep20-21swapper/200:35:042
2275469200,0sleep10-21swapper/100:10:051
2268920200,0sleep20-21swapper/223:55:012
2267066200,0sleep10-21swapper/123:50:041
2235638200,0sleep10-21swapper/122:35:031
2231460200,0sleep10-21swapper/122:25:041
2229114200,0sleep20-21swapper/222:20:032
2229113200,0sleep10-21swapper/122:20:021
2219957200,0sleep10-21swapper/122:00:021
2213432200,0sleep20-21swapper/221:45:022
2207549200,0sleep00-21swapper/021:30:020
2203531200,0sleep10-21swapper/121:20:041
2201310200,0sleep00-21swapper/021:15:010
2193757200,0sleep20-21swapper/220:55:022
2191842200,0sleep20-21swapper/220:50:022
2187375200,0sleep00-21swapper/020:35:030
2185224200,0sleep20-21swapper/220:30:012
2181635200,0sleep10-21swapper/120:20:031
2170112200,0sleep20-21swapper/219:50:022
2167444200,0sleep20-21swapper/219:45:032
2163597200,0sleep20-21swapper/219:35:012
2161918200,0sleep10-21swapper/119:30:041
2160004200,0sleep10-21swapper/119:25:041
2158091200,0sleep20-21swapper/219:20:052
2158090200,0sleep10-21swapper/119:20:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional