You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 11:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Tue Sep 16, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
217714999130,1cyclictest0-21swapper/322:35:153
217714999130,11cyclictest0-21swapper/320:20:123
2177149991211,0cyclictest0-21swapper/321:55:173
217714999120,1cyclictest0-21swapper/322:50:013
217714999120,11cyclictest0-21swapper/321:05:013
217714999120,11cyclictest0-21swapper/320:45:143
217714999111,9cyclictest69450irq/121-eno123:00:163
2177149991111,0cyclictest69450irq/121-eno123:05:143
2177149991111,0cyclictest69450irq/121-eno119:45:013
2177149991111,0cyclictest0-21swapper/321:40:143
2177149991110,0cyclictest0-21swapper/323:35:133
2177149991110,0cyclictest0-21swapper/322:50:023
2177149991110,0cyclictest0-21swapper/321:25:133
2177149991110,0cyclictest0-21swapper/319:30:133
217714999110,11cyclictest0-21swapper/321:10:133
217714999110,10cyclictest69450irq/121-eno123:40:223
217714999110,10cyclictest69450irq/121-eno122:03:223
217714999110,10cyclictest0-21swapper/323:20:133
217714999110,10cyclictest0-21swapper/319:50:013
217714999110,10cyclictest0-21swapper/319:25:143
217714999110,10cyclictest0-21swapper/300:25:023
217714999110,0cyclictest0-21swapper/320:05:013
217714999110,0cyclictest0-21swapper/320:05:003
217714999109,1cyclictest69450irq/121-eno123:55:193
217714999109,1cyclictest69450irq/121-eno122:10:123
217714999109,1cyclictest0-21swapper/320:10:153
217714999108,2cyclictest69450irq/121-eno123:25:143
217714999108,1cyclictest0-21swapper/323:50:123
217714999108,0cyclictest0-21swapper/320:05:023
2177149991010,0cyclictest69450irq/121-eno122:25:533
2177149991010,0cyclictest69450irq/121-eno122:15:223
2177149991010,0cyclictest69450irq/121-eno122:08:173
2177149991010,0cyclictest69450irq/121-eno121:35:193
2177149991010,0cyclictest69450irq/121-eno120:50:173
2177149991010,0cyclictest69450irq/121-eno119:15:013
2177149991010,0cyclictest0-21swapper/323:45:123
2177149991010,0cyclictest0-21swapper/300:10:223
217714999100,9cyclictest69450irq/121-eno122:40:573
217714999100,9cyclictest69450irq/121-eno122:20:163
217714999100,8cyclictest69450irq/121-eno121:32:113
217714999100,0cyclictest0-21swapper/322:30:203
217714999100,0cyclictest0-21swapper/320:15:133
217714999100,0cyclictest0-21swapper/300:15:193
21771499999,0cyclictest69450irq/121-eno123:30:253
21771499999,0cyclictest69450irq/121-eno123:15:183
21771499999,0cyclictest69450irq/121-eno122:55:193
21771499999,0cyclictest69450irq/121-eno121:50:183
21771499999,0cyclictest69450irq/121-eno120:25:143
21771499999,0cyclictest69450irq/121-eno119:20:173
21771499999,0cyclictest0-21swapper/319:55:123
21771499999,0cyclictest0-21swapper/319:50:123
21771499999,0cyclictest0-21swapper/300:05:013
21771499998,0cyclictest0-21swapper/323:10:183
21771499990,8cyclictest69450irq/121-eno121:45:173
21771499990,8cyclictest69450irq/121-eno121:20:183
21771499990,8cyclictest69450irq/121-eno119:39:493
21771499990,8cyclictest69450irq/121-eno100:35:443
21771499990,8cyclictest69450irq/121-eno100:05:133
21771499990,0cyclictest0-21swapper/320:30:163
21771499988,0cyclictest0-21swapper/321:05:103
2175084281,4sleep30-21swapper/319:05:013
21771499977,0cyclictest69450irq/121-eno100:30:193
21771499977,0cyclictest69450irq/121-eno100:25:133
21771499977,0cyclictest69450irq/121-eno100:25:123
21771499970,6cyclictest0-21swapper/321:15:173
21771499966,0cyclictest0-21swapper/320:35:193
21771499966,0cyclictest0-21swapper/319:11:543
21771499955,0cyclictest0-21swapper/320:55:123
21771499950,3cyclictest0-21swapper/320:40:163
2284554240,0sleep00-21swapper/023:31:230
2176690242,1sleep20-21swapper/219:06:082
2175324242,1sleep10-21swapper/119:05:071
2300551230,2sleep22300169-21/usr/sbin/munin00:10:192
2235797231,0sleep1191rcu_preempt21:35:201
2230632230,1sleep22230658-21apt-get21:25:132
2184596230,2sleep22184821-21vmstat19:25:212
2181608230,1sleep22181634-21apt-get19:20:132
2175843231,1sleep00-21swapper/019:05:180
2310078220,0sleep00-21swapper/000:32:270
2305380220,1sleep02305662-21users00:20:210
2302419220,1sleep22302681-21df_inode00:15:152
2294294220,1sleep02294380-21irqstats23:55:170
2293606220,1sleep12293625-21munin-run23:55:011
2275580220,1sleep00-21swapper/023:10:210
2268185221,1sleep20-21swapper/222:55:062
2265915220,1sleep20-21swapper/222:50:022
2264135220,1sleep00-21swapper/022:45:150
2257216221,0sleep22257235-21/usr/sbin/munin22:30:012
2254889220,1sleep00-21swapper/022:22:590
2240740220,1sleep12240834-21telnet21:50:131
2239535220,1sleep02239701-21sed21:45:200
2232249220,0sleep00-21swapper/021:28:510
2212877220,1sleep10-21swapper/120:40:121
2198673220,0sleep00-21swapper/020:05:020
2193726220,1sleep02193875-21ntp_states19:50:170
2191197220,1sleep00-21swapper/019:45:130
2187968220,1sleep12188118-21ntp_states19:35:171
2312341210,1sleep00-21swapper/000:39:030
2310720210,0sleep20-21swapper/200:35:172
2310687210,0sleep10-21swapper/100:35:161
2310009210,1sleep22310013-21ssh00:31:532
2308662210,0sleep10-21swapper/100:30:161
2306884210,0sleep20-21swapper/200:25:162
2306884210,0sleep20-21swapper/200:25:152
2306637210,0sleep10-21swapper/100:25:151
2306637210,0sleep10-21swapper/100:25:141
2306435210,0sleep00-21swapper/000:25:060
2306435210,0sleep00-21swapper/000:25:050
2305004210,0sleep12305145-21ntpq00:20:181
2304502210,0sleep20-21swapper/200:20:162
2304057210,1sleep12304059-21ssh00:19:471
2302764210,0sleep02302961-21strings00:15:180
2300792210,0sleep00-21swapper/000:10:210
2299910210,0sleep10-21swapper/100:10:021
2299479210,0sleep00-21swapper/000:06:160
2298464210,0sleep20-21swapper/200:05:182
2298217210,0sleep10-21swapper/100:05:171
2297504210,0sleep00-21swapper/000:02:170
2296424210,0sleep10-21swapper/100:00:181
2295987210,0sleep20-21swapper/200:00:142
2295103210,0sleep10-21swapper/123:55:221
2294592210,0sleep20-21swapper/223:55:192
2293122210,0sleep00-21swapper/023:50:470
2291254210,0sleep20-21swapper/223:50:012
2289999210,0sleep10-21swapper/123:45:171
2289416210,0sleep00-21swapper/023:45:120
2288640210,0sleep00-21swapper/023:40:230
2288269210,0sleep20-21swapper/223:40:222
2287319210,0sleep10-21swapper/123:40:091
2286196210,0sleep20-21swapper/223:35:202
2286024210,0sleep10-21swapper/123:35:191
2285942210,0sleep00-21swapper/023:35:190
2283316210,0sleep20-21swapper/223:30:132
2283187210,0sleep10-21swapper/123:30:121
2282553210,0sleep20-21swapper/223:27:132
2282402210,1sleep12282406-21ssh23:25:511
2281037210,0sleep00-21swapper/023:25:100
2280448210,0sleep10-21swapper/123:22:031
2279140210,0sleep20-21swapper/223:20:152
2278678210,0sleep00-21swapper/023:20:020
2277565210,0sleep10-21swapper/123:15:191
2276997210,0sleep20-21swapper/223:15:162
2276843210,0sleep00-21swapper/023:15:140
2275960210,0sleep20-21swapper/223:10:232
2275734210,0sleep10-21swapper/123:10:221
2274156210,0sleep12274158-21ssh23:07:021
2272838210,0sleep00-21swapper/023:05:170
2272670210,0sleep20-21swapper/223:05:152
2270840210,0sleep00-21swapper/023:00:160
2270571210,0sleep20-21swapper/223:00:152
2270034210,0sleep10-21swapper/123:00:021
2269506210,0sleep10-21swapper/122:55:211
2268652210,0sleep00-21swapper/022:55:160
2266908210,0sleep00-21swapper/022:50:200
2266546210,0sleep10-21swapper/122:50:171
2264214210,1sleep10-21swapper/122:45:171
2263508210,0sleep20-21swapper/222:45:022
2261826210,0sleep10-21swapper/122:40:161
2261732210,0sleep00-21swapper/022:40:160
2261394210,0sleep20-21swapper/222:40:012
2260997210,0sleep00-21swapper/022:36:320
2259751210,0sleep20-21swapper/222:35:172
2259623210,0sleep10-21swapper/122:35:161
2258244210,0sleep00-21swapper/022:30:180
2257841210,0sleep10-21swapper/122:30:151
2257474210,0sleep20-21swapper/222:30:122
2257048210,1sleep00-21swapper/022:28:310
2254461210,0sleep20-21swapper/222:20:202
2253288210,0sleep10-21swapper/122:20:111
2251928210,0sleep20-21swapper/222:15:192
2251624210,0sleep00-21swapper/022:15:170
2251190210,0sleep10-21swapper/122:15:141
2249866210,0sleep20-21swapper/222:10:202
2249711210,0sleep10-21swapper/122:10:191
2248832210,0sleep00-21swapper/022:10:020
2248611210,0sleep00-21swapper/022:08:060
2247894210,0sleep10-21swapper/122:05:191
2247453210,0sleep20-21swapper/222:05:162
2245105210,0sleep10-21swapper/122:00:171
2244899210,0sleep20-21swapper/222:00:062
2244637210,0sleep00-21swapper/022:00:000
2243495210,0sleep10-21swapper/121:55:221
2242965210,0sleep20-21swapper/221:55:192
2242810210,0sleep00-21swapper/021:55:170
2240838210,0sleep20-21swapper/221:50:152
2240714210,0sleep00-21swapper/021:50:120
2240192210,0sleep20-21swapper/221:47:412
2238628210,0sleep10-21swapper/121:45:121
2237996210,0sleep00-21swapper/021:41:160
2237047210,0sleep10-21swapper/121:40:171
2235965210,0sleep00-21swapper/021:36:030
2235331210,0sleep20-21swapper/221:35:182
2233900210,0sleep00-21swapper/021:30:230
2233457210,0sleep20-21swapper/221:30:202
2233386210,0sleep10-21swapper/121:30:201
2230820210,0sleep10-21swapper/121:25:161
2228642210,0sleep20-21swapper/221:20:122
2227343210,0sleep00-21swapper/021:15:220
2226798210,0sleep10-21swapper/121:15:191
2226366210,0sleep20-21swapper/221:14:562
2224764210,0sleep10-21swapper/121:10:151
2224671210,0sleep00-21swapper/021:10:130
2223887210,0sleep20-21swapper/221:05:192
2222685210,0sleep00-21swapper/021:05:020
2221779210,0sleep00-21swapper/021:00:210
2220839210,0sleep20-21swapper/221:00:152
2220810210,0sleep10-21swapper/121:00:141
2219044210,0sleep20-21swapper/220:55:152
2218652210,0sleep00-21swapper/020:55:120
2217549210,0sleep20-21swapper/220:50:222
2216454210,0sleep00-21swapper/020:50:010
2215768210,0sleep10-21swapper/120:45:221
2215655210,0sleep00-21swapper/020:45:210
2214577210,0sleep20-21swapper/220:45:032
2211690210,0sleep00-21swapper/020:35:200
2210696210,0sleep20-21swapper/220:35:022
2209803210,0sleep00-21swapper/020:30:150
2207636210,0sleep20-21swapper/220:25:162
2207552210,0sleep10-21swapper/120:25:151
2207301210,0sleep00-21swapper/020:25:150
2205230210,0sleep20-21swapper/220:20:132
2203265210,0sleep20-21swapper/220:15:122
2202995210,0sleep00-21swapper/020:15:020
2202028210,0sleep00-21swapper/020:10:220
2201578210,0sleep10-21swapper/120:10:191
2200163210,0sleep10-21swapper/120:05:231
2197559210,0sleep00-21swapper/020:00:180
2197559210,0sleep00-21swapper/020:00:170
2197272210,0sleep20-21swapper/220:00:162
2197272210,0sleep20-21swapper/220:00:152
2195840210,0sleep00-21swapper/019:55:160
2195521210,0sleep20-21swapper/219:55:152
2195437210,0sleep10-21swapper/119:55:141
2193482210,1sleep22193109-21/usr/sbin/munin19:50:142
2191993210,0sleep20-21swapper/219:45:192
2191226210,0sleep10-21swapper/119:45:141
2190483210,0sleep10-21swapper/119:40:211
2189730210,0sleep00-21swapper/019:40:160
2188119210,0sleep20-21swapper/219:35:172
2187803210,0sleep00-21swapper/019:35:160
2185465210,0sleep20-21swapper/219:30:142
2185435210,0sleep12185462-21apt-get19:30:131
2183900210,0sleep10-21swapper/119:25:161
2183520210,1sleep00-21swapper/019:25:110
2181774210,0sleep00-21swapper/019:20:150
2181278210,0sleep00-21swapper/019:19:150
2180107210,0sleep10-21swapper/119:15:161
2179672210,0sleep20-21swapper/219:15:132
2178633211,0sleep0171ktimers/019:10:500
2177907210,0sleep20-21swapper/219:10:162
2289167200,0sleep20-21swapper/223:45:022
2255365200,0sleep10-21swapper/122:25:041
2236554200,0sleep20-21swapper/221:40:022
2228629200,0sleep10-21swapper/121:20:031
2228626200,0sleep00-21swapper/021:20:020
2226610200,0sleep20-21swapper/221:15:042
2222708200,0sleep10-21swapper/121:05:021
2218599200,0sleep10-21swapper/120:55:011
2216686200,0sleep10-21swapper/120:50:021
2212865200,0sleep00-21swapper/020:40:030
2212608200,0sleep20-21swapper/220:40:012
2210932200,0sleep10-21swapper/120:35:051
2209018200,0sleep10-21swapper/120:30:051
2208780200,0sleep20-21swapper/220:30:022
2205191200,0sleep10-21swapper/120:20:041
2205190200,0sleep00-21swapper/020:20:030
2203254200,0sleep10-21swapper/120:15:031
2201081200,0sleep20-21swapper/220:10:042
2199169200,0sleep20-21swapper/220:05:042
2196993200,0sleep10-21swapper/120:00:031
2196993200,0sleep10-21swapper/120:00:021
2192884200,0sleep10-21swapper/119:50:011
2189271200,0sleep20-21swapper/219:40:032
2185424200,0sleep00-21swapper/019:30:040
2181597200,0sleep10-21swapper/119:20:041
2177284200,0sleep10-21swapper/119:10:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional