You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 06:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Fri Nov 28, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214948499130,11cyclictest0-21swapper/300:20:143
2149484991211,1cyclictest0-21swapper/320:30:123
2149484991211,0cyclictest0-21swapper/323:35:173
214948499120,1cyclictest0-21swapper/321:55:133
214948499120,11cyclictest69450irq/121-eno122:47:493
214948499119,1cyclictest0-21swapper/321:05:143
214948499119,1cyclictest0-21swapper/300:00:143
2149484991110,1cyclictest69450irq/121-eno100:33:073
2149484991110,0cyclictest0-21swapper/323:15:203
214948499110,8cyclictest0-21swapper/320:00:013
214948499110,11cyclictest0-21swapper/323:05:193
214948499110,11cyclictest0-21swapper/322:00:133
214948499110,10cyclictest69450irq/121-eno100:10:123
214948499110,10cyclictest0-21swapper/322:35:143
214948499110,10cyclictest0-21swapper/321:25:163
214948499110,10cyclictest0-21swapper/320:35:193
214948499110,10cyclictest0-21swapper/319:50:213
214948499110,10cyclictest0-21swapper/319:39:553
214948499110,0cyclictest0-21swapper/322:25:133
214948499109,0cyclictest0-21swapper/322:55:123
214948499109,0cyclictest0-21swapper/300:25:143
214948499101,8cyclictest69450irq/121-eno120:13:583
2149484991010,0cyclictest69450irq/121-eno122:30:553
2149484991010,0cyclictest69450irq/121-eno122:05:193
2149484991010,0cyclictest69450irq/121-eno121:30:403
2149484991010,0cyclictest69450irq/121-eno120:50:013
2149484991010,0cyclictest69450irq/121-eno120:20:183
2149484991010,0cyclictest69450irq/121-eno119:25:163
2149484991010,0cyclictest0-21swapper/323:25:013
2149484991010,0cyclictest0-21swapper/323:10:123
2149484991010,0cyclictest0-21swapper/321:20:173
214948499100,9cyclictest69450irq/121-eno122:10:143
214948499100,9cyclictest69450irq/121-eno121:13:543
214948499100,9cyclictest0-21swapper/323:25:143
214948499100,10cyclictest0-21swapper/319:15:023
214948499100,10cyclictest0-21swapper/300:35:193
214948499100,0cyclictest0-21swapper/323:30:023
214948499100,0cyclictest0-21swapper/319:55:173
214948499100,0cyclictest0-21swapper/300:15:143
21494849999,0cyclictest69450irq/121-eno123:59:333
21494849999,0cyclictest69450irq/121-eno121:46:563
21494849999,0cyclictest69450irq/121-eno121:38:363
21494849999,0cyclictest69450irq/121-eno119:10:193
21494849999,0cyclictest69450irq/121-eno100:05:063
21494849999,0cyclictest0-21swapper/320:45:133
21494849999,0cyclictest0-21swapper/319:45:013
21494849999,0cyclictest0-21swapper/319:25:003
21494849998,1cyclictest69450irq/121-eno121:15:123
21494849998,0cyclictest0-21swapper/323:50:153
21494849992,6cyclictest69450irq/121-eno122:21:203
21494849990,8cyclictest69450irq/121-eno123:04:283
21494849990,8cyclictest69450irq/121-eno122:50:193
21494849990,8cyclictest69450irq/121-eno122:15:223
21494849990,0cyclictest0-21swapper/323:40:023
21494849988,0cyclictest69450irq/121-eno120:15:173
21494849983,2cyclictest69450irq/121-eno120:40:123
21494849977,0cyclictest69450irq/121-eno121:50:073
21494849977,0cyclictest69450irq/121-eno121:43:333
21494849977,0cyclictest69450irq/121-eno121:00:233
21494849977,0cyclictest69450irq/121-eno119:45:173
21494849975,1cyclictest0-21swapper/320:05:143
21494849966,0cyclictest69450irq/121-eno122:40:143
21494849966,0cyclictest69450irq/121-eno119:30:163
21494849966,0cyclictest0-21swapper/323:45:203
2148114260,4sleep12148248-21latency19:05:171
2196692254,1sleep02169644-21kworker/0:2+events21:06:480
21494849955,0cyclictest0-21swapper/320:55:123
2274965240,3sleep22274967-21ssh00:14:382
2243222240,3sleep02243495-21df_inode23:00:140
21494849940,2cyclictest0-21swapper/320:25:133
2148034241,1sleep00-21swapper/019:05:160
2147677241,1sleep20-21swapper/219:05:142
2147653241,2sleep30-21swapper/319:05:023
2272924230,2sleep22272977-21cat00:10:022
2251453230,1sleep12251479-21apt-get23:20:141
2222547230,0sleep00-21swapper/022:10:160
2283837220,1sleep22284084-21diskstats00:35:152
2267965220,1sleep02267967-21ssh23:55:430
2266055220,0sleep10-21swapper/123:52:191
2262184220,1sleep00-21swapper/023:45:140
2257280220,0sleep00-21swapper/023:31:050
2256326220,1sleep22256408-21irqstats23:30:152
2255587220,1sleep00-21swapper/023:29:360
2245323220,1sleep02245588-21diskstats23:05:160
2244724220,1sleep12244726-21ssh23:03:291
2229948220,0sleep00-21swapper/022:27:330
2220027220,0sleep02220053-21apt-get22:05:150
2218551220,1sleep22218702-21ntpq22:00:172
2218366220,1sleep02218448-21irqstats22:00:160
2213410220,1sleep00-21swapper/021:49:270
2201203220,1sleep02201231-21apt-get21:20:130
2200610220,0sleep10-21swapper/121:16:341
2190045220,1sleep00-21swapper/020:50:190
2179427220,1sleep02179436-21latency_hist20:25:010
2177763220,1sleep10-21swapper/120:20:141
2171750220,1sleep12171764-21munin-run20:05:001
2156924220,1sleep12157096-21python319:25:181
2149754220,1sleep22150049-21df19:10:142
2283653210,0sleep00-21swapper/000:35:130
2282016210,0sleep10-21swapper/100:30:211
2281565210,0sleep00-21swapper/000:30:160
2280846210,0sleep10-21swapper/100:26:021
2279533210,0sleep00-21swapper/000:25:170
2279467210,0sleep20-21swapper/200:25:142
2278987210,0sleep10-21swapper/100:23:061
2277379210,0sleep20-21swapper/200:20:142
2277362210,1sleep02275048-21kworker/0:0+events00:20:040
2276167210,0sleep20-21swapper/200:15:212
2275884210,0sleep00-21swapper/000:15:190
2275424210,0sleep10-21swapper/100:15:161
2274605210,0sleep00-21swapper/000:11:280
2273175210,0sleep12273201-21apt-get00:10:131
2272822210,1sleep10-21swapper/100:09:081
2272713210,1sleep00-21swapper/000:08:110
2269695210,0sleep2328-21plymouthd00:00:202
2269565210,0sleep10-21swapper/100:00:191
2268985210,0sleep00-21swapper/000:00:030
2268006210,0sleep20-21swapper/223:56:052
2267477210,0sleep10-21swapper/123:55:201
2265157210,0sleep20-21swapper/223:50:202
2264021210,0sleep00-21swapper/023:50:020
2262806210,0sleep10-21swapper/123:45:191
2260712210,0sleep12260865-21ntp_states23:40:191
2260229210,0sleep20-21swapper/223:40:162
2260095210,0sleep00-21swapper/023:40:130
2258701210,0sleep00-21swapper/023:35:170
2258168210,0sleep10-21swapper/123:35:141
2255885210,0sleep10-21swapper/123:30:101
2255377210,0sleep20-21swapper/223:27:472
2253289210,0sleep10-21swapper/123:25:011
2252349210,0sleep00-21swapper/023:20:210
2251482210,0sleep22251574-21aten2.4-expect23:20:142
2250662210,0sleep20-21swapper/223:15:342
2249761210,0sleep00-21swapper/023:15:160
2249334210,0sleep10-21swapper/123:15:131
2248699210,0sleep10-21swapper/123:11:401
2247526210,0sleep00-21swapper/023:10:150
2246989210,0sleep20-21swapper/223:10:012
2246205210,0sleep20-21swapper/223:05:222
2246062210,0sleep10-21swapper/123:05:211
2244236210,0sleep20-21swapper/223:00:212
2242280210,0sleep00-21swapper/022:55:310
2241404210,0sleep20-21swapper/222:55:162
2241243210,0sleep10-21swapper/122:55:151
2239731210,0sleep10-21swapper/122:50:201
2239313210,0sleep20-21swapper/222:50:172
2238960210,0sleep00-21swapper/022:50:150
2237513210,0sleep10-21swapper/122:45:181
2237008210,0sleep20-21swapper/222:45:162
2236688210,0sleep00-21swapper/022:45:010
2235596210,0sleep20-21swapper/222:40:192
2235311210,0sleep00-21swapper/022:40:180
2234824210,0sleep10-21swapper/122:40:151
2234203210,0sleep10-21swapper/122:38:111
2233592210,0sleep00-21swapper/022:35:220
2231173210,0sleep10-21swapper/122:30:171
2230231210,0sleep00-21swapper/022:30:000
2229121210,0sleep20-21swapper/222:25:192
2228400210,0sleep10-21swapper/122:25:141
2227287210,0sleep00-21swapper/022:20:200
2226465210,0sleep20-21swapper/222:20:152
2226036210,0sleep10-21swapper/122:20:021
2224816210,0sleep10-21swapper/122:15:171
2224195210,0sleep00-21swapper/022:15:120
2224177210,0sleep20-21swapper/222:15:012
2223538210,0sleep10-21swapper/122:11:291
2222841210,0sleep20-21swapper/222:10:182
2221555210,0sleep20-21swapper/222:07:252
2220056210,0sleep10-21swapper/122:05:161
2218449210,0sleep10-21swapper/122:00:171
2217523210,0sleep20-21swapper/221:58:532
2216255210,0sleep10-21swapper/121:55:161
2216009210,0sleep00-21swapper/021:55:150
2214584210,0sleep00-21swapper/021:50:220
2214385210,0sleep20-21swapper/221:50:202
2214235210,0sleep10-21swapper/121:50:191
2212978210,0sleep20-21swapper/221:45:372
2212977210,0sleep10-21swapper/121:45:361
2211051210,0sleep20-21swapper/221:44:212
2210090210,0sleep10-21swapper/121:40:191
2209355210,0sleep00-21swapper/021:40:130
2208612210,1sleep00-21swapper/021:36:060
2208274210,0sleep10-21swapper/121:35:221
2207262210,0sleep22207413-21telnet21:35:152
2206410210,0sleep10-21swapper/121:30:231
2205351210,0sleep20-21swapper/221:30:162
2205217210,0sleep00-21swapper/021:30:140
2203641210,0sleep20-21swapper/221:25:192
2203365210,0sleep10-21swapper/121:25:171
2203270210,0sleep00-21swapper/021:25:160
2202860210,1sleep12202864-21ssh21:24:021
2200725210,1sleep00-21swapper/021:17:490
2199430210,0sleep20-21swapper/221:15:152
2198828210,0sleep10-21swapper/121:13:571
2197816210,0sleep20-21swapper/221:10:172
2197576210,0sleep00-21swapper/021:10:150
2195468210,0sleep10-21swapper/121:05:171
2195025210,0sleep00-21swapper/021:04:550
2194901210,0sleep10-21swapper/121:03:211
2194540210,0sleep20-21swapper/221:00:262
2192048210,0sleep20-21swapper/220:55:162
2191880210,0sleep10-21swapper/120:55:151
2191720210,0sleep00-21swapper/020:55:140
2190343210,0sleep20-21swapper/220:50:212
2190255210,0sleep10-21swapper/120:50:201
2188193210,0sleep10-21swapper/120:45:191
2188106210,0sleep00-21swapper/020:45:180
2186826211,0sleep2451ktimers/220:41:322
2186337210,0sleep10-21swapper/120:40:201
2185538210,0sleep00-21swapper/020:40:150
2183941210,0sleep20-21swapper/220:35:162
2182879210,0sleep00-21swapper/020:30:210
2181711210,0sleep10-21swapper/120:30:141
2180443210,0sleep20-21swapper/220:25:202
2180168210,0sleep00-21swapper/020:25:180
2176612210,0sleep20-21swapper/220:15:182
2176331210,0sleep00-21swapper/020:15:160
2175882210,0sleep10-21swapper/120:15:131
2174655210,0sleep20-21swapper/220:10:192
2174488210,0sleep10-21swapper/120:10:181
2174353210,0sleep00-21swapper/020:10:170
2172885210,0sleep00-21swapper/020:05:190
2171999210,0sleep20-21swapper/220:05:142
2170864210,0sleep20-21swapper/220:00:172
2169204210,0sleep10-21swapper/119:55:331
2168332210,0sleep00-21swapper/019:55:160
2167949210,0sleep20-21swapper/219:55:142
2165718210,0sleep00-21swapper/019:50:140
2165456210,1sleep00-21swapper/019:49:550
2165171210,0sleep20-21swapper/219:46:172
2164528210,0sleep10-21swapper/119:45:161
2162616210,0sleep20-21swapper/219:40:172
2162404210,0sleep10-21swapper/119:40:161
2162320210,0sleep00-21swapper/019:40:140
2160380210,0sleep20-21swapper/219:35:162
2160109210,0sleep10-21swapper/119:35:151
2159985210,0sleep00-21swapper/019:35:140
2159011210,0sleep10-21swapper/119:30:191
2158874210,0sleep00-21swapper/019:30:180
2156843210,0sleep00-21swapper/019:25:170
2155389210,1sleep00-21swapper/019:22:100
2155120210,0sleep20-21swapper/219:20:232
2152567210,0sleep00-21swapper/019:15:170
2152248210,0sleep20-21swapper/219:15:152
2150251210,0sleep10-21swapper/119:10:171
2149631210,0sleep00-21swapper/019:10:120
2283398200,0sleep10-21swapper/100:35:021
2281538200,0sleep20-21swapper/200:30:022
2262164200,0sleep20-21swapper/223:45:042
2257963200,0sleep20-21swapper/223:35:032
2232562200,0sleep20-21swapper/222:35:042
2230467200,0sleep20-21swapper/222:30:022
2201183200,0sleep20-21swapper/221:20:022
2195266200,0sleep20-21swapper/221:05:022
2187099200,0sleep20-21swapper/220:45:012
2183487200,0sleep10-21swapper/120:35:031
2183486200,0sleep00-21swapper/020:35:020
2181575200,0sleep20-21swapper/220:30:032
2179529200,0sleep10-21swapper/120:25:031
2177748200,0sleep20-21swapper/220:20:032
2171988200,0sleep10-21swapper/120:05:041
2170074200,0sleep00-21swapper/020:00:040
2165704200,0sleep10-21swapper/119:50:031
2165465200,0sleep20-21swapper/219:50:002
2158028200,0sleep20-21swapper/219:30:042
2156115200,0sleep20-21swapper/219:25:042
2153937200,0sleep10-21swapper/119:20:021
2151593200,0sleep10-21swapper/119:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional