You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 08:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Sat Jul 12, 2025 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21713532260186,25sleep10-21swapper/119:06:001
21715492257181,61sleep00-21swapper/019:08:060
2171839991270,121cyclictest2243542-21sshd21:40:221
2171839991260,120cyclictest2212614-21cpuspeed20:50:151
21718399912396,22cyclictest2296879-21kworker/u8:223:21:221
2171837991231,115cyclictest2278976-21apt-key22:30:030
2171839991211,114cyclictest2337203-21cpuspeed_turbos23:50:281
2171837991190,112cyclictest2284049-21xargs22:35:270
2171839991171,110cyclictest2270493-21sshd22:17:221
2171839991170,111cyclictest2274654-21sh22:24:171
2171837991170,111cyclictest2335288-21sh23:47:460
2171837991150,109cyclictest2236113-21latency21:30:200
21718399911453,48cyclictest2294549-21kworker/u8:123:13:421
2171839991131,106cyclictest2218923-21cpuspeed21:05:161
21718379911265,42cyclictest2231928-21ssh21:25:120
2171839991100,104cyclictest2289619-21sh22:44:591
2171839991091,101cyclictest2186566-21idleruntime-cro19:45:001
2171839991090,104cyclictest2190152-21switchtime19:50:251
2171837991090,103cyclictest2336767-21apt-key23:50:030
2171837991070,101cyclictest2261105-21cpu22:05:150
21718399910551,44cyclictest2294549-21kworker/u8:123:49:451
2171839991050,99cyclictest2196368-21sshd20:06:241
2171837991050,99cyclictest2244480-21sh21:41:030
2171839991040,98cyclictest2294485-21open_inodes22:50:261
2171839991040,97cyclictest2266964-21sh22:12:301
2171837991040,98cyclictest2223736-21sh21:13:360
2171837991030,97cyclictest2355979-21sh00:16:140
21718399910238,51cyclictest2294549-21kworker/u8:123:44:421
2171839991020,96cyclictest2344842-21sh00:00:231
2171837991010,95cyclictest2289130-21sh22:43:520
2171839991000,94cyclictest2220875-21sh21:10:121
2171839999952,42cyclictest2296879-21kworker/u8:223:25:111
2171839999943,51cyclictest2294549-21kworker/u8:100:08:121
217183999990,81cyclictest2258914-21unixbench_multi22:00:291
2171839999843,43cyclictest2294549-21kworker/u8:122:59:521
2171839999843,39cyclictest2296879-21kworker/u8:223:03:181
2171839999752,40cyclictest2294549-21kworker/u8:123:39:321
217183999970,91cyclictest2236187-21sh21:30:211
217183999970,91cyclictest2194514-21sshd20:02:231
217183999970,90cyclictest2247288-21mailstats21:45:241
217183799960,90cyclictest2212943-21gltestperf20:50:190
2171839999552,38cyclictest2285024-21ssh22:37:241
217183799950,89cyclictest2219285-21hwlatdetect21:05:180
217183999930,87cyclictest2211090-21if_enp2s020:45:201
217183799930,90cyclictest2188640-21latency_hist19:50:010
217183799930,87cyclictest2347322-21sh00:04:360
217183999920,86cyclictest2289988-21cpuspeed_turbos22:45:151
2171839999031,47cyclictest2361217-21idleruntime-cro00:24:591
2171839998942,42cyclictest2294549-21kworker/u8:123:56:331
217183999892,76cyclictest2234367-21sh21:28:041
217183799890,83cyclictest2198668-21dump-pmu-power20:15:010
2171839998847,36cyclictest2356310-21ssh00:17:001
2171837998826,50cyclictest2179798-21proc_pri19:25:240
217183799880,82cyclictest2268066-21dump-pmu-power22:15:000
217183999872,73cyclictest2366508-21sh00:30:451
217183999872,68cyclictest2178011-21switchtime19:20:221
2171837998730,47cyclictest2201372-21uname20:20:230
217183799860,80cyclictest2250700-21sh21:50:250
2171839998544,36cyclictest2224621-21ssh21:15:091
217183799850,79cyclictest2365188-21sh00:30:170
217183799850,79cyclictest2300035-21sh22:59:160
217183799850,79cyclictest2246441-21cstates21:45:150
217183799850,78cyclictest2268693-21fschecks_time22:15:210
217183999840,78cyclictest2179979-21switchtime19:25:251
217183999830,77cyclictest2215512-21swap20:55:241
217183799830,77cyclictest2225693-21mailstats21:15:270
2171839998248,29cyclictest2294549-21kworker/u8:123:16:281
217183999820,76cyclictest2188555-21apt-config19:50:021
217183999820,75cyclictest2229078-21missed_timers21:20:261
217183999810,75cyclictest2192818-21idleruntime-cro20:00:001
2171837997954,20cyclictest2294549-21kworker/u8:123:01:470
217183799790,73cyclictest2352013-21unixbench_multi00:10:260
2171839997835,38cyclictest2323554-21ssh23:30:391
217183999780,72cyclictest2208870-21sh20:40:181
217183999780,71cyclictest2362347-21pmu-power00:25:251
2171837997861,13cyclictest2323883-21ssh23:31:280
217183799780,72cyclictest2328888-21latency_hist23:40:000
217183799780,71cyclictest2290938-21mailstats22:45:240
2171837997753,19cyclictest2315487-21ssh23:20:220
217183999760,70cyclictest2255054-21sendmail_mailqu21:55:281
217183999760,69cyclictest2278647-21perf22:30:011
217183999760,69cyclictest2202584-21sh20:25:001
2171837997655,17cyclictest2356501-1kworker/u9:000:38:170
2171837997633,37cyclictest2210391-21cron20:44:590
2171839997554,16cyclictest2252903-21ssh21:54:051
2171839997551,19cyclictest2294549-21kworker/u8:100:10:101
2171837997510,58cyclictest2309035-21timerandwakeup23:10:290
217183799750,69cyclictest2278646-21munin-plugin-st22:30:010
217183799750,69cyclictest2229133-21needreboot21:20:260
217183799740,68cyclictest2216868-21/usr/sbin/munin21:00:230
217183799740,68cyclictest2185673-21proc_pri19:40:270
2171839997355,14cyclictest2241383-21ssh21:37:201
217183999720,66cyclictest2216868-21/usr/sbin/munin21:00:201
217183999720,66cyclictest2199861-21mailstats20:15:241
217183799720,66cyclictest2272599-21ntp_kernel_err22:20:220
217183799720,66cyclictest2208430-21sh20:40:000
217183799720,66cyclictest2190366-21unixbench_singl19:50:280
217183999710,65cyclictest2176790-21sendmail19:20:011
217183999710,33cyclictest2369700-21expr00:35:261
217183799710,68cyclictest2293968-21fschecks_time22:50:200
217183799710,65cyclictest2193345-21fschecks_time20:00:190
217183999700,64cyclictest2206583-21latency_hist20:35:021
217183799700,64cyclictest2183898-21threads19:35:250
217183999690,38cyclictest2206791-21cpuspeed_turbos20:35:151
217183799690,63cyclictest2364770-21sh00:30:000
217183799690,63cyclictest2198852-21acpi20:15:110
2171839996831,28cyclictest2279309-21apt-get22:30:151
217183999680,65cyclictest2261214-21cpuspeed_turbos22:05:151
217183799680,62cyclictest2195801-21pmu-power20:05:240
217183799680,62cyclictest2191575-21kernelversion19:55:220
217183799680,62cyclictest2181199-21fschecks_time19:30:170
217183999670,61cyclictest2173251-21unixbench_singl19:10:241
2171837996750,14cyclictest2305674-21ssh23:05:390
217183799670,62cyclictest2358139-21forks00:20:160
217183799670,61cyclictest2215365-21proc_pri20:55:220
217183999660,60cyclictest2203864-21timerandwakeup20:25:241
217183999660,60cyclictest2183405-21latency19:35:201
217183999660,60cyclictest2181017-21cpuspeed_turbos19:30:141
2171837996527,30cyclictest2332639-21sh23:45:010
2171837996514,48cyclictest2341726-21grep23:55:280
217183799650,62cyclictest2255318-21unixbench-2d21:55:300
217183799650,59cyclictest2172468-21if_err_enp2s019:10:180
217183999642,61cyclictest2198673-21latency_hist20:15:001
2171837996417,41cyclictest2239630-21sort21:35:200
217183799640,58cyclictest2319260-21netstat23:25:190
217183799630,4cyclictest2204537-21idleruntime-cro20:30:000
2171837996226,31cyclictest2350469-21cron00:10:010
217183799620,56cyclictest2177134-21cstates19:20:130
217183999610,58cyclictest2306741-21sh23:08:051
2171837996122,29cyclictest2257972-21grep22:00:190
217183799602,56cyclictest2205546-21pmu-power20:30:220
217183799582,54cyclictest2210758-21cstates20:45:170
2171837995732,21cyclictest2294549-21kworker/u8:123:19:330
217183799532,49cyclictest2175169-21cstates19:15:180
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional