You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-25 - 10:36
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: reduced 
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8.osadl.org (updated Mon Sep 25, 2023 00:44:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2002682994944,3cyclictest2119865-21kworker/u8:3+flush-8:021:15:312
2002673994743,3cyclictest2778447-21kworker/u8:4+events_unbound19:15:310
2002673993935,3cyclictest2054219-21kworker/u8:0+flush-8:021:05:000
2002673993834,3cyclictest2108786-21kworker/u8:2+flush-8:020:55:300
2002684993631,3cyclictest2179915-21apt-get21:50:033
2002682993428,4cyclictest2345358-21appstreamcli00:20:012
2002679993328,3cyclictest2317539-21latency_hist23:55:011
2002673993228,3cyclictest2312041-21kworker/u8:4+flush-8:023:55:200
2002684993127,3cyclictest2065388-21kworker/u8:4+flush-8:020:20:003
2002684993127,3cyclictest2054219-21kworker/u8:0+events_unbound20:53:343
2002682993124,4cyclictest2361431-21latency_hist00:35:002
2002679993125,4cyclictest2185673-21latency_hist21:55:011
2002673993128,2cyclictest2323247-21kworker/u8:3+flush-8:000:00:260
2002673993127,3cyclictest2026598-21kworker/u8:1+flush-8:019:40:370
2002684993027,2cyclictest2241095-21kworker/u8:1+flush-8:022:55:313
2002684993025,3cyclictest2219271-21latency_hist22:25:003
2002673993027,2cyclictest2054219-21kworker/u8:0+flush-8:020:25:300
2002673993027,2cyclictest1991794-21kworker/u8:0+events_unbound19:40:010
2002682992924,3cyclictest2213459-21apt-get22:20:022
2002679992926,2cyclictest2241095-21kworker/u8:1+flush-8:022:53:331
2002679992925,3cyclictest2778447-21kworker/u8:4+events_unbound19:15:051
2002679992924,4cyclictest2185676-21apt-get21:55:031
2002673992923,4cyclictest2169024-21latency_hist21:40:010
2002682992820,5cyclictest2312056-21latency_hist23:50:012
2002679992823,3cyclictest2301073-21kworker/u8:3+flush-8:023:40:211
2002673992825,2cyclictest2361401-21kworker/u8:2+flush-8:000:35:290
2002673992825,2cyclictest2059717-21kworker/u8:1+flush-8:020:30:320
2002673992824,3cyclictest2284723-21kworker/u8:1+events_unbound23:35:290
2002684992723,3cyclictest2224705-21kworker/u8:0+events_unbound22:30:303
2002679992722,3cyclictest2130397-21kworker/u8:1+flush-8:021:10:211
2002673992724,2cyclictest2197347-21kworker/u8:4+flush-8:023:15:280
2002673992724,2cyclictest2197347-21kworker/u8:4+events_unbound22:05:300
2002673992724,2cyclictest2081747-21kworker/u8:2+flush-8:020:20:320
2002673992724,2cyclictest2008276-21kworker/u8:3+events_unbound19:20:330
2002673992723,3cyclictest2279238-21kworker/u8:0+flush-8:000:15:330
2002684992623,2cyclictest2043078-21kworker/u8:2+flush-8:020:05:313
2002684992622,3cyclictest2273773-21kworker/u8:2+events_unbound23:50:303
2002684992622,3cyclictest2241095-21kworker/u8:1+flush-8:022:45:253
2002684992622,3cyclictest2026598-21kworker/u8:1+flush-8:019:50:313
2002684992622,2cyclictest2008276-21kworker/u8:3+flush-8:019:25:013
2002684992621,3cyclictest2169088-21kworker/u8:3+flush-8:021:40:283
2002679992623,2cyclictest2224705-21kworker/u8:0+flush-8:022:30:311
2002673992623,2cyclictest2008276-21kworker/u8:3+events_unbound20:00:230
2002673992622,3cyclictest2043078-21kworker/u8:2+events_unbound20:10:290
200267399260,23cyclictest1-21systemd19:59:280
2002684992521,3cyclictest2169088-21kworker/u8:3+events_unbound22:00:233
2002682992520,3cyclictest2241095-21kworker/u8:1+flush-8:022:50:002
2002682992519,4cyclictest4170283-21systemd-journal23:40:002
2002673992522,2cyclictest2169088-21kworker/u8:3+events_unbound22:35:240
2002673992521,3cyclictest2169088-21kworker/u8:3+flush-8:022:10:210
2002684992420,3cyclictest2323247-21kworker/u8:3+flush-8:000:20:313
2002684992420,3cyclictest2008276-21kworker/u8:3+flush-8:019:20:013
2002684992419,4cyclictest2081747-21kworker/u8:2+events_unbound20:20:343
2002684992419,3cyclictest2252012-21latency_hist22:55:013
2002679992421,2cyclictest2054219-21kworker/u8:0+flush-8:021:00:311
2002679992420,3cyclictest2054219-21kworker/u8:0+events_unbound20:45:221
2002679992416,2cyclictest2322986-21munin-run00:00:001
2002673992421,2cyclictest2323247-21kworker/u8:3+flush-8:000:05:330
2002673992421,2cyclictest2224705-21kworker/u8:0+events_unbound22:30:380
2002673992420,3cyclictest2241095-21kworker/u8:1+flush-8:022:55:260
2002684992319,3cyclictest2361401-21kworker/u8:2+flush-8:000:35:253
2002684992319,3cyclictest2241095-21kworker/u8:1+events_unbound23:00:203
2002684992319,3cyclictest2054219-21kworker/u8:0+flush-8:020:30:243
2002684992318,4cyclictest2130397-21kworker/u8:1+flush-8:021:10:303
2002682992317,4cyclictest2185676-21apt-get21:55:012
2002679992320,2cyclictest2241095-21kworker/u8:1+flush-8:022:55:311
2002679992319,3cyclictest2169088-21kworker/u8:3+events_unbound22:02:301
2002679992317,4cyclictest2197247-21apt-get22:05:191
2002673992320,2cyclictest2141799-21kworker/u8:2+events_unbound21:25:290
2002673992320,2cyclictest2054219-21kworker/u8:0+flush-8:021:30:360
2002673992320,2cyclictest2026598-21kworker/u8:1+events_unbound19:50:240
2002684992219,2cyclictest2349866-21kworker/u8:1+events_unbound00:30:333
2002684992218,3cyclictest4170283-21systemd-journal23:30:013
2002682992218,2cyclictest0-21swapper/200:00:002
2002682992217,4cyclictest4170283-21systemd-journal19:25:012
2002679992220,1cyclictest0-21swapper/120:50:221
2002679992219,2cyclictest2241095-21kworker/u8:1+flush-8:023:00:261
2002679992219,2cyclictest2169088-21kworker/u8:3+flush-8:022:35:331
2002679992218,3cyclictest2279238-21kworker/u8:0+events_unbound00:10:351
2002679992218,3cyclictest2263177-21kworker/u8:0+events_unbound23:10:291
2002679992218,2cyclictest2169088-21kworker/u8:3+events_unbound22:20:331
2002673992219,2cyclictest2273773-21kworker/u8:2+events_unbound23:50:260
2002673992219,2cyclictest2169088-21kworker/u8:3+events_unbound22:25:260
200267399220,15cyclictest2114186-21awk20:50:000
2002684992117,3cyclictest2284723-21kworker/u8:1+events_unbound23:30:203
2002684992117,3cyclictest2279238-21kworker/u8:0+events_unbound23:55:283
2002684992117,3cyclictest2141799-21kworker/u8:2+events_unbound21:15:303
2002682992117,3cyclictest2174684-21kworker/u8:1+events_unbound21:45:232
2002682992117,2cyclictest2114447-21apt-get20:50:212
2002679992119,1cyclictest0-21swapper/123:35:191
2002679992117,3cyclictest2141799-21kworker/u8:2+flush-8:021:35:341
2002679992117,3cyclictest2026616-21latency_hist19:30:011
200267999210,20cyclictest0-21swapper/120:00:281
2002673992118,2cyclictest2241095-21kworker/u8:1+events_unbound22:45:230
2002673992118,2cyclictest2169088-21kworker/u8:3+events_unbound22:40:230
2002673992118,2cyclictest2059717-21kworker/u8:1+flush-8:020:15:210
200267399210,19cyclictest2008277-21munin-run19:15:010
2002684992017,2cyclictest2279238-21kworker/u8:0+flush-8:000:05:313
2002684992017,2cyclictest2008276-21kworker/u8:3+events_unbound19:55:183
2002684992016,3cyclictest2141799-21kworker/u8:2+events_unbound21:35:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional