You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-12 - 12:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Thu Sep 12, 2024 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21059232270196,29sleep10-21swapper/119:08:001
21057602255196,44sleep00-21swapper/019:06:160
116899490,3rtkit-daemon1167-21rtkit-daemon20:29:221
116899480,3rtkit-daemon1167-21rtkit-daemon23:23:430
116899470,3rtkit-daemon1167-21rtkit-daemon20:06:010
116899470,3rtkit-daemon0-21swapper/000:36:501
116899450,2rtkit-daemon1167-21rtkit-daemon20:35:031
210622499391,13cyclictest2121003-21apt-get19:45:150
116899390,6rtkit-daemon2154488-21diskmemload21:26:331
116899390,3rtkit-daemon0-21swapper/022:12:550
210622499389,8cyclictest13-21ksoftirqd/020:40:230
210622499376,13cyclictest2266747-21sed23:55:180
210622499375,8cyclictest2175733-21apt-get21:40:120
116899370,6rtkit-daemon2189514-21perl22:00:171
210622499368,9cyclictest2120480-21python319:45:010
210622499365,6cyclictest2189384-21diskstats22:00:160
210622499362,10cyclictest2245591-1kworker/u9:123:45:110
2106224993613,8cyclictest13-21ksoftirqd/022:50:000
210622499361,10cyclictest2204141-21ssh22:20:250
116899360,4rtkit-daemon0-21swapper/119:10:061
116899360,3rtkit-daemon1167-21rtkit-daemon20:10:221
210622499356,7cyclictest2199321-21apt-check22:15:010
210622499353,7cyclictest2285964-21apt-get00:25:140
210622499353,7cyclictest13-21ksoftirqd/021:10:170
210622499352,5cyclictest2172288-21apt-get21:35:140
116899350,4rtkit-daemon1167-21rtkit-daemon23:50:160
116899350,4rtkit-daemon1167-21rtkit-daemon23:42:070
116899350,4rtkit-daemon0-21swapper/120:14:160
116899350,3rtkit-daemon0-21swapper/023:38:180
116899350,3rtkit-daemon0-21swapper/000:33:431
116899340,3rtkit-daemon1167-21rtkit-daemon22:32:410
116899340,3rtkit-daemon0-21swapper/119:16:541
116899340,3rtkit-daemon0-21swapper/119:12:000
116899340,3rtkit-daemon0-21swapper/100:21:380
116899340,3rtkit-daemon0-21swapper/022:25:101
210622499338,9cyclictest13-21ksoftirqd/020:45:220
210622499334,7cyclictest2158284-21apt-get21:15:130
210622499333,7cyclictest13-21ksoftirqd/019:35:000
116899330,4rtkit-daemon0-21swapper/123:00:280
116899330,3rtkit-daemon0-21swapper/100:12:171
116899330,3rtkit-daemon0-21swapper/022:41:320
116899330,3rtkit-daemon0-21swapper/021:47:031
116899330,3rtkit-daemon0-21swapper/019:33:431
22316962320,17sleep10-21swapper/123:02:051
210622699323,9cyclictest26-21ksoftirqd/122:00:001
210622499323,8cyclictest2162146-21apt-get21:20:150
210622499323,8cyclictest13-21ksoftirqd/022:05:240
210622499323,6cyclictest13-21ksoftirqd/020:30:020
210622499320,6cyclictest2282321-21munin-run00:20:000
116899320,4rtkit-daemon1167-21rtkit-daemon22:52:511
116899320,3rtkit-daemon1167-21rtkit-daemon22:35:250
116899320,3rtkit-daemon1167-21rtkit-daemon20:41:061
116899320,3rtkit-daemon1167-21rtkit-daemon19:24:200
116899320,3rtkit-daemon0-21swapper/120:35:430
116899320,3rtkit-daemon0-21swapper/021:00:221
116899320,3rtkit-daemon0-21swapper/020:06:061
210622499319,7cyclictest13-21ksoftirqd/020:15:220
210622499318,8cyclictest13-21ksoftirqd/020:55:010
210622499316,7cyclictest13-21ksoftirqd/023:25:120
210622499313,6cyclictest2239697-21apt-get23:15:120
210622499310,8cyclictest2168811-21apt-get21:30:130
210622499310,13cyclictest2181697-21ssh21:49:150
116899310,4rtkit-daemon0-21swapper/021:23:011
116899310,3rtkit-daemon1167-21rtkit-daemon20:23:111
116899310,3rtkit-daemon0-21swapper/023:45:361
116899310,3rtkit-daemon0-21swapper/023:32:361
116899310,3rtkit-daemon0-21swapper/022:30:291
116899310,3rtkit-daemon0-21swapper/022:16:151
116899310,3rtkit-daemon0-21swapper/019:38:191
116899310,3rtkit-daemon0-21swapper/000:05:161
210622499303,7cyclictest13-21ksoftirqd/021:50:160
210622499302,7cyclictest2108393-21pmu-power19:15:010
210622499300,9cyclictest13-21ksoftirqd/021:55:190
116899300,4rtkit-daemon1167-21rtkit-daemon23:24:241
116899300,3rtkit-daemon0-21swapper/021:10:521
116899300,3rtkit-daemon0-21swapper/019:53:501
116899300,3rtkit-daemon0-21swapper/019:29:281
116899300,2rtkit-daemon1167-21rtkit-daemon22:56:421
210622499293,6cyclictest13-21ksoftirqd/000:10:140
210622499293,10cyclictest2154337-21taskset21:08:380
210622499291,7cyclictest2269470-21apt-get00:00:100
210622499291,7cyclictest2249584-21apt-get23:30:130
210622499290,13cyclictest2224551-21seq22:50:530
116899290,3rtkit-daemon0-21swapper/120:28:330
116899290,3rtkit-daemon0-21swapper/021:40:551
116899290,3rtkit-daemon0-21swapper/021:32:561
116899290,3rtkit-daemon0-21swapper/021:09:561
116899290,3rtkit-daemon0-21swapper/019:45:581
116899290,3rtkit-daemon0-21swapper/000:22:341
210622499284,8cyclictest13-21ksoftirqd/020:50:160
210622499284,7cyclictest2154488-21diskmemload22:26:190
210622499283,9cyclictest2112807-21/usr/sbin/munin19:25:230
210622499283,8cyclictest13-21ksoftirqd/000:05:190
210622499282,7cyclictest13-21ksoftirqd/023:05:150
210622499282,7cyclictest13-21ksoftirqd/000:35:240
210622499280,7cyclictest2165570-21apt-get21:25:130
210622499280,7cyclictest2150875-21grep21:00:150
116899280,3rtkit-daemon1167-21rtkit-daemon19:51:160
116899280,3rtkit-daemon0-21swapper/122:56:500
2106226992720,5cyclictest2281325-21sh00:17:131
210622699270,6cyclictest0-21swapper/123:40:091
210622499274,7cyclictest13-21ksoftirqd/020:03:130
210622499273,7cyclictest13-21ksoftirqd/019:55:190
210622499271,7cyclictest13-21ksoftirqd/000:30:170
116899270,3rtkit-daemon0-21swapper/022:38:261
116899270,3rtkit-daemon0-21swapper/019:43:101
116899270,3rtkit-daemon0-21swapper/019:22:281
210622499262,7cyclictest2236935-21cat23:10:200
116899260,3rtkit-daemon0-21swapper/023:59:401
116899260,3rtkit-daemon0-21swapper/023:28:451
116899260,3rtkit-daemon0-21swapper/022:05:061
116899260,3rtkit-daemon0-21swapper/019:56:441
116899260,1rtkit-daemon1167-21rtkit-daemon23:11:261
2106226992513,1cyclictest0-21swapper/120:30:021
210622699250,9cyclictest2183474-21sed21:50:241
210622499259,4cyclictest141rcu_preempt20:20:120
2106224992510,7cyclictest2116729-21apt-get19:35:140
116899250,3rtkit-daemon0-21swapper/022:20:291
116899250,20rtkit-daemon2106216-21cyclictest23:37:281
116899240,19rtkit-daemon2106216-21cyclictest23:15:161
22711332230,2sleep12154488-21diskmemload00:01:201
2106226992312,8cyclictest2148954-21df20:55:131
2106226992312,7cyclictest62550irq/132-enp2s023:05:141
2106226992310,3cyclictest2173549-21unixbench_multi21:35:251
210622699221,10cyclictest2264231-21ssh23:50:361
210622699220,5cyclictest2216771-21/usr/sbin/munin22:40:171
116899220,1rtkit-daemon1167-21rtkit-daemon20:46:231
210622699212,14cyclictest2126895-21apt-get20:00:151
210622699211,3cyclictest2134478-1kworker/1:2H20:20:001
210622699211,10cyclictest2288349-21ssh00:28:111
116899210,14rtkit-daemon0-21swapper/122:46:111
2106226991913,4cyclictest2147610-21pmu-power20:50:221
2106226991911,6cyclictest2197056-21users22:10:251
2106226991911,6cyclictest2158423-21grep21:15:141
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:063
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
none09:38:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional