You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-21 - 01:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Wed May 21, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
212205799150,12cyclictest0-21swapper/320:05:163
2122057991211,0cyclictest0-21swapper/322:45:153
2122057991211,0cyclictest0-21swapper/322:20:023
212205799120,1cyclictest0-21swapper/320:45:003
212205799120,1cyclictest0-21swapper/320:25:123
212205799120,11cyclictest0-21swapper/323:45:013
212205799120,11cyclictest0-21swapper/323:20:013
212205799120,11cyclictest0-21swapper/322:00:133
212205799120,11cyclictest0-21swapper/321:15:233
212205799120,11cyclictest0-21swapper/319:25:133
212205799120,11cyclictest0-21swapper/319:10:183
212205799120,11cyclictest0-21swapper/300:30:003
212205799120,0cyclictest0-21swapper/321:05:133
212205799110,0cyclictest0-21swapper/321:26:543
212205799110,0cyclictest0-21swapper/321:00:143
212205799110,0cyclictest0-21swapper/320:50:133
212205799108,1cyclictest0-21swapper/323:45:163
2122057991010,0cyclictest0-21swapper/322:35:193
2122057991010,0cyclictest0-21swapper/322:20:013
2122057991010,0cyclictest0-21swapper/321:50:013
2122057991010,0cyclictest0-21swapper/300:05:003
212205799100,9cyclictest2154651-21taskset20:30:243
212205799100,9cyclictest0-21swapper/319:15:153
212205799100,0cyclictest0-21swapper/322:55:203
21220579999,0cyclictest0-21swapper/322:30:183
21220579999,0cyclictest0-21swapper/320:10:113
21220579999,0cyclictest0-21swapper/319:45:193
21220579999,0cyclictest0-21swapper/300:20:123
21220579997,1cyclictest0-21swapper/321:10:133
21220579990,8cyclictest0-21swapper/323:00:163
21220579990,8cyclictest0-21swapper/321:55:243
21220579990,7cyclictest0-21swapper/321:40:143
21220579990,0cyclictest0-21swapper/323:20:183
21220579990,0cyclictest0-21swapper/322:10:013
2130346281,5sleep22130372-21apt-get19:30:122
21220579988,0cyclictest0-21swapper/323:25:223
21220579988,0cyclictest0-21swapper/322:40:183
21220579988,0cyclictest0-21swapper/321:30:193
21220579988,0cyclictest0-21swapper/320:45:133
21220579988,0cyclictest0-21swapper/320:15:213
21220579988,0cyclictest0-21swapper/319:50:133
21220579988,0cyclictest0-21swapper/319:40:213
21220579988,0cyclictest0-21swapper/319:35:123
21220579988,0cyclictest0-21swapper/300:05:153
21220579980,7cyclictest0-21swapper/322:09:033
21220579977,0cyclictest0-21swapper/323:30:213
21220579977,0cyclictest0-21swapper/323:10:223
21220579977,0cyclictest0-21swapper/323:10:213
21220579977,0cyclictest0-21swapper/321:35:143
21220579977,0cyclictest0-21swapper/321:22:583
21220579977,0cyclictest0-21swapper/321:00:003
21220579977,0cyclictest0-21swapper/320:20:193
21220579977,0cyclictest0-21swapper/320:00:163
21220579977,0cyclictest0-21swapper/319:30:193
21220579977,0cyclictest0-21swapper/300:35:223
21220579976,0cyclictest0-21swapper/323:35:253
21220579966,0cyclictest0-21swapper/323:05:203
21220579966,0cyclictest0-21swapper/322:25:173
21220579966,0cyclictest0-21swapper/321:53:013
21220579966,0cyclictest0-21swapper/319:55:113
21220579966,0cyclictest0-21swapper/319:20:123
21220579966,0cyclictest0-21swapper/300:30:243
21220579966,0cyclictest0-21swapper/300:15:233
21220579966,0cyclictest0-21swapper/300:00:003
21220579960,5cyclictest0-21swapper/320:37:583
2121885261,2sleep30-21swapper/319:09:563
2121613260,1sleep10-21swapper/119:06:261
13989860,2rtkit-daemon2121119-21ps19:05:180
13989860,0rtkit-daemon331-21plymouthd21:57:570
21220579955,0cyclictest0-21swapper/323:54:523
21220579950,0cyclictest0-21swapper/300:10:163
13989850,2rtkit-daemon762-21ntpd19:40:490
13989850,2rtkit-daemon2237501-21apt-get23:55:030
13989850,2rtkit-daemon2168707-21diskmemload22:58:050
13989850,0rtkit-daemon0-21swapper/021:39:470
21220579940,3cyclictest0-21swapper/322:50:263
2121584242,1sleep20-21swapper/219:06:022
13989840,2rtkit-daemon2190133-21/usr/sbin/munin22:00:200
13989840,2rtkit-daemon2168707-21diskmemload22:35:410
13989840,2rtkit-daemon2124104-21munin-node23:41:460
13989840,2rtkit-daemon2124104-21munin-node20:55:150
13989840,1rtkit-daemon2168979-21apt-get21:10:130
13989840,0rtkit-daemon331-21plymouthd23:35:160
2253120230,1sleep02253208-21irqstats00:30:210
2178626230,0sleep00-21swapper/021:34:220
2168698230,0sleep10-21swapper/121:10:011
2167032230,1sleep12167058-21apt-get21:05:131
13989830,2rtkit-daemon760-21snmpd23:52:040
13989830,2rtkit-daemon417-21systemd-journal19:45:250
13989830,2rtkit-daemon2139699-21perf19:59:500
13989830,2rtkit-daemon1399-21sendmail-mta20:28:370
13989830,2rtkit-daemon1-21systemd21:53:100
13989830,1rtkit-daemon762-21ntpd00:12:180
13989830,1rtkit-daemon760-21snmpd19:38:010
13989830,1rtkit-daemon760-21snmpd00:24:570
13989830,1rtkit-daemon331-21plymouthd23:27:440
13989830,1rtkit-daemon331-21plymouthd23:04:560
13989830,1rtkit-daemon331-21plymouthd21:40:190
13989830,1rtkit-daemon331-21plymouthd00:26:440
13989830,1rtkit-daemon2234431-21processes23:45:220
13989830,1rtkit-daemon2223523-21df23:20:140
13989830,1rtkit-daemon2193263-21dump-pmu-power22:10:010
13989830,1rtkit-daemon2175008-21apt-get21:25:140
13989830,1rtkit-daemon2168707-21diskmemload22:50:580
13989830,1rtkit-daemon2168707-21diskmemload22:12:480
13989830,1rtkit-daemon2168707-21diskmemload00:37:540
13989830,1rtkit-daemon2124104-21munin-node21:19:430
13989830,1rtkit-daemon1399-21sendmail-mta22:40:480
13989830,1rtkit-daemon1-21systemd22:33:000
13989830,1rtkit-daemon1-21systemd22:26:550
13989830,1rtkit-daemon1-21systemd22:20:170
13989830,1rtkit-daemon1-21systemd22:17:590
13989830,1rtkit-daemon1-21systemd21:20:320
13989830,1rtkit-daemon1-21systemd20:09:570
13989830,1rtkit-daemon1-21systemd00:00:160
13989830,1rtkit-daemon0-21swapper/023:15:040
13989830,0rtkit-daemon2124615-21apt-get19:15:160
13989830,0rtkit-daemon0-21swapper/023:11:130
13989830,0rtkit-daemon0-21swapper/023:11:130
13989830,0rtkit-daemon0-21swapper/022:47:110
13989830,0rtkit-daemon0-21swapper/021:45:510
13989830,0rtkit-daemon0-21swapper/019:34:230
2255707220,1sleep12255912-21grep00:35:221
2254427220,0sleep20-21swapper/200:34:192
2252001220,1sleep22252005-21ssh00:26:192
2207114220,1sleep12207216-21wc22:40:231
2194271220,1sleep22194342-21awk22:10:232
2189333220,1sleep20-21swapper/222:00:132
2183516220,1sleep22183668-21memory21:45:162
2163687220,1sleep22163867-21/usr/sbin/munin20:55:172
2155444220,1sleep02155691-21diskstats20:35:140
2154987220,2sleep10-21swapper/120:34:431
2137109220,1sleep12137391-21users19:45:201
2126656220,1sleep02126943-21df19:20:140
13989820,1rtkit-daemon762-21ntpd20:40:110
13989820,1rtkit-daemon760-21snmpd20:45:420
13989820,1rtkit-daemon684-21gmain23:30:230
13989820,1rtkit-daemon684-21gmain00:15:030
13989820,1rtkit-daemon2124104-21munin-node23:05:260
13989820,1rtkit-daemon2124104-21munin-node20:30:560
13989820,1rtkit-daemon2124104-21munin-node20:00:200
13989820,1rtkit-daemon2107211-21munin-node19:10:170
13989820,0rtkit-daemon331-21plymouthd20:20:170
13989820,0rtkit-daemon331-21plymouthd20:10:040
13989820,0rtkit-daemon2129720-21users19:25:200
13989820,0rtkit-daemon0-21swapper/021:05:180
13989820,0rtkit-daemon0-21swapper/021:00:070
13989820,0rtkit-daemon0-21swapper/020:52:580
13989820,0rtkit-daemon0-21swapper/020:15:030
13989820,0rtkit-daemon0-21swapper/019:50:180
13989820,0rtkit-daemon0-21swapper/000:05:170
2255286210,0sleep20-21swapper/200:35:192
2254094210,0sleep10-21swapper/100:31:221
2252196210,0sleep10-21swapper/100:28:021
2249906210,0sleep20-21swapper/200:21:152
2248524210,0sleep10-21swapper/100:20:141
2247282210,0sleep20-21swapper/200:15:222
2247158210,0sleep10-21swapper/100:15:211
2245960210,0sleep20-21swapper/200:13:342
2243598210,1sleep20-21swapper/200:06:062
2242369210,0sleep10-21swapper/100:05:161
2241937210,0sleep10-21swapper/100:04:521
2240922210,0sleep20-21swapper/200:00:212
2239419210,0sleep10-21swapper/123:56:241
2238196210,0sleep20-21swapper/223:55:212
2237031210,0sleep10-21swapper/123:51:031
2235656210,0sleep20-21swapper/223:50:162
2234118210,0sleep20-21swapper/223:45:202
2233562210,0sleep10-21swapper/123:45:151
2232209210,0sleep10-21swapper/123:40:201
2231708210,0sleep20-21swapper/223:40:172
2231078210,0sleep20-21swapper/223:39:002
2230923210,0sleep10-21swapper/123:37:391
2228980210,0sleep10-21swapper/123:33:541
2226924210,0sleep20-21swapper/223:29:122
2225455210,0sleep10-21swapper/123:25:181
2224458210,0sleep20-21swapper/223:20:512
2223204210,0sleep10-21swapper/123:20:141
2222230210,0sleep20-21swapper/223:15:222
2220734210,0sleep10-21swapper/123:15:011
2220297210,0sleep10-21swapper/123:11:091
2220297210,0sleep10-21swapper/123:11:091
2219710210,0sleep22219881-21python323:10:222
2219710210,0sleep22219881-21python323:10:222
2218334210,0sleep10-21swapper/123:07:181
2217097210,0sleep20-21swapper/223:05:192
2215226210,0sleep10-21swapper/123:00:201
2213332210,0sleep10-21swapper/122:55:201
2212800210,0sleep20-21swapper/222:55:172
2212357210,0sleep20-21swapper/222:55:022
2211879210,0sleep10-21swapper/122:50:481
2210024210,0sleep20-21swapper/222:47:522
2209810210,0sleep10-21swapper/122:45:591
2207787210,0sleep20-21swapper/222:41:322
2204671210,0sleep20-21swapper/222:35:202
2204381210,0sleep12204670-21df22:35:191
2203331210,0sleep20-21swapper/222:30:272
2202159210,0sleep10-21swapper/122:30:181
2201414210,0sleep20-21swapper/222:25:512
2201390210,0sleep10-21swapper/122:25:391
2198593210,0sleep20-21swapper/222:20:192
2197429210,0sleep10-21swapper/122:20:021
2197079210,0sleep10-21swapper/122:16:571
2196447210,0sleep20-21swapper/222:15:222
2193505210,0sleep10-21swapper/122:10:141
2192777210,0sleep10-21swapper/122:05:531
2191199210,0sleep20-21swapper/222:05:022
2190746210,0sleep10-21swapper/122:01:201
2187203210,0sleep10-21swapper/121:55:041
2186968210,0sleep20-21swapper/221:55:012
2186042210,0sleep22186216-21wc21:50:212
2185914210,0sleep10-21swapper/121:50:201
2183441210,0sleep10-21swapper/121:45:151
2179681210,0sleep20-21swapper/221:35:202
2178948210,0sleep10-21swapper/121:35:151
2178605210,0sleep20-21swapper/221:34:132
2176962210,0sleep10-21swapper/121:30:161
2176604210,0sleep10-21swapper/121:28:541
2175041210,0sleep20-21swapper/221:25:152
2173153210,0sleep20-21swapper/221:20:152
2173013210,0sleep10-21swapper/121:20:141
2172700210,0sleep10-21swapper/121:19:581
2169687210,0sleep20-21swapper/221:10:182
2167678210,0sleep20-21swapper/221:05:182
2166094210,0sleep10-21swapper/121:00:211
2164668210,0sleep10-21swapper/120:57:401
2162264210,0sleep10-21swapper/120:50:211
2161829210,0sleep20-21swapper/220:50:172
2159653210,0sleep10-21swapper/120:45:161
2158855210,0sleep20-21swapper/220:45:012
2158721210,0sleep10-21swapper/120:43:201
2157626210,0sleep22157708-21irqstats20:40:162
2155692210,0sleep10-21swapper/120:35:161
2155259210,0sleep20-21swapper/220:35:132
2154281210,0sleep20-21swapper/220:30:202
2151690210,0sleep10-21swapper/120:25:151
2150172210,0sleep10-21swapper/120:20:181
2149660210,0sleep20-21swapper/220:20:162
2147591210,0sleep20-21swapper/220:15:152
2146474210,0sleep12146647-21smartctl20:10:191
2145217210,0sleep10-21swapper/120:07:171
2141860210,0sleep20-21swapper/220:00:142
2140187210,0sleep20-21swapper/219:55:152
2139678210,0sleep10-21swapper/119:55:021
2139514210,0sleep20-21swapper/219:52:582
2138015210,0sleep10-21swapper/119:50:121
2136682210,0sleep20-21swapper/219:45:172
2134674210,0sleep20-21swapper/219:40:182
2133783211,0sleep2451ktimers/219:38:132
2131648210,0sleep10-21swapper/119:30:231
2128878210,0sleep20-21swapper/219:25:162
2127015210,0sleep20-21swapper/219:20:162
2125897210,0sleep10-21swapper/119:15:311
2125877210,0sleep20-21swapper/219:15:232
2123217210,0sleep20-21swapper/219:10:192
2123063210,0sleep10-21swapper/119:10:181
2244042200,0sleep10-21swapper/100:10:011
2227257200,0sleep20-21swapper/223:30:032
2214447200,0sleep20-21swapper/223:00:012
2180961200,0sleep20-21swapper/221:40:042
2180960200,0sleep10-21swapper/121:40:031
2170968200,0sleep20-21swapper/221:15:042
2165109200,0sleep20-21swapper/221:00:022
2151423200,0sleep20-21swapper/220:25:032
2147575200,0sleep10-21swapper/120:15:021
2145667200,0sleep20-21swapper/220:10:032
2143754200,0sleep20-21swapper/220:05:022
2141640200,0sleep10-21swapper/120:00:011
2134182200,0sleep10-21swapper/119:40:041
2132247200,0sleep10-21swapper/119:35:031
2128421200,0sleep10-21swapper/119:25:031
2126510200,0sleep10-21swapper/119:20:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional