You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-22 - 11:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Thu May 22, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
218018199130,11cyclictest0-21swapper/322:45:143
218018199130,11cyclictest0-21swapper/321:50:123
218018199130,11cyclictest0-21swapper/319:30:123
2180181991210,1cyclictest0-21swapper/321:15:143
2180181991210,1cyclictest0-21swapper/320:45:123
2180181991210,1cyclictest0-21swapper/300:00:153
218018199120,1cyclictest0-21swapper/323:05:153
218018199120,11cyclictest0-21swapper/321:25:133
218018199120,11cyclictest0-21swapper/321:20:133
218018199120,11cyclictest0-21swapper/320:25:003
218018199120,0cyclictest0-21swapper/319:10:123
2180181991111,0cyclictest0-21swapper/323:30:163
2180181991111,0cyclictest0-21swapper/321:35:023
218018199110,9cyclictest0-21swapper/320:40:153
218018199110,10cyclictest0-21swapper/322:15:003
218018199110,10cyclictest0-21swapper/321:45:143
218018199110,10cyclictest0-21swapper/321:45:013
218018199110,10cyclictest0-21swapper/319:50:213
218018199110,0cyclictest0-21swapper/322:50:183
218018199110,0cyclictest0-21swapper/322:25:023
218018199110,0cyclictest0-21swapper/300:25:223
218018199109,0cyclictest0-21swapper/323:10:163
2180181991010,0cyclictest0-21swapper/323:35:193
2180181991010,0cyclictest0-21swapper/322:05:153
2180181991010,0cyclictest0-21swapper/321:00:133
2180181991010,0cyclictest0-21swapper/319:40:013
2180181991010,0cyclictest0-21swapper/319:25:103
2180181991010,0cyclictest0-21swapper/300:30:233
218018199100,10cyclictest0-21swapper/320:35:173
218018199100,0cyclictest0-21swapper/320:00:223
218018199100,0cyclictest0-21swapper/319:19:593
218018199100,0cyclictest0-21swapper/300:05:223
21801819999,0cyclictest0-21swapper/323:55:013
21801819999,0cyclictest0-21swapper/323:55:003
21801819999,0cyclictest0-21swapper/323:20:013
21801819999,0cyclictest0-21swapper/320:50:203
21801819999,0cyclictest0-21swapper/320:25:133
21801819999,0cyclictest0-21swapper/320:12:163
21801819999,0cyclictest0-21swapper/300:11:293
21801819998,0cyclictest0-21swapper/322:35:143
21801819998,0cyclictest0-21swapper/319:20:123
21801819990,9cyclictest0-21swapper/323:20:023
21801819990,8cyclictest0-21swapper/323:44:563
21801819990,8cyclictest0-21swapper/320:30:123
21801819990,8cyclictest0-21swapper/320:15:173
21801819990,8cyclictest0-21swapper/300:15:133
21801819987,0cyclictest0-21swapper/320:05:133
21801819980,7cyclictest0-21swapper/319:55:173
21801819980,0cyclictest0-21swapper/323:00:193
21801819980,0cyclictest0-21swapper/321:00:013
21801819980,0cyclictest0-21swapper/300:35:163
2179510281,5sleep30-21swapper/319:06:183
21801819977,0cyclictest0-21swapper/323:45:363
21801819977,0cyclictest0-21swapper/323:25:123
21801819977,0cyclictest0-21swapper/321:55:163
21801819976,0cyclictest0-21swapper/322:00:143
21801819975,1cyclictest0-21swapper/321:30:133
21801819970,6cyclictest0-21swapper/322:25:203
21801819970,6cyclictest0-21swapper/319:41:163
21801819965,0cyclictest0-21swapper/319:47:253
21801819960,1cyclictest0-21swapper/321:05:163
21801819960,0cyclictest0-21swapper/322:45:023
21801819960,0cyclictest0-21swapper/321:10:203
21801819955,0cyclictest0-21swapper/322:15:153
21801819954,0cyclictest0-21swapper/322:30:173
21801819950,4cyclictest0-21swapper/322:55:173
21801819950,3cyclictest0-21swapper/300:20:203
13989850,2rtkit-daemon2196479-21apt-get19:50:151
13989850,0rtkit-daemon0-21swapper/121:52:471
13989850,0rtkit-daemon0-21swapper/100:10:261
2241436240,0sleep20-21swapper/221:43:352
2241198240,3sleep10-21swapper/121:41:301
2235670240,3sleep22235872-21ntpq21:30:172
2184328243,1sleep02182187-21kworker/0:3+events19:18:440
2179509242,1sleep20-21swapper/219:06:162
2178273241,1sleep00-21swapper/019:05:140
13989840,2rtkit-daemon684-21gmain21:35:201
13989840,2rtkit-daemon614-21wpa_supplicant22:29:231
13989840,2rtkit-daemon2283997-21apt-get23:25:121
13989840,2rtkit-daemon2249991-21munin-run22:05:001
13989840,2rtkit-daemon1-21systemd00:07:361
13989840,2rtkit-daemon0-21swapper/119:05:101
13989840,1rtkit-daemon2182220-21munin-node21:45:181
2314959230,2sleep02315157-21ssh00:35:240
2292399230,1sleep12292425-21apt-get23:45:131
2251607230,2sleep10-21swapper/122:06:031
2206463231,1sleep20-21swapper/220:15:132
2198358230,1sleep22198384-21apt-get19:55:112
13989830,2rtkit-daemon760-21snmpd00:31:251
13989830,2rtkit-daemon2165118-21munin-node19:12:331
13989830,2rtkit-daemon1399-21sendmail-mta19:17:521
13989830,2rtkit-daemon1-21systemd21:11:331
13989830,1rtkit-daemon765-21lldpd23:17:511
13989830,1rtkit-daemon762-21ntpd23:11:261
13989830,1rtkit-daemon762-21ntpd22:24:241
13989830,1rtkit-daemon762-21ntpd00:20:271
13989830,1rtkit-daemon684-21gmain00:04:121
13989830,1rtkit-daemon331-21plymouthd23:30:331
13989830,1rtkit-daemon2182220-21munin-node22:37:041
13989830,1rtkit-daemon1399-21sendmail-mta23:01:281
13989830,1rtkit-daemon1-21systemd23:50:511
13989830,1rtkit-daemon1-21systemd23:40:151
13989830,1rtkit-daemon1-21systemd23:06:051
13989830,1rtkit-daemon1-21systemd22:44:001
13989830,1rtkit-daemon1-21systemd22:32:081
13989830,1rtkit-daemon1-21systemd22:19:041
13989830,1rtkit-daemon1-21systemd22:12:561
13989830,1rtkit-daemon1-21systemd20:50:281
13989830,1rtkit-daemon1-21systemd20:32:231
13989830,1rtkit-daemon0-21swapper/119:35:151
13989830,0rtkit-daemon609-21rsyslogd21:00:241
13989830,0rtkit-daemon331-21plymouthd21:30:371
13989830,0rtkit-daemon0-21swapper/123:36:481
13989830,0rtkit-daemon0-21swapper/121:21:441
2314628220,1sleep22314783-21cut00:35:222
2313141220,0sleep20-21swapper/200:33:222
2310857220,1sleep00-21swapper/000:26:350
2309157220,1sleep20-21swapper/200:25:012
2303314220,1sleep22303560-21diskstats00:10:152
2289806220,0sleep00-21swapper/023:37:590
2285411220,1sleep00-21swapper/023:26:030
2268700220,0sleep00-21swapper/022:49:090
2262245220,1sleep00-21swapper/022:32:350
2255757220,0sleep00-21swapper/022:15:500
2247347220,0sleep00-21swapper/021:55:300
2242833220,1sleep20-21swapper/221:45:222
2195910220,0sleep00-21swapper/019:46:170
2194536220,0sleep22194562-21apt-get19:45:112
2193246220,1sleep02193402-21ntp_states19:40:170
2184850220,1sleep22185121-21df_inode19:20:142
13989820,1rtkit-daemon765-21lldpd21:25:041
13989820,1rtkit-daemon765-21lldpd21:06:021
13989820,1rtkit-daemon762-21ntpd19:31:011
13989820,1rtkit-daemon760-21snmpd22:55:181
13989820,1rtkit-daemon760-21snmpd20:35:441
13989820,1rtkit-daemon760-21snmpd19:47:171
13989820,1rtkit-daemon6926-21packagekitd19:41:431
13989820,1rtkit-daemon614-21wpa_supplicant22:50:141
13989820,1rtkit-daemon613-21systemd-logind20:06:511
13989820,1rtkit-daemon331-21plymouthd00:25:231
13989820,1rtkit-daemon2216006-21cstates20:40:151
13989820,1rtkit-daemon1-21systemd22:45:161
13989820,1rtkit-daemon1-21systemd20:55:141
13989820,0rtkit-daemon331-21plymouthd21:17:521
13989820,0rtkit-daemon331-21plymouthd20:20:021
13989820,0rtkit-daemon331-21plymouthd20:10:091
13989820,0rtkit-daemon331-21plymouthd20:00:031
13989820,0rtkit-daemon2246547-21irqstats21:55:171
13989820,0rtkit-daemon0-21swapper/123:55:191
13989820,0rtkit-daemon0-21swapper/123:20:271
13989820,0rtkit-daemon0-21swapper/120:45:181
13989820,0rtkit-daemon0-21swapper/120:25:091
13989820,0rtkit-daemon0-21swapper/120:15:141
13989820,0rtkit-daemon0-21swapper/119:55:171
13989820,0rtkit-daemon0-21swapper/119:25:111
13989820,0rtkit-daemon0-21swapper/119:20:191
13989820,0rtkit-daemon0-21swapper/100:35:181
13989820,0rtkit-daemon0-21swapper/100:15:111
2313220210,1sleep00-21swapper/000:34:030
2309568210,0sleep20-21swapper/200:25:162
2308692210,0sleep00-21swapper/000:20:550
2306683210,0sleep00-21swapper/000:16:500
2305210210,0sleep20-21swapper/200:15:132
2303645210,0sleep00-21swapper/000:10:180
2301072210,0sleep20-21swapper/200:05:162
2300792210,0sleep00-21swapper/000:05:020
2298681210,0sleep00-21swapper/000:00:010
2298164210,0sleep20-21swapper/223:55:352
2296318210,0sleep00-21swapper/023:55:010
2296094210,0sleep00-21swapper/023:53:000
2295976210,0sleep20-21swapper/223:51:592
2293020210,0sleep20-21swapper/223:45:182
2292775210,0sleep00-21swapper/023:45:160
2291172210,0sleep00-21swapper/023:40:200
2290324210,0sleep20-21swapper/223:40:142
2288648210,0sleep20-21swapper/223:35:182
2286541210,0sleep00-21swapper/023:30:200
2285862210,0sleep20-21swapper/223:30:012
2285518210,0sleep20-21swapper/223:27:022
2281872210,0sleep20-21swapper/223:20:042
2281869210,0sleep00-21swapper/023:20:020
2280451210,0sleep20-21swapper/223:15:212
2279287210,0sleep00-21swapper/023:15:030
2278325210,0sleep00-21swapper/023:10:220
2278045210,0sleep20-21swapper/223:10:202
2276892210,1sleep02276894-21ssh23:07:330
2275342210,0sleep20-21swapper/223:05:152
2274574210,0sleep20-21swapper/223:00:322
2272976210,0sleep00-21swapper/023:00:010
2270404210,0sleep00-21swapper/022:50:450
2269049210,0sleep20-21swapper/222:50:102
2268417210,0sleep20-21swapper/222:46:392
2264887210,0sleep20-21swapper/222:40:142
2262755210,1sleep00-21swapper/022:35:040
2260430210,0sleep20-21swapper/222:30:022
2260258210,0sleep00-21swapper/022:28:310
2259953210,0sleep20-21swapper/222:25:492
2257860210,1sleep00-21swapper/022:20:470
2256635210,0sleep20-21swapper/222:20:172
2255787210,0sleep20-21swapper/222:16:092
2253903210,0sleep20-21swapper/222:12:562
2251727210,0sleep20-21swapper/222:07:082
2251720210,0sleep00-21swapper/022:07:020
2248569210,0sleep02248648-21if_err_eno122:00:170
2248262210,0sleep20-21swapper/222:00:152
2246825210,0sleep20-21swapper/221:55:192
2245372210,1sleep00-21swapper/021:51:290
2243937210,0sleep20-21swapper/221:50:112
2241898210,0sleep00-21swapper/021:45:160
2239765210,0sleep00-21swapper/021:40:130
2238745210,0sleep00-21swapper/021:35:270
2238080210,0sleep20-21swapper/221:35:182
2235946210,0sleep00-21swapper/021:30:200
2233532210,1sleep00-21swapper/021:25:160
2233167210,0sleep20-21swapper/221:25:142
2231928210,0sleep00-21swapper/021:20:180
2231158210,0sleep20-21swapper/221:20:122
2229297210,0sleep20-21swapper/221:15:162
2229125210,0sleep00-21swapper/021:15:030
2228561210,0sleep20-21swapper/221:11:412
2227125210,0sleep00-21swapper/021:10:150
2225737210,0sleep20-21swapper/221:05:202
2225443210,0sleep00-21swapper/021:05:180
2222041210,0sleep00-21swapper/020:55:170
2220753210,0sleep20-21swapper/220:50:232
2219030210,0sleep20-21swapper/220:47:472
2217567210,0sleep00-21swapper/020:45:130
2216483210,0sleep00-21swapper/020:40:200
2215359210,0sleep02215459-21wc20:40:010
2211782210,0sleep02211808-21apt-get20:30:120
2209898210,0sleep20-21swapper/220:25:132
2209548210,0sleep00-21swapper/020:24:040
2206776210,0sleep00-21swapper/020:15:140
2205561210,1sleep00-21swapper/020:12:140
2204302210,0sleep20-21swapper/220:10:162
2203573210,0sleep20-21swapper/220:06:172
2202337210,0sleep00-21swapper/020:05:150
2201896210,0sleep20-21swapper/220:04:172
2201636210,0sleep00-21swapper/020:00:540
2198524210,0sleep00-21swapper/019:55:140
2197916210,0sleep00-21swapper/019:52:300
2197070210,0sleep20-21swapper/219:50:202
2192616210,0sleep20-21swapper/219:40:032
2191494210,0sleep00-21swapper/019:35:210
2190696210,0sleep20-21swapper/219:35:152
2188271210,0sleep00-21swapper/019:30:000
2187281210,0sleep20-21swapper/219:25:142
2187027210,0sleep00-21swapper/019:25:120
2184697210,0sleep00-21swapper/019:20:110
2182761210,0sleep20-21swapper/219:15:132
2180863210,0sleep00-21swapper/019:10:160
2180046210,0sleep20-21swapper/219:10:022
2298940200,0sleep20-21swapper/200:00:032
2273240200,0sleep00-21swapper/023:00:060
2271122200,0sleep20-21swapper/222:55:032
2264871200,0sleep00-21swapper/022:40:040
2262521200,0sleep20-21swapper/222:35:022
2252291200,0sleep00-21swapper/022:10:030
2223282200,0sleep20-21swapper/221:00:042
2223280200,0sleep00-21swapper/021:00:020
2221348200,0sleep20-21swapper/220:55:042
2219204200,0sleep00-21swapper/020:50:010
2215615200,0sleep20-21swapper/220:40:032
2213681200,0sleep20-21swapper/220:35:022
2211769200,0sleep20-21swapper/220:30:022
2209859200,0sleep00-21swapper/020:25:030
2207727200,0sleep20-21swapper/220:20:022
2188769200,0sleep20-21swapper/219:30:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional