You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 02:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Mon Dec 01, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197301099140,12cyclictest0-21swapper/319:40:133
1973010991312,0cyclictest0-21swapper/321:40:013
1973010991310,2cyclictest0-21swapper/323:25:133
197301099130,12cyclictest0-21swapper/323:50:133
197301099130,12cyclictest0-21swapper/322:15:143
197301099130,12cyclictest0-21swapper/321:45:133
1973010991211,0cyclictest0-21swapper/322:00:133
1973010991210,1cyclictest0-21swapper/300:20:113
197301099120,11cyclictest0-21swapper/323:40:183
197301099120,11cyclictest0-21swapper/323:10:203
197301099120,11cyclictest0-21swapper/323:05:153
197301099120,11cyclictest0-21swapper/320:10:153
197301099112,8cyclictest69450irq/121-eno121:13:253
1973010991111,0cyclictest0-21swapper/322:50:153
1973010991111,0cyclictest0-21swapper/322:25:023
1973010991110,0cyclictest0-21swapper/300:35:243
197301099110,11cyclictest0-21swapper/323:20:123
197301099110,10cyclictest69450irq/121-eno123:55:213
197301099110,10cyclictest69450irq/121-eno100:25:413
197301099110,10cyclictest0-21swapper/322:40:203
197301099110,10cyclictest0-21swapper/319:30:003
197301099110,0cyclictest0-21swapper/321:55:153
197301099110,0cyclictest0-21swapper/321:50:133
197301099110,0cyclictest0-21swapper/321:50:133
197301099110,0cyclictest0-21swapper/320:45:133
197301099110,0cyclictest0-21swapper/319:55:113
197301099109,0cyclictest0-21swapper/323:45:133
197301099109,0cyclictest0-21swapper/320:55:143
197301099101,8cyclictest69450irq/121-eno122:05:173
1973010991010,0cyclictest69450irq/121-eno122:55:133
1973010991010,0cyclictest69450irq/121-eno122:35:203
1973010991010,0cyclictest69450irq/121-eno100:15:123
1973010991010,0cyclictest0-21swapper/322:30:023
1973010991010,0cyclictest0-21swapper/320:40:143
1973010991010,0cyclictest0-21swapper/320:30:133
1973010991010,0cyclictest0-21swapper/319:15:013
197301099100,9cyclictest69450irq/121-eno122:27:533
197301099100,9cyclictest69450irq/121-eno121:25:003
197301099100,9cyclictest69450irq/121-eno121:06:333
197301099100,9cyclictest69450irq/121-eno120:20:133
197301099100,9cyclictest69450irq/121-eno119:38:413
197301099100,9cyclictest0-21swapper/321:20:193
197301099100,0cyclictest0-21swapper/319:15:193
19730109999,0cyclictest69450irq/121-eno121:15:203
19730109999,0cyclictest69450irq/121-eno120:15:143
19730109999,0cyclictest0-21swapper/320:25:203
19730109999,0cyclictest0-21swapper/319:30:193
19730109999,0cyclictest0-21swapper/300:30:143
19730109998,0cyclictest69450irq/121-eno100:00:353
19730109990,8cyclictest69450irq/121-eno123:37:483
19730109990,8cyclictest69450irq/121-eno122:12:413
19730109990,8cyclictest69450irq/121-eno119:45:123
19730109990,8cyclictest69450irq/121-eno100:08:523
19730109990,8cyclictest0-21swapper/321:33:223
19730109990,0cyclictest0-21swapper/320:54:563
19730109988,0cyclictest69450irq/121-eno123:00:213
19730109988,0cyclictest69450irq/121-eno122:45:163
19730109988,0cyclictest69450irq/121-eno120:09:593
19730109988,0cyclictest0-21swapper/321:00:113
19730109980,7cyclictest69450irq/121-eno100:14:363
19730109977,0cyclictest69450irq/121-eno121:40:133
19730109977,0cyclictest69450irq/121-eno119:50:093
19730109977,0cyclictest0-21swapper/323:30:133
19730109960,5cyclictest0-21swapper/323:15:203
19730109960,5cyclictest0-21swapper/319:20:213
2053671250,3sleep22053697-21apt-get22:30:132
19730109955,0cyclictest0-21swapper/320:35:233
19730109954,0cyclictest0-21swapper/320:00:313
1972369251,2sleep30-21swapper/319:05:223
2007992242,2sleep2754-21snmpd20:37:462
1998827240,1sleep21998853-21apt-get20:15:132
1972849242,1sleep10-21swapper/119:09:481
1970955241,1sleep20-21swapper/219:05:012
2105021230,1sleep00-21swapper/000:35:150
2085351230,1sleep10-21swapper/123:45:131
2083695230,1sleep02083777-21irqstats23:40:150
2079061230,1sleep10-21swapper/123:30:121
2076968230,1sleep20-21swapper/223:25:132
2045825230,2sleep02045997-21python322:10:180
2036393230,1sleep02036419-21apt-get21:50:130
2036393230,1sleep02036419-21apt-get21:50:120
2028233230,1sleep22028259-21apt-get21:30:142
2002831230,2sleep00-21swapper/020:25:160
1977210230,1sleep11977228-21apt-get19:20:011
1971949231,1sleep00-21swapper/019:05:180
2101708220,1sleep12101854-21wc00:25:201
2096795220,1sleep12097061-21df_inode00:15:111
2094693220,1sleep12094961-21df00:10:111
2087010220,0sleep20-21swapper/223:48:312
2070816220,1sleep22071107-21df23:10:152
2066241220,0sleep02066267-21apt-get23:00:120
2059960220,0sleep12059988-21apt-get22:45:131
2059224220,1sleep00-21swapper/022:40:480
2052983220,0sleep00-21swapper/022:28:310
2049907220,1sleep20-21swapper/222:20:172
2042424220,0sleep10-21swapper/122:02:431
2020827220,1sleep12019935-21/usr/sbin/munin21:10:201
2020059220,1sleep00-21swapper/021:10:150
2005206220,1sleep22005356-21ntp_states20:30:182
2004964220,1sleep02005043-21grep20:30:160
1989861220,1sleep21990011-21ntp_states19:50:202
1987793220,1sleep21987946-21memory19:45:152
1977081222,0sleep1351ktimers/119:18:201
1975649220,1sleep01975947-21cat19:15:140
2105050210,0sleep10-21swapper/100:35:171
2104763210,0sleep20-21swapper/200:35:022
2104695210,1sleep00-21swapper/000:34:280
2104639210,0sleep20-21swapper/200:34:002
2102208210,0sleep00-21swapper/000:25:550
2101292210,0sleep20-21swapper/200:25:172
2100165210,0sleep20-21swapper/200:21:212
2098749210,0sleep10-21swapper/100:20:111
2098256210,0sleep20-21swapper/200:18:082
2096212210,0sleep00-21swapper/000:13:340
2094528210,0sleep20-21swapper/200:10:042
2094220210,0sleep20-21swapper/200:09:232
2093936210,0sleep10-21swapper/100:06:541
2092951210,0sleep10-21swapper/100:00:221
2092405210,0sleep20-21swapper/200:00:192
2091657210,0sleep00-21swapper/000:00:130
2089682210,0sleep20-21swapper/223:55:152
2089528210,0sleep00-21swapper/023:55:130
2089515210,0sleep10-21swapper/123:55:061
2089181210,0sleep20-21swapper/223:54:142
2088481210,0sleep10-21swapper/123:50:211
2087724210,0sleep00-21swapper/023:50:170
2086895210,1sleep00-21swapper/023:47:290
2083302210,0sleep20-21swapper/223:40:142
2083262210,0sleep10-21swapper/123:40:131
2082571210,0sleep00-21swapper/023:36:240
2081308210,0sleep10-21swapper/123:35:171
2080897210,0sleep20-21swapper/223:35:012
2079966210,0sleep00-21swapper/023:30:190
2079679210,0sleep20-21swapper/223:30:172
2078399210,0sleep10-21swapper/123:26:271
2077096210,0sleep00-21swapper/023:25:140
2075260210,0sleep10-21swapper/123:20:161
2074880210,0sleep20-21swapper/223:20:132
2074873210,0sleep00-21swapper/023:20:070
2074076210,1sleep22074078-21ssh23:15:242
2073504210,0sleep10-21swapper/123:15:191
2072794210,0sleep00-21swapper/023:15:140
2072288210,0sleep10-21swapper/123:13:021
2070682210,0sleep00-21swapper/023:10:140
2069662210,0sleep20-21swapper/223:05:362
2069221210,0sleep00-21swapper/023:05:220
2068332210,0sleep10-21swapper/123:05:151
2067928210,0sleep10-21swapper/123:03:431
2066332210,0sleep20-21swapper/223:00:152
2064226210,0sleep20-21swapper/222:55:142
2064132210,0sleep10-21swapper/122:55:141
2063880210,0sleep00-21swapper/022:55:010
2063756210,0sleep10-21swapper/122:53:581
2062048210,0sleep22062074-21apt-get22:50:152
2061792210,0sleep00-21swapper/022:50:010
2060249210,0sleep00-21swapper/022:45:160
2059947210,0sleep20-21swapper/222:45:072
2058485210,0sleep20-21swapper/222:40:182
2058319210,0sleep10-21swapper/122:40:171
2057234210,0sleep10-21swapper/122:36:531
2056699210,0sleep20-21swapper/222:35:222
2055741210,0sleep00-21swapper/022:35:040
2055168210,1sleep00-21swapper/022:32:030
2054093210,0sleep10-21swapper/122:30:161
2052672210,0sleep10-21swapper/122:25:481
2050884210,0sleep00-21swapper/022:23:270
2049227210,0sleep10-21swapper/122:20:121
2048887210,0sleep10-21swapper/122:19:271
2047056210,0sleep00-21swapper/022:15:030
2046343210,0sleep10-21swapper/122:10:271
2045543210,0sleep20-21swapper/222:10:162
2044674210,0sleep20-21swapper/222:09:082
2044081210,0sleep00-21swapper/022:05:210
2043016210,0sleep12043170-21cpu22:05:151
2042294210,0sleep20-21swapper/222:01:352
2040316210,0sleep00-21swapper/022:00:020
2039535210,0sleep20-21swapper/221:55:232
2038910210,0sleep10-21swapper/121:55:181
2038620210,0sleep00-21swapper/021:55:170
2037926210,0sleep10-21swapper/121:52:221
2037926210,0sleep10-21swapper/121:52:211
2037184210,0sleep20-21swapper/221:50:192
2037184210,0sleep20-21swapper/221:50:182
2035827210,0sleep00-21swapper/021:47:170
2034838210,0sleep10-21swapper/121:45:181
2034396210,1sleep20-21swapper/221:45:152
2033831210,0sleep10-21swapper/121:43:051
2033709210,0sleep00-21swapper/021:42:010
2032075210,0sleep20-21swapper/221:40:012
2031947210,0sleep00-21swapper/021:39:560
2031930210,0sleep10-21swapper/121:39:491
2031637210,0sleep20-21swapper/221:36:382
2029168210,0sleep10-21swapper/121:30:201
2029011210,0sleep00-21swapper/021:30:190
2027193210,0sleep10-21swapper/121:25:201
2026414210,0sleep00-21swapper/021:25:150
2025713210,0sleep20-21swapper/221:25:002
2024555210,0sleep10-21swapper/121:20:161
2024389210,0sleep00-21swapper/021:20:150
2024035210,0sleep20-21swapper/221:20:132
2023240210,0sleep10-21swapper/121:15:311
2021957210,0sleep00-21swapper/021:15:140
2020380210,0sleep20-21swapper/221:10:172
2018464210,0sleep00-21swapper/021:05:180
2018092210,0sleep20-21swapper/221:05:162
2017641210,0sleep00-21swapper/021:03:220
2016956210,0sleep10-21swapper/121:00:181
2015141210,0sleep00-21swapper/020:55:220
2014174210,0sleep10-21swapper/120:55:151
2012978210,0sleep20-21swapper/220:50:192
2012261210,0sleep10-21swapper/120:50:131
2011093210,0sleep20-21swapper/220:45:192
2010127210,0sleep10-21swapper/120:45:021
2009811210,0sleep10-21swapper/120:41:221
2008855210,0sleep00-21swapper/020:40:170
2008446210,0sleep20-21swapper/220:40:152
2006789210,0sleep10-21swapper/120:35:161
2006576210,0sleep00-21swapper/020:35:150
2004339210,0sleep10-21swapper/120:30:011
2003841210,0sleep20-21swapper/220:25:222
2003638210,0sleep10-21swapper/120:25:211
2001197210,0sleep20-21swapper/220:20:162
2000949210,0sleep10-21swapper/120:20:151
2000794210,0sleep00-21swapper/020:20:150
1999794210,0sleep10-21swapper/120:15:201
1999622210,0sleep0328-21plymouthd20:15:190
1996946210,0sleep10-21swapper/120:10:151
1996917210,0sleep00-21swapper/020:10:140
1996664210,0sleep20-21swapper/220:10:012
1995446210,0sleep10-21swapper/120:05:161
1995367210,0sleep00-21swapper/020:05:150
1993532210,0sleep20-21swapper/220:00:162
1993179210,0sleep00-21swapper/020:00:140
1992544210,0sleep10-21swapper/119:56:301
1992543210,0sleep00-21swapper/019:56:290
1988995210,0sleep00-21swapper/019:50:020
1988102210,0sleep00-21swapper/019:45:160
1985970210,0sleep10-21swapper/119:40:181
1985480210,0sleep20-21swapper/219:40:142
1984195210,0sleep10-21swapper/119:35:181
1983485210,0sleep00-21swapper/019:35:130
1983233210,0sleep01983350-21latency_hist19:35:000
1981570210,0sleep10-21swapper/119:30:121
1979056210,0sleep20-21swapper/219:20:342
1977747210,0sleep00-21swapper/019:20:160
1974858210,0sleep20-21swapper/219:15:002
1974832210,0sleep10-21swapper/119:15:001
1974137210,0sleep20-21swapper/219:10:212
1973881210,0sleep00-21swapper/019:10:190
2102910200,0sleep10-21swapper/100:30:031
2098730200,0sleep00-21swapper/000:20:020
2096617200,0sleep00-21swapper/000:15:020
2093495200,0sleep00-21swapper/000:05:010
2051303200,0sleep20-21swapper/222:25:052
2047100200,0sleep20-21swapper/222:15:042
2021912200,0sleep20-21swapper/221:15:042
2018006200,0sleep10-21swapper/121:05:031
2016094200,0sleep20-21swapper/221:00:032
2014160200,0sleep20-21swapper/220:55:042
2012014200,0sleep00-21swapper/020:50:000
2010339200,0sleep00-21swapper/020:45:050
1996902200,0sleep20-21swapper/220:10:052
1993074200,0sleep10-21swapper/120:00:031
1991142200,0sleep20-21swapper/219:55:032
1989228200,0sleep10-21swapper/119:50:031
1987316200,0sleep10-21swapper/119:45:021
1985148200,0sleep00-21swapper/019:40:010
1983470200,0sleep20-21swapper/219:35:032
1981553200,0sleep20-21swapper/219:30:022
1979642200,0sleep00-21swapper/019:25:040
1979639200,0sleep20-21swapper/219:25:022
1979406200,0sleep10-21swapper/119:25:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional