You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 02:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Sun Nov 30, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
196949499140,12cyclictest0-21swapper/323:55:133
196949499138,0cyclictest0-21swapper/320:05:013
196949499130,12cyclictest0-21swapper/321:50:133
196949499130,12cyclictest0-21swapper/300:00:163
196949499130,11cyclictest0-21swapper/322:20:133
1969494991211,1cyclictest69450irq/121-eno100:30:183
1969494991211,1cyclictest0-21swapper/322:15:163
1969494991211,1cyclictest0-21swapper/300:10:133
196949499120,1cyclictest0-21swapper/300:05:133
196949499120,11cyclictest69450irq/121-eno123:37:073
196949499120,11cyclictest69450irq/121-eno121:58:313
196949499120,11cyclictest0-21swapper/319:15:023
1969494991111,0cyclictest69450irq/121-eno122:05:213
1969494991111,0cyclictest0-21swapper/322:30:123
1969494991111,0cyclictest0-21swapper/319:15:013
1969494991111,0cyclictest0-21swapper/319:15:013
1969494991110,1cyclictest69450irq/121-eno119:50:133
1969494991110,0cyclictest0-21swapper/322:45:143
1969494991110,0cyclictest0-21swapper/322:25:123
1969494991110,0cyclictest0-21swapper/320:15:133
196949499110,11cyclictest0-21swapper/300:20:203
196949499110,10cyclictest0-21swapper/321:45:003
196949499110,10cyclictest0-21swapper/321:30:123
196949499110,10cyclictest0-21swapper/300:35:133
196949499110,0cyclictest0-21swapper/322:00:163
196949499110,0cyclictest0-21swapper/321:05:223
196949499109,0cyclictest0-21swapper/322:50:143
1969494991010,0cyclictest69450irq/121-eno123:41:263
1969494991010,0cyclictest69450irq/121-eno123:05:143
1969494991010,0cyclictest69450irq/121-eno122:55:213
1969494991010,0cyclictest69450irq/121-eno121:15:153
1969494991010,0cyclictest0-21swapper/323:30:133
1969494991010,0cyclictest0-21swapper/322:35:123
1969494991010,0cyclictest0-21swapper/321:10:213
1969494991010,0cyclictest0-21swapper/320:40:163
196949499100,9cyclictest69450irq/121-eno123:50:533
196949499100,9cyclictest69450irq/121-eno120:10:213
196949499100,9cyclictest69450irq/121-eno119:55:133
196949499100,9cyclictest0-21swapper/323:15:193
196949499100,9cyclictest0-21swapper/320:25:193
196949499100,9cyclictest0-21swapper/319:30:223
19694949999,0cyclictest69450irq/121-eno123:00:153
19694949999,0cyclictest0-21swapper/323:25:023
19694949999,0cyclictest0-21swapper/322:40:203
19694949999,0cyclictest0-21swapper/322:10:123
19694949999,0cyclictest0-21swapper/321:45:203
19694949998,0cyclictest0-21swapper/323:25:143
19694949990,8cyclictest69450irq/121-eno120:20:163
19694949988,0cyclictest69450irq/121-eno123:45:183
19694949988,0cyclictest69450irq/121-eno119:45:183
19694949988,0cyclictest69450irq/121-eno100:25:163
19694949988,0cyclictest0-21swapper/321:20:203
19694949988,0cyclictest0-21swapper/320:50:123
19694949988,0cyclictest0-21swapper/320:50:003
19694949988,0cyclictest0-21swapper/319:20:183
19694949986,2cyclictest69450irq/121-eno119:25:123
19694949980,7cyclictest69450irq/121-eno123:12:443
1969149281,4sleep30-21swapper/319:07:293
19694949977,0cyclictest69450irq/121-eno121:25:133
19694949977,0cyclictest69450irq/121-eno119:40:143
19694949970,6cyclictest69450irq/121-eno119:35:143
19694949960,5cyclictest69450irq/121-eno120:30:143
2062909252,2sleep02062984-21cat23:00:170
2047806250,3sleep12047832-21apt-get22:25:121
19694949955,0cyclictest69450irq/121-eno120:55:173
19694949955,0cyclictest69450irq/121-eno120:00:183
19694949954,0cyclictest0-21swapper/320:35:183
19694949953,1cyclictest0-21swapper/300:15:133
19694949951,3cyclictest69450irq/121-eno121:00:023
19694949950,4cyclictest69450irq/121-eno121:36:023
1969209250,1sleep10-21swapper/119:08:151
2009037240,2sleep02009064-21apt-get20:50:130
1967674242,1sleep20-21swapper/219:05:082
2105426230,1sleep12105450-21munin-run00:40:001
2065874230,2sleep22065876-21ssh23:05:232
2026979230,2sleep12027026-21basename21:35:131
1994034230,2sleep11994181-21ntpq20:10:191
1967684231,1sleep00-21swapper/019:05:140
2086498220,1sleep02086028-21/usr/sbin/munin23:55:160
2077924220,1sleep12078131-21ntpq23:35:171
2070208220,1sleep00-21swapper/023:16:420
2065215220,1sleep00-21swapper/023:05:170
2059077220,0sleep00-21swapper/022:50:200
2053816220,1sleep12053846-21perf22:40:011
2050747220,1sleep02050871-21python322:30:200
2046767220,1sleep02047018-21users22:20:220
2035240220,1sleep02035267-21apt-get21:55:130
2023827220,1sleep02022975-21/usr/sbin/munin21:25:200
2021945220,1sleep22022171-21unixbench_multi21:20:212
2019492220,1sleep12019607-21ps21:15:191
1997000220,1sleep11997014-21dump-pmu-power20:20:011
1983601220,1sleep20-21swapper/219:45:162
1981369220,0sleep00-21swapper/019:39:490
1980692220,1sleep11980949-21unixbench_multi19:35:221
1978672220,1sleep10-21swapper/119:30:211
1975890220,1sleep11975892-21/usr/sbin/munin19:25:121
1975528222,0sleep0171ktimers/019:23:320
1971314220,1sleep21971789-21df_inode19:15:012
1971314220,1sleep21971789-21df_inode19:15:012
2105349210,0sleep20-21swapper/200:39:212
2102843210,0sleep00-21swapper/000:30:360
2102286210,0sleep20-21swapper/200:30:222
2100483210,0sleep20-21swapper/200:25:282
2099957210,0sleep00-21swapper/000:25:220
2099172210,0sleep10-21swapper/100:25:151
2098244210,0sleep00-21swapper/000:21:300
2098194210,0sleep10-21swapper/100:21:031
2096969210,0sleep20-21swapper/200:20:162
2096206210,0sleep10-21swapper/100:19:281
2095120210,0sleep00-21swapper/000:15:180
2094864210,0sleep20-21swapper/200:15:172
2093457210,0sleep10-21swapper/100:10:221
2092999210,0sleep20-21swapper/200:10:192
2092091210,0sleep00-21swapper/000:10:010
2090699210,0sleep10-21swapper/100:05:181
2090495210,0sleep00-21swapper/000:05:180
2090315210,0sleep20-21swapper/200:05:152
2089533210,0sleep00-21swapper/000:00:570
2086651210,0sleep10-21swapper/123:55:171
2086157210,0sleep20-21swapper/223:55:142
2084880210,0sleep00-21swapper/023:50:210
2083925210,0sleep10-21swapper/123:50:061
2083549210,0sleep20-21swapper/223:50:022
2083425210,0sleep10-21swapper/123:50:011
2082952210,0sleep00-21swapper/023:45:520
2081593210,0sleep20-21swapper/223:45:142
2080648210,0sleep10-21swapper/123:40:241
2079603210,0sleep20-21swapper/223:40:172
2079510210,0sleep00-21swapper/023:40:150
2078376210,0sleep0328-21plymouthd23:35:190
2077466210,0sleep20-21swapper/223:35:142
2076642210,0sleep20-21swapper/223:30:412
2076546210,0sleep10-21swapper/123:30:201
2075297210,0sleep02075323-21apt-get23:30:110
2073742210,0sleep20-21swapper/223:25:202
2073659210,0sleep10-21swapper/123:25:201
2073216210,0sleep00-21swapper/023:25:150
2071709210,0sleep10-21swapper/123:20:191
2071304210,0sleep20-21swapper/223:20:172
2070957210,0sleep00-21swapper/023:20:140
2069129210,0sleep20-21swapper/223:15:162
2068875210,0sleep10-21swapper/123:15:151
2067371210,0sleep00-21swapper/023:10:180
2067088210,0sleep20-21swapper/223:10:162
2066814210,0sleep10-21swapper/123:10:151
2065351210,0sleep10-21swapper/123:05:181
2063161210,0sleep20-21swapper/223:00:192
2061806210,0sleep00-21swapper/022:56:330
2060607210,0sleep10-21swapper/122:55:191
2060369210,0sleep20-21swapper/222:55:162
2059701210,0sleep10-21swapper/122:51:251
2058797210,0sleep22058989-21strings22:50:182
2057612210,0sleep20-21swapper/222:46:262
2056612210,0sleep10-21swapper/122:45:171
2056332210,0sleep00-21swapper/022:45:170
2054744210,0sleep20-21swapper/222:40:192
2054516210,0sleep00-21swapper/022:40:160
2054092210,0sleep10-21swapper/122:40:131
2052978210,0sleep00-21swapper/022:35:230
2051734210,0sleep20-21swapper/222:35:012
2051207210,0sleep20-21swapper/222:30:262
2049895210,0sleep10-21swapper/122:30:131
2049164210,0sleep20-21swapper/222:25:492
2048664210,0sleep00-21swapper/022:25:190
2047462210,0sleep20-21swapper/222:24:132
2045952210,0sleep10-21swapper/122:20:151
2045109210,0sleep00-21swapper/022:17:020
2044349210,0sleep20-21swapper/222:15:212
2043615210,0sleep10-21swapper/122:15:161
2041783210,0sleep10-21swapper/122:10:151
2039438210,0sleep10-21swapper/122:05:141
2039436210,0sleep00-21swapper/022:05:140
2037779210,0sleep10-21swapper/122:00:181
2037539210,0sleep00-21swapper/022:00:170
2037336210,0sleep20-21swapper/222:00:082
2036002210,0sleep20-21swapper/221:55:192
2035857210,0sleep10-21swapper/121:55:181
2034609210,0sleep00-21swapper/021:51:410
2033870210,0sleep20-21swapper/221:50:192
2033155210,0sleep10-21swapper/121:50:141
2032477210,0sleep10-21swapper/121:46:171
2032464210,0sleep20-21swapper/221:46:102
2031927210,0sleep00-21swapper/021:45:200
2029154210,0sleep00-21swapper/021:40:160
2027627210,0sleep20-21swapper/221:35:182
2027403210,0sleep00-21swapper/021:35:160
2025719210,0sleep20-21swapper/221:30:172
2025426210,0sleep00-21swapper/021:30:150
2024988210,0sleep12025047-21aten2.4-expect21:30:121
2024595210,0sleep10-21swapper/121:28:321
2024261210,0sleep20-21swapper/221:25:212
2022388210,1sleep00-21swapper/021:21:310
2021135210,0sleep10-21swapper/121:20:161
2020261210,0sleep20-21swapper/221:18:042
2018747210,0sleep00-21swapper/021:15:140
2018021210,0sleep20-21swapper/221:10:242
2016721210,0sleep10-21swapper/121:10:161
2016720210,1sleep00-21swapper/021:10:150
2016423210,0sleep20-21swapper/221:09:322
2015841210,0sleep10-21swapper/121:05:231
2014800210,1sleep00-21swapper/021:05:140
2014521210,0sleep10-21swapper/121:04:381
2013333210,0sleep00-21swapper/021:00:170
2012978210,0sleep20-21swapper/221:00:152
2012421210,1sleep00-21swapper/020:57:340
2011696210,0sleep20-21swapper/220:55:202
2010952210,0sleep10-21swapper/120:55:151
2009193210,0sleep20-21swapper/220:50:152
2008312210,0sleep10-21swapper/120:47:171
2006866210,0sleep20-21swapper/220:45:142
2006614210,0sleep00-21swapper/020:45:000
2006571210,0sleep10-21swapper/120:44:301
2006440210,0sleep00-21swapper/020:42:480
2003446210,0sleep02003015-21/usr/sbin/munin20:35:160
2003013210,0sleep10-21swapper/120:35:131
2002655210,1sleep00-21swapper/020:33:370
2002542210,0sleep10-21swapper/120:32:141
2001552210,0sleep20-21swapper/220:30:172
1999630210,0sleep10-21swapper/120:25:161
1999450210,0sleep00-21swapper/020:25:150
1997711210,0sleep20-21swapper/220:20:172
1997507210,0sleep10-21swapper/120:20:161
1997333210,0sleep00-21swapper/020:20:150
1996102210,0sleep00-21swapper/020:15:190
1992289210,0sleep20-21swapper/220:05:202
1991520210,0sleep10-21swapper/120:05:151
1991367210,0sleep00-21swapper/020:05:020
1990815210,0sleep00-21swapper/020:02:420
1989855210,0sleep20-21swapper/220:00:212
1989769210,0sleep10-21swapper/120:00:201
1988328210,0sleep20-21swapper/219:55:192
1988171210,0sleep10-21swapper/119:55:181
1987150210,0sleep00-21swapper/019:55:010
1985718210,0sleep20-21swapper/219:50:152
1985544210,0sleep10-21swapper/119:50:151
1985484210,0sleep00-21swapper/019:50:140
1983998210,0sleep00-21swapper/019:45:170
1983572210,0sleep10-21swapper/119:45:141
1982623210,0sleep00-21swapper/019:40:200
1981687210,0sleep20-21swapper/219:40:142
1981658210,0sleep10-21swapper/119:40:131
1977901210,0sleep00-21swapper/019:30:160
1976859210,0sleep00-21swapper/019:25:190
1974003210,0sleep20-21swapper/219:20:142
1973637210,1sleep00-21swapper/019:19:120
1973637210,1sleep00-21swapper/019:19:110
1972098210,0sleep10-21swapper/119:15:161
1972098210,0sleep10-21swapper/119:15:161
1971151210,0sleep1191rcu_preempt19:12:571
1970162210,0sleep20-21swapper/219:10:172
1969835210,0sleep00-21swapper/019:10:140
2103577200,0sleep00-21swapper/000:35:030
2101496200,0sleep10-21swapper/100:30:051
2088145200,0sleep20-21swapper/200:00:042
2087890200,0sleep10-21swapper/100:00:021
2062456200,0sleep10-21swapper/123:00:021
2041506200,0sleep20-21swapper/222:10:042
2041504200,0sleep00-21swapper/022:10:020
2039419200,0sleep20-21swapper/222:05:032
2028983200,0sleep20-21swapper/221:40:022
2028729200,0sleep10-21swapper/121:40:011
2009023200,0sleep10-21swapper/120:50:021
2004934200,0sleep20-21swapper/220:40:032
2002999200,0sleep20-21swapper/220:35:022
1999169200,0sleep20-21swapper/220:25:022
1995085200,0sleep20-21swapper/220:15:012
1993406200,0sleep00-21swapper/020:10:020
1993172200,0sleep20-21swapper/220:10:002
1979707200,0sleep20-21swapper/219:35:022
1977792200,0sleep20-21swapper/219:30:022
1975645200,0sleep20-21swapper/219:25:012
1973967200,0sleep10-21swapper/119:20:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional