You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 08:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Tue Dec 02, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1993972991611,0cyclictest0-21swapper/319:45:013
1993972991311,1cyclictest0-21swapper/300:05:133
199397299130,12cyclictest69450irq/121-eno119:15:123
199397299130,11cyclictest0-21swapper/320:40:133
199397299130,11cyclictest0-21swapper/300:10:153
199397299130,11cyclictest0-21swapper/300:00:123
199397299129,2cyclictest0-21swapper/323:05:153
1993972991211,0cyclictest0-21swapper/320:45:143
199397299120,11cyclictest69450irq/121-eno122:42:413
199397299120,11cyclictest0-21swapper/322:10:123
199397299120,11cyclictest0-21swapper/321:05:133
199397299120,11cyclictest0-21swapper/319:50:133
199397299120,11cyclictest0-21swapper/300:35:193
199397299120,0cyclictest0-21swapper/320:55:153
199397299116,1cyclictest0-21swapper/323:15:133
1993972991111,0cyclictest69450irq/121-eno121:35:183
1993972991111,0cyclictest0-21swapper/321:30:173
1993972991110,0cyclictest0-21swapper/321:25:153
1993972991110,0cyclictest0-21swapper/321:15:183
1993972991110,0cyclictest0-21swapper/320:15:003
199397299110,9cyclictest69450irq/121-eno123:23:423
199397299110,10cyclictest69450irq/121-eno100:25:133
199397299110,10cyclictest69450irq/121-eno100:15:173
199397299110,10cyclictest0-21swapper/322:20:013
199397299110,10cyclictest0-21swapper/322:05:133
199397299110,10cyclictest0-21swapper/322:05:123
199397299110,10cyclictest0-21swapper/320:05:163
199397299110,10cyclictest0-21swapper/319:10:123
199397299110,10cyclictest0-21swapper/300:20:113
199397299109,0cyclictest0-21swapper/322:35:203
199397299109,0cyclictest0-21swapper/321:10:123
1993972991010,0cyclictest69450irq/121-eno122:01:183
1993972991010,0cyclictest69450irq/121-eno121:40:233
1993972991010,0cyclictest69450irq/121-eno121:20:153
1993972991010,0cyclictest0-21swapper/323:35:143
1993972991010,0cyclictest0-21swapper/320:25:143
1993972991010,0cyclictest0-21swapper/319:20:183
199397299100,9cyclictest69450irq/121-eno123:00:153
199397299100,10cyclictest0-21swapper/320:39:153
199397299100,0cyclictest0-21swapper/319:35:183
19939729999,0cyclictest69450irq/121-eno122:45:203
19939729999,0cyclictest69450irq/121-eno122:25:153
19939729999,0cyclictest0-21swapper/323:30:213
19939729999,0cyclictest0-21swapper/319:25:203
19939729999,0cyclictest0-21swapper/300:31:173
19939729998,1cyclictest69450irq/121-eno122:20:133
19939729990,9cyclictest0-21swapper/323:40:193
19939729990,8cyclictest69450irq/121-eno121:50:143
19939729990,8cyclictest69450irq/121-eno121:00:143
19939729990,8cyclictest69450irq/121-eno119:40:163
19939729990,8cyclictest0-21swapper/321:47:143
19939729990,0cyclictest0-21swapper/322:50:193
19939729988,0cyclictest69450irq/121-eno123:55:153
19939729988,0cyclictest69450irq/121-eno123:50:543
19939729988,0cyclictest69450irq/121-eno119:30:193
19939729988,0cyclictest0-21swapper/323:45:123
19939729988,0cyclictest0-21swapper/323:15:003
19939729988,0cyclictest0-21swapper/321:55:143
19939729988,0cyclictest0-21swapper/320:20:143
19939729987,0cyclictest0-21swapper/320:15:133
19939729980,7cyclictest69450irq/121-eno123:29:193
19939729980,7cyclictest69450irq/121-eno119:55:193
19939729970,7cyclictest0-21swapper/322:55:203
19939729966,0cyclictest0-21swapper/322:30:133
19939729966,0cyclictest0-21swapper/320:50:133
19939729960,5cyclictest0-21swapper/320:00:153
2018420250,0sleep00-21swapper/020:10:130
19939729950,4cyclictest69450irq/121-eno120:32:143
1992180250,3sleep30-21swapper/319:05:123
1992949241,1sleep10-21swapper/119:05:191
2117903230,1sleep22118039-21memory00:10:182
2117545230,2sleep02117806-21cat00:10:160
2102752230,1sleep02102778-21apt-get23:35:140
2099189230,1sleep12099339-21ntp_states23:25:181
2093007230,2sleep12093094-21/usr/sbin/munin23:10:181
2046725230,2sleep02046807-21pmu-power21:20:190
2022532230,1sleep02022558-21apt-get20:20:140
1992212231,1sleep00-21swapper/019:05:130
1992169231,1sleep20-21swapper/219:05:032
2129357220,1sleep20-21swapper/200:35:202
2125936220,1sleep02126209-21df_inode00:30:140
2116679220,0sleep20-21swapper/200:05:462
2112954220,0sleep02112960-40mandb00:00:010
2095409220,0sleep00-21swapper/023:15:220
2088168220,1sleep00-21swapper/023:00:160
2087555220,0sleep22087569-21apt-get23:00:022
2085907220,1sleep02086155-21diskstats22:55:160
2085145220,0sleep00-21swapper/022:52:150
2075609220,1sleep02075759-21ntp_states22:30:180
2065306220,1sleep22065459-21systemctl22:05:182
2065306220,1sleep22065459-21systemctl22:05:182
2062152220,1sleep12062245-21sed22:00:011
2057600220,0sleep00-21swapper/021:46:430
2054503220,1sleep00-21swapper/021:40:190
2052005220,1sleep22052076-21aten_r1power_en21:35:122
2047997220,1sleep12048023-21apt-get21:25:151
2047646220,0sleep20-21swapper/221:24:002
2040062220,1sleep10-21swapper/121:05:151
2034046220,1sleep12034133-21cat20:50:011
2034038220,1sleep00-21swapper/020:49:560
2030913220,1sleep10-21swapper/120:40:161
2028025220,0sleep22028041-21apt-get20:35:012
2018575220,1sleep22018849-21df_inode20:10:162
2010056220,1sleep00-21swapper/019:47:440
2006566220,1sleep02006832-21diskstats19:40:150
1998925220,1sleep21999078-21memory19:20:162
1994590220,1sleep20-21swapper/219:10:162
2128145210,0sleep00-21swapper/000:35:030
2126749210,0sleep10-21swapper/100:30:191
2125767210,0sleep20-21swapper/200:30:042
2124442210,0sleep10-21swapper/100:25:181
2123954210,0sleep2328-21plymouthd00:25:152
2123445210,0sleep00-21swapper/000:25:010
2122913210,0sleep00-21swapper/000:20:210
2120226210,0sleep20-21swapper/200:15:192
2119937210,0sleep00-21swapper/000:15:170
2119251210,0sleep10-21swapper/100:15:021
2118280210,0sleep12118407-21switchtime00:10:211
2116377210,0sleep10-21swapper/100:05:211
2115331210,0sleep00-21swapper/000:05:120
2114827210,0sleep20-21swapper/200:02:502
2113240210,0sleep10-21swapper/100:00:131
2112440210,0sleep10-21swapper/123:55:281
2111663210,0sleep20-21swapper/223:55:212
2110007210,0sleep00-21swapper/023:50:190
2109553210,0sleep12109745-21strings23:50:161
2108787210,0sleep20-21swapper/223:50:012
2108544210,0sleep00-21swapper/023:47:550
2108003210,0sleep10-21swapper/123:45:201
2106273210,0sleep00-21swapper/023:41:190
2106265210,0sleep10-21swapper/123:41:171
2105296210,0sleep20-21swapper/223:40:162
2102909210,0sleep20-21swapper/223:35:162
2102781210,0sleep10-21swapper/123:35:151
2102201210,0sleep10-21swapper/123:32:271
2101428210,0sleep22101522-21ps23:30:202
2100662210,0sleep00-21swapper/023:30:140
2100149210,0sleep00-21swapper/023:27:500
2097001210,0sleep00-21swapper/023:20:170
2096663210,0sleep20-21swapper/223:20:152
2096580210,0sleep10-21swapper/123:20:141
2095132210,0sleep20-21swapper/223:15:192
2094982210,0sleep10-21swapper/123:15:181
2093788210,0sleep20-21swapper/223:12:152
2092271210,0sleep00-21swapper/023:10:130
2091502210,0sleep20-21swapper/223:05:302
2090871210,0sleep00-21swapper/023:05:200
2089928210,0sleep10-21swapper/123:05:011
2089621210,0sleep10-21swapper/123:02:221
2086156210,0sleep10-21swapper/122:55:171
2085722210,0sleep20-21swapper/222:55:142
2083626210,0sleep10-21swapper/122:50:121
2082276210,0sleep00-21swapper/022:45:190
2081539210,0sleep20-21swapper/222:45:142
2081531210,0sleep10-21swapper/122:45:081
2081190210,0sleep10-21swapper/122:44:121
2079546210,0sleep00-21swapper/022:40:150
2078902210,0sleep20-21swapper/222:39:572
2077636210,0sleep10-21swapper/122:35:191
2077083210,0sleep00-21swapper/022:35:150
2076325210,0sleep10-21swapper/122:30:391
2075368210,0sleep22074987-21/usr/sbin/munin22:30:162
2074071210,0sleep00-21swapper/022:25:220
2073057210,0sleep20-21swapper/222:25:162
2072930210,0sleep10-21swapper/122:25:151
2072186210,0sleep00-21swapper/022:21:010
2069456210,0sleep10-21swapper/122:15:181
2068958210,0sleep20-21swapper/222:15:152
2068695210,0sleep00-21swapper/022:15:130
2068092210,0sleep20-21swapper/222:11:592
2066757210,0sleep10-21swapper/122:10:141
2066633210,0sleep00-21swapper/022:10:130
2065018210,0sleep00-21swapper/022:05:160
2065018210,0sleep00-21swapper/022:05:160
2064266210,0sleep10-21swapper/122:05:011
2064266210,0sleep10-21swapper/122:05:011
2063817210,1sleep00-21swapper/022:01:090
2063075210,0sleep10-21swapper/122:00:171
2060063210,0sleep20-21swapper/221:55:022
2059744210,0sleep00-21swapper/021:52:160
2059203210,0sleep10-21swapper/121:50:201
2058238210,0sleep20-21swapper/221:50:132
2057453210,0sleep20-21swapper/221:45:252
2057450210,0sleep10-21swapper/121:45:251
2055640210,0sleep20-21swapper/221:42:532
2054668210,0sleep10-21swapper/121:40:201
2052446210,0sleep10-21swapper/121:35:151
2051994210,0sleep00-21swapper/021:35:060
2051401210,0sleep10-21swapper/121:31:271
2051195210,0sleep20-21swapper/221:30:212
2050169210,0sleep00-21swapper/021:30:140
2049369210,0sleep20-21swapper/221:26:082
2047783210,0sleep00-21swapper/021:25:020
2047636210,0sleep10-21swapper/121:23:551
2045366210,0sleep10-21swapper/121:16:181
2044089210,0sleep00-21swapper/021:15:130
2043962210,0sleep20-21swapper/221:15:112
2043359210,0sleep20-21swapper/221:11:152
2041718210,0sleep00-21swapper/021:10:010
2041158210,0sleep00-21swapper/021:05:210
2038407210,0sleep00-21swapper/021:00:160
2038141210,0sleep20-21swapper/221:00:142
2037871210,0sleep10-21swapper/121:00:011
2037731210,0sleep20-21swapper/220:58:142
2036828210,0sleep00-21swapper/020:55:200
2036333210,0sleep10-21swapper/120:55:171
2035140210,0sleep00-21swapper/020:50:200
2034847210,0sleep20-21swapper/220:50:192
2033456210,0sleep20-21swapper/220:45:212
2030732210,0sleep00-21swapper/020:40:160
2030468210,0sleep20-21swapper/220:40:132
2029902210,0sleep00-21swapper/020:36:150
2028972210,0sleep10-21swapper/120:35:161
2027886210,0sleep00-21swapper/020:33:150
2026590210,0sleep20-21swapper/220:30:162
2026420210,0sleep10-21swapper/120:30:151
2024600210,0sleep20-21swapper/220:25:162
2024445210,0sleep00-21swapper/020:25:140
2022688210,0sleep20-21swapper/220:20:162
2022043210,0sleep20-21swapper/220:17:162
2021326210,0sleep10-21swapper/120:15:191
2020595210,0sleep00-21swapper/020:15:140
2019132210,0sleep10-21swapper/120:10:181
2017244210,0sleep10-21swapper/120:05:221
2016700210,0sleep20-21swapper/220:05:192
2015394210,0sleep00-21swapper/020:00:220
2014599210,0sleep20-21swapper/220:00:152
2013706210,0sleep10-21swapper/119:55:211
2012412210,0sleep01-21systemd19:55:000
2011277210,0sleep10-21swapper/119:50:171
2008063210,0sleep10-21swapper/119:45:021
2007370210,0sleep10-21swapper/119:40:201
2006398210,0sleep20-21swapper/219:40:132
2005079210,0sleep20-21swapper/219:35:172
2004911210,0sleep10-21swapper/119:35:161
2002612210,0sleep00-21swapper/019:30:150
2001817210,0sleep20-21swapper/219:27:132
1999365210,0sleep10-21swapper/119:20:191
1998554210,0sleep00-21swapper/019:20:150
1998191210,0sleep20-21swapper/219:20:002
1997417210,0sleep10-21swapper/119:15:191
1996617210,0sleep01996842-21cut19:15:140
1995707210,1sleep00-21swapper/019:13:420
1994431210,0sleep10-21swapper/119:10:151
2128445200,0sleep10-21swapper/100:35:031
2121602200,0sleep20-21swapper/200:20:032
2121601200,0sleep10-21swapper/100:20:031
2113225200,0sleep00-21swapper/000:00:040
2106698200,0sleep20-21swapper/223:45:012
2098550200,0sleep20-21swapper/223:25:032
2083613200,0sleep20-21swapper/222:50:052
2079436200,0sleep20-21swapper/222:40:052
2070791200,0sleep20-21swapper/222:20:032
2070790200,0sleep10-21swapper/122:20:031
2062246200,0sleep20-21swapper/222:00:022
2060299200,0sleep00-21swapper/021:55:040
2041954200,0sleep10-21swapper/121:10:021
2040039200,0sleep20-21swapper/221:05:032
2034283200,0sleep10-21swapper/120:50:051
2024431200,0sleep10-21swapper/120:25:041
2022518200,0sleep10-21swapper/120:20:031
2016261200,0sleep00-21swapper/020:05:010
2014581200,0sleep10-21swapper/120:00:021
2012649200,0sleep00-21swapper/019:55:040
2012646200,0sleep20-21swapper/219:55:022
2010733200,0sleep20-21swapper/219:50:022
2008557200,0sleep20-21swapper/219:45:022
2004452200,0sleep00-21swapper/019:35:030
2002538200,0sleep10-21swapper/119:30:041
2002039200,0sleep20-21swapper/219:30:022
2000363200,0sleep10-21swapper/119:25:031
2000362200,0sleep00-21swapper/019:25:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional