You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 09:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Pentium G4400 @3300 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of shadow in rack #8, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack8slot7s.osadl.org (updated Tue Jul 05, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166692550,0sleep016670-21fschecks_time23:20:120
215812310,0sleep10-21swapper/120:35:161
21610992019,1cyclictest1120-21diskmemload21:36:080
2161099181,10cyclictest4455-21apt-get19:50:120
2161099180,17cyclictest10828-21latency_hist23:05:000
2161099171,15cyclictest6610-21meminfo00:20:160
2161199163,5cyclictest0-21swapper/122:50:111
2161099162,9cyclictest23781-21apt-get23:40:120
2161099161,6cyclictest25606-21apt-get23:45:100
2161099153,6cyclictest17253-21apt-get20:25:120
2161099153,10cyclictest26916-21apt-get22:20:120
2161099152,9cyclictest26393-21apt-get20:50:120
2161099152,5cyclictest6286-21apt-get19:55:110
2161099151,6cyclictest9676-21apt-get00:30:100
2161099150,6cyclictest24048-21apt-get19:15:130
2161099150,14cyclictest1120-21diskmemload23:39:210
2161099150,14cyclictest10527-21meminfo20:05:150
21611991413,1cyclictest0-21swapper/123:06:241
2161099145,8cyclictest4187-21apt-get00:15:110
2161099143,5cyclictest5503-21apt-get22:50:110
2161099142,8cyclictest30570-21apt-get22:30:110
2161099142,6cyclictest25086-21apt-get22:15:110
2161099142,11cyclictest30116-21meminfo19:30:170
2161099141,8cyclictest14635-21apt-get23:15:110
2161099141,8cyclictest11503-21apt-get00:35:110
2161099141,7cyclictest27702-21apt-get19:25:110
21610991413,1cyclictest1120-21diskmemload21:13:260
2161099140,8cyclictest20126-21apt-get23:30:150
2161099140,6cyclictest7849-21apt-get00:25:100
2161099140,1cyclictest19597-21/usr/sbin/munin22:00:180
2161099140,13cyclictest1120-21diskmemload22:48:090
210962142,2sleep00-21swapper/019:06:290
2161199139,3cyclictest327332sleep100:04:571
2161199138,1cyclictest0-21swapper/122:33:161
2161199136,4cyclictest0-21swapper/123:35:121
2161199133,6cyclictest0-21swapper/123:20:151
2161199133,3cyclictest0-21swapper/121:20:181
2161199133,3cyclictest0-21swapper/120:40:111
2161199132,2cyclictest0-21swapper/100:20:111
2161199131,5cyclictest0-21swapper/121:05:121
2161199131,2cyclictest0-21swapper/120:30:011
2161199131,1cyclictest0-21swapper/119:50:111
2161199130,7cyclictest0-21swapper/119:15:211
2161199130,5cyclictest0-21swapper/121:40:121
2161099137,5cyclictest1569-21irqbalance20:45:500
2161099136,4cyclictest15350irq/140-nvme0q121:29:330
2161099133,6cyclictest30048-21apt-get21:00:130
2161099133,5cyclictest28743-21apt-get22:25:120
2161099133,5cyclictest12291-21apt-get21:40:120
2161099132,6cyclictest21428-21apt-get22:05:110
2161099132,5cyclictest11766-21apt-get20:10:110
21610991313,0cyclictest0-21swapper/020:00:190
2161099130,5cyclictest2366-21apt-esm-hook00:10:110
2161099130,10cyclictest1120-21diskmemload21:20:100
306482120,0sleep00-21swapper/023:57:120
2161199125,3cyclictest0-21swapper/121:10:111
2161199123,4cyclictest0-21swapper/121:55:211
2161199123,2cyclictest0-21swapper/122:40:121
2161199122,4cyclictest0-21swapper/119:30:191
2161199122,3cyclictest0-21swapper/122:05:111
2161199122,2cyclictest0-21swapper/123:25:131
2161199121,5cyclictest0-21swapper/123:10:191
2161199121,5cyclictest0-21swapper/121:45:131
2161199121,4cyclictest0-21swapper/123:45:101
2161199121,4cyclictest0-21swapper/121:15:111
2161199121,3cyclictest0-21swapper/119:59:591
21611991212,0cyclictest0-21swapper/120:00:091
2161199120,6cyclictest0-21swapper/123:00:121
2161199120,5cyclictest0-21swapper/120:45:111
2161199120,5cyclictest0-21swapper/120:35:001
2161199120,4cyclictest0-21swapper/121:00:131
2161199120,4cyclictest0-21swapper/119:40:011
2161199120,4cyclictest0-21swapper/119:10:201
2161199120,3cyclictest0-21swapper/123:40:121
2161099126,3cyclictest25878-21apt-get19:20:110
2161099124,5cyclictest742-21apt-get19:40:110
2161099124,5cyclictest742-21apt-get19:40:110
2161099124,3cyclictest31358-21apt-get19:35:130
2161099123,5cyclictest18291-21apt-get23:25:100
2161099123,4cyclictest27437-21apt-get23:50:120
2161099122,4cyclictest32396-21apt-get22:35:120
2161099120,11cyclictest18370-21meminfo21:55:230
214982121,0sleep021580-21/usr/sbin/munin20:35:160
190782121,1sleep019082-21apt-get20:30:140
98802110,0sleep00-21swapper/021:30:380
31332110,1sleep00-21swapper/021:15:040
288452110,1sleep10-21swapper/123:52:261
265192110,0sleep10-21swapper/122:17:391
248062110,1sleep10-21swapper/122:13:541
2161199112,5cyclictest0-21swapper/120:50:101
2161199111,5cyclictest0-21swapper/100:15:121
2161199111,4cyclictest0-21swapper/100:10:151
2161199111,3cyclictest0-21swapper/123:55:131
2161199111,2cyclictest0-21swapper/121:51:171
2161199111,2cyclictest0-21swapper/100:05:171
2161199110,5cyclictest0-21swapper/100:25:101
2161099114,3cyclictest23258-21apt-get22:10:110
2161099113,6cyclictest15350irq/140-nvme0q123:05:240
2161099113,5cyclictest2868-21ls22:40:200
2161099113,4cyclictest15428-21apt-get20:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional