You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-13 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Celeron(R) CPU N2930 @ 1.83GHz, Linux 4.18.7-rt5 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack4slot7s.osadl.org (updated Sat Jun 12, 2021 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230272468424,28sleep00-21swapper/010:10:570
230132455379,58sleep10-21swapper/110:10:501
2320699362,6cyclictest26662-21apt-get14:31:160
2320699362,6cyclictest24496-21apt-get13:01:160
2320699352,5cyclictest26151-21apt-get11:41:130
2320699352,5cyclictest20427-21apt-get11:26:140
2320699352,10cyclictest9498-21apt-get13:46:170
23206993411,19cyclictest32199-21seq14:44:370
2320699332,7cyclictest27764-21apt-get10:21:110
23206993310,20cyclictest8154-21mii-tool13:41:350
2320699323,6cyclictest3784-21apt-get13:31:210
2320699323,6cyclictest3105-21apt-get10:41:160
2320699323,5cyclictest9629-21apt-get15:11:230
2320699322,7cyclictest18387-21apt-get11:21:120
2320699322,7cyclictest1042-21apt-get10:36:150
2320699322,6cyclictest28700-21apt-get14:36:170
2320699322,6cyclictest14559-21apt-get11:11:120
2320699322,5cyclictest20535-21apt-get12:51:160
2320699313,6cyclictest29673-21apt-get10:26:160
2320699313,5cyclictest31571-21apt-get10:31:150
2320699313,4cyclictest7726-21apt-get15:06:200
2320699312,6cyclictest26419-21apt-get13:06:270
2320699312,5cyclictest5823-21apt-get15:01:180
2320799304,14cyclictest4970-21diskmemload14:31:171
2320699303,6cyclictest17254-21apt-get15:31:180
2320699303,5cyclictest5152-21apt-get12:11:150
2320699302,9cyclictest11202-21idleruntime11:01:170
2320699302,6cyclictest24231-21apt-get11:36:150
2320699302,6cyclictest22324-21apt-get11:31:140
2320699302,6cyclictest1878-21apt-get13:26:160
2320699302,6cyclictest16739-21apt-get12:41:180
2320699302,6cyclictest15224-21apt-get14:01:170
2320699302,5cyclictest32522-21apt-get14:46:160
2320699302,5cyclictest28448-21apt-get13:11:230
2320699302,5cyclictest24768-21apt-get14:26:200
2320699302,5cyclictest19028-21apt-get14:11:170
2320699302,5cyclictest12920-21apt-get12:31:230
2320699299,3cyclictest7100-21seq13:37:580
2320699299,3cyclictest7100-21seq13:37:580
2320699298,3cyclictest15176-21latency_hist15:26:060
2320699297,3cyclictest29850-21latency_hist11:51:010
2320699297,3cyclictest12885-21cat11:06:190
2320699297,3cyclictest11703-21expr13:51:240
2320699296,4cyclictest0-21swapper/015:41:050
2320699292,5cyclictest8801-21apt-get10:56:140
2320699292,5cyclictest3898-21apt-get14:56:170
2320699292,5cyclictest15355-21apt-get15:26:200
2320699292,5cyclictest11009-21apt-get12:26:140
2320699292,5cyclictest11009-21apt-get12:26:140
2320699291,6cyclictest9109-21apt-get12:21:130
2320699287,3cyclictest2582-21irqstats14:51:240
2320699287,3cyclictest2582-21irqstats14:51:240
2320699287,2cyclictest21100-21grep14:16:200
2320699286,3cyclictest26346-21cat10:16:240
2320699286,3cyclictest16663-21cpuspeed_turbos11:16:220
2320699281,6cyclictest18646-21apt-get12:46:230
2320699281,5cyclictest30341-21apt-get13:16:180
2320699281,5cyclictest1345-21apt-get12:01:140
2320699281,5cyclictest13301-21apt-get13:56:200
2320699277,3cyclictest16678-21kworker/0:214:06:370
2320699276,3cyclictest1319-21taskset13:23:360
2320699275,4cyclictest31851-21apt-get11:56:150
2320699275,3cyclictest7170-21expr10:51:190
2320699265,3cyclictest22530-21taskset12:56:070
2320699262,6cyclictest22861-21apt-get14:21:200
2320699261,5cyclictest11523-21apt-get15:16:190
2320799255,13cyclictest25198-21munin-node13:31:221
2320799254,15cyclictest4970-21diskmemload14:01:181
2320699256,3cyclictest15993-21grep12:36:460
2320699252,5cyclictest3254-21apt-get12:06:170
2320699252,4cyclictest5004-21apt-get10:46:180
2320799245,12cyclictest4970-21diskmemload14:26:201
2320799244,8cyclictest0-21swapper/113:16:181
2320799243,14cyclictest31575-21runrttasks10:31:161
2320799243,14cyclictest25780-21ntp_states10:16:031
2320799243,13cyclictest4970-21diskmemload12:16:161
2320799243,12cyclictest4970-21diskmemload13:51:191
23207992413,5cyclictest241ktimersoftd/112:26:141
23207992413,5cyclictest241ktimersoftd/112:26:141
23207992411,11cyclictest7287-21kworker/1:212:23:531
2320799234,11cyclictest0-21swapper/111:46:141
2320799233,13cyclictest0-21swapper/111:09:441
2320799232,7cyclictest0-21swapper/112:01:141
23207992313,5cyclictest0-21swapper/113:26:171
2320699231,4cyclictest29963-21apt-get11:51:220
2320799224,12cyclictest0-21swapper/114:36:181
2320799223,13cyclictest29967-21runrttasks11:51:221
2320799223,11cyclictest0-21swapper/110:46:171
23207992211,10cyclictest13087-21kworker/1:013:23:151
2320799219,9cyclictest28123-21awk13:11:021
2320799219,5cyclictest0-21swapper/111:16:201
2320799215,8cyclictest0-21swapper/114:41:211
2320799214,8cyclictest0-21swapper/113:46:171
2320799214,8cyclictest0-21swapper/113:11:231
2320799214,8cyclictest0-21swapper/112:56:161
2320799214,10cyclictest0-21swapper/111:26:151
2320799212,13cyclictest547-21lldpd11:56:151
2320799206,11cyclictest32027-21kworker/1:012:06:171
2320799205,8cyclictest0-21swapper/111:01:111
2320799205,6cyclictest0-21swapper/113:41:201
2320799204,9cyclictest0-21swapper/114:56:171
2320799204,9cyclictest0-21swapper/111:11:121
2320799204,8cyclictest0-21swapper/112:41:171
2320799204,8cyclictest0-21swapper/112:31:221
2320799204,8cyclictest0-21swapper/110:56:141
2320799204,8cyclictest0-21swapper/110:21:111
2320799204,11cyclictest0-21swapper/113:56:201
2320799203,9cyclictest0-21swapper/114:21:201
2320799203,9cyclictest0-21swapper/111:21:121
2320799203,9cyclictest0-21swapper/110:51:151
2320799203,7cyclictest0-21swapper/115:16:181
2320799203,10cyclictest0-21swapper/111:41:141
2320799202,6cyclictest0-21swapper/115:36:201
2320799202,16cyclictest28811-21kworker/1:010:41:031
2320799202,16cyclictest2110-21kworker/1:114:11:301
2320799201,17cyclictest28811-21kworker/1:010:36:151
2320799201,16cyclictest16294-21kworker/1:211:31:141
2320799201,16cyclictest10886-21kworker/1:210:11:181
2320799197,10cyclictest16312-21seq12:38:461
2320799194,9cyclictest0-21swapper/114:46:161
2320799194,8cyclictest0-21swapper/112:11:151
2320799194,8cyclictest0-21swapper/110:26:171
2320799194,7cyclictest0-21swapper/115:31:181
2320799194,7cyclictest0-21swapper/115:21:181
2320799193,9cyclictest0-21swapper/115:01:191
2320799193,9cyclictest0-21swapper/112:51:161
2320799193,7cyclictest0-21swapper/111:36:141
2320799193,6cyclictest0-21swapper/114:16:171
2320799193,10cyclictest4970-21diskmemload12:46:241
2320799192,6cyclictest0-21swapper/115:11:231
2320799186,7cyclictest0-21swapper/115:06:181
2320799183,8cyclictest0-21swapper/114:51:171
2320799183,8cyclictest0-21swapper/114:51:171
2320799182,8cyclictest0-21swapper/113:01:161
23206991813,3cyclictest23487-21cut10:11:200
2320799175,7cyclictest0-21swapper/113:36:221
2320799175,7cyclictest0-21swapper/113:36:221
2320799174,7cyclictest0-21swapper/114:06:161
2320799173,7cyclictest0-21swapper/115:26:201
2320699159,3cyclictest7020-21/usr/sbin/munin12:16:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional