You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-10 - 10:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot7s.osadl.org (updated Sat Jun 10, 2023 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182482530471,46sleep10-21swapper/119:09:061
179082465408,43sleep00-21swapper/019:05:220
195012540,6sleep019504-21fschecks_time23:25:020
257872480,2chrt0-21swapper/019:25:130
1847699333,21cyclictest32181-21diskmemload23:29:541
18476993013,13cyclictest34850irq/91-enp1s0-r23:44:521
1847699292,21cyclictest32181-21diskmemload00:15:011
181292290,2chrt0-21swapper/120:30:161
181292290,2chrt0-21swapper/120:30:161
1847699244,11cyclictest22829-21snmpd19:34:551
1847699233,5cyclictest22-21ksoftirqd/122:44:581
198622210,3chrt0-21swapper/022:00:100
1847699217,4cyclictest141rcu_preempt19:54:591
1847699210,13cyclictest141rcu_preempt20:55:141
1847599211,5cyclictest0-21swapper/000:11:400
18475992110,9cyclictest22829-21snmpd00:24:570
1847699208,3cyclictest141rcu_preempt21:44:581
1847699204,4cyclictest6044-21in:imuxsock21:17:581
1847699203,9cyclictest141rcu_preempt20:50:091
18476992012,6cyclictest22829-21snmpd23:06:151
18476992011,7cyclictest23460-21cat23:35:031
18476992011,7cyclictest22829-21snmpd23:29:281
18476992011,7cyclictest22829-21snmpd22:55:371
18476992011,7cyclictest10117-21cat23:00:131
18476992010,8cyclictest32181-21diskmemload00:09:591
1847699200,7cyclictest19646-21/usr/sbin/munin22:00:061
1847699200,17cyclictest27521-21awk22:20:061
1847599204,10cyclictest0-21swapper/000:34:590
1847599203,9cyclictest12-21ksoftirqd/000:04:580
18475992011,7cyclictest32111-21seq19:43:330
18475992011,7cyclictest27256-21cat19:30:060
18475992011,7cyclictest22829-21snmpd22:34:020
18475992011,7cyclictest22829-21snmpd21:31:360
18475992011,7cyclictest22829-21snmpd19:54:060
18475992011,7cyclictest12624-21awk20:15:090
18475992011,6cyclictest22829-21snmpd19:15:170
18475992010,8cyclictest22829-21snmpd23:39:580
1847599200,4cyclictest0-21swapper/000:19:510
304912191,2sleep130520-21apt-get22:29:551
1847699199,8cyclictest34850irq/91-enp1s0-r23:44:381
1847699192,9cyclictest32181-21diskmemload22:14:551
18476991911,6cyclictest22829-21snmpd23:21:281
18476991911,6cyclictest22829-21snmpd23:14:191
18476991911,6cyclictest22829-21snmpd22:09:011
18476991911,6cyclictest22829-21snmpd21:59:131
18476991911,6cyclictest22829-21snmpd21:21:451
18476991911,6cyclictest22829-21snmpd19:59:401
18476991911,6cyclictest22829-21snmpd19:40:511
18476991911,6cyclictest22829-21snmpd19:16:351
18476991910,7cyclictest22829-21snmpd23:19:281
18476991910,7cyclictest22829-21snmpd20:15:431
1847699190,8cyclictest141rcu_preempt20:29:071
1847599199,8cyclictest22829-21snmpd23:49:590
1847599194,8cyclictest0-21swapper/000:29:550
1847599194,5cyclictest496-21runrttasks22:22:260
1847599193,9cyclictest22860-21seq20:44:580
18475991913,4cyclictest28887-21cstates19:34:570
18475991911,6cyclictest22829-21snmpd22:13:260
18475991911,6cyclictest22829-21snmpd20:34:280
18475991911,6cyclictest22829-21snmpd20:34:280
18475991911,6cyclictest15792-21cat23:15:000
18475991910,7cyclictest22829-21snmpd20:28:490
18475991910,6cyclictest11959-21cat21:40:030
73122181,2sleep00-21swapper/000:17:140
1847699188,8cyclictest25141-21awk19:25:041
1847699188,8cyclictest22-21ksoftirqd/123:50:481
1847699188,8cyclictest22-21ksoftirqd/122:12:471
1847699188,8cyclictest22-21ksoftirqd/121:53:391
1847699187,3cyclictest22-21ksoftirqd/120:20:081
1847699187,3cyclictest22-21ksoftirqd/120:20:081
1847699187,3cyclictest141rcu_preempt19:20:051
1847699182,3cyclictest141rcu_preempt23:54:581
1847699182,3cyclictest141rcu_preempt00:00:031
1847699182,3cyclictest141rcu_preempt00:00:031
18476991811,5cyclictest22829-21snmpd21:38:301
1847699181,13cyclictest1898-21apt-get22:39:511
18476991810,6cyclictest8137-21cat21:30:041
18476991810,6cyclictest632-21sort22:35:081
18476991810,6cyclictest6284-21cat22:50:041
18476991810,6cyclictest22829-21snmpd21:42:281
18476991810,6cyclictest22829-21snmpd21:24:541
18476991810,6cyclictest22829-21snmpd21:05:231
18476991810,6cyclictest22829-21snmpd00:26:061
1847599189,7cyclictest22829-21snmpd20:04:130
1847599189,7cyclictest10045-21cat20:10:000
1847599185,6cyclictest0-21swapper/020:54:580
1847599184,4cyclictest0-21swapper/023:09:580
1847599183,9cyclictest0-21swapper/022:39:500
18475991813,3cyclictest30528-21aten2_r4power_e21:04:550
18475991811,5cyclictest22829-21snmpd23:55:380
18475991811,5cyclictest22829-21snmpd21:35:420
18475991810,6cyclictest6755-21sed21:25:100
18475991810,6cyclictest30360-21grep22:29:380
18475991810,6cyclictest26588-21sed20:54:390
18475991810,6cyclictest22829-21snmpd23:34:550
18475991810,6cyclictest22829-21snmpd22:46:180
18475991810,6cyclictest22829-21snmpd22:19:380
18475991810,6cyclictest22829-21snmpd21:15:480
18475991810,6cyclictest22829-21snmpd20:23:490
18475991810,6cyclictest22829-21snmpd20:23:490
18475991810,6cyclictest22829-21snmpd19:47:150
1847699179,6cyclictest32695-21df21:09:591
1847699179,6cyclictest22829-21snmpd19:53:241
1847699179,6cyclictest22829-21snmpd00:30:301
1847699178,7cyclictest720-21cut19:45:051
1847699178,7cyclictest28202-21seq19:32:331
1847699178,7cyclictest22829-21snmpd22:28:111
1847699177,8cyclictest22-21ksoftirqd/100:22:121
1847699177,8cyclictest22-21ksoftirqd/100:06:541
1847699172,8cyclictest141rcu_preempt20:40:131
1847699171,13cyclictest24672-21cat20:49:381
18476991710,5cyclictest22829-21snmpd21:01:081
18476991710,5cyclictest22829-21snmpd20:05:521
1847599179,6cyclictest32504-21cut00:00:000
1847599179,6cyclictest32504-21cut00:00:000
1847599179,6cyclictest22829-21snmpd22:36:230
1847599179,6cyclictest22829-21snmpd21:00:290
1847599178,7cyclictest22109-21unixbench-2d22:05:090
1847599178,7cyclictest17693-21cat21:55:060
1847599174,7cyclictest0-21swapper/021:09:550
1847599173,9cyclictest0-21swapper/023:04:580
1847599173,5cyclictest0-21swapper/021:19:540
1847599172,12cyclictest10618-21timerandwakeup23:00:220
18475991711,4cyclictest22829-21snmpd20:09:040
18475991710,5cyclictest22829-21snmpd23:46:380
18475991710,5cyclictest22829-21snmpd21:51:220
18475991710,5cyclictest19594-21cat20:35:060
134882171,14sleep10-21swapper/100:35:021
1847699169,5cyclictest883-21kworker/1:220:09:571
1847699165,8cyclictest0-21swapper/119:09:501
1847699162,7cyclictest0-21swapper/120:34:591
1847599169,5cyclictest22563-21kworker/u4:223:33:310
1847599168,6cyclictest4083-21expr19:55:010
1847599167,7cyclictest8632-21awk22:55:150
1847599167,7cyclictest22829-21snmpd21:46:430
1847599163,6cyclictest0-21swapper/019:20:030
1847599163,5cyclictest0-21swapper/022:49:570
1847599162,11cyclictest20966-21apt-get20:40:040
1847599154,6cyclictest0-21swapper/019:09:520
1847599151,11cyclictest17129-21apt-get23:19:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional