You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-11-29 - 08:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack4slot7s.osadl.org (updated Tue Nov 29, 2022 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25262573476,62sleep10-21swapper/119:09:091
21802465399,50sleep00-21swapper/019:05:230
59892550,7sleep012-21ksoftirqd/020:39:490
121792300,4sleep012172-21unixbench_singl19:29:570
167492270,3chrt16752-21sendmail_mailqu23:55:021
51582250,2sleep10-21swapper/120:37:511
2737992413,9cyclictest14014-21snmpd22:15:141
2736992311,3cyclictest13381-21cat22:24:300
2736992214,5cyclictest11596-21apt-key23:44:310
2736992212,3cyclictest15961-21tail19:39:570
273799219,9cyclictest14014-21snmpd00:24:481
273799216,6cyclictest32270-21seq23:11:451
2737992115,3cyclictest22-21ksoftirqd/120:59:301
2737992111,8cyclictest14014-21snmpd21:30:041
2737992111,8cyclictest14014-21snmpd20:09:341
2737992111,8cyclictest14014-21snmpd19:34:411
273699218,4cyclictest6676-21strings22:05:000
273699212,2cyclictest141rcu_preempt19:27:410
2736992111,3cyclictest1910-21cpuspeed_turbos20:29:500
137642210,5sleep113823-21grep20:59:501
57222201,16sleep15737-21munin-run22:04:301
273799209,9cyclictest19467-21sh00:04:301
273799207,9cyclictest211rcuc/100:14:441
2737992014,3cyclictest3814-21turbostat.cron21:59:301
2737992011,7cyclictest30636-21grep21:44:311
2737992011,7cyclictest14014-21snmpd00:33:071
2737992010,8cyclictest14014-21snmpd22:44:481
2737992010,7cyclictest2543-21cat23:19:491
273699209,3cyclictest12-21ksoftirqd/023:34:450
273699209,3cyclictest12-21ksoftirqd/022:35:080
273699209,3cyclictest12-21ksoftirqd/000:19:460
273699202,2cyclictest141rcu_preempt22:39:510
273699202,2cyclictest141rcu_preempt21:54:420
2736992015,3cyclictest23029-21unixbench_multi00:10:020
2736992012,6cyclictest26808-21cron22:59:290
2736992012,5cyclictest14014-21snmpd00:32:190
2736992011,6cyclictest14014-21snmpd19:59:460
2736992010,3cyclictest3772-21awk20:34:450
2736992010,3cyclictest12-21ksoftirqd/023:04:530
2736992010,3cyclictest12-21ksoftirqd/021:34:550
2736992010,3cyclictest12-21ksoftirqd/020:19:500
273799198,9cyclictest22-21ksoftirqd/122:34:521
273799198,8cyclictest22-21ksoftirqd/119:19:441
273799193,12cyclictest26915-21apt-get21:34:481
273799193,10cyclictest28264-21apt-get20:14:431
273799192,13cyclictest25103-21apt-get22:54:491
2737991912,5cyclictest14014-21snmpd23:37:081
2737991911,6cyclictest14014-21snmpd21:28:041
2737991911,6cyclictest14014-21snmpd21:17:341
2737991911,6cyclictest14014-21snmpd20:08:221
2737991911,6cyclictest14014-21snmpd19:16:391
2737991911,6cyclictest14014-21snmpd19:10:591
273799191,14cyclictest19811-21apt-get00:04:531
2737991910,7cyclictest1676-21/usr/sbin/munin20:29:581
2737991910,7cyclictest14014-21snmpd22:26:151
2737991910,7cyclictest14014-21snmpd21:22:461
2737991910,7cyclictest14014-21snmpd20:28:531
273699199,3cyclictest12-21ksoftirqd/023:14:560
273699199,3cyclictest12-21ksoftirqd/022:59:460
273699199,3cyclictest12-21ksoftirqd/020:54:530
273699199,3cyclictest12-21ksoftirqd/000:24:480
273699199,2cyclictest12-21ksoftirqd/019:19:420
273699198,3cyclictest12-21ksoftirqd/021:09:460
273699198,3cyclictest12-21ksoftirqd/019:15:010
273699194,4cyclictest12-21ksoftirqd/023:54:580
273699193,2cyclictest141rcu_preempt21:59:570
273699193,2cyclictest141rcu_preempt00:14:470
273699192,2cyclictest141rcu_preempt23:44:570
273699192,2cyclictest141rcu_preempt23:25:030
273699192,2cyclictest141rcu_preempt23:09:510
273699192,2cyclictest141rcu_preempt22:49:500
273699192,2cyclictest141rcu_preempt22:45:350
273699192,2cyclictest141rcu_preempt21:49:580
273699192,2cyclictest141rcu_preempt21:31:050
273699192,2cyclictest141rcu_preempt21:19:470
273699192,2cyclictest141rcu_preempt21:14:530
273699192,2cyclictest141rcu_preempt20:24:550
273699192,2cyclictest141rcu_preempt19:54:430
273699192,2cyclictest141rcu_preempt00:04:340
273699191,2cyclictest141rcu_preempt00:37:360
2736991911,6cyclictest28862-21awk21:39:450
2736991911,6cyclictest19169-21fw_packets19:49:520
2736991911,6cyclictest18517-21cron19:49:300
2736991911,6cyclictest14014-21snmpd21:44:380
2736991911,5cyclictest2863-21basename19:09:450
273699190,2cyclictest141rcu_preempt22:14:450
273699190,2cyclictest141rcu_preempt22:10:290
273699190,2cyclictest141rcu_preempt20:50:000
273799183,9cyclictest32623-21apt-get21:49:431
273799183,11cyclictest21819-21apt-get00:09:461
273799183,10cyclictest9831-21apt-get23:39:441
273799181,8cyclictest14014-21snmpd22:10:121
273799181,4cyclictest17614-21chrt21:09:471
2737991813,3cyclictest23646-21fschecks_time22:49:481
2737991813,3cyclictest15915-21grep19:39:571
2737991811,5cyclictest4646-21kworker/1:019:56:111
2737991811,5cyclictest14014-21snmpd20:20:051
2737991810,6cyclictest14014-21snmpd20:53:001
2737991810,6cyclictest11115-21awk19:29:441
273699188,3cyclictest12-21ksoftirqd/023:29:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional