You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-29 - 17:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3825 @1333 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s.osadl.org (updated Sun Jan 29, 2023 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285199912831,4cyclictest2779-21snmpd07:28:501
284572639591,33sleep00-21swapper/007:24:570
283302564518,31sleep10-21swapper/107:23:401
2851899137118,16cyclictest81rcu_preempt07:28:500
308592800,5sleep00-21swapper/010:19:150
308592800,5sleep00-21swapper/010:19:140
2851999797,37cyclictest7958-21date12:10:011
2851999742,6cyclictest17998-21cat08:20:011
2851999711,5cyclictest1087-21wc10:25:281
196512710,8sleep12851999cyclictest12:40:211
2851999691,32cyclictest30873-21munin-node07:30:031
28519996911,38cyclictest15030-21sh09:35:331
2851999688,33cyclictest0-21swapper/111:55:341
2851999684,47cyclictest24220-21memory10:00:351
28519996819,30cyclictest22-21ksoftirqd/110:37:011
28519996710,38cyclictest17631-21latency_hist11:10:011
2851999661,7cyclictest27987-21sed10:10:271
28519996610,35cyclictest2226-21dbus-daemon11:34:181
2851999642,8cyclictest27960-21hddtemp_smartct08:45:231
2851999641,49cyclictest7756-21taskset10:41:551
2851999631,6cyclictest19228-21latency_hist12:40:001
2851999631,49cyclictest19033-21taskset11:11:341
2851999623,7cyclictest20201-21hddtemp_smartct09:50:221
28519996217,27cyclictest22-21ksoftirqd/112:21:311
2851999621,43cyclictest8256-21aten_r4power_cu10:45:151
28519996212,38cyclictest15190-21seq11:00:451
28519996210,32cyclictest2996-21seq07:40:201
2851999619,34cyclictest32735-21cut11:50:021
2851999611,6cyclictest11100-21ntpq08:00:321
28519996111,32cyclictest20438-21processes11:15:331
2851999602,53cyclictest21467-21tr12:45:181
28519996011,32cyclictest32064-21awk08:55:341
2851999599,33cyclictest11837-21taskset09:28:501
2851999594,48cyclictest16252-21diskstats09:40:281
2851999594,48cyclictest16252-21diskstats09:40:271
2851999591,9cyclictest23355-21aten_r4power_cu11:25:201
2851999591,5cyclictest8918-21/usr/sbin/munin07:55:271
2851999591,39cyclictest6457-21apt09:15:141
2851999582,6cyclictest13687-21apt-get12:25:191
2851999582,39cyclictest17822-21/usr/sbin/munin09:45:311
2851999581,8cyclictest30024-21sensors11:40:341
2851999581,7cyclictest27528-21fschecks_time11:35:251
2851999581,10cyclictest25805-21cpuspeed_turbos08:40:181
2851999572,39cyclictest0-21swapper/109:14:101
2851999572,38cyclictest6285-21chrt07:49:521
2851999571,5cyclictest21793-21/usr/sbin/munin08:30:351
2851999571,5cyclictest18030-21apt08:20:151
2851999571,39cyclictest4407-21latency_hist09:10:011
2851999563,8cyclictest29852-21hddtemp_smartct08:50:251
2851999563,44cyclictest21453-21apt-get11:20:181
2851999563,39cyclictest633-21diskstats11:50:201
2851999561,7cyclictest24859-21unixbench_multi08:35:351
2851999561,6cyclictest9922-21chrt09:23:301
28519995615,24cyclictest22-21ksoftirqd/112:34:561
2851999561,38cyclictest21590-21/usr/sbin/munin09:55:391
2851999558,31cyclictest470-21cat10:25:001
2851999556,4cyclictest4146-21taskset10:33:481
2851999555,41cyclictest23139-21apt-get12:50:121
2851999552,9cyclictest20864-21gzip08:25:361
2851999551,9cyclictest6772-21diskstats07:50:191
2851999551,6cyclictest12486-21tune2fs09:30:241
225402550,4sleep0111rcuc/009:55:360
2851999544,43cyclictest26705-21users10:05:441
2851999542,6cyclictest15722-21chrt08:12:411
2851999542,6cyclictest12000-21apt10:55:211
2851999541,9cyclictest2779-21snmpd12:03:091
2851999541,7cyclictest9349-21taskset12:11:081
2851999541,7cyclictest13667-21taskset08:05:501
2851999541,6cyclictest2168-21chrt09:02:331
2851999532,6cyclictest29653-21tune2fs10:15:301
2851999532,6cyclictest29653-21tune2fs10:15:301
2851999532,6cyclictest11497-21chrt12:18:561
2851999531,7cyclictest1223-21idleruntime07:35:271
2851999531,6cyclictest10107-21chrt10:50:151
2851899371,23cyclictest4886-21diskstats07:45:180
2851899370,11cyclictest81rcu_preempt09:09:190
2851899362,21cyclictest30999-21aten_r4power_po11:45:250
2851899361,21cyclictest25236-21apt-get10:05:150
2851899354,16cyclictest12130-21apt-get09:30:180
2851899352,15cyclictest5659-21/usr/sbin/munin09:10:360
28518993511,12cyclictest22979-21unixbench_multi08:30:380
28518993510,4cyclictest25177-21latency_hist11:30:000
190112348,22sleep03638-21gdbus11:11:190
2851899332,5cyclictest81rcu_preempt09:35:200
2851899331,11cyclictest81rcu_preempt11:23:300
28518993222,6cyclictest3-21ksoftirqd/009:00:270
28518993212,7cyclictest11615-21cron12:20:000
327172311,5sleep00-21swapper/008:57:400
308422311,5sleep00-21swapper/008:52:460
2851899318,12cyclictest2226-21dbus-daemon07:52:280
2851899316,13cyclictest17960-21wget12:35:250
2851899315,13cyclictest17229-21timerandwakeup08:15:350
2851899312,15cyclictest23428-21df12:50:180
2851899305,22cyclictest13505-21cron12:25:000
2851899304,20cyclictest9052-21memory07:55:310
2851899302,14cyclictest3638-21gdbus07:40:590
2851899301,4cyclictest81rcu_preempt09:41:050
2851899301,4cyclictest81rcu_preempt09:41:050
2851899301,4cyclictest81rcu_preempt09:26:420
2851899301,18cyclictest11997-21apt-get08:05:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional