You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-21 - 11:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3825 @1333 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack9slot4s.osadl.org (updated Fri May 20, 2022 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80209911571118,35cyclictest10084-21cat19:30:010
80219910891064,22cyclictest0-21swapper/119:30:011
79372515417,30sleep00-21swapper/019:24:430
75932463418,30sleep10-21swapper/119:21:061
802099771,7cyclictest1893-21seq00:48:180
802099771,41cyclictest2038-21taskset23:23:060
802099771,41cyclictest2038-21taskset23:23:050
152182710,6sleep115219-21needreboot19:40:231
88172680,4sleep00-21swapper/023:40:270
163112680,4sleep041ktimersoftd/019:45:010
802099662,5cyclictest21987-21if_eth000:15:190
802099659,34cyclictest20580-21open_files22:45:280
8020996412,35cyclictest12169-21sh21:00:000
802099638,37cyclictest3298-21runrttasks23:46:060
802099628,7cyclictest23271-21grep20:00:300
802099626,35cyclictest2205-21dbus-daemon21:47:540
802099619,32cyclictest6033-21seq22:07:060
802099619,31cyclictest17649-21taskset19:45:370
802099611,48cyclictest9816-21taskset22:17:110
802099611,39cyclictest21633-21taskset21:24:560
802099608,4cyclictest17630-21taskset21:12:430
802099606,36cyclictest21434-21taskset19:55:510
8020996016,26cyclictest3-21ksoftirqd/019:35:470
8020996016,26cyclictest3-21ksoftirqd/019:35:460
802099601,42cyclictest25239-21chrt20:06:020
8020996013,30cyclictest25205-21runrttasks21:32:580
8020996012,32cyclictest10238-21iostat19:30:030
802099599,31cyclictest12948-21irqstats21:00:210
802099594,6cyclictest9059-21smartctl20:50:200
802099592,6cyclictest24497-21unixbench_multi00:20:310
802099591,41cyclictest317-21chrt21:52:590
8020995911,30cyclictest16189-21fschecks_time00:00:170
802099589,30cyclictest15101-21wc22:30:300
802099585,4cyclictest40750irq/92-i91519:50:170
802099581,41cyclictest27582-21diskstats23:05:150
802099581,40cyclictest32497-21taskset23:17:130
802099581,36cyclictest2784-21cut22:00:130
802099572,49cyclictest0-21swapper/020:39:230
802099571,5cyclictest12792-21/usr/sbin/munin23:50:250
802099571,10cyclictest3105-21uname23:25:220
8020995710,32cyclictest17850-21apt-get22:40:210
802099568,4cyclictest691-21apt-get21:55:110
802099562,38cyclictest4377-21apt-get23:30:100
802099561,40cyclictest26557-21snmpd00:07:260
802099561,36cyclictest26925-21chrt23:03:010
802099559,29cyclictest0-21swapper/021:15:250
802099552,39cyclictest25786-21apt-get20:10:110
802099552,39cyclictest22305-21memory22:50:220
802099551,7cyclictest23698-21tr22:55:130
802099551,7cyclictest14801-21cut23:55:280
802099551,37cyclictest27692-21aten_r4power_cu20:15:120
8020995510,32cyclictest30176-21/usr/sbin/munin23:10:280
802099547,42cyclictest3-21ksoftirqd/020:30:580
802099546,5cyclictest29656-21cat00:35:240
802099542,7cyclictest6968-21df_inode20:45:150
802099542,6cyclictest6192-21taskset20:41:470
802099542,5cyclictest17214-21taskset22:35:370
802099541,7cyclictest32558-21taskset00:44:360
802099541,7cyclictest28563-21taskset00:32:310
802099541,7cyclictest21832-21cut21:25:120
802099541,6cyclictest25722-21cut21:35:230
802099541,6cyclictest14648-21fschecks_count21:05:270
802099541,5cyclictest11147-21/usr/sbin/munin22:20:270
8020995411,28cyclictest26050-21ntp_states00:25:320
802099531,6cyclictest31455-21taskset20:25:080
802099531,6cyclictest30865-21taskset20:20:330
802099531,6cyclictest2952-21sed00:50:230
802099531,6cyclictest28588-21cat21:40:350
802099531,6cyclictest20644-21sort00:10:290
802099522,5cyclictest0-21swapper/023:38:250
802099521,6cyclictest12184-21cut22:25:140
802099521,5cyclictest6532-21cut22:10:120
802199342,18cyclictest1720-21ntp_states20:30:261
802199331,13cyclictest0-21swapper/123:42:111
101092331,28sleep110105-21apt-get23:45:121
8021993116,8cyclictest31487-21iostat_ios00:40:211
8021993111,7cyclictest3298-21runrttasks00:37:221
230592311,5sleep10-21swapper/122:52:141
802199306,5cyclictest224692fschecks_time20:00:161
802199302,24cyclictest0-21swapper/121:01:411
8021993021,6cyclictest25584-21sshd20:09:411
8021993016,8cyclictest6888-21iostat_ios23:35:211
8021993012,14cyclictest10724-21df20:55:151
8021993010,6cyclictest312102wc21:50:001
264162301,25sleep126442-21ntp_states21:35:351
802199292,4cyclictest81rcu_preempt22:12:231
802199291,4cyclictest81rcu_preempt22:32:171
802199291,24cyclictest10124-21munin-node23:10:101
8021992911,14cyclictest253492chrt21:34:261
205882291,4sleep120677-21sendmail_mailqu22:45:291
141462291,5sleep10-21swapper/119:38:361
141462291,5sleep10-21swapper/119:38:361
802199288,7cyclictest30866-21taskset20:20:351
802199283,4cyclictest81rcu_preempt23:00:291
802199283,19cyclictest28347-21ntp_states21:40:331
802199282,4cyclictest81rcu_preempt21:22:101
8021992816,6cyclictest25513-21diskstats00:25:221
802199281,4cyclictest81rcu_preempt23:20:351
802199281,4cyclictest81rcu_preempt23:20:351
802199281,4cyclictest81rcu_preempt21:28:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional