You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-28 - 16:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Atom(TM) Processor E3940 @ 1.60GHz, Linux 4.16.15-rt7 (Profile)

Latency plot of shadow in rack #5, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 50 highest latencies:
System rack5slot3s.osadl.org (updated Tue Sep 28, 2021 12:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127362240164,24sleep10-21swapper/107:09:181
125902240165,25sleep20-21swapper/207:07:262
127072231162,55sleep30-21swapper/307:08:553
125512200163,24sleep00-21swapper/007:06:540
13064999087,2cyclictest0-21swapper/211:04:402
271282720,2sleep10-21swapper/110:05:181
258822620,1sleep00-21swapper/008:50:120
1306599481,31cyclictest823-21snmpd07:47:303
287572420,4sleep230-21rcuc/208:55:172
1306599418,24cyclictest16890-21/usr/sbin/munin12:05:313
1306399401,14cyclictest0-21swapper/108:00:221
1306399401,14cyclictest0-21swapper/108:00:211
13062993927,2cyclictest5722sleep010:16:290
1306599388,20cyclictest1159-21/usr/sbin/munin10:20:283
1306599388,20cyclictest1159-21/usr/sbin/munin10:20:273
1306599383,2cyclictest86550irq/126-enp1s0-10:35:343
1306599381,6cyclictest28866-21/usr/sbin/munin12:35:193
1306599381,26cyclictest30598-21unixbench-2d10:10:303
1306599363,6cyclictest24401-40dnf07:31:573
1306599362,20cyclictest0-21swapper/310:50:183
1306599361,5cyclictest581-21systemd-journal11:06:543
1306599361,23cyclictest14762-21/usr/sbin/munin08:25:233
1306599359,23cyclictest21246-21irqstats07:25:203
1306599355,3cyclictest86850irq/129-enp1s0-10:05:203
1306599353,3cyclictest12050irq/123-ahci[0010:30:013
1306599352,3cyclictest5081-21hddtemp_smartct11:40:203
1306599351,2cyclictest0-21swapper/312:18:413
1306599351,20cyclictest25643-21latency_hist08:50:013
13065993510,14cyclictest18988-21awk08:35:023
1306299351,25cyclictest0-21swapper/008:20:210
1306599349,22cyclictest6862-21/usr/sbin/munin09:20:263
1306599343,5cyclictest11155-21ntpq10:40:293
1306599342,5cyclictest11307-21/usr/sbin/munin09:30:313
1306599341,21cyclictest12533-21/usr/sbin/munin08:20:173
1306299349,12cyclictest8634-21idleruntime-cro11:50:010
1306599332,3cyclictest10839-21latency_hist11:55:013
1306599331,3cyclictest6993-21grep11:45:193
1306599331,3cyclictest31551-21/usr/sbin/munin07:50:253
1306599331,3cyclictest2783-21gltestperf11:35:173
1306599331,3cyclictest26709-21ls12:30:163
1306599331,3cyclictest13875-21df_inode09:35:163
1306599331,24cyclictest86850irq/129-enp1s0-10:32:163
1306599331,23cyclictest2196-21diskmemload12:21:153
1306599331,22cyclictest0-21swapper/311:00:173
1306599331,20cyclictest0-21swapper/311:14:403
1306599331,19cyclictest0-21swapper/312:10:363
1306399331,15cyclictest0-21swapper/111:28:211
13062993319,3cyclictest23982-21kworker/0:212:34:320
1306299331,14cyclictest19900-21kworker/0:107:30:230
1306299331,12cyclictest29737-21kworker/0:211:40:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional