You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-02 - 09:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3825 @1333 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s.osadl.org (updated Fri Dec 02, 2022 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272619912031174,25cyclictest12726-21kworker/0:019:25:270
272629910911069,16cyclictest28102-21memory19:25:241
270772546499,32sleep00-21swapper/019:23:400
270602464368,81sleep10-21swapper/119:23:281
1462721070,2sleep014628-21fschecks_time23:05:180
307552750,4sleep0111rcuc/020:55:310
210632510,7sleep12726299cyclictest00:46:241
27262994511,6cyclictest22-21ksoftirqd/121:15:181
2726299448,6cyclictest22-21ksoftirqd/123:35:431
2726299446,5cyclictest22-21ksoftirqd/119:45:261
27262994415,7cyclictest22-21ksoftirqd/121:48:251
27262994410,6cyclictest22-21ksoftirqd/123:50:331
27262994410,6cyclictest22-21ksoftirqd/121:55:241
2726299437,6cyclictest22-21ksoftirqd/122:55:211
2726299436,6cyclictest22-21ksoftirqd/121:20:241
27262994324,10cyclictest22-21ksoftirqd/121:05:201
2726299429,6cyclictest22-21ksoftirqd/122:40:201
2726299428,6cyclictest22-21ksoftirqd/122:30:131
2726299427,6cyclictest22-21ksoftirqd/122:45:321
2726299426,6cyclictest22-21ksoftirqd/121:35:131
2726299425,5cyclictest22-21ksoftirqd/122:35:241
265062420,4sleep126501-21strings22:10:241
2726299419,5cyclictest22-21ksoftirqd/123:25:051
2726299418,6cyclictest22-21ksoftirqd/120:14:251
2726299417,6cyclictest22-21ksoftirqd/120:04:431
2726299416,4cyclictest81rcu_preempt23:15:311
2726299415,6cyclictest22-21ksoftirqd/100:50:141
2726299408,6cyclictest22-21ksoftirqd/121:03:531
2726299408,5cyclictest22-21ksoftirqd/121:26:451
2726299408,5cyclictest22-21ksoftirqd/100:35:531
2726299407,6cyclictest22-21ksoftirqd/120:59:451
2726299406,4cyclictest81rcu_preempt21:30:161
2726299406,4cyclictest81rcu_preempt20:25:111
2726299406,4cyclictest81rcu_preempt00:05:141
2726299405,5cyclictest22-21ksoftirqd/122:50:241
2726299405,4cyclictest81rcu_preempt22:20:151
2726299398,5cyclictest22-21ksoftirqd/119:55:481
2726299397,5cyclictest22-21ksoftirqd/100:13:191
2726299397,4cyclictest81rcu_preempt19:40:551
2726299395,6cyclictest22-21ksoftirqd/100:20:021
2726299395,6cyclictest22-21ksoftirqd/100:19:471
2726299395,4cyclictest81rcu_preempt20:05:201
27262993923,4cyclictest22-21ksoftirqd/100:00:141
27262993912,9cyclictest22-21ksoftirqd/121:52:241
2726299385,4cyclictest81rcu_preempt19:35:291
2726299385,4cyclictest81rcu_preempt00:30:151
2726299384,4cyclictest81rcu_preempt23:55:221
2726299383,26cyclictest41150irq/93-i91523:13:341
27262993810,9cyclictest22-21ksoftirqd/123:45:301
2726299378,4cyclictest81rcu_preempt20:30:311
2726299375,6cyclictest22-21ksoftirqd/119:53:571
2726299373,5cyclictest22-21ksoftirqd/123:07:431
27262993722,4cyclictest22-21ksoftirqd/123:30:161
27262993721,4cyclictest22-21ksoftirqd/123:20:171
27262993718,4cyclictest22-21ksoftirqd/100:40:321
2726199371,25cyclictest21216-21pidof00:48:010
2726299364,6cyclictest22-21ksoftirqd/122:15:351
2726299364,4cyclictest81rcu_preempt23:00:221
27262993618,4cyclictest22-21ksoftirqd/120:51:331
27262993618,4cyclictest22-21ksoftirqd/120:51:321
2726299361,5cyclictest22-21ksoftirqd/120:25:001
2726299358,4cyclictest22-21ksoftirqd/122:25:231
2726299352,6cyclictest22-21ksoftirqd/100:29:151
2726299352,4cyclictest81rcu_preempt20:40:281
27262993517,4cyclictest22-21ksoftirqd/121:10:121
27262993517,4cyclictest22-21ksoftirqd/119:30:201
27262993516,4cyclictest22-21ksoftirqd/122:07:401
27262993513,4cyclictest22-21ksoftirqd/122:00:061
2726199356,26cyclictest31260-21cron19:30:590
224572351,30sleep021743-21/usr/sbin/munin23:25:240
182852351,5sleep018453-21/usr/sbin/munin21:50:140
132722351,30sleep013329-21/usr/sbin/munin21:35:260
2726299347,5cyclictest81rcu_preempt23:40:131
2726299341,6cyclictest22-21ksoftirqd/120:15:511
2726299341,4cyclictest81rcu_preempt20:45:171
27262993411,4cyclictest22-21ksoftirqd/121:40:171
2726299331,4cyclictest81rcu_preempt20:35:191
2726199337,13cyclictest20530-21latency23:20:220
2726199332,15cyclictest25800-21df23:35:150
27261993312,7cyclictest26762-21python22:10:290
2726199331,18cyclictest4609-21basename00:05:150
2726199327,12cyclictest12340-21latency_hist21:35:000
2726199323,15cyclictest17782-21apt-get00:40:180
27261993214,6cyclictest3-21ksoftirqd/021:45:010
113622320,4sleep02726199cyclictest20:05:190
2726199312,4cyclictest0-21swapper/019:55:010
27261993113,4cyclictest15444-21ntp_states20:15:270
2726199311,14cyclictest7454-21python00:10:330
2726199302,15cyclictest9757-21python21:25:310
2726199302,15cyclictest12936-21/usr/sbin/munin00:25:250
2726199302,14cyclictest7660-21iostat_ios19:55:220
2726199302,12cyclictest1341-21df_inode21:05:160
291752291,5sleep00-21swapper/020:51:060
291752291,5sleep00-21swapper/020:51:060
2726199296,11cyclictest81rcu_preempt00:20:350
2726199295,12cyclictest81rcu_preempt23:10:330
2726199294,13cyclictest81rcu_preempt23:20:000
2726199294,12cyclictest1029-21fschecks_time23:55:200
27261992923,4cyclictest3-21ksoftirqd/022:40:370
27261992922,4cyclictest4781-21gdbus20:25:250
2726199292,15cyclictest5890-21/usr/sbin/munin21:15:290
2726199292,13cyclictest9561-21iostat20:00:230
2726199292,13cyclictest12594-21cstates23:00:180
2726199291,4cyclictest81rcu_preempt19:39:050
27261992911,6cyclictest0-21swapper/000:15:450
27261992911,5cyclictest81rcu_preempt23:45:000
2726199288,16cyclictest2921-21wget22:35:130
2726199284,4cyclictest81rcu_preempt21:47:150
2726199282,13cyclictest31273-21munin-run22:25:000
27261992815,4cyclictest0-21swapper/000:38:310
2726199281,4cyclictest81rcu_preempt20:37:060
2726199281,14cyclictest4781-21gdbus20:30:180
2726199281,14cyclictest24365-21/usr/sbin/munin23:30:250
2726199280,4cyclictest81rcu_preempt21:58:480
235702281,5sleep00-21swapper/022:03:450
179462281,5sleep00-21swapper/020:22:030
83652271,5sleep00-21swapper/021:22:590
6352271,5sleep00-21swapper/021:02:320
3112271,5sleep00-21swapper/022:26:190
30202271,5sleep00-21swapper/019:44:170
2726199277,7cyclictest3035-21fschecks_count00:00:330
2726199272,8cyclictest25331-21users20:40:310
2726199272,12cyclictest4780-21packagekitd21:13:410
2726199271,4cyclictest81rcu_preempt00:54:260
2726199271,3cyclictest81rcu_preempt23:51:020
2726199271,12cyclictest11720-21runrttasks22:55:500
27261992710,5cyclictest14262-21expr00:30:160
238572271,5sleep00-21swapper/022:05:100
141622271,5sleep00-21swapper/020:12:060
291862261,5sleep00-21swapper/022:18:190
275132261,5sleep00-21swapper/020:48:270
2726199268,5cyclictest81rcu_preempt22:45:320
2726199261,17cyclictest0-21swapper/023:48:190
2726199261,17cyclictest0-21swapper/022:53:080
2726199261,13cyclictest4283-21/usr/sbin/munin19:45:310
23732261,5sleep00-21swapper/022:32:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional