You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 05:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Apr 27, 2024 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309469912431199,26cyclictest7204-21diskstats19:45:121
309469911831151,28cyclictest31108-21cut19:25:101
304672580535,30sleep00-21swapper/019:20:340
305612468424,29sleep10-21swapper/119:21:331
3094599153144,6cyclictest0-21swapper/019:45:120
309459911696,15cyclictest0-21swapper/019:25:100
11672900,2sleep11169-21fschecks_count20:55:161
124722790,4sleep041ktimersoftd/022:50:250
43902760,3sleep0111rcuc/022:30:110
143602750,8sleep13094699cyclictest21:30:131
3094599605,12cyclictest10115-21hwlatdetect00:10:180
111682391,35sleep110667-21/usr/sbin/munin19:55:211
3094599385,18cyclictest6137-21diskstats00:00:170
30945993814,12cyclictest25259-21iostat00:50:160
3094599379,13cyclictest6204-21gdbus19:38:280
3094599362,21cyclictest12066-21/usr/sbin/munin00:15:200
30945993618,6cyclictest8114-21aten_r4power_en22:40:100
3094599359,12cyclictest30333-21/usr/sbin/munin20:45:290
3094599353,17cyclictest11019-21memory21:20:260
3094599352,11cyclictest81rcu_preempt23:41:310
3094699342,18cyclictest0-21swapper/100:54:561
3094599344,14cyclictest2220-21dbus-daemon23:57:130
245012341,29sleep124522-21munin-run00:50:001
3094599338,12cyclictest12566-21aten_r4power_cu20:00:090
3094599331,20cyclictest26038-21cut20:35:170
3094599331,18cyclictest15303-21aten_r4power_po00:25:110
3094599331,13cyclictest12076-21runrttasks19:56:550
3094699326,4cyclictest81rcu_preempt22:40:391
3094699326,4cyclictest81rcu_preempt20:07:111
3094699326,4cyclictest81rcu_preempt00:23:271
3094699321,6cyclictest0-21swapper/122:18:521
30946993216,5cyclictest22-21ksoftirqd/121:25:101
224222321,27sleep122431-21ntpq21:50:291
3094699316,4cyclictest81rcu_preempt20:51:591
3094699314,4cyclictest81rcu_preempt21:19:011
3094699311,5cyclictest0-21swapper/122:35:311
3094599319,5cyclictest27429-21tr22:05:130
3094599313,15cyclictest0-21swapper/021:52:510
30945993123,5cyclictest18444-21iostat_ios21:40:230
30945993123,5cyclictest18444-21iostat_ios21:40:220
30945993111,7cyclictest16344-21grep21:35:170
30945993110,6cyclictest19651-21sh23:10:160
64162301,5sleep00-21swapper/019:41:350
3094699306,4cyclictest81rcu_preempt23:12:271
3094699305,4cyclictest81rcu_preempt23:08:421
3094699305,4cyclictest81rcu_preempt00:38:091
3094699303,4cyclictest81rcu_preempt20:45:591
3094699301,4cyclictest81rcu_preempt23:33:561
3094699301,2cyclictest0-21swapper/123:25:201
3094599302,8cyclictest0-21swapper/022:55:320
3094599302,15cyclictest23655-21seq20:29:540
3094599302,15cyclictest0-21swapper/021:30:280
3094599302,14cyclictest650-21diskstats19:30:020
3094599302,13cyclictest3976-21unixbench_multi21:00:320
3094599301,16cyclictest8963-21/usr/sbin/munin21:15:460
30945993011,6cyclictest7070-21/usr/sbin/munin22:35:310
3094599301,13cyclictest860-21/usr/sbin/munin23:45:240
3094599301,12cyclictest2565-21munin-run21:00:000
30945993010,7cyclictest18970-21/usr/sbin/munin20:15:220
90972291,24sleep19229-21fschecks_time19:50:141
3094699295,4cyclictest81rcu_preempt19:38:351
3094699295,4cyclictest81rcu_preempt00:12:151
3094699294,4cyclictest81rcu_preempt23:56:451
3094699294,4cyclictest81rcu_preempt20:41:141
3094699293,4cyclictest81rcu_preempt22:09:341
3094699293,17cyclictest0-21swapper/123:45:031
30946992918,7cyclictest23800-21sort23:20:251
30946992914,12cyclictest22-21ksoftirqd/120:03:151
30946992911,5cyclictest3020-21runrttasks23:40:441
3094699291,14cyclictest3020-21runrttasks23:37:101
3094599299,7cyclictest28053-21sort20:40:170
3094599298,3cyclictest0-21swapper/023:20:290
3094599294,18cyclictest29048-21diskstats23:35:140
3094599292,10cyclictest5507-21ntp_states21:05:300
3094599291,4cyclictest81rcu_preempt23:05:130
3094599291,4cyclictest81rcu_preempt00:44:380
30945992912,6cyclictest13868-21/usr/sbin/munin00:20:200
30945992911,6cyclictest3295-21/usr/sbin/munin22:25:290
30945992911,6cyclictest3295-21/usr/sbin/munin22:25:290
3094599291,13cyclictest26929-21wget23:30:100
30945992910,14cyclictest15037-21irqstats20:05:210
3094599290,4cyclictest81rcu_preempt23:02:180
28722291,5sleep10-21swapper/119:34:041
254582291,5sleep10-21swapper/120:34:051
196372291,5sleep10-21swapper/120:17:171
76322281,5sleep10-21swapper/121:10:331
42472281,5sleep10-21swapper/121:02:221
3094699289,6cyclictest18832-21cron00:35:001
3094699285,4cyclictest81rcu_preempt20:14:471
3094699284,4cyclictest81rcu_preempt00:17:161
30946992818,6cyclictest20098-21cut21:45:181
30946992816,7cyclictest4601-21diskstats22:30:151
30946992812,13cyclictest6386-21cron21:10:001
30946992812,12cyclictest22-21ksoftirqd/122:20:281
3094599284,13cyclictest40950irq/93-i91521:25:270
3094599282,13cyclictest19278-21df00:35:130
3094599281,14cyclictest21718-21/usr/sbin/munin23:15:170
3094599281,13cyclictest25913-21processes23:25:310
3094599281,13cyclictest23906-21wc00:45:370
3094599281,13cyclictest21431-21cron21:50:000
30945992810,6cyclictest31357-21runrttasks20:50:080
30945992810,6cyclictest26079-21/usr/sbin/munin22:00:240
30945992810,5cyclictest6649-21/usr/sbin/munin21:10:130
30945992810,5cyclictest24194-21missed_timers21:55:220
272442281,5sleep10-21swapper/120:38:111
269722281,5sleep10-21swapper/122:03:551
247642281,5sleep10-21swapper/121:55:411
212282281,5sleep10-21swapper/123:15:101
184862281,5sleep00-21swapper/000:31:270
171632281,5sleep10-21swapper/123:03:271
162382281,5sleep00-21swapper/020:10:020
58362271,5sleep10-21swapper/100:00:091
3094699273,4cyclictest81rcu_preempt22:53:321
3094699273,4cyclictest81rcu_preempt20:22:171
3094699272,4cyclictest81rcu_preempt20:26:431
30946992719,5cyclictest8466-21needreboot00:05:231
30946992711,4cyclictest81rcu_preempt21:40:161
30946992711,4cyclictest81rcu_preempt21:40:161
3094699271,14cyclictest6634-21sshd19:43:511
3094599272,13cyclictest0-21swapper/023:50:150
3094599272,13cyclictest0-21swapper/023:50:140
3094599272,12cyclictest8281-21if_eth000:05:180
3094599271,4cyclictest81rcu_preempt20:23:190
30945992711,4cyclictest9777-21awk19:50:290
30945992711,4cyclictest24185-21/usr/sbin/munin20:30:150
3094599271,12cyclictest29936-21ntpdc22:10:250
30945992710,5cyclictest31938-21gzip22:15:260
305462271,5sleep10-21swapper/122:12:041
223752271,5sleep10-21swapper/100:42:421
176062271,5sleep10-21swapper/121:39:291
153532271,5sleep10-21swapper/122:59:221
112752271,5sleep10-21swapper/122:45:581
37682261,4sleep10-21swapper/122:26:081
37682261,4sleep10-21swapper/122:26:081
3094699266,7cyclictest0-21swapper/123:50:251
3094699266,7cyclictest0-21swapper/123:50:251
30946992610,5cyclictest40950irq/93-i91500:25:221
30945992616,6cyclictest10757-21ntp_kernel_pll_22:45:240
30945992610,4cyclictest926-21hddtemp_smartct22:20:170
114942260,4sleep10-21swapper/121:20:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional