You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-02 - 02:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s.osadl.org (updated Fri Mar 01, 2024 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
112959912041194,7cyclictest0-21swapper/107:25:141
112949911821157,22cyclictest0-21swapper/007:25:170
112959911211095,22cyclictest19918-21update-cracklib07:45:351
109812563518,30sleep00-21swapper/007:22:150
109812563518,30sleep00-21swapper/007:22:150
110572481437,30sleep10-21swapper/107:23:031
110572481437,30sleep10-21swapper/107:23:031
112949910370,16cyclictest19916-21update-cracklib07:45:350
243072820,5sleep01129499cyclictest07:55:310
289262810,2sleep10-21swapper/111:00:241
163492770,3sleep0111rcuc/009:00:280
313372740,8sleep01129499cyclictest11:05:380
188892490,23sleep03-21ksoftirqd/012:00:210
324232430,6sleep11129599cyclictest12:35:261
219772410,8sleep11129599cyclictest09:15:261
116402381,34sleep111729-21grep10:15:171
1129499366,5cyclictest81rcu_preempt08:30:340
1129499362,5cyclictest9300-21runrttasks10:07:170
11294993621,5cyclictest3-21ksoftirqd/008:10:060
11294993620,6cyclictest3-21ksoftirqd/011:55:400
11294993619,6cyclictest3-21ksoftirqd/010:32:580
1129599353,17cyclictest0-21swapper/110:33:491
11294993520,5cyclictest3-21ksoftirqd/007:50:320
11294993519,5cyclictest3-21ksoftirqd/007:43:180
46752342,4sleep14695-21iostat_ios09:55:331
1129599345,4cyclictest81rcu_preempt07:40:281
11294993419,5cyclictest3-21ksoftirqd/012:43:110
11294993418,6cyclictest3-21ksoftirqd/012:31:250
11294993418,5cyclictest3-21ksoftirqd/011:52:360
11294993418,5cyclictest3-21ksoftirqd/008:29:180
182972331,9sleep10-21swapper/111:56:511
164862331,4sleep116504-21iostat07:35:321
11294993317,6cyclictest3-21ksoftirqd/012:48:160
11294993317,6cyclictest3-21ksoftirqd/012:16:580
11294993311,6cyclictest3-21ksoftirqd/010:40:260
325032321,26sleep132608-21df11:10:291
1129499325,14cyclictest8045-21pidof08:40:010
11294993216,6cyclictest3-21ksoftirqd/012:27:440
11294993212,7cyclictest14829-21ntp_states07:30:400
1129499321,17cyclictest2307-21munin-run08:25:010
10402321,27sleep11067-21hddtemp_smartct08:20:241
28632311,4sleep12899-21fschecks_count08:25:251
1129599316,4cyclictest81rcu_preempt09:43:271
1129599316,4cyclictest81rcu_preempt09:04:021
1129599316,4cyclictest81rcu_preempt08:32:271
1129599312,4cyclictest81rcu_preempt11:32:541
11295993118,4cyclictest40750irq/92-i91510:58:001
11295993112,6cyclictest23800-21sort07:55:191
11295993111,6cyclictest0-21swapper/109:48:281
11294993116,5cyclictest3-21ksoftirqd/008:53:200
11294993115,5cyclictest3-21ksoftirqd/008:55:080
1129499311,17cyclictest23570-21/usr/sbin/munin09:20:190
304792301,8sleep00-21swapper/009:38:430
231462301,25sleep123153-21iostat_ios12:10:281
231462301,25sleep123153-21iostat_ios12:10:281
1129599305,4cyclictest81rcu_preempt08:40:201
1129599304,9cyclictest9680-21diskstats11:35:271
1129599304,4cyclictest81rcu_preempt12:07:161
1129599301,4cyclictest81rcu_preempt12:22:591
1129499308,11cyclictest3-21ksoftirqd/011:17:170
11294993015,5cyclictest3-21ksoftirqd/011:32:510
11294993015,5cyclictest3-21ksoftirqd/009:43:530
11294993014,5cyclictest3-21ksoftirqd/011:48:460
11294993014,4cyclictest81rcu_preempt12:50:290
11294993012,5cyclictest27824-21/usr/sbin/munin09:30:320
11294993012,5cyclictest0-21swapper/010:00:390
1129499301,20cyclictest0-21swapper/012:11:390
1129499301,20cyclictest0-21swapper/012:11:390
1129599295,4cyclictest81rcu_preempt11:26:451
1129599295,4cyclictest81rcu_preempt10:14:121
1129599295,4cyclictest81rcu_preempt10:09:151
1129599294,4cyclictest81rcu_preempt11:49:101
1129599294,4cyclictest81rcu_preempt11:17:091
1129599294,4cyclictest81rcu_preempt10:27:201
1129599293,4cyclictest81rcu_preempt10:48:021
1129599293,4cyclictest81rcu_preempt10:00:491
1129599293,4cyclictest81rcu_preempt09:38:301
11295992919,6cyclictest30433-21sed08:10:361
11295992918,7cyclictest14124-21iostat_ios10:20:311
1129499293,7cyclictest20542-21python09:10:500
1129499292,13cyclictest9680-21diskstats11:35:270
1129499292,13cyclictest4926-21ntp_states09:55:380
11294992915,4cyclictest3-21ksoftirqd/007:36:180
11294992914,5cyclictest3-21ksoftirqd/011:44:060
11294992914,5cyclictest3-21ksoftirqd/010:27:490
11294992914,5cyclictest3-21ksoftirqd/010:24:370
11294992913,5cyclictest3-21ksoftirqd/009:05:380
1129499291,17cyclictest26470-21mailstats08:00:350
1129499291,15cyclictest25455-21/usr/sbin/munin10:50:280
53872281,5sleep00-21swapper/011:24:210
38912281,5sleep00-21swapper/009:54:470
36472281,4sleep10-21swapper/109:52:151
327102281,5sleep10-21swapper/108:18:431
230512281,5sleep00-21swapper/009:19:430
12982281,5sleep00-21swapper/011:12:210
113872281,5sleep00-21swapper/008:45:430
1129599286,4cyclictest81rcu_preempt08:59:361
1129599284,17cyclictest25258-21ntp_states12:15:321
1129599283,4cyclictest81rcu_preempt11:51:021
1129599283,13cyclictest25514-21/usr/sbin/munin08:00:361
1129599282,4cyclictest81rcu_preempt12:00:561
1129599282,4cyclictest81rcu_preempt07:33:041
1129599282,11cyclictest0-21swapper/108:05:141
11295992816,8cyclictest22-21ksoftirqd/111:07:281
1129599281,4cyclictest81rcu_preempt09:31:251
11295992814,8cyclictest10694-21iostat_ios08:45:261
11294992821,5cyclictest0-21swapper/008:05:150
11294992812,6cyclictest81rcu_preempt12:22:590
11294992811,5cyclictest25759-21iostat_ios09:25:320
11294992811,5cyclictest25759-21iostat_ios09:25:310
11294992810,5cyclictest5535-21gdbus10:19:390
64542271,5sleep00-21swapper/011:25:320
314452271,5sleep10-21swapper/112:31:341
262292271,5sleep10-21swapper/110:52:151
232062271,5sleep10-21swapper/107:52:361
1129599275,4cyclictest81rcu_preempt08:35:421
1129599273,4cyclictest81rcu_preempt11:42:111
11295992719,5cyclictest13226-21unixbench_singl08:50:461
11295992718,6cyclictest23354-21aten_r4power_po09:20:171
1129599271,4cyclictest81rcu_preempt11:23:481
1129599271,4cyclictest81rcu_preempt10:38:201
1129599271,14cyclictest4019-21iostat12:45:311
11295992710,4cyclictest0-21swapper/110:40:571
1129499275,6cyclictest0-21swapper/011:00:190
1129499274,12cyclictest0-21swapper/009:48:490
11294992712,5cyclictest3-21ksoftirqd/012:08:380
1129499271,13cyclictest9056-21chrt08:40:330
1129499271,13cyclictest19643-21hddtemp_smartct10:35:250
111912271,5sleep00-21swapper/010:12:260
67012261,5sleep10-21swapper/112:52:011
295502261,4sleep10-21swapper/112:26:211
254502260,8sleep11129599cyclictest09:25:261
254502260,8sleep11129599cyclictest09:25:251
1129599263,18cyclictest0-21swapper/112:40:411
1129499263,11cyclictest23086-21cpu10:45:270
11294992612,12cyclictest0-21swapper/008:19:240
1129499261,13cyclictest28073-21chrt10:56:550
10012261,5sleep00-21swapper/012:38:020
1129599259,5cyclictest40750irq/92-i91509:10:391
1129599252,3cyclictest81rcu_preempt09:06:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional