You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-18 - 19:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Apr 18, 2024 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250229912401216,20cyclictest16794-21smartctl08:25:221
250229911691145,20cyclictest25183-21wget07:25:081
250219911641126,27cyclictest0-21swapper/007:25:100
246002539494,31sleep00-21swapper/007:21:090
245982464418,31sleep10-21swapper/107:21:081
250219911897,6cyclictest0-21swapper/008:25:220
43852510,8sleep00-21swapper/007:50:320
258872470,6sleep125885-21proc_pri11:40:291
138432430,9sleep02502199cyclictest12:35:190
2502199429,4cyclictest81rcu_preempt07:40:240
2502199421,8cyclictest0-21swapper/007:35:120
2502199409,4cyclictest81rcu_preempt09:10:130
2502199399,4cyclictest81rcu_preempt11:40:500
2502199395,4cyclictest81rcu_preempt12:49:130
2502199387,4cyclictest81rcu_preempt09:36:190
2502199384,3cyclictest81rcu_preempt08:21:550
25021993810,25cyclictest3-21ksoftirqd/008:30:310
2502199377,4cyclictest81rcu_preempt09:28:020
2502199377,4cyclictest81rcu_preempt08:58:320
2502199376,4cyclictest81rcu_preempt12:11:220
2502199375,4cyclictest81rcu_preempt09:17:280
291052361,31sleep11126-21snmpd08:58:101
2502199368,5cyclictest81rcu_preempt08:06:000
2502199367,4cyclictest81rcu_preempt10:55:340
2502199367,4cyclictest81rcu_preempt09:43:590
2502199367,4cyclictest81rcu_preempt08:47:130
2502199366,9cyclictest81rcu_preempt08:15:280
2502199366,9cyclictest81rcu_preempt08:15:280
2502199366,4cyclictest81rcu_preempt12:25:250
2502199366,4cyclictest81rcu_preempt12:15:170
2502199366,4cyclictest81rcu_preempt11:30:100
2502199366,4cyclictest81rcu_preempt08:42:220
2502199361,8cyclictest0-21swapper/010:42:000
73222351,30sleep17352-21ntpq09:25:231
2502199359,11cyclictest0-21swapper/010:05:300
2502199356,4cyclictest81rcu_preempt11:03:310
2502199355,4cyclictest81rcu_preempt09:21:080
2502199355,4cyclictest81rcu_preempt07:45:140
2502199354,4cyclictest81rcu_preempt11:10:100
2502199352,11cyclictest81rcu_preempt10:17:490
2502199351,4cyclictest81rcu_preempt12:22:100
2502199350,4cyclictest81rcu_preempt10:28:120
2502199347,4cyclictest81rcu_preempt10:35:320
2502199347,4cyclictest81rcu_preempt07:57:160
2502199346,4cyclictest81rcu_preempt09:09:000
2502199345,4cyclictest81rcu_preempt12:03:130
2502199345,4cyclictest81rcu_preempt11:49:280
2502199345,4cyclictest81rcu_preempt09:51:070
2502199345,4cyclictest81rcu_preempt08:10:120
2502199344,4cyclictest81rcu_preempt11:15:380
2502199344,4cyclictest81rcu_preempt11:15:370
2502199344,4cyclictest81rcu_preempt10:14:060
2502199344,4cyclictest81rcu_preempt08:50:110
2502199343,4cyclictest81rcu_preempt11:51:110
2502199341,7cyclictest81rcu_preempt10:31:290
2502199341,10cyclictest81rcu_preempt12:41:320
2502199340,4cyclictest81rcu_preempt11:35:180
196032341,29sleep019610-21iostat_ios12:50:240
160142341,28sleep116046-21ntp_states12:40:221
56572331,9sleep10-21swapper/110:46:281
2502199335,4cyclictest81rcu_preempt09:47:470
2502199334,4cyclictest81rcu_preempt11:59:550
2502199334,4cyclictest81rcu_preempt11:22:190
2502199334,4cyclictest81rcu_preempt09:00:040
2502199334,4cyclictest81rcu_preempt08:35:470
2502199332,7cyclictest0-21swapper/009:55:130
25021993324,5cyclictest20506-21/usr/sbin/munin11:25:320
2502199331,4cyclictest81rcu_preempt12:05:570
2502199331,4cyclictest81rcu_preempt10:50:210
2502199331,4cyclictest81rcu_preempt10:47:330
2502199331,4cyclictest81rcu_preempt10:23:150
9472321,27sleep1952-21cron07:45:001
2502199321,4cyclictest81rcu_preempt11:05:480
2502199321,4cyclictest81rcu_preempt10:02:020
2502199321,3cyclictest7339-21fschecks_time08:00:170
2502199321,11cyclictest0-21swapper/012:30:070
175042321,4sleep117624-21hddtemp_smartct12:45:181
25022993118,7cyclictest3005-21iostat_ios10:40:211
25022993116,8cyclictest18461-21diskstats08:30:151
2502199313,4cyclictest81rcu_preempt09:30:250
93302301,5sleep10-21swapper/110:55:391
33942301,5sleep10-21swapper/112:06:121
327372301,5sleep10-21swapper/109:06:461
267042301,5sleep10-21swapper/110:16:251
250592301,5sleep10-21swapper/110:13:511
25022993020,6cyclictest12207-21wget09:40:101
2502299301,15cyclictest12500-21sshd11:05:231
2502199304,4cyclictest81rcu_preempt07:34:060
180562301,25sleep118063-21iostat_ios11:20:211
158572301,5sleep10-21swapper/108:22:151
54762291,5sleep10-21swapper/112:13:221
285792291,5sleep10-21swapper/110:21:111
2502299295,17cyclictest13928-21iostat_ios12:35:221
2502299292,23cyclictest10883-21iostat_ios09:35:191
2502299292,22cyclictest11663-21munin-run11:05:011
2502299291,23cyclictest21310-21users08:35:341
232592291,5sleep10-21swapper/110:09:421
123292291,5sleep10-21swapper/108:14:511
101782291,5sleep10-21swapper/108:06:571
47032281,5sleep10-21swapper/107:53:451
44692281,23sleep14490-21pidof09:20:011
309912281,5sleep10-21swapper/107:36:321
252192281,5sleep10-21swapper/108:46:481
2502299289,15cyclictest22-21ksoftirqd/112:30:041
2502299286,18cyclictest0-21swapper/110:50:181
2502299284,17cyclictest31281-21diskstats10:30:161
25022992812,12cyclictest0-21swapper/109:00:111
235132281,5sleep10-21swapper/108:43:391
21222281,5sleep10-21swapper/109:11:071
173842281,5sleep10-21swapper/109:52:161
17312281,5sleep10-21swapper/110:36:001
155612281,5sleep10-21swapper/111:15:111
155612281,5sleep10-21swapper/111:15:101
14502281,5sleep10-21swapper/112:01:431
98912271,4sleep10-21swapper/109:32:391
91902271,22sleep10-21swapper/112:22:431
65092271,5sleep10-21swapper/107:58:001
303122271,5sleep10-21swapper/111:53:331
282552271,5sleep10-21swapper/111:46:401
277572271,5sleep10-21swapper/107:30:101
2502299273,18cyclictest7723-21ntp_states08:00:281
25022992717,6cyclictest26221-21wc08:50:201
25022992715,7cyclictest20311-21iostat_ios10:00:241
25022992711,13cyclictest31700-21taskset11:55:321
246032271,5sleep10-21swapper/111:38:001
226562271,5sleep10-21swapper/111:32:121
207502271,5sleep10-21swapper/111:26:561
139612271,5sleep10-21swapper/108:17:161
139612271,5sleep10-21swapper/108:17:151
111672271,5sleep10-21swapper/112:28:471
73372261,5sleep10-21swapper/112:18:091
63372261,4sleep10-21swapper/109:24:401
190022261,5sleep10-21swapper/112:50:091
25022992516,6cyclictest22-21ksoftirqd/107:45:171
25022992516,5cyclictest22-21ksoftirqd/110:25:171
2502299251,21cyclictest13683-21/usr/sbin/munin11:10:081
2502299232,16cyclictest14549-21hddtemp_smartct09:45:161
2502299231,18cyclictest17809-21/usr/sbin/munin09:55:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional