You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-19 - 02:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Thu Jul 18, 2024 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221959912121178,29cyclictest26745-21cat07:35:001
221949911301100,15cyclictest14001-21kworker/0:207:25:040
221959910981089,6cyclictest0-21swapper/107:25:081
221282714617,81sleep10-21swapper/107:24:531
219472507456,31sleep00-21swapper/007:23:000
2219499162117,39cyclictest26631-21apt-get07:35:010
70422930,8sleep12219599cyclictest12:25:141
231942490,8sleep02219499cyclictest10:15:230
91182421,4sleep00-21swapper/009:39:340
92662401,35sleep09275-21diskstats11:05:110
2219599364,4cyclictest81rcu_preempt08:03:161
17672361,32sleep1970-21/usr/sbin/munin12:10:231
2219499352,19cyclictest29176-21diskstats07:40:170
2219499351,23cyclictest27008-21/usr/sbin/munin11:50:280
22195993417,4cyclictest22-21ksoftirqd/111:50:281
2219599341,10cyclictest14632-21/usr/sbin/munin11:20:221
22194993411,12cyclictest0-21swapper/008:17:560
33622331,29sleep03442-21aten_r4power_vo10:50:090
243232331,28sleep12376-21NetworkManager08:52:231
22195993316,14cyclictest22-21ksoftirqd/110:22:221
2219499331,20cyclictest12884-21seq09:49:300
2219599329,9cyclictest6204-21gdbus11:08:321
2219599326,4cyclictest81rcu_preempt10:16:331
22195993217,12cyclictest22-21ksoftirqd/109:15:401
22195993213,5cyclictest25132-21timerandwakeup11:45:261
2219499327,12cyclictest25168-21timerwakeupswit11:45:270
2219499322,14cyclictest14895-21iostat_ios12:45:180
22194993218,11cyclictest24080-21unixbench_singl08:50:270
219462320,8sleep02219499cyclictest11:39:460
110542321,5sleep00-21swapper/009:44:590
2219599315,4cyclictest81rcu_preempt11:43:331
2219599314,4cyclictest81rcu_preempt10:31:571
22195993113,6cyclictest43822switchtime10:50:251
22194993124,3cyclictest0-21swapper/012:26:030
2219499312,15cyclictest848-21memory07:50:200
2219499312,15cyclictest15267-21/usr/sbin/munin09:55:140
2219499312,14cyclictest27623-21ntp_states07:35:280
2219499311,4cyclictest81rcu_preempt12:44:540
22194993114,6cyclictest19582-21ntp_states10:05:270
22194993114,5cyclictest26624-21df10:25:520
22194993112,6cyclictest5151-21df12:20:130
2219499311,18cyclictest17096-21cstates10:00:140
2219499311,16cyclictest22700-21cron08:50:010
22194993110,5cyclictest3726-21cut12:15:230
87392301,5sleep00-21swapper/011:04:090
87012303,5sleep122-21ksoftirqd/111:03:471
312692301,5sleep10-21swapper/112:03:431
2219599304,4cyclictest81rcu_preempt12:50:591
2219599304,19cyclictest8620-21/usr/sbin/munin12:30:291
2219599301,4cyclictest81rcu_preempt12:44:371
2219599301,4cyclictest81rcu_preempt08:23:121
2219599301,4cyclictest81rcu_preempt07:35:431
2219599301,11cyclictest18365-21timerwakeupswit08:35:291
2219499308,10cyclictest6204-21gdbus08:20:480
2219499302,15cyclictest14404-21chrt08:25:270
2219499301,4cyclictest81rcu_preempt11:18:450
22194993012,6cyclictest23173-21python11:40:260
22194993010,6cyclictest28157-21basename10:30:100
5972291,5sleep00-21swapper/012:07:500
53912291,5sleep00-21swapper/009:29:510
301122291,5sleep10-21swapper/110:35:121
298832291,5sleep00-21swapper/009:06:300
2219599296,4cyclictest81rcu_preempt12:20:511
2219599296,4cyclictest81rcu_preempt10:01:221
2219599295,4cyclictest81rcu_preempt12:36:501
2219599295,4cyclictest81rcu_preempt12:36:491
2219599294,4cyclictest81rcu_preempt09:40:001
2219599294,4cyclictest81rcu_preempt08:15:541
2219599294,18cyclictest30684-21diskstats09:10:121
2219599291,4cyclictest81rcu_preempt09:04:221
2219599291,4cyclictest81rcu_preempt08:10:131
2219599291,16cyclictest2343-21irqbalance12:09:171
2219599291,16cyclictest1591-21taskset07:51:571
2219499292,14cyclictest3913-21sendmail-msp08:00:000
2219499292,14cyclictest11456-21iostat_ios11:10:190
22194992919,6cyclictest1533-21cron09:20:010
2219499291,4cyclictest81rcu_preempt12:35:080
2219499291,4cyclictest81rcu_preempt12:35:070
22194992913,5cyclictest25571-21ntp_states08:55:230
22194992913,5cyclictest25571-21ntp_states08:55:220
22194992913,13cyclictest3-21ksoftirqd/010:35:220
22194992912,5cyclictest3020-21runrttasks10:49:320
22194992911,5cyclictest5503-21df_inode10:55:160
2219499291,14cyclictest3019-21unixbench_multi09:20:280
195362291,4sleep119573-21ntp_states10:05:241
290712281,5sleep00-21swapper/011:55:340
28152281,5sleep10-21swapper/112:15:011
249112281,24sleep125020-21df08:55:121
249112281,24sleep125020-21df08:55:121
2219599287,18cyclictest22-21ksoftirqd/107:55:151
2219599286,10cyclictest81rcu_preempt09:30:321
2219599284,5cyclictest81rcu_preempt08:07:101
2219599284,17cyclictest18981-21iostat_ios11:30:201
2219599283,4cyclictest81rcu_preempt11:26:021
2219599282,4cyclictest81rcu_preempt12:48:251
2219599282,4cyclictest81rcu_preempt10:58:261
2219599282,10cyclictest20549-21df_inode11:35:141
2219599281,5cyclictest1647-21diskstats10:45:141
2219599281,4cyclictest81rcu_preempt10:11:161
2219599281,15cyclictest27784-21/usr/sbin/munin11:55:291
2219499288,6cyclictest30749-21/usr/sbin/munin07:45:190
2219499284,18cyclictest5868-21df_inode09:30:180
2219499283,8cyclictest0-21swapper/012:30:140
2219499282,14cyclictest15213-21/usr/sbin/munin11:20:210
22194992816,7cyclictest6230-21diskstats08:05:130
22194992811,5cyclictest30948-21users12:00:300
2219499281,15cyclictest0-21swapper/011:26:370
2219499281,14cyclictest16878-21/usr/sbin/munin12:50:190
22194992811,4cyclictest0-21swapper/009:50:230
22194992810,5cyclictest6204-21gdbus08:41:460
22194992810,5cyclictest1712-21sed12:10:210
204752281,5sleep10-21swapper/108:41:251
149822281,7sleep10-21swapper/108:28:031
107662281,5sleep10-21swapper/109:41:581
49862271,5sleep10-21swapper/109:25:351
323282271,5sleep10-21swapper/107:48:391
312312271,5sleep00-21swapper/009:10:260
224322271,5sleep10-21swapper/108:47:131
2219599275,4cyclictest81rcu_preempt09:09:361
2219599274,4cyclictest81rcu_preempt09:22:181
2219599274,12cyclictest40950irq/93-i91509:45:231
2219599271,4cyclictest81rcu_preempt10:43:061
2219599271,14cyclictest29178-21diskstats07:40:181
2219499272,14cyclictest0-21swapper/008:35:190
2219499272,13cyclictest21640-21python10:10:290
22194992710,5cyclictest19703-21sshd11:30:560
167712271,5sleep10-21swapper/108:32:091
145482271,5sleep10-21swapper/109:52:161
141932271,5sleep10-21swapper/111:17:201
121572271,5sleep10-21swapper/111:10:451
22195992617,6cyclictest22-21ksoftirqd/110:25:091
2219499261,16cyclictest0-21swapper/009:00:140
2219499261,13cyclictest8107-21taskset08:10:130
2219499261,12cyclictest32230-21forks10:40:130
2219499261,12cyclictest24425-21wget10:20:090
22195992517,5cyclictest22-21ksoftirqd/109:55:111
2219499251,16cyclictest0-21swapper/008:00:120
2219499241,15cyclictest0-21swapper/008:31:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional