You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 12:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Dec 02, 2025 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149659911461130,13cyclictest0-21swapper/119:25:141
149659911461123,19cyclictest2631-21perl20:15:181
144812573527,31sleep00-21swapper/019:20:340
145152555472,41sleep10-21swapper/119:20:571
149649914490,28cyclictest15192-21wget19:25:130
149649910684,18cyclictest0-21swapper/020:15:180
200092850,8sleep11496599cyclictest21:40:151
167262830,4sleep0111rcuc/023:16:300
306612710,6sleep130645-21ssh00:05:121
217192670,7sleep01496499cyclictest19:40:160
114422620,25sleep122-21ksoftirqd/121:30:301
9442580,8sleep01496499cyclictest22:26:590
137422510,4sleep013739-21cpuspeed_turbos20:45:130
118332480,7sleep01496499cyclictest00:52:330
300492440,4sleep041ktimersoftd/000:04:410
92272401,35sleep09326-21users00:15:310
1496499393,5cyclictest81rcu_preempt22:30:210
14964993922,6cyclictest3-21ksoftirqd/022:00:220
1496599389,17cyclictest0-21swapper/100:27:221
1496499371,21cyclictest28756-21munin-run20:00:000
4972360,2sleep0498-21fschecks_time23:00:190
14965993614,8cyclictest81rcu_preempt23:45:221
1496499361,8cyclictest17136-21ssh21:36:360
1496499361,21cyclictest31946-21ls20:05:340
110722361,4sleep111082-21ssh00:51:231
1496499353,17cyclictest8182-21diskstats20:30:160
1496499351,7cyclictest4728-21ssh00:10:510
1496499351,7cyclictest13216-21ssh22:05:450
14964993512,5cyclictest5576-21sh00:45:280
1496599347,23cyclictest0-21swapper/123:40:581
1496599345,25cyclictest0-21swapper/121:26:241
1496499349,4cyclictest81rcu_preempt22:15:090
14964993415,6cyclictest3-21ksoftirqd/021:51:170
1496499341,26cyclictest40950irq/93-i91500:33:170
1496499341,19cyclictest7441-21ssh21:26:330
1496499341,13cyclictest23985-21pidof23:25:000
114382341,9sleep00-21swapper/020:39:400
65252331,5sleep00-21swapper/023:05:430
48932330,4sleep041ktimersoftd/021:24:520
167942332,4sleep10-21swapper/122:43:441
1496599336,14cyclictest0-21swapper/122:31:361
1496599335,4cyclictest81rcu_preempt19:41:411
14965993323,6cyclictest9945-21/usr/sbin/munin23:10:121
1496499336,13cyclictest0-21swapper/021:09:310
1496499332,4cyclictest81rcu_preempt21:10:520
14964993322,7cyclictest27574-21ssh23:28:130
14964993318,5cyclictest3-21ksoftirqd/000:35:210
14964993317,5cyclictest3-21ksoftirqd/020:28:020
1496499331,19cyclictest24341-21sh21:45:000
14964993310,11cyclictest11130-21unixbench_multi23:10:290
315992321,4sleep131611-21ssh23:32:051
161022321,4sleep116104-21ssh22:09:571
1496599326,4cyclictest81rcu_preempt19:35:441
1496599322,9cyclictest0-21swapper/122:36:371
1496599321,9cyclictest2631-21ls21:55:241
1496599321,5cyclictest81rcu_preempt00:21:561
14965993210,19cyclictest0-21swapper/100:34:501
1496499328,5cyclictest81rcu_preempt21:57:360
1496499327,5cyclictest81rcu_preempt00:05:020
1496499326,5cyclictest81rcu_preempt22:40:510
1496499323,17cyclictest0-21swapper/023:31:060
1496499321,8cyclictest0-21swapper/022:20:290
14964993214,6cyclictest3-21ksoftirqd/021:31:480
14964993210,17cyclictest21195-21rm22:48:060
35752311,26sleep13611-21hddtemp_smartct00:10:191
296632311,5sleep10-21swapper/122:23:341
1496599315,4cyclictest81rcu_preempt20:41:211
1496599315,4cyclictest81rcu_preempt20:38:551
1496599315,4cyclictest81rcu_preempt19:30:341
1496599315,4cyclictest81rcu_preempt00:43:391
1496599312,9cyclictest27931-21df_inode22:55:161
1496599312,9cyclictest27931-21df_inode22:55:161
1496599312,25cyclictest0-21swapper/100:35:271
1496599311,4cyclictest81rcu_preempt21:39:171
1496499313,4cyclictest81rcu_preempt00:20:280
1496499312,4cyclictest81rcu_preempt23:57:190
1496499312,15cyclictest28579-21ntp_states22:55:270
1496499312,15cyclictest28579-21ntp_states22:55:260
14964993117,4cyclictest3-21ksoftirqd/022:54:380
14964993111,7cyclictest0-21swapper/019:35:380
14964993111,6cyclictest18455-21ntp_states19:30:260
1496499311,14cyclictest27861-21ssh21:15:060
1236823112,4sleep122-21ksoftirqd/100:19:581
1496599308,18cyclictest0-21swapper/123:00:031
1496599305,4cyclictest81rcu_preempt22:54:031
1496599303,4cyclictest81rcu_preempt20:34:481
14965993019,7cyclictest30944-21snmpd19:55:061
1496599301,8cyclictest8912-21ssh22:01:301
1496599301,4cyclictest81rcu_preempt23:55:211
1496599301,4cyclictest81rcu_preempt23:26:191
1496599301,4cyclictest81rcu_preempt20:26:501
14965993013,14cyclictest22-21ksoftirqd/121:15:281
14965993010,7cyclictest14757-21unixbench_singl20:45:301
1496499307,12cyclictest81rcu_preempt19:50:310
1496499305,12cyclictest6712-21cat23:40:140
1496499305,12cyclictest24478-21unixbench_multi19:45:290
1496499303,4cyclictest81rcu_preempt00:42:470
1496499302,15cyclictest19893-21memory21:00:240
14964993011,6cyclictest26070-21users21:45:330
1496499301,14cyclictest330-21tr20:10:130
1496499301,14cyclictest13506-21ssh23:46:410
14964993010,6cyclictest8972-21diskmemload22:35:220
131762301,4sleep00-21swapper/020:43:000
12112301,5sleep10-21swapper/121:54:351
65132291,24sleep16523-21ssh23:05:421
20972291,5sleep10-21swapper/121:20:571
189092291,5sleep00-21swapper/022:12:010
1496599292,23cyclictest26685-21ntp_states00:00:251
1496599292,14cyclictest0-21swapper/123:38:481
14965992916,9cyclictest22-21ksoftirqd/123:17:081
14965992915,8cyclictest4795-21diskstats00:45:151
1496599291,4cyclictest81rcu_preempt20:54:041
1496599291,24cyclictest31750-21memory22:25:241
1496599291,16cyclictest22752-21ssh23:23:121
1496599291,15cyclictest21907-21ntp_states21:05:251
14964992912,6cyclictest3-21ksoftirqd/020:57:400
1496499291,15cyclictest30139-21grep20:00:310
57002281,5sleep00-21swapper/020:23:350
323842281,5sleep10-21swapper/120:08:341
286082281,5sleep10-21swapper/121:49:131
248762281,4sleep10-21swapper/119:48:491
1496599287,7cyclictest6204-21gdbus21:02:211
1496599284,4cyclictest81rcu_preempt20:02:481
1496599282,10cyclictest4410-21df20:20:151
1496599281,7cyclictest30944-21snmpd22:18:101
14965992816,9cyclictest22-21ksoftirqd/123:50:381
14965992816,9cyclictest22-21ksoftirqd/122:10:381
1496499283,12cyclictest0-21swapper/023:50:270
1496499282,16cyclictest0-21swapper/023:38:160
1496499282,13cyclictest17657-21aten_r4power_vo00:25:130
253312271,5sleep10-21swapper/121:11:401
198492271,5sleep10-21swapper/122:46:091
168122271,5sleep00-21swapper/020:51:410
266492261,5sleep10-21swapper/119:52:451
186572261,5sleep10-21swapper/120:56:191
1496599259,5cyclictest40950irq/93-i91520:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional