You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 16:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Wed Apr 29, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195509912661,4cyclictest0-21swapper/109:25:001
195509912661,4cyclictest0-21swapper/109:25:001
195499912341183,37cyclictest19775-21aten_r4power_po07:25:130
195509911431128,12cyclictest0-21swapper/107:25:121
193872562517,30sleep00-21swapper/007:23:510
194152561517,30sleep10-21swapper/107:24:081
1954999112103,5cyclictest8625-21date09:25:000
1954999112103,5cyclictest8625-21date09:25:000
60492840,4sleep1201rcuc/110:35:191
1955099564,17cyclictest26483-21ntp_states11:35:261
1955099556,16cyclictest23407-21perl10:55:161
1955099554,17cyclictest25177-21users12:10:301
1955099554,16cyclictest32290-21aten_r4power_cu09:15:101
19550995512,11cyclictest19577-21unixbench_singl08:45:291
19550995512,11cyclictest19577-21unixbench_singl08:45:281
1955099544,16cyclictest10986-21/usr/sbin/munin11:55:141
1955099533,16cyclictest12977-21taskset10:43:271
1955099525,16cyclictest3286-21runrttasks11:49:261
1955099521,16cyclictest21969-21aten_r4power_cu09:40:111
1955099521,15cyclictest6707-21sh11:13:091
1955099513,15cyclictest25294-21taskset09:00:511
1955099513,14cyclictest27581-21diskmemload10:15:261
1955099512,15cyclictest29097-21ssh11:01:081
1955099512,15cyclictest20061-21iostat_ios12:05:201
1955099511,18cyclictest31343-21awk11:40:301
1955099511,17cyclictest22041-21df12:45:141
1955099511,16cyclictest26305-21ssh10:20:541
1955099511,16cyclictest21458-21/usr/sbin/munin11:30:121
1955099502,16cyclictest27812-21chrt09:10:101
1955099502,15cyclictest9932-21ssh10:02:481
1955099502,15cyclictest8758-21ssh12:30:081
1955099502,15cyclictest30292-21sh07:50:161
1955099502,15cyclictest29571-21ssh10:25:171
1955099502,15cyclictest28487-21taskset09:46:421
1955099502,15cyclictest21182-21ssh10:52:321
1955099502,14cyclictest20424-21sh09:37:551
1955099501,18cyclictest15815-21runrttasks12:37:441
1955099493,29cyclictest5669-21python12:25:301
1955099492,15cyclictest9816-21ssh11:16:021
1955099492,15cyclictest28674-21ssh12:15:191
1955099492,15cyclictest18652-21ssh12:04:121
1955099491,16cyclictest6225-21runrttasks11:50:041
1955099491,16cyclictest6225-21runrttasks11:50:031
1955099491,15cyclictest2695-21snmpd11:23:051
1955099491,15cyclictest2695-21snmpd10:14:401
1955099488,16cyclictest31975-21ssh11:05:141
1955099483,21cyclictest16559-21ssh09:33:451
1955099482,15cyclictest3434-21ssh10:32:091
1955099482,15cyclictest19461-21ssh12:41:351
1955099482,15cyclictest1798-21which08:00:161
1955099482,14cyclictest4627-21chrt08:06:051
1955099481,15cyclictest13747-21chrt10:06:511
1955099481,15cyclictest12186-21ssh09:28:451
1954999481,18cyclictest11412-21sh11:18:440
1955099473,16cyclictest1574-21ssh12:20:411
1955099473,15cyclictest4989-21ssh09:56:521
1955099472,15cyclictest5725-21cat08:10:181
1955099472,15cyclictest28092-21cat07:45:111
1955099472,14cyclictest16390-21ssh10:46:501
1955099462,15cyclictest8306-21users08:15:291
1955099462,15cyclictest28037-21ssh12:51:301
1955099462,15cyclictest22788-21cat07:30:151
1955099462,15cyclictest19025-21ssh11:26:501
1955099461,14cyclictest26333-21df_inode07:40:141
1955099460,15cyclictest1367-21ssh09:53:201
1955099452,16cyclictest24742-21grep07:35:181
1955099427,12cyclictest12982-21df_inode08:30:131
1955099420,14cyclictest8941-21/usr/sbin/munin08:20:241
1955099420,14cyclictest21046-21ntpq08:50:231
1955099413,15cyclictest16463-21/usr/sbin/munin08:40:281
1955099412,16cyclictest22680-21/usr/sbin/munin08:55:191
1954999412,4cyclictest81rcu_preempt12:05:120
1954999406,4cyclictest81rcu_preempt12:25:210
1955099381,8cyclictest0-21swapper/108:35:541
206722370,8sleep01954999cyclictest09:38:190
1954999371,18cyclictest16223-21ssh11:24:270
1954999364,11cyclictest81rcu_preempt08:09:590
1954999361,23cyclictest30900-21ssh09:13:110
1954999361,21cyclictest30081-21df_inode07:50:120
1954999361,20cyclictest19583-21ssh12:41:460
1954999361,13cyclictest0-21swapper/012:13:510
1954999361,10cyclictest81rcu_preempt07:47:190
117592361,31sleep011831-21python08:25:270
306712350,6sleep00-21swapper/009:50:070
1955099351,8cyclictest0-21swapper/109:05:041
1954999359,13cyclictest25834-21latency_hist12:50:010
1954999353,5cyclictest81rcu_preempt08:15:450
1954999351,21cyclictest24309-21wc07:35:090
1954999351,21cyclictest13741-21iostat12:35:190
1954999350,10cyclictest81rcu_preempt10:21:470
1954999344,4cyclictest81rcu_preempt11:56:090
1954999344,4cyclictest81rcu_preempt11:36:520
1954999342,7cyclictest21706-21hddtemp_smartct11:30:160
1954999342,5cyclictest81rcu_preempt10:15:320
1954999342,27cyclictest22275-21df_inode09:40:130
1954999342,16cyclictest29052-21ntp_states12:15:250
1954999341,21cyclictest31007-21ssh10:26:280
1954999341,21cyclictest18543-21/usr/sbin/munin10:50:180
1954999341,17cyclictest8153-21ssh10:37:450
1954999340,4cyclictest81rcu_preempt09:26:480
275202331,4sleep027582-21df11:00:120
1955099338,4cyclictest0-21swapper/108:25:271
1954999334,5cyclictest81rcu_preempt12:50:150
1954999334,4cyclictest81rcu_preempt10:45:120
1954999331,15cyclictest0-21swapper/009:48:550
1954999331,13cyclictest0-21swapper/009:09:590
41952320,4sleep0111rcuc/009:20:010
1955099321,11cyclictest32287-21fschecks_time07:55:161
1954999325,4cyclictest81rcu_preempt08:20:120
1954999324,5cyclictest81rcu_preempt10:40:240
1954999324,4cyclictest81rcu_preempt11:29:540
1954999323,4cyclictest81rcu_preempt11:08:310
1954999322,20cyclictest0-21swapper/012:22:250
1954999322,15cyclictest1851-21ntp_states10:30:250
1954999321,4cyclictest81rcu_preempt10:55:080
1954999321,4cyclictest81rcu_preempt07:44:150
1954999321,3cyclictest0-21swapper/009:58:520
1954999321,18cyclictest31544-21ssh11:40:500
1954999321,14cyclictest18697-21ssh10:12:510
1954999318,4cyclictest31982cat08:05:000
1954999314,4cyclictest81rcu_preempt08:41:000
1954999311,7cyclictest5340-21ssh11:48:490
1954999311,4cyclictest81rcu_preempt08:35:000
1954999306,5cyclictest81rcu_preempt12:00:300
1954999303,4cyclictest81rcu_preempt09:04:160
1954999301,5cyclictest81rcu_preempt10:00:190
1954999301,4cyclictest81rcu_preempt10:05:450
1954999301,4cyclictest81rcu_preempt09:34:560
1954999301,24cyclictest3941-21expr11:10:110
1954999301,17cyclictest20513-21diskstats08:50:140
1954999299,4cyclictest0-21swapper/012:32:050
1954999293,11cyclictest22699-21perl07:30:140
1954999292,4cyclictest81rcu_preempt08:11:070
1954999291,5cyclictest81rcu_preempt11:53:050
1954999291,5cyclictest81rcu_preempt11:53:050
1954999290,4cyclictest81rcu_preempt07:56:520
19549992811,4cyclictest19133-21ntpdc08:45:230
19549992811,4cyclictest19133-21ntpdc08:45:220
1954999272,13cyclictest0-21swapper/008:55:270
1954999270,4cyclictest81rcu_preempt08:39:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional