You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 13:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Dec 08, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141089912691,5cyclictest14357-21wget19:25:131
141089912411220,17cyclictest0-21swapper/121:15:011
141079911691128,34cyclictest14531-21df19:25:130
139482566478,72sleep00-21swapper/019:23:590
139282539493,31sleep10-21swapper/119:23:471
1410799208180,10cyclictest0-21swapper/021:15:010
193312970,8sleep01410799cyclictest00:28:050
50332910,9sleep01410799cyclictest23:05:350
251712770,5sleep041ktimersoftd/021:45:360
34942740,8sleep01410799cyclictest20:20:160
70352570,7sleep01410799cyclictest00:15:200
170472570,8sleep11410899cyclictest20:55:231
311942550,25sleep03-21ksoftirqd/022:25:310
311942550,25sleep03-21ksoftirqd/022:25:310
97592510,8sleep01410799cyclictest20:35:280
182602500,4sleep1211ktimersoftd/123:20:121
257482470,7sleep11410899cyclictest22:20:231
143362450,5sleep01410799cyclictest23:15:270
210572440,21sleep03-21ksoftirqd/022:49:380
100372440,3sleep1201rcuc/123:45:121
100372440,3sleep1201rcuc/123:45:111
14107994316,5cyclictest23710-21taskset22:51:300
1410799421,9cyclictest0-21swapper/023:49:340
1410799421,9cyclictest0-21swapper/023:49:340
179982400,9sleep01410799cyclictest20:58:220
14107994023,6cyclictest3-21ksoftirqd/023:40:140
226922391,34sleep122703-21ssh21:44:021
1410799391,4cyclictest81rcu_preempt00:51:010
272022381,33sleep127216-21ssh23:29:341
1410799384,5cyclictest81rcu_preempt21:18:030
1410799383,4cyclictest81rcu_preempt00:24:410
14107993813,5cyclictest19874-21diskstats23:55:170
264462370,3sleep0111rcuc/000:01:260
148612371,32sleep16204-21gdbus22:09:401
1410899375,5cyclictest81rcu_preempt22:39:041
1410799372,7cyclictest16725-21ssh21:37:220
1410899362,9cyclictest408-21ntp_states21:20:261
14107993618,6cyclictest3-21ksoftirqd/021:51:020
14107993618,6cyclictest3-21ksoftirqd/021:51:010
1410799361,4cyclictest81rcu_preempt22:38:140
1410799359,4cyclictest81rcu_preempt00:05:060
1410799356,5cyclictest81rcu_preempt21:32:550
300022341,5sleep00-21swapper/023:31:390
225652341,29sleep122574-21sh23:57:511
1410899342,11cyclictest0-21swapper/100:41:201
14108993414,17cyclictest22-21ksoftirqd/123:09:291
1410799348,5cyclictest81rcu_preempt22:18:010
1410799348,4cyclictest81rcu_preempt22:55:430
1410799346,4cyclictest81rcu_preempt23:54:080
1410799342,16cyclictest5980-21ntp_states20:25:270
14107993411,6cyclictest21222-21ssh00:30:130
66732331,28sleep16473-21/usr/sbin/munin00:15:161
1410899338,12cyclictest0-21swapper/100:36:511
1410899337,13cyclictest0-21swapper/100:23:531
1410899335,4cyclictest81rcu_preempt20:21:431
1410899331,5cyclictest81rcu_preempt22:52:101
1410799331,7cyclictest5401-21ssh22:32:540
14107993315,6cyclictest3-21ksoftirqd/021:43:450
14107993314,7cyclictest3-21ksoftirqd/023:25:480
1410799331,20cyclictest18835-21iostat23:20:200
14107993310,5cyclictest23554-21ls19:45:280
274332320,7sleep11410899cyclictest21:15:171
1410899329,19cyclictest0-21swapper/122:10:261
1410899325,4cyclictest81rcu_preempt23:14:071
14108993216,12cyclictest22-21ksoftirqd/120:00:191
1410899321,5cyclictest81rcu_preempt22:56:221
1410799329,11cyclictest6204-21gdbus20:30:050
1410799326,5cyclictest81rcu_preempt22:40:240
1410799325,14cyclictest24797-21hddtemp_smartct19:50:190
1410799324,4cyclictest81rcu_preempt21:22:570
1410799321,26cyclictest16879-21wget19:30:150
1410799321,20cyclictest2593-21runrttasks21:55:570
9362310,28sleep1949-21ssh22:28:361
9362310,28sleep1949-21ssh22:28:361
1410899315,4cyclictest81rcu_preempt19:49:011
1410899315,14cyclictest0-21swapper/100:05:291
1410899314,8cyclictest0-21swapper/121:01:591
1410899313,16cyclictest0-21swapper/121:54:301
1410899313,16cyclictest0-21swapper/121:54:301
1410899312,18cyclictest0-21swapper/100:25:451
1410899311,4cyclictest81rcu_preempt23:51:201
1410799317,4cyclictest81rcu_preempt00:10:140
1410799316,4cyclictest81rcu_preempt23:01:440
1410799314,4cyclictest81rcu_preempt00:46:180
1410799312,5cyclictest81rcu_preempt23:38:280
14107993114,3cyclictest0-21swapper/022:23:000
116992311,26sleep10-21swapper/100:54:431
1410899304,17cyclictest0-21swapper/120:45:521
1410899302,17cyclictest0-21swapper/122:03:171
1410899301,4cyclictest81rcu_preempt23:36:061
1410899301,19cyclictest0-21swapper/120:05:221
1410799306,4cyclictest81rcu_preempt22:05:020
1410799306,4cyclictest81rcu_preempt00:38:510
1410799305,4cyclictest81rcu_preempt23:13:170
1410799301,4cyclictest81rcu_preempt20:44:500
1410799301,4cyclictest81rcu_preempt20:13:450
1410799301,4cyclictest81rcu_preempt20:02:210
14107993012,5cyclictest30884-21df_inode00:40:160
1410799301,25cyclictest18365-21wget21:00:120
14107993012,14cyclictest30559-21irqstats20:05:220
123522301,4sleep10-21swapper/121:33:021
64972291,5sleep10-21swapper/120:26:151
61792291,5sleep10-21swapper/122:34:041
182592291,5sleep10-21swapper/119:32:411
1410899299,16cyclictest0-21swapper/120:33:361
1410899296,4cyclictest81rcu_preempt22:16:531
1410899294,16cyclictest0-21swapper/121:08:371
1410899293,4cyclictest81rcu_preempt21:57:091
1410899293,4cyclictest81rcu_preempt19:37:071
1410899293,13cyclictest16856-21aten_r4power_po22:45:121
1410899292,15cyclictest0-21swapper/100:04:151
1410899292,14cyclictest31562-21diskstats23:00:161
1410899291,7cyclictest8206-21ssh23:42:551
14108992917,9cyclictest22-21ksoftirqd/122:40:471
14108992914,12cyclictest22-21ksoftirqd/100:30:171
1410799296,5cyclictest81rcu_preempt21:25:480
1410799295,4cyclictest81rcu_preempt22:03:030
1410799292,14cyclictest26708-21/usr/sbin/munin19:55:200
1410799292,13cyclictest15828-21users20:50:320
1410799292,13cyclictest13860-21grep20:45:300
30112281,5sleep10-21swapper/120:19:211
277852281,5sleep10-21swapper/119:58:561
257352281,5sleep10-21swapper/121:46:261
215152281,5sleep00-21swapper/021:05:430
200862281,5sleep00-21swapper/019:37:120
1410899289,15cyclictest0-21swapper/100:10:461
1410899286,4cyclictest81rcu_preempt21:36:561
14108992817,8cyclictest22-21ksoftirqd/123:30:321
1410899281,5cyclictest40950irq/93-i91519:50:291
1410899281,4cyclictest81rcu_preempt20:11:401
14108992811,4cyclictest0-21swapper/121:25:141
1410799287,16cyclictest2220-21dbus-daemon22:10:390
1410799286,5cyclictest3020-21runrttasks19:40:060
1410799281,24cyclictest1257-21aten_r4power_cu20:15:140
1410899278,15cyclictest0-21swapper/100:46:061
1410899272,13cyclictest81rcu_preempt23:15:241
88942261,5sleep10-21swapper/120:35:051
14108992617,5cyclictest22-21ksoftirqd/120:50:311
1410899258,5cyclictest40950irq/93-i91519:40:281
1410899251,10cyclictest3020-21runrttasks20:40:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional