You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 03:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri May 01, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
155819911981171,12cyclictest0-21swapper/019:25:140
155829911821159,19cyclictest11946-21ssh21:30:291
155829911821159,19cyclictest11946-21ssh21:30:291
155062581517,50sleep10-21swapper/119:24:481
154012536456,65sleep00-21swapper/019:23:420
1558199141117,18cyclictest0-21swapper/021:30:290
1558199141117,18cyclictest0-21swapper/021:30:290
1381221180,4sleep00-21swapper/023:13:240
163902960,5sleep041ktimersoftd/023:49:560
19812900,8sleep01558199cyclictest21:54:460
159102730,2sleep115911-21fschecks_count21:35:141
163412720,8sleep01558199cyclictest22:42:120
15582996547,11cyclictest15724-21/usr/sbin/munin19:25:141
314332480,3sleep0111rcuc/022:58:050
286212470,6sleep11558299cyclictest23:28:491
286212470,6sleep11558299cyclictest23:28:491
39242440,3sleep041ktimersoftd/000:45:120
15582994219,7cyclictest22-21ksoftirqd/123:58:421
15581994112,13cyclictest3286-21runrttasks22:10:160
1558299390,4cyclictest81rcu_preempt00:48:521
303362381,4sleep130347-21ssh00:04:081
1558299384,4cyclictest81rcu_preempt22:10:381
39542370,8sleep01558199cyclictest00:10:320
247192371,5sleep03-21ksoftirqd/019:45:260
161562371,32sleep016180-21ntpq23:15:250
1558199378,4cyclictest5077-21taskset21:24:130
152562371,4sleep115267-21ssh00:22:561
122732371,32sleep112283-21ssh00:54:591
252702361,32sleep025281-21ssh00:33:270
15582993628,5cyclictest22-21ksoftirqd/100:40:011
15582993615,8cyclictest22-21ksoftirqd/100:43:511
15582993611,21cyclictest961-21sh22:26:051
15581993614,5cyclictest22419-21hddtemp_smartct22:15:180
15581993610,14cyclictest17314-21chrt20:50:530
5432351,31sleep0558-21ssh23:33:110
207292350,7sleep00-21swapper/000:28:510
197272350,3sleep0111rcuc/023:52:450
1558299354,4cyclictest81rcu_preempt21:49:281
15582993511,20cyclictest10950-21uname20:35:191
15581993510,13cyclictest3649-21runrttasks20:15:240
1558299341,7cyclictest12211-21diskstats23:45:151
15582993413,5cyclictest22-21ksoftirqd/123:33:251
1558299341,29cyclictest23071-21sort19:40:271
15582993412,11cyclictest40250irq/92-i91523:41:401
15582993412,10cyclictest22-21ksoftirqd/123:39:421
15581993417,6cyclictest3-21ksoftirqd/021:45:270
1558199341,14cyclictest353-21udevd23:05:270
15581993410,12cyclictest0-21swapper/000:35:040
288482331,28sleep028909-21fschecks_count21:15:170
176722331,4sleep116998-21/usr/sbin/munin00:25:231
1558299338,5cyclictest40250irq/92-i91522:35:001
15582993318,8cyclictest17429-21iostat_ios23:50:221
15582993310,9cyclictest81rcu_preempt22:17:261
1558199332,21cyclictest0-21swapper/022:30:210
12752331,28sleep11288-21sh00:08:511
31362322,5sleep10-21swapper/123:01:571
256732321,5sleep025687-21ssh23:59:240
226902321,5sleep122702-21rm21:41:451
15582993214,15cyclictest22-21ksoftirqd/122:07:541
1558199327,13cyclictest24087-21fschecks_time21:10:150
1558199322,12cyclictest0-21swapper/021:37:180
1558199321,5cyclictest0-21swapper/022:04:220
15581993212,6cyclictest0-21swapper/000:21:170
1558199321,16cyclictest24982-21sort21:45:010
1558299316,21cyclictest0-21swapper/122:37:231
1558299312,17cyclictest0-21swapper/122:43:121
1558299311,9cyclictest81rcu_preempt22:45:081
15582993119,8cyclictest22-21ksoftirqd/121:50:111
1558299311,7cyclictest0-21swapper/123:11:441
1558299311,4cyclictest81rcu_preempt23:20:531
1558299311,4cyclictest81rcu_preempt00:17:421
15582993114,14cyclictest22-21ksoftirqd/121:25:421
1558199314,4cyclictest81rcu_preempt23:20:320
1558199314,4cyclictest81rcu_preempt00:17:410
1558199311,4cyclictest81rcu_preempt21:26:460
1558199311,16cyclictest0-21swapper/000:54:250
15581993111,5cyclictest24335-21ssh22:50:250
15581993110,6cyclictest1426-21runrttasks22:26:450
10452311,26sleep11202-21df21:20:131
27802301,5sleep12934-21fschecks_count21:55:171
195602301,5sleep00-21swapper/019:30:580
1558299308,5cyclictest40250irq/92-i91521:15:161
1558299307,12cyclictest40250irq/92-i91519:55:201
1558299305,3cyclictest81rcu_preempt19:37:121
1558299305,13cyclictest81rcu_preempt22:20:161
15582993012,6cyclictest19604-21cron20:59:591
1558299301,25cyclictest0-21swapper/100:10:431
1558299301,15cyclictest25010-21ssh22:50:471
15582993011,4cyclictest81rcu_preempt21:05:131
1558199303,5cyclictest81rcu_preempt23:36:270
1558199303,4cyclictest81rcu_preempt23:27:100
1558199303,4cyclictest81rcu_preempt23:27:090
1558199302,4cyclictest81rcu_preempt22:05:540
1558199301,4cyclictest81rcu_preempt00:07:310
15581993011,6cyclictest21232-21/usr/sbin/munin19:35:260
1558199301,15cyclictest7178-21ssh23:40:140
1558199301,15cyclictest18768-21cpuspeed_turbos22:45:130
1558199301,14cyclictest31089-21runrttasks20:03:250
15581993010,7cyclictest32213-21/usr/sbin/munin20:05:220
80522291,5sleep10-21swapper/123:07:021
271562291,5sleep10-21swapper/119:51:461
231862291,5sleep00-21swapper/021:08:110
214072291,5sleep10-21swapper/121:04:131
211482291,5sleep00-21swapper/021:01:320
194752291,5sleep10-21swapper/123:19:371
1558299292,14cyclictest0-21swapper/121:10:361
1558299291,7cyclictest21801-21/usr/sbin/munin00:30:131
1558299291,4cyclictest81rcu_preempt20:08:461
15582992914,11cyclictest1716-21proc_pri20:10:301
1558299291,15cyclictest28259-21cut22:55:111
15582992910,4cyclictest40250irq/92-i91520:20:151
1558199299,7cyclictest5091-21fschecks_count20:20:150
1558199292,15cyclictest7081-21/usr/sbin/munin20:25:160
1558199292,14cyclictest31822-21diskstats00:40:160
1558199292,13cyclictest3481-21seq23:02:260
1558199291,4cyclictest81rcu_preempt22:24:310
1558199291,4cyclictest81rcu_preempt19:56:230
15581992911,6cyclictest9414-21fgrep20:30:280
1558199291,15cyclictest27554-21mailstats00:00:280
1558199291,14cyclictest2740-21df21:55:130
1558199291,14cyclictest13585-21ssh22:40:010
116522291,3sleep123375-21diskmemload22:04:371
82982281,23sleep18307-21munin-run20:30:001
193642281,5sleep00-21swapper/020:57:390
1558299286,4cyclictest81rcu_preempt20:16:461
1558299284,4cyclictest81rcu_preempt19:47:161
1558199284,17cyclictest23024-21python19:40:270
1558199281,18cyclictest0-21swapper/020:10:230
15581992810,14cyclictest135842chrt20:41:090
1558299274,4cyclictest81rcu_preempt20:42:401
1558299274,4cyclictest81rcu_preempt20:01:221
1558199272,12cyclictest14717-21irqstats20:45:200
1558299265,4cyclictest81rcu_preempt19:30:271
15582992616,6cyclictest14867-21strings20:45:221
15582992612,4cyclictest81rcu_preempt20:30:161
116642261,5sleep00-21swapper/020:35:590
1558299254,4cyclictest81rcu_preempt20:54:491
15581992515,6cyclictest26358-21iostat_ios19:50:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional