You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 10:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Jul 11, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276329912721,1267cyclictest0-21swapper/019:27:300
276329912721,1267cyclictest0-21swapper/019:27:290
264622645598,31sleep00-21swapper/019:20:210
274732465417,33sleep10-21swapper/119:23:551
2763399196187,6cyclictest0-21swapper/119:27:301
2763399196187,6cyclictest0-21swapper/119:27:301
1935821250,10sleep02763299cyclictest00:45:010
2763399731,4cyclictest933-21aten_r4power_en22:30:101
2763399721,6cyclictest31464-21/usr/sbin/munin22:25:211
2763399702,7cyclictest18850-21users00:40:311
2763399691,5cyclictest31250-21chrt22:24:271
27633996415,28cyclictest22-21ksoftirqd/122:04:511
27633996313,27cyclictest22-21ksoftirqd/120:05:511
2763399611,4cyclictest40250irq/92-i91521:55:101
2763399602,36cyclictest15125-21iostat21:40:181
27633996012,28cyclictest22-21ksoftirqd/123:34:471
27633996011,27cyclictest5844-21cat22:40:281
2763399599,33cyclictest30006-21aten_r4power_po20:55:111
2763399599,30cyclictest25531-21taskset22:08:491
2763399597,35cyclictest26239-21awk23:35:221
2763399597,26cyclictest40250irq/92-i91523:10:151
2763399592,35cyclictest30979-21memory19:30:221
2763399592,33cyclictest3286-21runrttasks00:21:131
2763399591,8cyclictest15692-21/usr/sbin/munin00:35:221
2763399591,6cyclictest26633-21fschecks_time20:45:161
2763399589,31cyclictest13616-21cut21:35:261
2763399583,47cyclictest24591-21diskstats20:40:151
2763399582,35cyclictest3286-21runrttasks21:47:381
2763399582,10cyclictest26640-21ntp_states22:10:241
2763399581,4cyclictest12889-21/usr/sbin/munin23:00:201
27633995811,30cyclictest3286-21runrttasks21:50:081
2763399579,29cyclictest28272-21cat20:50:111
2763399578,31cyclictest28366-21python23:40:281
2763399573,7cyclictest2695-21snmpd21:06:221
2763399573,7cyclictest22225-21turbostat.cron20:34:551
2763399571,9cyclictest11590-21ntpq21:30:271
2763399571,9cyclictest11590-21ntpq21:30:261
2763399571,8cyclictest3286-21runrttasks21:04:481
2763399571,5cyclictest9016-21/usr/sbin/munin22:50:171
2763399571,4cyclictest30207-21/usr/sbin/munin23:45:261
2763399567,31cyclictest18875-21expr23:15:261
2763399562,9cyclictest15003-21ntp_states23:05:241
2763399562,8cyclictest7243-21iostat22:45:191
2763399562,8cyclictest7243-21iostat22:45:181
2763399562,6cyclictest5363-21latency_hist19:50:011
2763399562,3cyclictest0-21swapper/100:15:121
2763399561,6cyclictest23053-21seq23:26:211
2763399561,6cyclictest22595-21cpuspeed_turbos20:35:111
2763399561,5cyclictest2884-21basename22:35:101
2763399555,32cyclictest3264-21taskset19:43:211
2763399555,32cyclictest16481-21taskset20:18:531
2763399552,9cyclictest20322-21ntp_states00:45:251
2763399551,5cyclictest5057-21latency_hist21:15:011
2763399551,42cyclictest32342-21/usr/sbin/munin19:35:121
2763399551,39cyclictest3941-21seq00:01:501
2763399551,37cyclictest31926-21ntp_states23:50:231
2763399551,10cyclictest803-21df_inode23:55:141
2763399547,29cyclictest8606-21seq21:23:451
2763399543,45cyclictest21662-21diskstats00:50:141
2763399542,35cyclictest9721-21ntp_states21:25:251
2763399541,6cyclictest19876-21grep20:25:291
2763399541,5cyclictest6124-21mailstats21:15:271
2763399541,39cyclictest10936-21chrt20:04:461
2763399541,37cyclictest28520-21ntpq22:15:241
2763399532,6cyclictest5467-21seq19:50:051
2763399531,6cyclictest7865-21seq00:13:381
2763399531,6cyclictest21155-21seq23:21:051
2763399531,6cyclictest12500-21if_eth000:25:181
2763399531,5cyclictest16776-21/usr/sbin/munin20:20:151
2763399531,37cyclictest10569-21cpuspeed_turbos22:55:121
2763399531,35cyclictest7840-21hddtemp_smartct19:55:171
2763399521,5cyclictest13607-21seq20:10:291
2763399511,6cyclictest5837-21chrt00:07:031
2763399511,6cyclictest14937-21timerwakeupswit00:30:291
242112420,6sleep0111rcuc/023:30:200
56432370,4sleep041ktimersoftd/022:40:260
27632993726,6cyclictest13311-21/usr/sbin/munin23:00:270
2763299361,20cyclictest3310-21taskset19:43:490
27632993611,12cyclictest23825-21latency_hist22:05:000
2763299358,12cyclictest11565-21gdbus19:47:440
2763299342,9cyclictest81rcu_preempt20:00:010
2763299341,5cyclictest81rcu_preempt20:16:140
2763299341,21cyclictest11565-21gdbus21:10:110
2763299331,4cyclictest81rcu_preempt21:31:300
2763299331,4cyclictest81rcu_preempt21:31:300
2763299331,24cyclictest0-21swapper/020:46:100
2763299331,21cyclictest25225-21processes20:40:260
209602331,5sleep00-21swapper/000:47:300
133142331,4sleep013418-21fschecks_time20:10:250
101812331,5sleep00-21swapper/021:25:390
2763299329,7cyclictest11565-21gdbus00:27:280
2763299328,12cyclictest5295-21ps00:05:270
68332311,5sleep00-21swapper/019:51:190
40402311,5sleep00-21swapper/000:02:530
308492311,5sleep00-21swapper/023:49:050
2763299312,24cyclictest13656-21python21:35:270
2763299311,18cyclictest8383-21munin-run22:50:000
2763299311,18cyclictest8383-21munin-run22:50:000
27632993111,7cyclictest6857-21runrttasks21:20:010
2763299311,13cyclictest8594-21runrttasks21:23:370
27632993110,5cyclictest16933-21wc23:10:260
167722311,5sleep00-21swapper/020:20:090
2763299307,11cyclictest2225-21dbus-daemon21:54:590
2763299302,14cyclictest3286-21runrttasks23:25:170
2763299302,12cyclictest9179-21latency22:50:210
27632993013,6cyclictest12337-21/usr/sbin/munin20:05:300
2763299301,17cyclictest29205-21runrttasks22:17:560
27632993011,6cyclictest20836-21python23:20:280
317742291,5sleep00-21swapper/019:32:380
294162291,5sleep00-21swapper/020:51:240
2763299296,12cyclictest32413-21expr19:35:130
2763299295,12cyclictest0-21swapper/000:20:180
27632992921,5cyclictest13821-21aten_r4power_cu00:30:120
2763299291,4cyclictest81rcu_preempt21:45:550
2763299291,4cyclictest81rcu_preempt20:00:060
2763299291,4cyclictest81rcu_preempt00:13:500
2763299291,13cyclictest31921-21ntpq23:50:230
217292291,5sleep00-21swapper/021:58:270
95112281,5sleep00-21swapper/000:16:140
43502281,5sleep00-21swapper/022:37:290
2763299281,4cyclictest81rcu_preempt21:02:560
2763299281,24cyclictest27151-21runrttasks22:11:060
2763299281,19cyclictest0-21swapper/000:51:080
27632992811,5cyclictest23990-21wget22:05:120
2763299281,14cyclictest29965-21grep22:20:150
2763299281,14cyclictest23286-21grep20:35:250
2763299281,14cyclictest19461-21grep20:25:230
2763299281,13cyclictest1238-21/usr/sbin/munin21:05:200
27632992810,6cyclictest18238-21fschecks_count23:15:150
220732281,5sleep00-21swapper/020:33:200
158362281,5sleep00-21swapper/021:40:430
120362281,5sleep00-21swapper/022:59:110
313572271,5sleep00-21swapper/020:57:020
2763299279,6cyclictest1397-21sed22:30:180
2763299279,5cyclictest16868-21grep00:35:280
2763299272,3cyclictest81rcu_preempt23:05:210
2763299271,16cyclictest0-21swapper/023:36:460
2763299271,14cyclictest1810-21taskset23:55:350
2763299271,13cyclictest32612-21grep22:25:270
2763299271,13cyclictest28974-21taskset23:44:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional