You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 19:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Mon Mar 09, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25859912361218,15cyclictest0-21swapper/107:27:091
25849910921082,7cyclictest0-21swapper/007:26:440
24672620573,32sleep10-21swapper/107:24:201
25222464417,32sleep00-21swapper/007:24:560
275362850,8sleep1258599cyclictest11:40:131
188732850,8sleep0258499cyclictest09:17:390
196412840,8sleep1258599cyclictest08:05:231
326682820,3sleep00-21swapper/012:52:250
258599801,31cyclictest16857-21ntpq09:15:241
258599791,36cyclictest19336-21sh12:37:581
258599761,34cyclictest25451-21sh12:45:011
258599752,41cyclictest14818-21diskstats10:20:151
258599752,34cyclictest19629-21df10:25:131
258599751,35cyclictest11347-21df_inode07:45:131
258599751,32cyclictest14116-21chrt11:25:291
258599751,31cyclictest15961-21latency_hist10:55:001
258599748,61cyclictest138250irq/90-eth011:05:241
258599741,37cyclictest12712-21sh09:45:021
258599732,32cyclictest6432-21/usr/sbin/munin10:45:271
258599731,36cyclictest5418-21hwlatdetect11:50:171
258599731,33cyclictest13062-21taskset11:58:161
2585997217,39cyclictest23144-21iostat_ios08:15:211
258599721,38cyclictest302-21grep11:45:161
258599721,37cyclictest11639-21hwlatdetect09:10:191
258599721,34cyclictest31439-21grep12:50:291
258599721,34cyclictest25474-21switchtime08:20:261
258599721,31cyclictest6718-21taskset11:18:271
258599712,31cyclictest2328-21sh12:20:251
2585997117,37cyclictest17517-21iostat_ios08:00:211
258599711,38cyclictest31547-21runrttasks08:37:331
258599711,38cyclictest31363-21sh09:30:221
258599711,37cyclictest31801-21sh10:37:231
258599711,37cyclictest27990-21ssh12:46:551
258599711,37cyclictest27990-21ssh12:46:551
258599711,36cyclictest3345-21cstates09:35:131
258599711,36cyclictest24722-21sh10:30:161
258599711,35cyclictest24583-21chrt09:56:231
258599711,33cyclictest24559-21taskset12:10:141
258599702,34cyclictest9467-21df_inode07:40:151
258599701,37cyclictest21764-21ssh09:54:201
258599701,37cyclictest21764-21ssh09:54:191
258599701,36cyclictest8274-21/usr/sbin/munin09:40:151
258599701,36cyclictest19015-21diskmemload10:57:331
258599701,36cyclictest10825-21chrt12:29:401
258599701,36cyclictest10769-21diskmemload09:24:161
258599701,35cyclictest12642-21sed12:30:281
258599701,33cyclictest7461-21df_inode09:00:131
258599701,33cyclictest5428-21taskset10:43:571
258599693,32cyclictest10988-21taskset11:22:361
258599691,37cyclictest21232-21if_eth008:10:201
258599691,36cyclictest4191-21ntp_kernel_err08:50:241
258599691,36cyclictest24465-21chrt11:03:231
258599691,35cyclictest4254-21rm10:09:401
258599691,35cyclictest13975-21sh10:19:411
258599691,34cyclictest5127-21sh10:10:161
258599691,33cyclictest3302-21runrttasks11:13:501
258599691,33cyclictest24847-21taskset11:36:391
258599682,32cyclictest2228-21ntp_states08:45:241
258599681,35cyclictest3302-21runrttasks12:05:451
258599681,34cyclictest30807-21chrt12:15:521
258599681,34cyclictest17822-21cut11:30:121
258599681,34cyclictest15650-21gzip12:00:271
258599681,33cyclictest29232-21sh09:28:321
258599681,32cyclictest5764-21hddtemp_smartct08:55:181
258599681,30cyclictest27475-21chrt10:00:121
258599672,30cyclictest7571-21df_inode07:35:131
258599671,33cyclictest14547-21savelog07:53:041
258599671,31cyclictest15619-21irqstats07:55:181
258599642,32cyclictest4963-21df_inode07:30:021
258599641,35cyclictest3302-21runrttasks08:26:161
258599631,32cyclictest10836-21latency_hist09:10:011
258599611,40cyclictest826-21chrt08:40:591
258599601,31cyclictest29635-21chrt08:32:121
228122500,12sleep0138250irq/90-eth012:08:200
3372420,5sleep0111rcuc/008:40:250
2584994118,7cyclictest23767-21python11:35:280
180722410,3sleep041ktimersoftd/012:03:280
258499396,5cyclictest81rcu_preempt11:15:250
2584993913,5cyclictest103022ssh09:41:470
245552390,6sleep0111rcuc/010:30:150
258499389,15cyclictest4022-21ntpq09:35:240
258499381,34cyclictest0-21swapper/010:12:350
258499369,13cyclictest14647-21mandb07:53:050
258499363,29cyclictest0-21swapper/011:49:550
258499363,28cyclictest9781-21irqstats07:40:210
258499362,6cyclictest3608-21ssh12:21:150
258499361,32cyclictest0-21swapper/009:46:390
258499361,23cyclictest28705-21ssh11:07:310
258499361,14cyclictest0-21swapper/010:17:070
2584993610,12cyclictest10769-21diskmemload10:43:300
13382361,31sleep02645-21snmpd09:33:060
258499352,30cyclictest0-21swapper/011:03:150
2584993514,5cyclictest2206-21dbus-daemon10:03:320
258499351,21cyclictest31415-21iostat_ios11:10:220
258499347,4cyclictest0-21swapper/010:59:050
258499346,4cyclictest81rcu_preempt11:28:270
258499342,4cyclictest0-21swapper/011:56:360
258499341,7cyclictest20791-21ssh11:32:470
258499341,29cyclictest30840-21ssh12:15:560
258499341,29cyclictest2403-21irqbalance09:28:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional