You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 11:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed Dec 31, 2025 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
72669912671,1261cyclictest7437-21aten_r4power_en19:25:121
72659911741145,8cyclictest0-21swapper/019:25:130
72669911651143,18cyclictest14453-21strings19:40:251
71742490444,29sleep00-21swapper/019:24:360
69992466419,32sleep10-21swapper/119:22:471
726599241218,18cyclictest0-21swapper/019:40:250
2940121060,2sleep029403-21mailstats22:30:270
261152890,9sleep0726599cyclictest22:27:150
229362810,9sleep0726599cyclictest20:05:000
726699751,38cyclictest32225-21ssh23:06:471
726699741,38cyclictest31107-21seq00:12:371
726699741,37cyclictest21615-21fschecks_time20:00:161
726699731,39cyclictest15070-21diskmemload23:00:011
726699731,38cyclictest23002-21sh21:50:281
726699731,36cyclictest17581-21ssh21:11:391
726699722,32cyclictest25365-21/usr/sbin/munin21:20:141
726699721,39cyclictest3302-21runrttasks22:49:401
726699721,37cyclictest29422-21sh21:57:231
726699721,36cyclictest15988-21cat22:50:191
726699721,36cyclictest10744-21ntpq19:30:241
726699713,34cyclictest15070-21diskmemload23:01:111
726699712,38cyclictest15070-21diskmemload22:35:481
726699711,38cyclictest31453-21/usr/sbin/munin23:40:211
726699711,35cyclictest15070-21diskmemload00:18:021
726699711,34cyclictest9136-21chrt20:52:141
726699711,34cyclictest19197-21seq21:46:371
726699711,34cyclictest19197-21seq21:46:361
726699704,27cyclictest40550irq/92-i91523:10:111
726699701,33cyclictest23377-21cut00:05:131
726699691,37cyclictest28191-21chrt20:16:111
726699691,36cyclictest17247-21sh22:18:281
726699691,34cyclictest11708-21sh00:25:301
726699691,33cyclictest5703-21seq23:45:551
726699691,33cyclictest30936-21ps21:25:271
726699681,37cyclictest15070-21diskmemload21:37:251
726699681,37cyclictest15070-21diskmemload00:04:221
726699681,34cyclictest8906-21sh23:15:491
726699681,34cyclictest12810-21chrt21:01:131
726699681,33cyclictest24106-21sh22:25:191
726699681,33cyclictest23533-21seq23:30:581
726699681,32cyclictest32378-21seq00:48:051
726699681,32cyclictest15174-21seq23:22:521
726699672,36cyclictest6507-21ntp_states00:20:261
726699671,33cyclictest25575-21uname20:10:211
726699665,30cyclictest19328-21/usr/sbin/munin19:55:241
726699661,43cyclictest3302-21runrttasks22:43:031
726699661,32cyclictest22941-21sh21:17:231
726699661,32cyclictest11059-21seq22:11:331
726699661,31cyclictest20694-21sh23:28:511
726699651,50cyclictest15574-21/usr/sbin/munin19:45:131
726699651,38cyclictest2872-21ssh00:50:461
726699651,35cyclictest15070-21diskmemload23:53:121
726699641,6cyclictest30985-21chrt23:39:441
726699641,38cyclictest17723-21taskset23:59:181
726699632,38cyclictest31609-21aten_r4power_po22:00:121
726699631,34cyclictest15070-21diskmemload00:44:301
726699631,31cyclictest15572-21df_inode00:30:191
726699621,41cyclictest3039-21python20:35:271
726699621,38cyclictest5854-21ssh21:33:231
726699612,42cyclictest2329-21NetworkManager21:43:401
726699612,39cyclictest4338-21df22:05:141
726699612,36cyclictest3302-21runrttasks00:35:131
726699611,38cyclictest24551-21taskset20:07:201
726699601,40cyclictest22868-21taskset22:24:341
726699601,38cyclictest868-21cat20:30:261
726699601,38cyclictest3302-21runrttasks20:27:291
726699601,36cyclictest28394-21egrep22:30:121
726699592,32cyclictest29760-21python20:20:261
726699591,38cyclictest5634-21turbostat.cron20:44:551
726699591,38cyclictest11791-21chrt19:35:031
726699581,38cyclictest13555-21expr21:05:131
726699581,37cyclictest10977-21chrt20:56:521
726699571,38cyclictest17753-21seq19:50:161
726699561,36cyclictest6788-21mailstats20:45:291
281512490,4sleep0111rcuc/023:35:390
113212480,3sleep011318-21sh23:52:020
726599401,12cyclictest81rcu_preempt00:10:270
726599384,10cyclictest81rcu_preempt19:34:170
276042380,4sleep0111rcuc/023:02:060
726599371,16cyclictest154832ssh23:23:190
726599364,13cyclictest30133-21hwlatdetect00:45:210
726599362,5cyclictest81rcu_preempt00:40:300
726599361,15cyclictest1951-21aten_r4power_cu20:35:120
80502351,30sleep08060-21ssh22:09:120
726599351,21cyclictest24472-21ssh00:39:480
276322351,30sleep027662-21/usr/sbin/munin21:55:270
187372351,4sleep018747-21ssh22:53:210
726599349,13cyclictest2516-21cut23:10:110
726599345,4cyclictest81rcu_preempt21:36:550
726599342,4cyclictest0-21swapper/022:24:160
726599342,29cyclictest0-21swapper/023:56:150
726599342,27cyclictest19925-21sh23:27:450
726599342,18cyclictest0-21swapper/020:26:570
726599341,5cyclictest32042-21hwlatdetect23:40:180
726599341,29cyclictest31395-21ssh23:05:360
726599341,20cyclictest2645-21snmpd00:50:540
726599341,13cyclictest6553-21netstat22:40:250
266792343,4sleep026692-21sh20:15:000
155672341,5sleep015580-21df_inode00:30:180
726599337,13cyclictest24973-21ssh00:05:440
726599336,5cyclictest81rcu_preempt21:10:150
726599334,4cyclictest81rcu_preempt23:16:010
726599334,4cyclictest81rcu_preempt21:25:480
726599334,4cyclictest81rcu_preempt00:17:320
726599334,4cyclictest81rcu_preempt00:00:020
726599333,3cyclictest15070-21diskmemload22:35:150
726599332,4cyclictest0-21swapper/000:26:350
7265993323,6cyclictest20940-21pidof19:59:000
7265993313,9cyclictest0-21swapper/022:00:290
726599331,29cyclictest0-21swapper/021:34:360
726599331,19cyclictest30497-21gdbus21:48:190
726599331,19cyclictest30497-21gdbus21:48:180
726599331,18cyclictest24532-21sh23:32:240
726599331,14cyclictest22494-21ssh22:56:450
7265993310,5cyclictest11464-21/usr/sbin/munin21:00:160
78882321,5sleep00-21swapper/023:49:060
726599324,4cyclictest81rcu_preempt21:54:120
726599324,4cyclictest81rcu_preempt21:18:290
726599323,4cyclictest81rcu_preempt22:10:520
7265993215,14cyclictest3-21ksoftirqd/000:20:350
726599321,29cyclictest0-21swapper/022:15:550
726599321,29cyclictest0-21swapper/020:15:550
726599317,4cyclictest81rcu_preempt21:20:250
726599311,14cyclictest15492-21ssh21:43:160
188252311,5sleep00-21swapper/019:51:330
74432301,5sleep00-21swapper/020:49:080
726599304,13cyclictest40550irq/92-i91520:56:090
726599301,18cyclictest0-21swapper/020:50:260
166882300,7sleep00-21swapper/019:45:300
14062301,6sleep00-21swapper/020:31:240
133052301,5sleep00-21swapper/019:37:520
726599291,4cyclictest81rcu_preempt22:46:260
7265992912,5cyclictest53212sshd20:41:400
246702291,5sleep00-21swapper/020:08:370
726599282,13cyclictest0-21swapper/021:05:280
726599280,4cyclictest81rcu_preempt20:23:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional