You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 06:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Fri May 09, 2025 00:45:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28695996235,19cyclictest24882-21sendmail-msp00:00:181
28710995745,7cyclictest12004-21sh00:35:152
28710995745,7cyclictest12004-21sh00:35:152
28710995423,20cyclictest27-21ksoftirqd/200:10:142
2869599545,38cyclictest20481-21ssh22:35:151
28710995210,26cyclictest27-21ksoftirqd/219:20:102
2869499515,41cyclictest405-21ssh00:05:120
28710995033,15cyclictest27-21ksoftirqd/220:15:132
28710995033,15cyclictest27-21ksoftirqd/220:15:122
2869599481,8cyclictest131rcu_preempt23:15:111
2869499481,39cyclictest27035-21sendmail-msp23:00:150
28695994734,9cyclictest30124-21sendmail-msp21:40:151
2871099461,37cyclictest14537-21ssh21:30:132
2869599463,8cyclictest131rcu_preempt00:20:141
2869599463,32cyclictest5850-21sendmail-msp19:20:101
2869599462,35cyclictest29514-21sendmail-msp22:00:171
2869599462,35cyclictest29514-21sendmail-msp22:00:161
2871099452,35cyclictest17745-21sendmail-msp20:40:122
28694994416,21cyclictest25571-21sendmail-msp23:40:190
2869599414,26cyclictest30709-21sendmail-msp21:20:141
28695994123,8cyclictest21-21ksoftirqd/120:10:131
2869499411,31cyclictest11800-21sendmail-msp20:00:140
2872399391,25cyclictest25866irq/58-eth021:30:143
2869499390,31cyclictest9172-21ssh23:50:120
2871099383,25cyclictest18010-21ssh23:35:132
2871099382,18cyclictest25571-21sendmail-msp23:41:192
2871099380,29cyclictest0-21swapper/219:10:122
28695993822,8cyclictest28321-21ssh22:40:131
28694993817,16cyclictest12-21ksoftirqd/023:55:150
28694993817,16cyclictest12-21ksoftirqd/023:55:140
28694993813,18cyclictest12-21ksoftirqd/021:10:160
28694993813,18cyclictest0-21swapper/023:05:150
2869599372,26cyclictest21-21ksoftirqd/120:45:161
2871099362,27cyclictest29034-21ssh21:59:182
2871099362,17cyclictest6223-21/usr/sbin/munin21:45:192
2871099362,11cyclictest601-21rngd22:15:192
2871099362,11cyclictest601-21rngd22:15:182
2869499361,27cyclictest30979-21sendmail-msp20:20:110
2869499361,27cyclictest30979-21sendmail-msp20:20:100
2872399351,29cyclictest0-21swapper/323:25:183
28710993519,11cyclictest27-21ksoftirqd/220:50:102
28710993512,13cyclictest0-21swapper/222:20:132
2869499357,17cyclictest601-21rngd19:10:130
2871099346,16cyclictest22146irq/40-dwc2_hso21:50:162
2871099344,17cyclictest22146irq/40-dwc2_hso20:55:152
28710993412,16cyclictest28693-21cyclictest23:30:152
2869599343,19cyclictest6656-21ssh21:25:181
2869599342,24cyclictest25571-21sendmail-msp23:40:141
28710993318,13cyclictest0-21swapper/223:15:122
2872399321,15cyclictest25866irq/58-eth023:15:123
2869499324,18cyclictest22970-21ssh21:15:130
2872399312,16cyclictest25866irq/58-eth023:35:143
2871099316,8cyclictest28693-21cyclictest23:10:152
28710993116,9cyclictest28693-21cyclictest19:25:142
2869599313,21cyclictest21-21ksoftirqd/122:25:131
2869499313,17cyclictest25036-21sendmail-msp19:40:130
2869499312,22cyclictest29709-21ssh22:20:190
28694993117,12cyclictest26630-21ssh23:20:190
28694993117,12cyclictest26630-21ssh23:20:180
2871099303,16cyclictest22146irq/40-dwc2_hso22:55:132
2871099302,11cyclictest27035-21sendmail-msp23:01:202
2871099301,22cyclictest27-21ksoftirqd/222:50:192
28695993022,4cyclictest131rcu_preempt20:25:141
28695993022,4cyclictest131rcu_preempt20:25:131
2869599301,20cyclictest21-21ksoftirqd/119:50:111
2869499305,8cyclictest24882-21sendmail-msp00:00:350
28694993015,8cyclictest601-21rngd00:25:140
2872399293,16cyclictest25866irq/58-eth021:45:143
28723992917,9cyclictest25866irq/58-eth000:30:133
28710992915,10cyclictest22459-21sendmail-msp00:20:142
2871099291,16cyclictest26247-21sendmail-msp23:20:202
2871099291,16cyclictest26247-21sendmail-msp23:20:192
2869599292,21cyclictest26635-21ssh23:20:191
2869599292,21cyclictest26635-21ssh23:20:181
2869499293,13cyclictest23552-21uptime22:55:310
2869499292,20cyclictest4723-21sendmail-msp21:00:170
2872399281,20cyclictest0-21swapper/322:20:203
2871099282,20cyclictest0-21swapper/220:10:152
2869599282,22cyclictest21-21ksoftirqd/122:15:141
2869599282,22cyclictest21-21ksoftirqd/122:15:141
2869599282,18cyclictest30277-21ssh00:25:161
2869499285,9cyclictest22459-21sendmail-msp00:21:310
2869499285,8cyclictest601-21rngd22:25:190
2869499285,11cyclictest8323-21kthreadcore00:30:230
2869499282,21cyclictest13785-21sed22:10:180
2869499282,18cyclictest6666-21ssh21:25:200
28694992820,3cyclictest29514-21sendmail-msp22:00:160
28694992820,3cyclictest29514-21sendmail-msp22:00:150
28694992812,12cyclictest12-21ksoftirqd/020:45:160
2872399272,17cyclictest25866irq/58-eth019:30:153
2872399271,14cyclictest25866irq/58-eth022:30:143
2871099273,9cyclictest0-21swapper/222:27:182
2871099273,19cyclictest0-21swapper/200:18:212
2871099272,19cyclictest22146irq/40-dwc2_hso19:35:142
28710992716,6cyclictest5265-21ssh22:05:152
2871099271,15cyclictest29514-21sendmail-msp22:00:322
2871099271,15cyclictest29514-21sendmail-msp22:00:322
2869599274,10cyclictest131rcu_preempt22:30:131
2869599270,3cyclictest131rcu_preempt19:25:131
2869499276,8cyclictest6170-21/usr/sbin/munin19:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional