You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 20:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Wed Dec 03, 2025 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1622699575,6cyclictest131rcu_preempt10:00:131
16245995129,17cyclictest29566irq/58-eth009:50:133
1622699513,39cyclictest3398-21ssh11:00:141
1622699503,6cyclictest131rcu_preempt08:55:121
1622699496,40cyclictest6435-21ssh11:45:141
1622699472,37cyclictest7225-21rm09:35:161
1622699472,37cyclictest7225-21rm09:35:151
1622699441,32cyclictest25261-21ssh12:20:141
16234994214,19cyclictest27-21ksoftirqd/209:15:132
1622699423,35cyclictest15201-21ssh10:25:131
1622699421,33cyclictest17992-21ssh12:15:141
1622699421,33cyclictest17992-21ssh12:15:131
1624599414,22cyclictest29566irq/58-eth012:00:123
1623499412,26cyclictest26346irq/40-dwc2_hso11:10:132
1622699402,31cyclictest30413-21ssh10:35:151
1624599382,22cyclictest29566irq/58-eth012:30:133
16234993823,9cyclictest0-21swapper/211:30:142
16226993812,6cyclictest7803-21cron07:35:021
1621499381,27cyclictest32361-21ssh09:30:150
16234993715,13cyclictest27-21ksoftirqd/212:00:132
1623499351,18cyclictest7919-21ssh12:30:132
1622699353,25cyclictest3683-21ssh09:55:171
1622699353,25cyclictest3683-21ssh09:55:161
1622699353,25cyclictest28366-21ssh09:50:131
1623499343,20cyclictest26346irq/40-dwc2_hso07:25:142
1622699345,17cyclictest21-21ksoftirqd/109:10:131
1622699342,24cyclictest23805-21ssh11:35:141
1621499341,25cyclictest0-21swapper/007:10:140
1623499333,8cyclictest0-21swapper/210:04:232
1623499332,21cyclictest26346irq/40-dwc2_hso08:50:142
1622699331,17cyclictest22722-21ls07:50:171
1623499326,15cyclictest27-21ksoftirqd/212:05:172
16226993211,4cyclictest736-21/usr/sbin/munin10:15:301
1624599317,16cyclictest29566irq/58-eth012:35:133
16234993122,7cyclictest27-21ksoftirqd/207:40:112
1623499312,12cyclictest0-21swapper/211:15:142
1623499312,11cyclictest0-21swapper/209:05:122
1623499311,4cyclictest0-21swapper/211:45:122
1622699312,22cyclictest20590-21apt-get10:50:051
1622699311,11cyclictest27195-21apt-get12:00:031
1621499312,21cyclictest27541-21ssh12:00:050
1623499302,18cyclictest26346irq/40-dwc2_hso09:20:142
16245992920,6cyclictest29566irq/58-eth010:55:143
16245992920,6cyclictest29566irq/58-eth010:55:133
1624599291,13cyclictest29566irq/58-eth010:10:133
1623499293,24cyclictest0-21swapper/209:46:232
1623499293,19cyclictest0-21swapper/210:45:152
1623499292,21cyclictest0-21swapper/208:35:142
1623499292,21cyclictest0-21swapper/208:35:132
16234992914,12cyclictest3643-21/usr/sbin/munin09:55:252
16234992914,12cyclictest3643-21/usr/sbin/munin09:55:242
1623499291,18cyclictest26346irq/40-dwc2_hso08:00:152
16226992910,5cyclictest24408-21sshd09:24:491
1621499293,16cyclictest18854-1kworker/u9:111:55:130
1621499292,20cyclictest25906-21ssh10:10:130
1621499292,19cyclictest31973-21ntp_192.168.11409:50:230
1624599284,11cyclictest29566irq/58-eth011:50:123
1623499283,16cyclictest26346irq/40-dwc2_hso11:50:132
1621499282,20cyclictest16930-21ssh11:50:240
1624599271,16cyclictest0-21swapper/310:00:143
1624599271,13cyclictest29566irq/58-eth012:20:143
1623499273,16cyclictest26346irq/40-dwc2_hso10:10:122
1623499272,17cyclictest26346irq/40-dwc2_hso11:25:122
16234992717,7cyclictest0-21swapper/210:35:142
16234992712,12cyclictest0-21swapper/207:30:192
1622699274,19cyclictest15527-21ssh12:35:141
16226992712,3cyclictest131rcu_preempt10:10:151
1622699271,12cyclictest24157-21ntp_192.168.11411:55:251
1621499279,12cyclictest13057-1kworker/u9:009:46:240
1621499275,6cyclictest12-21ksoftirqd/011:26:370
16214992720,4cyclictest23804-21sh11:35:130
1623499263,16cyclictest26346irq/40-dwc2_hso07:15:152
1623499262,9cyclictest0-21swapper/210:15:132
1623499262,17cyclictest0-21swapper/210:50:042
1623499262,10cyclictest0-21swapper/210:55:142
1623499262,10cyclictest0-21swapper/210:55:132
1621499267,13cyclictest12-21ksoftirqd/008:45:130
1621499262,16cyclictest842-21munin-node10:05:140
16214992614,6cyclictest0-21swapper/007:40:130
1621499261,19cyclictest24866-21sh09:25:130
1621499261,15cyclictest17497-21ssh09:20:130
1623499257,12cyclictest24865-21diskmemload09:25:132
1623499256,10cyclictest27194-21cron12:00:002
1623499252,16cyclictest0-21swapper/209:50:142
1623499252,15cyclictest26346irq/40-dwc2_hso08:45:132
1621499256,6cyclictest12-21ksoftirqd/009:17:010
1621499254,5cyclictest12-21ksoftirqd/011:40:300
16245992416,5cyclictest321rcuc/310:39:403
16245992414,4cyclictest0-21swapper/311:55:133
1623499244,16cyclictest26346irq/40-dwc2_hso08:10:132
1623499243,8cyclictest0-21swapper/211:00:142
1623499243,15cyclictest26346irq/40-dwc2_hso07:10:132
1623499241,8cyclictest7228-21ssh09:35:172
1623499241,8cyclictest7228-21ssh09:35:162
16234992417,4cyclictest4811-21ssh09:10:222
1623499241,14cyclictest26353-21unixbench_singl07:50:282
1622699242,17cyclictest2701-21ssh11:40:271
1621499249,8cyclictest12-21ksoftirqd/009:40:440
1621499248,3cyclictest131rcu_preempt10:02:170
1621499248,10cyclictest12-21ksoftirqd/012:31:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional