You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 06:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Wed Dec 03, 2025 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16730996838,18cyclictest29566irq/58-eth023:55:133
1670399612,52cyclictest12790-21ssh00:10:120
16730995429,12cyclictest29566irq/58-eth021:40:163
1670399471,7cyclictest131rcu_preempt21:40:150
16714994614,24cyclictest21-21ksoftirqd/119:35:151
1670399464,33cyclictest865-21ssh22:45:130
1670399462,32cyclictest12842-21ssh21:35:140
1671499452,33cyclictest1833-21rm23:05:131
1670399453,32cyclictest4189-21ssh00:25:150
1670399432,6cyclictest131rcu_preempt19:25:120
1672299405,24cyclictest0-21swapper/220:45:152
1670399403,33cyclictest19982-21ssh00:35:150
1673099394,24cyclictest29566irq/58-eth000:05:153
1673099392,20cyclictest29566irq/58-eth021:35:143
1672299392,22cyclictest27-21ksoftirqd/223:15:132
1671499390,34cyclictest28625-21ssh00:20:141
1670399397,18cyclictest12-21ksoftirqd/000:15:130
1673099381,22cyclictest29566irq/58-eth000:35:143
1671499381,33cyclictest10204-21ssh23:10:131
1672299372,18cyclictest23186-21cut23:35:242
1672299362,28cyclictest5145-21ssh22:26:242
1672299353,21cyclictest26346irq/40-dwc2_hso20:05:152
16714993523,8cyclictest21-21ksoftirqd/119:25:131
16703993518,10cyclictest14114-21cut23:30:230
1672299344,9cyclictest9193-21ssh22:50:142
1671499343,25cyclictest21276-21ssh21:40:161
1671499342,25cyclictest16452-21ssh22:35:161
1673099333,18cyclictest29566irq/58-eth000:30:133
1671499332,23cyclictest5696-21ssh21:50:161
1671499332,23cyclictest5696-21ssh21:50:151
16714993310,4cyclictest131rcu_preempt00:30:131
1670399331,22cyclictest28348-21sh21:25:140
16722993216,2cyclictest0-21swapper/223:20:122
1671499323,20cyclictest2792-21diskmemload23:55:151
1671499322,23cyclictest15337-21ssh22:15:161
16722993122,6cyclictest0-21swapper/222:40:152
16703993113,8cyclictest12-21ksoftirqd/023:20:110
1673099302,18cyclictest29566irq/58-eth021:05:143
1673099302,16cyclictest29566irq/58-eth021:55:133
1672299307,15cyclictest26346irq/40-dwc2_hso21:55:122
1672299305,15cyclictest26346irq/40-dwc2_hso20:30:132
1672299303,19cyclictest3009-21ssh23:25:132
1672299302,20cyclictest5331-21memory23:05:242
1671499302,22cyclictest32717-21ssh23:03:241
1671499302,22cyclictest32717-21ssh23:03:231
1670399304,5cyclictest131rcu_preempt22:25:120
1670399302,23cyclictest23083-21ssh22:38:000
16703993022,2cyclictest0-21swapper/000:30:130
1673099293,19cyclictest0-21swapper/323:08:233
1672299295,15cyclictest26346irq/40-dwc2_hso21:30:132
1671499292,21cyclictest17774-21ssh23:32:231
1671499292,20cyclictest19985-21ssh21:20:151
16714992914,7cyclictest16690-21cyclictest19:30:121
16730992810,8cyclictest29566irq/58-eth022:25:113
1673099280,16cyclictest29566irq/58-eth023:20:113
1672299286,16cyclictest15777-21kworker/2:020:50:162
1672299283,20cyclictest0-21swapper/222:14:222
1672299282,19cyclictest28388-21ssh23:40:132
1672299282,18cyclictest22974-21sh22:56:232
1672299282,11cyclictest22213-21ssh22:18:222
1672299282,11cyclictest0-21swapper/222:31:232
1672299282,10cyclictest7474-21ssh22:48:022
1672299281,19cyclictest23765-21ssh22:20:132
1671499284,16cyclictest21-21ksoftirqd/119:40:131
16714992814,11cyclictest0-21swapper/122:40:131
1670399282,19cyclictest31878-21ssh23:40:230
1673099273,16cyclictest0-21swapper/323:30:233
1673099273,16cyclictest0-21swapper/323:15:233
1673099272,19cyclictest0-21swapper/322:38:013
1672299274,16cyclictest27-21ksoftirqd/219:50:152
1672299273,15cyclictest26346irq/40-dwc2_hso20:10:142
1672299272,11cyclictest5008-21ssh22:07:552
1671499279,2cyclictest21-21ksoftirqd/122:13:031
1671499272,19cyclictest18599-21ssh23:15:121
1670399272,20cyclictest22178-21/usr/sbin/munin23:15:230
1670399272,19cyclictest13434-21ssh22:12:570
1672299263,20cyclictest0-21swapper/223:32:222
1672299263,19cyclictest0-21swapper/221:50:162
1672299263,19cyclictest0-21swapper/221:50:152
1672299263,16cyclictest27-21ksoftirqd/200:05:142
1672299263,15cyclictest26346irq/40-dwc2_hso19:55:142
1671499263,17cyclictest28373-21ssh23:40:131
1671499261,19cyclictest3008-21sh23:25:121
1670399263,18cyclictest2792-21diskmemload22:30:140
1670399262,15cyclictest0-21swapper/019:15:150
1670399262,15cyclictest0-21swapper/019:15:140
1673099253,16cyclictest0-21swapper/323:35:243
16730992513,8cyclictest29566irq/58-eth021:45:133
1673099251,17cyclictest29566irq/58-eth023:45:133
1672299254,16cyclictest26346irq/40-dwc2_hso20:35:162
1672299253,19cyclictest0-21swapper/223:03:242
1672299253,19cyclictest0-21swapper/223:03:242
1672299253,16cyclictest26346irq/40-dwc2_hso20:55:122
1672299252,19cyclictest24086-21ssh22:39:232
1672299251,17cyclictest26346irq/40-dwc2_hso20:40:122
1672299251,14cyclictest21156-21sh23:55:152
1671499259,11cyclictest21-21ksoftirqd/122:23:231
1671499252,20cyclictest28475-21ssh21:25:171
1673099243,14cyclictest0-21swapper/323:14:233
16730992412,8cyclictest29566irq/58-eth022:50:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional