You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 05:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Sat Nov 22, 2025 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1003599477,23cyclictest29566irq/58-eth000:35:153
10027994739,6cyclictest27-21ksoftirqd/219:55:132
1002799454,22cyclictest932-21snmpd22:35:152
1002799441,33cyclictest24410-21ssh00:00:132
1002799433,34cyclictest21913-21ssh23:20:112
1001999434,34cyclictest26507-21ssh22:25:131
10035994227,11cyclictest29566irq/58-eth021:30:143
10035994122,9cyclictest0-21swapper/322:45:173
1003599411,21cyclictest29566irq/58-eth023:30:133
1001999411,31cyclictest13419-21ssh23:15:121
1000799404,32cyclictest15106-21ssh21:40:120
1003599394,21cyclictest29566irq/58-eth000:05:133
1000799394,32cyclictest30558-21ssh21:30:140
1003599382,23cyclictest29566irq/58-eth000:10:123
1002799381,32cyclictest15097-21ssh21:40:122
1001999381,30cyclictest7747-21ssh23:50:121
10027993718,5cyclictest0-21swapper/200:15:142
10019993712,15cyclictest21-21ksoftirqd/121:30:311
1000799372,26cyclictest32103-21ssh21:50:130
1003599361,18cyclictest29566irq/58-eth021:10:133
1001999351,25cyclictest21-21ksoftirqd/121:05:121
1003599342,19cyclictest29566irq/58-eth000:15:143
1000799343,20cyclictest23918-21ssh00:20:130
1003599331,17cyclictest29566irq/58-eth000:20:133
1002799335,20cyclictest26346irq/40-dwc2_hso23:05:132
10027993324,4cyclictest932-21snmpd20:30:132
10027993324,4cyclictest932-21snmpd20:30:132
1001999332,6cyclictest23244-21apt-get23:40:161
10019993322,6cyclictest530-21usb-storage20:10:111
1002799321,11cyclictest1865466ssh23:35:272
1000799325,19cyclictest16272-21ssh00:15:160
1000799322,9cyclictest12-21ksoftirqd/023:20:130
1003599311,17cyclictest29566irq/58-eth023:50:123
1001999318,5cyclictest131rcu_preempt22:15:121
1001999312,7cyclictest131rcu_preempt22:35:131
1001999312,18cyclictest4958-21ssh23:10:171
10019993117,8cyclictest0-21swapper/120:45:141
1000799317,3cyclictest131rcu_preempt20:00:140
1000799313,18cyclictest1365-21kworker/u8:222:55:130
1000799313,18cyclictest1365-21kworker/u8:222:55:130
1003599302,12cyclictest29566irq/58-eth022:55:133
1003599302,12cyclictest29566irq/58-eth022:55:133
1003599301,16cyclictest29566irq/58-eth000:00:133
1002799303,5cyclictest271ksoftirqd/222:25:022
1002799303,18cyclictest26346irq/40-dwc2_hso21:25:152
1002799302,11cyclictest1818-21grep23:25:302
1000799309,14cyclictest12-21ksoftirqd/022:35:150
1000799306,18cyclictest8182-21ssh00:10:130
1000799304,7cyclictest12-21ksoftirqd/021:20:170
1000799303,5cyclictest12-21ksoftirqd/022:40:170
1000799302,18cyclictest24400-21ssh00:00:120
1002799295,14cyclictest26346irq/40-dwc2_hso20:25:122
1002799293,9cyclictest27-21ksoftirqd/223:40:172
1002799293,15cyclictest26346irq/40-dwc2_hso20:55:142
1002799292,19cyclictest0-21swapper/220:05:152
10027992911,15cyclictest3206-21kworker/u8:121:20:142
10019992923,3cyclictest131rcu_preempt19:15:141
10019992912,6cyclictest131rcu_preempt20:00:141
1001999291,20cyclictest13616-21sh21:20:141
1001999291,18cyclictest21-21ksoftirqd/120:30:141
1001999291,18cyclictest21-21ksoftirqd/120:30:141
1000799292,5cyclictest12-21ksoftirqd/023:00:310
10007992919,8cyclictest0-21swapper/022:30:130
1003599284,16cyclictest29566irq/58-eth022:30:123
1003599284,16cyclictest0-21swapper/323:20:123
1002799285,9cyclictest27-21ksoftirqd/221:35:212
1002799285,14cyclictest26346irq/40-dwc2_hso21:30:152
1002799284,5cyclictest27-21ksoftirqd/219:25:182
1002799284,14cyclictest0-21swapper/222:49:432
1002799283,9cyclictest27-21ksoftirqd/219:45:182
1002799283,14cyclictest26346irq/40-dwc2_hso21:50:142
1002799283,10cyclictest27-21ksoftirqd/200:35:242
1002799282,8cyclictest27-21ksoftirqd/223:00:232
1002799280,12cyclictest11429-21ntp_states23:50:262
1001999288,12cyclictest25804-21diskmemload21:25:261
1000799282,19cyclictest22202-21sh21:25:140
1003599272,13cyclictest29566irq/58-eth000:25:113
10035992710,11cyclictest0-21swapper/323:15:133
1002799276,5cyclictest27-21ksoftirqd/223:15:152
1002799276,12cyclictest0-21swapper/222:30:142
1002799274,4cyclictest27-21ksoftirqd/222:10:272
1002799272,10cyclictest0-21swapper/220:15:132
1001999274,5cyclictest131rcu_preempt00:35:151
1000799277,3cyclictest131rcu_preempt23:35:150
1000799275,10cyclictest131rcu_preempt22:22:110
1000799273,6cyclictest12-21ksoftirqd/022:55:010
1000799273,6cyclictest12-21ksoftirqd/019:10:260
1000799273,5cyclictest12-21ksoftirqd/020:40:010
1000799273,12cyclictest12-21ksoftirqd/019:40:240
1000799273,12cyclictest12-21ksoftirqd/019:40:240
1000799272,18cyclictest6465-21ssh23:30:140
1000799272,11cyclictest12-21ksoftirqd/020:05:150
1000799271,7cyclictest7920-21cut21:15:230
1000799271,21cyclictest23256-21ssh23:40:160
1000799271,16cyclictest842-21munin-node20:25:130
1002799266,4cyclictest27-21ksoftirqd/221:55:222
1002799265,4cyclictest27-21ksoftirqd/222:03:062
1002799264,10cyclictest27-21ksoftirqd/219:15:312
1002799262,19cyclictest0-21swapper/222:55:142
1002799262,19cyclictest0-21swapper/222:55:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional