You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Fri Nov 14, 2025 12:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
568499662,34cyclictest6159-21ssh09:20:142
5670995818,31cyclictest21-21ksoftirqd/110:50:151
568499552,45cyclictest26425-21ssh09:55:132
567099512,35cyclictest7424-21ssh10:25:141
567099471,37cyclictest24529-21ssh09:10:131
566099433,6cyclictest131rcu_preempt10:45:130
566099413,34cyclictest27690-21sshd12:05:130
569599395,22cyclictest29566irq/58-eth012:10:133
568499381,21cyclictest18588-21ssh12:20:152
567099378,21cyclictest21-21ksoftirqd/107:40:121
569599363,22cyclictest29566irq/58-eth011:45:143
568499362,21cyclictest20822-21ssh09:30:132
566099362,28cyclictest12407-21ssh11:55:160
566099362,28cyclictest12407-21ssh11:55:150
566099352,27cyclictest6659-21ssh11:30:180
569599331,21cyclictest29566irq/58-eth010:05:123
566099333,26cyclictest4512-21ssh11:50:120
567099323,22cyclictest18576-21sh12:20:131
568499319,18cyclictest5647-21cyclictest09:42:442
568499311,23cyclictest24527-21rm09:10:122
566099313,20cyclictest12-21ksoftirqd/008:15:140
5660993121,7cyclictest0-21swapper/009:05:120
566099311,24cyclictest3576-21ssh09:40:150
568499302,22cyclictest0-21swapper/212:25:142
5670993011,9cyclictest21-21ksoftirqd/112:25:141
5695992915,9cyclictest29566irq/58-eth010:45:133
567099291,22cyclictest16047-21ssh10:08:451
566099293,18cyclictest12-21ksoftirqd/011:00:160
566099292,21cyclictest29381-21apt-get11:45:140
5660992910,8cyclictest131rcu_preempt08:25:160
5684992811,6cyclictest0-21swapper/210:25:182
567099282,20cyclictest10816-21ssh09:44:441
568499272,20cyclictest0-21swapper/208:05:152
568499272,19cyclictest0-21swapper/208:45:142
567099272,2cyclictest131rcu_preempt12:15:131
567099272,19cyclictest21962-21ssh10:34:461
567099272,19cyclictest17283-21ssh09:47:451
567099272,19cyclictest17283-21ssh09:47:451
566099273,16cyclictest16946-21ssh11:15:130
566099272,19cyclictest9418-21sh12:35:140
5695992620,4cyclictest29566irq/58-eth011:10:173
5695992615,7cyclictest29566irq/58-eth012:20:143
568499263,18cyclictest9657-21ssh11:10:152
568499261,14cyclictest31786-21sh09:35:262
567099262,19cyclictest10425-21sh10:47:461
567099262,16cyclictest1338-21ssh12:30:131
566099263,4cyclictest131rcu_preempt07:15:120
5660992619,3cyclictest0-21swapper/011:10:160
5660992617,5cyclictest0-21swapper/010:10:140
569599251,18cyclictest0-21swapper/309:50:453
568499255,13cyclictest0-21swapper/210:45:122
568499254,6cyclictest0-21swapper/207:20:142
568499252,18cyclictest24339-21ssh09:51:462
5684992512,9cyclictest0-21swapper/210:15:112
568499251,14cyclictest30100-21ssh10:40:162
568499251,12cyclictest19476-21ssh10:55:182
568499250,13cyclictest30143-21ls07:35:162
569599249,10cyclictest0-21swapper/311:39:443
5695992416,5cyclictest29566irq/58-eth011:30:183
5695992412,9cyclictest0-21swapper/312:00:203
568499249,6cyclictest0-21swapper/207:15:172
568499248,12cyclictest0-21swapper/207:55:232
568499248,12cyclictest0-21swapper/207:55:222
568499244,13cyclictest26346irq/40-dwc2_hso07:45:122
568499243,16cyclictest0-21swapper/209:47:452
568499243,16cyclictest0-21swapper/209:47:442
568499242,18cyclictest27693-21ssh12:05:132
568499242,16cyclictest0-21swapper/211:50:132
5684992413,9cyclictest13154-21ssh11:34:012
5684992413,8cyclictest0-21swapper/212:10:252
5684992412,10cyclictest0-21swapper/210:00:252
567099241,19cyclictest29890-21find07:35:131
566099247,12cyclictest12-21ksoftirqd/010:20:140
566099241,20cyclictest0-21swapper/008:40:160
569599233,13cyclictest0-21swapper/309:47:453
569599233,13cyclictest0-21swapper/309:47:443
569599232,16cyclictest0-21swapper/312:30:143
569599231,12cyclictest0-21swapper/310:35:173
568499239,11cyclictest0-21swapper/209:15:332
568499235,14cyclictest26346irq/40-dwc2_hso11:25:162
568499234,14cyclictest26346irq/40-dwc2_hso10:10:152
568499232,16cyclictest0-21swapper/211:35:122
5684992312,9cyclictest22353-21ssh10:35:032
5684992312,8cyclictest0-21swapper/210:20:142
568499231,18cyclictest24168-21diskmemload12:33:452
568499231,14cyclictest9424-21ssh12:35:152
568499231,11cyclictest13201-21grep10:05:252
5684992310,5cyclictest22652-21ssh11:17:072
568499230,13cyclictest15095-21ls10:30:152
567099232,16cyclictest9672-21ssh11:10:161
567099231,11cyclictest25439-21ssh11:40:291
566099236,12cyclictest629-21Async14:00:480
566099234,13cyclictest21625-21ssh11:40:130
566099232,14cyclictest9411-21ssh10:05:130
566099232,14cyclictest0-21swapper/008:35:140
566099231,19cyclictest11286-21ssh09:45:150
566099231,19cyclictest11286-21ssh09:45:140
566099231,12cyclictest31759-21kthreadcore10:40:220
569599223,13cyclictest0-21swapper/310:34:453
569599223,13cyclictest0-21swapper/309:44:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional