You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 13:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Sat Jul 12, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17096996549,13cyclictest23346irq/40-dwc2_hso22:35:142
17104996241,14cyclictest32466irq/58-eth023:05:133
1709699573,33cyclictest31584-21ssh22:45:142
17096995719,29cyclictest27-21ksoftirqd/222:50:172
17104995440,7cyclictest32466irq/58-eth023:55:143
17087995336,10cyclictest22016-21kworker/u8:100:10:141
17087995336,10cyclictest22016-21kworker/u8:100:10:141
1708799503,10cyclictest131rcu_preempt20:00:141
17087994724,12cyclictest131rcu_preempt21:20:191
17087994724,12cyclictest131rcu_preempt21:20:181
1707699472,35cyclictest32276-21ssh23:05:120
1707699471,2cyclictest0-21swapper/021:10:130
1707699461,3cyclictest0-21swapper/021:00:150
1709699442,22cyclictest738-21ssh00:25:152
1708799446,32cyclictest9257-21ssh23:30:121
1710499439,21cyclictest32466irq/58-eth023:25:123
1707699432,36cyclictest0-21swapper/021:30:130
1707699431,2cyclictest7922-21apt-get00:30:160
1707699421,3cyclictest0-21swapper/020:05:150
1708799413,26cyclictest22395-21ssh22:20:141
17087994121,11cyclictest131rcu_preempt22:15:171
1707699411,5cyclictest0-21swapper/020:25:130
1707699411,3cyclictest0-21swapper/022:25:130
1707699403,29cyclictest17682-21sh23:35:190
1707699402,2cyclictest14915-21apt-get22:35:140
1710499397,13cyclictest32466irq/58-eth023:20:133
1707699391,3cyclictest0-21swapper/020:35:150
1707699391,35cyclictest0-21swapper/022:50:160
1707699391,2cyclictest22379-21apt-get22:20:150
1707699391,2cyclictest13994-21apt-get22:15:160
1707699390,6cyclictest24703-21ssh23:57:520
1707699390,5cyclictest727-21apt-get00:25:150
17087993817,9cyclictest131rcu_preempt22:10:141
17087993813,20cyclictest21-21ksoftirqd/122:45:131
1707699381,3cyclictest23308-21apt-get22:40:160
1707699381,3cyclictest23308-21apt-get22:40:150
1707699381,33cyclictest28808-21ssh21:45:140
1707699381,2cyclictest0-21swapper/022:00:150
1709699371,29cyclictest28074-21ssh21:25:142
1708799372,28cyclictest14891-21ssh00:35:131
1707699372,7cyclictest0-21swapper/020:55:130
1707699372,31cyclictest0-21swapper/020:50:120
1707699371,3cyclictest0-21swapper/022:55:140
1707699371,3cyclictest0-21swapper/021:40:140
1707699371,2cyclictest0-21swapper/023:20:130
1707699370,3cyclictest11313-21apt-get20:45:140
17104993615,14cyclictest0-21swapper/322:05:133
17087993630,4cyclictest0-21swapper/122:50:151
1707699361,2cyclictest0-21swapper/022:05:130
1707699361,2cyclictest0-21swapper/019:40:160
17096993519,11cyclictest27-21ksoftirqd/222:05:142
1708799354,2cyclictest0-21swapper/120:45:131
1708799352,27cyclictest15697-21ssh22:55:141
1708799352,23cyclictest17819-21ssh00:15:141
1707699356,26cyclictest2677-21diskmemload00:00:310
1707699355,26cyclictest0-21swapper/000:15:130
1707699351,3cyclictest0-21swapper/021:35:150
1707699351,3cyclictest0-21swapper/021:25:150
1707699351,3cyclictest0-21swapper/019:10:120
1707699351,2cyclictest346-21apt-get20:00:130
1707699351,2cyclictest19739-21apt-get21:20:180
1707699351,2cyclictest19739-21apt-get21:20:180
1707699351,2cyclictest0-21swapper/023:15:130
1707699351,10cyclictest32014-21cut19:25:190
1707699341,6cyclictest11395-21cat23:50:230
1707699340,5cyclictest25825-21apt-get23:40:130
1708799335,20cyclictest21-21ksoftirqd/120:50:151
1707699331,9cyclictest30066-21ssh23:02:230
1707699331,8cyclictest6615-21diskstats20:40:170
1707699331,8cyclictest5953-21/usr/sbin/munin22:10:190
1707699331,6cyclictest5109-21cut00:05:210
1707699331,4cyclictest31562-21apt-get22:45:130
1707699331,3cyclictest0-21swapper/019:15:160
1710499326,14cyclictest0-21swapper/300:25:143
17104993224,3cyclictest32466irq/58-eth023:40:123
1709699327,6cyclictest0-21swapper/222:15:172
1709699322,24cyclictest9266-21ssh23:30:132
1707699322,22cyclictest9280-21ssh23:30:140
1707699321,8cyclictest6049-21ssh23:25:590
1707699321,8cyclictest18325-21memory00:35:240
1707699321,7cyclictest21829-21ntp_192.168.11419:45:280
1707699321,7cyclictest16357-21ssh23:15:030
1707699321,6cyclictest29330-21apt20:30:110
1707699321,6cyclictest0-21swapper/020:20:150
1707699321,4cyclictest31460-21ntp_states19:55:290
1707699321,3cyclictest0-21swapper/020:10:140
1707699320,3cyclictest4693-21ssh21:50:150
17096993114,2cyclictest0-21swapper/200:10:142
17096993114,2cyclictest0-21swapper/200:10:132
1708799311,23cyclictest24017-21ssh23:00:131
1707699311,8cyclictest15970-21cut20:15:200
1707699311,8cyclictest15970-21cut20:15:190
1707699311,7cyclictest13169-21uniq21:55:200
1707699311,7cyclictest13169-21uniq21:55:190
1707699311,6cyclictest6672-21entropy22:30:160
1707699311,6cyclictest29409-21kthreadcore19:20:190
1707699311,5cyclictest1716-21/usr/sbin/munin23:45:110
1707699311,3cyclictest25522-21apt-get00:20:120
1707699311,3cyclictest0-21swapper/021:05:140
1710499307,17cyclictest32466irq/58-eth021:10:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional