You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Sat Jul 19, 2025 00:45:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1054999644,46cyclictest24031-21ssh23:15:141
1054099583,44cyclictest31289-21ssh00:35:150
10540995833,21cyclictest328-21ssh22:25:110
1054099544,38cyclictest9288-21ssh23:25:130
1054099544,38cyclictest9288-21ssh23:25:130
1054099511,38cyclictest32231-21ssh21:30:130
1054099503,35cyclictest23392-21ssh21:25:120
10540994933,10cyclictest29835-21apt-get23:55:140
10540994817,20cyclictest0-21swapper/019:40:160
1056099474,35cyclictest23346irq/40-dwc2_hso23:05:142
1054099472,33cyclictest6402-21ssh23:05:140
10568994532,11cyclictest0-21swapper/323:10:113
10540994534,7cyclictest24023-21apt-get23:15:150
10540994430,9cyclictest21037-21apt-get23:50:170
1054099431,34cyclictest419-21rm23:20:130
10540994235,3cyclictest21670-21apt-get19:55:130
10560994112,17cyclictest27-21ksoftirqd/220:10:122
10540994116,8cyclictest20025-21ssh22:15:480
10540994012,11cyclictest13076-21ssh00:23:050
1056899398,20cyclictest0-21swapper/300:10:163
1056099392,21cyclictest32078-21ssh23:35:542
10540993913,10cyclictest6452-21diskstats00:00:160
10540993912,20cyclictest0-21swapper/023:40:140
10540993831,3cyclictest14449-21apt-get20:55:140
10540993830,4cyclictest30041-21apt-get19:30:140
10540993830,4cyclictest30041-21apt-get19:30:140
10540993816,8cyclictest17803-21users20:20:310
10540993816,8cyclictest17803-21users20:20:310
10540993813,10cyclictest32539-21ssh22:41:260
10540993813,10cyclictest14438-21ssh21:36:420
10540993812,8cyclictest3889-21ssh00:16:310
10540993715,11cyclictest27587-21ntp_192.168.11421:05:240
10540993713,10cyclictest3009-21ssh21:12:180
10540993713,10cyclictest17944-21ssh22:35:040
10540993712,10cyclictest16300-21sh22:33:170
10540993712,10cyclictest16300-21sh22:33:170
1056899363,17cyclictest32466irq/58-eth023:00:123
10540993629,4cyclictest3669-21apt-get20:10:120
10540993615,7cyclictest28748-21diskmemload00:31:330
10540993614,9cyclictest28495-21ssh22:58:410
10540993614,9cyclictest28495-21ssh22:58:410
10540993614,13cyclictest22468-21rm21:40:410
10540993613,5cyclictest12216-21apt-get22:50:130
10540993613,10cyclictest20895-21ssh00:07:520
10540993612,8cyclictest1659-21ssh21:49:000
10540993610,9cyclictest17480-21ssh21:56:280
1056899353,20cyclictest32466irq/58-eth021:10:143
1056099352,28cyclictest25667-21ssh23:33:542
1056099352,23cyclictest29981-21ssh23:00:132
10540993530,3cyclictest22876-21apt-get20:30:140
10540993519,11cyclictest3416-21apt-get22:45:150
10540993515,9cyclictest25775-21sh23:34:030
10540993514,7cyclictest20368-21ssh23:10:570
10540993512,7cyclictest0-21swapper/022:10:540
10540993512,20cyclictest27831-21grep20:35:200
10540993512,10cyclictest10744-21ssh21:54:130
10540993511,9cyclictest28748-21diskmemload22:21:580
10540993511,10cyclictest19697-21ssh21:20:520
10540993510,10cyclictest13834-21ssh21:19:390
1056899348,15cyclictest32466irq/58-eth000:25:143
1056899342,27cyclictest32466irq/58-eth021:15:133
1056099341,17cyclictest14571-21ssh21:20:152
10540993425,7cyclictest22792-21apt-get00:10:160
10540993421,10cyclictest29971-21apt-get23:00:120
10540993413,8cyclictest28748-21diskmemload00:27:050
10540993413,7cyclictest18965-21sed19:15:250
10540993412,9cyclictest17238-21sh23:45:480
10568993314,13cyclictest0-21swapper/323:20:143
1056099332,25cyclictest0-21swapper/222:39:542
1056099332,17cyclictest9340-21ssh22:30:172
1056099332,17cyclictest9340-21ssh22:30:172
1056099331,28cyclictest6194-21rm00:00:052
10540993317,12cyclictest866-21ntp_states22:05:250
10540993313,7cyclictest28748-21diskmemload22:02:150
10540993313,7cyclictest28748-21diskmemload22:02:150
10540993310,9cyclictest14654-21usage_Anybus19:10:300
10568993222,7cyclictest32466irq/58-eth022:40:163
1056899322,20cyclictest32466irq/58-eth023:55:143
1056099322,21cyclictest27-21ksoftirqd/219:30:132
1056099322,21cyclictest27-21ksoftirqd/219:30:132
1054099328,8cyclictest23836-21ntp_states19:20:290
1054099328,8cyclictest23836-21ntp_states19:20:290
10540993214,3cyclictest28748-21diskmemload23:37:190
10540993211,9cyclictest12169-21df_inode19:45:140
10540993210,8cyclictest3234-21cut19:35:210
1056899315,19cyclictest32466irq/58-eth021:20:153
1056099313,19cyclictest23346irq/40-dwc2_hso22:50:132
10549993115,13cyclictest21-21ksoftirqd/122:05:141
1054099311,22cyclictest0-21swapper/020:05:160
10540993110,9cyclictest5937-21kthreadcore20:45:200
10540993110,9cyclictest5937-21kthreadcore20:45:200
1056099303,20cyclictest23346irq/40-dwc2_hso00:10:162
1056099302,21cyclictest0-21swapper/220:30:152
1054999302,23cyclictest14577-21ssh21:20:161
10549993013,11cyclictest10536-21cyclictest19:55:121
10540993018,9cyclictest21384-21memory20:25:250
1056099292,20cyclictest0-21swapper/220:20:142
1056099292,20cyclictest0-21swapper/220:20:142
1056099292,18cyclictest23346irq/40-dwc2_hso22:15:142
1054999294,15cyclictest32215-21ssh21:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional