You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 03:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Thu Dec 04, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1060199481,24cyclictest932-21snmpd22:10:142
1061099451,25cyclictest29566irq/58-eth022:20:143
1061099451,25cyclictest29566irq/58-eth022:20:133
1061099442,24cyclictest29566irq/58-eth000:35:173
1058199430,34cyclictest22672-21rm00:20:140
1058199412,4cyclictest131rcu_preempt00:00:140
1061099404,22cyclictest29566irq/58-eth023:10:133
10593993921,10cyclictest21-21ksoftirqd/123:15:141
1061099385,20cyclictest29566irq/58-eth021:20:143
1061099379,25cyclictest29566irq/58-eth021:40:143
10610993714,17cyclictest29566irq/58-eth023:05:133
1061099371,2cyclictest0-21swapper/300:30:123
1060199372,28cyclictest932-21snmpd19:35:132
1058199371,29cyclictest5471-21ssh21:15:140
10601993610,6cyclictest27-21ksoftirqd/219:10:122
1058199361,29cyclictest12545-21ssh23:15:120
1058199361,19cyclictest26740-21ssh23:21:570
1061099357,18cyclictest0-21swapper/300:00:143
1060199352,27cyclictest20297-21sh23:19:402
1060199352,20cyclictest29243-21ssh23:25:122
1059399351,26cyclictest15029-21ssh21:40:141
1061099343,26cyclictest0-21swapper/300:15:153
1059399341,22cyclictest26041-21ssh22:25:131
1061099333,25cyclictest0-21swapper/322:55:133
1061099331,2cyclictest0-21swapper/320:50:143
1061099323,24cyclictest0-21swapper/323:55:123
1058199322,22cyclictest30574-21ssh00:25:160
1061099312,22cyclictest0-21swapper/300:10:153
1060199313,25cyclictest27-21ksoftirqd/222:55:132
1060199312,24cyclictest13722-21ssh23:53:542
10601993119,7cyclictest261rcuc/223:12:412
1060199311,25cyclictest23189-21ssh00:00:132
1059399312,24cyclictest9295-21ssh22:15:161
1058199315,19cyclictest31821-21ssh21:50:140
1058199312,22cyclictest6078-21/usr/sbin/munin00:30:160
1058199311,22cyclictest24777-21ssh22:05:170
1061099302,22cyclictest0-21swapper/321:15:133
10610993018,7cyclictest29566irq/58-eth022:35:273
1061099301,2cyclictest0-21swapper/322:05:173
1061099301,2cyclictest0-21swapper/321:55:113
1061099301,24cyclictest0-21swapper/323:20:153
1060199304,15cyclictest26346irq/40-dwc2_hso20:30:132
1060199304,11cyclictest131rcu_preempt23:30:112
1060199303,12cyclictest7045-21ssh00:10:172
1060199303,12cyclictest17631-21ssh22:20:122
1060199303,12cyclictest17631-21ssh22:20:122
10593993022,2cyclictest0-21swapper/122:30:141
1061099292,21cyclictest0-21swapper/319:25:133
1061099292,17cyclictest29566irq/58-eth023:50:143
1061099291,6cyclictest0-21swapper/323:00:133
1060199295,14cyclictest26346irq/40-dwc2_hso21:45:152
1060199295,14cyclictest26346irq/40-dwc2_hso21:20:142
1060199292,18cyclictest29646-21rm21:10:142
1060199291,15cyclictest30442-21ssh00:25:132
10581992921,3cyclictest12-21ksoftirqd/023:55:120
1058199291,20cyclictest17655-21ssh22:20:140
1058199291,20cyclictest17655-21ssh22:20:130
1061099281,8cyclictest0-21swapper/322:50:143
1061099281,8cyclictest0-21swapper/322:50:133
1061099281,6cyclictest0-21swapper/322:45:123
10610992815,10cyclictest29566irq/58-eth021:10:153
1061099281,3cyclictest0-21swapper/322:00:113
1061099281,3cyclictest0-21swapper/300:20:133
1061099281,22cyclictest0-21swapper/319:45:133
1060199285,17cyclictest27-21ksoftirqd/220:50:132
1060199283,20cyclictest0-21swapper/222:03:402
1060199282,16cyclictest26346irq/40-dwc2_hso23:45:132
1059399286,19cyclictest23442-21ssh21:45:151
1059399281,19cyclictest20950-21ssh23:20:151
1058199282,18cyclictest30667-21sh23:45:130
1061099274,17cyclictest0-21swapper/319:40:133
1061099272,7cyclictest0-21swapper/321:50:153
1061099272,2cyclictest0-21swapper/320:20:153
1061099271,7cyclictest0-21swapper/323:40:163
1061099271,4cyclictest0-21swapper/322:10:253
1061099271,2cyclictest0-21swapper/319:20:133
1061099271,23cyclictest0-21swapper/300:25:143
1061099270,2cyclictest0-21swapper/320:30:123
1060199275,7cyclictest27-21ksoftirqd/223:55:132
1060199273,18cyclictest5470-21sh21:15:152
1060199273,14cyclictest26346irq/40-dwc2_hso19:55:132
10601992720,4cyclictest14251-21tr20:20:222
1059399272,19cyclictest13459-21ssh21:56:401
1061099262,18cyclictest0-21swapper/322:40:133
1061099261,8cyclictest0-21swapper/320:25:123
1061099261,5cyclictest0-21swapper/320:40:133
1061099261,3cyclictest0-21swapper/323:25:183
1061099261,3cyclictest0-21swapper/321:26:343
1061099261,3cyclictest0-21swapper/300:05:163
1061099261,3cyclictest0-21swapper/300:05:153
1061099261,2cyclictest0-21swapper/321:05:123
1061099261,2cyclictest0-21swapper/319:30:123
1061099261,22cyclictest0-21swapper/321:35:133
1060199265,9cyclictest27-21ksoftirqd/221:05:132
1060199264,16cyclictest26346irq/40-dwc2_hso19:15:162
1060199262,16cyclictest26346irq/40-dwc2_hso21:25:142
10593992616,4cyclictest21-21ksoftirqd/123:40:151
1058199262,20cyclictest7807-21ssh21:55:140
10581992617,5cyclictest0-21swapper/022:15:170
1058199261,18cyclictest5327-21ssh23:30:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional