You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-29 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack8slot4s.osadl.org (updated Fri Aug 29, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25779982239174,21sleep40-21swapper/419:07:464
25778732236170,21sleep50-21swapper/519:06:025
25778702224161,50sleep20-21swapper/219:05:592
25778562220165,17sleep60-21swapper/619:05:476
25779862216183,21sleep30-21swapper/319:07:373
25780962212159,42sleep10-21swapper/119:09:111
25780012208178,19sleep70-21swapper/719:07:497
25779042207174,22sleep00-21swapper/019:06:290
257840299382,19cyclictest2624344-21ntpq20:25:217
2578389992827,1cyclictest2654891-21sendmail21:20:002
257840299270,25cyclictest2608367-21awk20:00:017
2578402992622,3cyclictest2695666-21apt-get22:30:167
257838999260,1cyclictest2767272-21munin-run00:35:002
2578402992523,1cyclictest0-21swapper/723:50:017
257840099250,3cyclictest2636947-21dump-pmu-power20:50:006
2578389992520,4cyclictest0-21swapper/200:15:132
257838999250,24cyclictest0-21swapper/221:45:162
257840299240,22cyclictest2669885-21apt-get21:45:167
257840299240,0cyclictest0-21swapper/723:15:137
257840299240,0cyclictest0-21swapper/719:35:137
257840099240,23cyclictest2587598-21awk19:25:016
257840099240,23cyclictest0-21swapper/623:20:006
2578397992422,1cyclictest2695666-21apt-get22:30:175
257839299240,22cyclictest0-21swapper/320:15:133
2578389992419,4cyclictest0-21swapper/223:30:132
257838999240,23cyclictest842-21runrttasks20:10:132
2578384992424,0cyclictest0-21swapper/023:10:130
2578402992321,1cyclictest2660615-21munin-run21:30:007
2578400992321,1cyclictest2637375-21apt-get20:50:136
257839799230,22cyclictest2639807-21munin-run20:55:005
2578395992320,2cyclictest2622672-21munin-run20:25:014
257839599230,22cyclictest0-21swapper/423:50:004
2578392992322,1cyclictest0-21swapper/323:20:143
2578392992322,1cyclictest0-21swapper/323:20:143
257839299230,2cyclictest2628372-21turbostat20:35:013
257839299230,22cyclictest0-21swapper/323:25:143
257839299230,22cyclictest0-21swapper/323:25:143
257839299230,22cyclictest0-21swapper/321:30:143
2578389992320,3cyclictest0-21swapper/223:10:132
257838999230,23cyclictest2593547-21munin-run19:35:012
257838999230,22cyclictest2749855-21idleruntime-cro00:05:002
257838999230,22cyclictest0-21swapper/221:20:162
257838999230,22cyclictest0-21swapper/220:25:152
257838699230,23cyclictest2764409-21dump-pmu-power00:30:001
257838699230,23cyclictest2608379-21sleep20:00:001
257838499230,22cyclictest0-21swapper/021:40:130
2578402992220,1cyclictest2588258-21apt-get19:25:127
257840299220,21cyclictest0-21swapper/721:20:177
257840299220,21cyclictest0-21swapper/720:00:147
2578400992221,1cyclictest2600211-21apt-get19:45:136
2578400992221,1cyclictest0-21swapper/620:40:146
2578400992221,0cyclictest0-21swapper/622:50:146
2578400992220,1cyclictest0-21swapper/623:55:126
257840099220,21cyclictest0-21swapper/623:30:006
257840099220,21cyclictest0-21swapper/623:30:006
257840099220,21cyclictest0-21swapper/622:40:126
257840099220,21cyclictest0-21swapper/622:10:126
257840099220,21cyclictest0-21swapper/620:25:156
257840099220,21cyclictest0-21swapper/600:00:116
257840099220,1cyclictest2658179-21apt-get21:25:136
257840099220,1cyclictest2646484-21http21:05:166
2578397992221,1cyclictest2663462-21dump-pmu-power21:35:005
2578397992220,1cyclictest2700959-21perf22:40:005
2578397992220,1cyclictest0-21swapper/519:55:145
257839799220,22cyclictest2642921-21apt-get21:00:015
257839799220,22cyclictest1896684-21systemd-journal23:30:005
257839799220,22cyclictest1896684-21systemd-journal23:30:005
257839799220,21cyclictest0-21swapper/522:50:145
257839799220,21cyclictest0-21swapper/519:25:025
257839799220,21cyclictest0-21swapper/500:35:165
257839599220,21cyclictest0-21swapper/422:50:144
257839599220,21cyclictest0-21swapper/420:55:114
257839599220,21cyclictest0-21swapper/419:30:134
2578392992222,0cyclictest0-21swapper/320:10:133
2578392992221,1cyclictest2689960-21apt-get22:20:173
257839299220,21cyclictest2767692-21apt-get00:35:163
257839299220,21cyclictest0-21swapper/323:55:123
257839299220,21cyclictest0-21swapper/322:35:143
257839299220,21cyclictest0-21swapper/321:15:183
257839299220,21cyclictest0-21swapper/319:20:143
257839299220,1cyclictest2675592-21apt-get21:55:133
257839299220,1cyclictest0-21swapper/322:20:003
257839299220,0cyclictest0-21swapper/320:45:133
257838999220,21cyclictest2678467-21apt-get22:00:122
257838999220,21cyclictest2587582-21perf19:25:012
257838999220,21cyclictest0-21swapper/223:50:142
257838999220,1cyclictest0-21swapper/221:00:152
257838999220,0cyclictest0-21swapper/223:05:142
257838999220,0cyclictest0-21swapper/200:20:142
2578386992222,0cyclictest0-21swapper/120:35:131
2578386992222,0cyclictest0-21swapper/100:00:111
257838699220,22cyclictest0-21swapper/123:40:001
257838699220,22cyclictest0-21swapper/119:40:011
257838699220,1cyclictest0-21swapper/121:55:001
257838699220,1cyclictest0-21swapper/119:45:011
2578384992221,1cyclictest0-21swapper/020:50:000
2578384992220,1cyclictest2715683-21apt-get23:05:140
257838499220,21cyclictest2735704-21apt-get23:40:120
257838499220,21cyclictest2620235-21apt-get20:20:130
257838499220,21cyclictest0-21swapper/019:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional