You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 06:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Fri May 09, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30859210490,9sleep10-21swapper/119:08:161
30987210088,8sleep30-21swapper/319:09:553
3082029070,16sleep20-21swapper/219:07:452
3070428270,8sleep00-21swapper/019:06:140
3108099290,10cyclictest12470-21aten2_r7power_e22:15:151
3108699270,2cyclictest0-21swapper/321:20:003
3108399261,24cyclictest0-21swapper/220:30:212
3108099254,1cyclictest23554-21diskmemload22:25:201
31083992420,3cyclictest676-21ntp_states23:20:262
3108399240,23cyclictest0-21swapper/220:00:202
31086992320,2cyclictest31832-21apache_volume23:20:183
31083992320,2cyclictest26125-21ntp_states21:35:222
31083992320,2cyclictest23567-21munin-run21:10:002
31083992320,2cyclictest23567-21munin-run21:09:592
3108099235,8cyclictest0-21swapper/122:30:131
3108099230,0cyclictest0-21swapper/123:42:111
31076992320,2cyclictest31866-21apache_volume22:55:140
31076992320,2cyclictest18400-21apache_volume21:30:130
31076992320,2cyclictest14331-21users22:40:280
276322230,4chrt39-21ksoftirqd/322:01:033
31083992219,2cyclictest5959-21hddtemp_smartct21:20:202
31083992219,2cyclictest19067-21apache_accesses23:10:112
3108099225,11cyclictest0-21swapper/120:25:151
31076992219,2cyclictest418-21memory23:45:210
31076992219,2cyclictest11351-21irqstats00:20:190
3107699220,19cyclictest0-21swapper/019:55:130
3108099210,19cyclictest0-21swapper/100:34:461
31076992118,2cyclictest6084-21apache_volume22:35:140
31076992118,2cyclictest4269-21apache_accesses00:15:150
240502210,0sleep10-21swapper/121:34:371
31086992017,2cyclictest32468-21df22:30:153
3108699200,1cyclictest0-21swapper/323:30:163
3108699200,19cyclictest0-21swapper/321:24:253
3108399200,18cyclictest0-21swapper/221:14:172
31080992017,2cyclictest26628-21ntp_states23:15:201
31076992017,2cyclictest24020-21apache_accesses21:10:130
31086991917,1cyclictest336-21ntp_states21:40:223
31083991918,1cyclictest0-21swapper/200:15:172
31083991918,1cyclictest0-21swapper/200:08:342
31080991912,2cyclictest7102-21ntp_states22:10:211
3108099191,14cyclictest0-21swapper/122:35:151
31080991910,3cyclictest25416-21grep22:50:151
31080991910,2cyclictest20446-21tr23:10:211
31076991916,2cyclictest7759-21users22:10:270
31076991914,4cyclictest16942-21python19:45:260
3108699180,1cyclictest0-21swapper/321:39:083
31083991815,2cyclictest26568-21memory22:25:212
31083991815,2cyclictest14329-21users22:15:282
31083991814,3cyclictest23554-21diskmemload23:51:112
3108099189,3cyclictest12891-21sh19:40:001
31080991812,2cyclictest7029-21users21:20:281
3108099180,1cyclictest0-21swapper/122:57:321
3108099180,1cyclictest0-21swapper/122:47:571
3107699188,5cyclictest18213-21perf21:55:000
3107699186,6cyclictest5781-21munin-run19:25:000
31086991714,2cyclictest25252-21apache_processe23:40:143
31086991713,3cyclictest381rcuc/323:35:143
3108399171,1cyclictest186402chrt23:35:032
31080991714,2cyclictest5836-21apache_volume23:00:131
3108099170,1cyclictest0-21swapper/123:45:241
3108099170,12cyclictest10544-21wc19:35:011
3107699172,8cyclictest0-21swapper/022:00:420
31076991714,2cyclictest12549-21hddtemp_smartct21:25:240
31086991616,0cyclictest0-21swapper/322:50:253
31083991615,1cyclictest23554-21diskmemload22:50:362
3108399160,1cyclictest23554-21diskmemload23:15:122
3108099168,3cyclictest18341-21wc21:55:001
31080991613,2cyclictest31463-21df_inode21:15:171
3108099160,16cyclictest0-21swapper/122:08:491
31076991613,2cyclictest24412-21munin-run00:05:000
31086991513,1cyclictest7622-21users23:50:253
31086991512,2cyclictest13081-21diskstats22:40:163
31086991511,3cyclictest1142-21chrt00:11:183
3108699150,14cyclictest0-21swapper/322:07:543
3108399158,6cyclictest12498-21grep21:25:232
31083991513,1cyclictest32574-21diskstats22:30:162
3108399151,2cyclictest37850irq/131-snd_hda00:30:272
31083991512,2cyclictest10859-21df00:20:152
3108099152,8cyclictest18392-21turbostat23:35:011
31080991510,3cyclictest19137-21taskset21:00:161
3107699151,7cyclictest5613-21perf23:25:010
3108699149,3cyclictest0-21swapper/323:46:193
3108699148,5cyclictest30065-21apache221:52:493
3108699145,5cyclictest19032-21/usr/sbin/munin23:10:153
31086991414,0cyclictest0-21swapper/323:16:223
31083991413,1cyclictest0-21swapper/223:02:362
31083991410,3cyclictest10511-21idleruntime-cro19:35:012
3108399140,13cyclictest22208-21head19:55:262
3108099149,3cyclictest21557-21wc19:55:191
3108099146,7cyclictest10982-21munin-node00:12:431
31080991410,2cyclictest12534-21sh22:40:151
3108099140,12cyclictest7480-21cat19:25:271
3107699143,9cyclictest31449-21perf22:55:000
31076991411,2cyclictest12402-21apache_accesses23:30:140
31076991410,2cyclictest12521-21grep23:55:160
3108699139,3cyclictest18292-21grep20:55:273
3108699139,3cyclictest12902-21munin-plugin-st19:40:013
3108699139,2cyclictest12893-21cat20:45:213
3108699133,5cyclictest224-21systemd-journal00:09:593
31086991310,2cyclictest21923-21tr00:30:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional