You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 05:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Nov 24, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
240089912271218,6cyclictest0-21swapper/119:25:141
240079911901150,36cyclictest0-21swapper/019:25:130
236212694614,42sleep10-21swapper/119:21:371
225232441360,64sleep00-21swapper/019:20:160
2400799138112,23cyclictest0-21swapper/020:00:260
551921120,8sleep12400899cyclictest23:30:131
313472970,4sleep0111rcuc/023:23:100
132972960,10sleep0111rcuc/022:30:270
176392900,9sleep02400799cyclictest21:28:190
241292850,4sleep1211ktimersoftd/123:15:231
29902740,5sleep12984-21pidof00:35:001
29902740,5sleep12984-21pidof00:35:001
83862640,10sleep12400899cyclictest22:59:501
194202620,7sleep02400799cyclictest21:30:160
95622510,3sleep0111rcuc/021:53:320
95622510,3sleep0111rcuc/021:53:320
77492501,31sleep07760-21sh22:58:560
275082440,3sleep0111rcuc/020:55:280
24007994322,10cyclictest3-21ksoftirqd/022:20:300
179242430,7sleep12400899cyclictest22:35:251
184382405,3sleep00-21swapper/022:02:260
272282390,3sleep041ktimersoftd/023:52:130
272282390,3sleep041ktimersoftd/023:52:120
2400899396,5cyclictest81rcu_preempt23:48:591
24008993929,6cyclictest26519-21ssh23:51:101
24008993929,6cyclictest26519-21ssh23:51:101
2400799393,4cyclictest81rcu_preempt20:25:270
2400799392,23cyclictest5675-21diskstats23:30:160
224082391,4sleep122481-21cut20:45:001
180712391,4sleep10-21swapper/100:15:561
178572391,34sleep117867-21ssh21:28:381
2400799387,4cyclictest81rcu_preempt00:20:150
309862371,32sleep130997-21sh23:22:401
2400899376,5cyclictest81rcu_preempt23:40:371
24007993721,5cyclictest3-21ksoftirqd/021:55:390
2400799371,9cyclictest9467-21ssh22:26:210
311892361,31sleep031202-21sh22:49:590
310462361,31sleep131845-21diskmemload21:41:451
304282361,31sleep131845-21diskmemload00:29:541
2400799361,8cyclictest32042-21ssh23:57:130
24007993618,6cyclictest3-21ksoftirqd/022:43:300
2400799361,7cyclictest26815-21ssh21:37:370
2400799361,10cyclictest81rcu_preempt00:10:310
88532352,3sleep10-21swapper/123:00:111
59172351,4sleep15928-21df_inode20:00:131
250582351,30sleep125063-21irqstats20:50:211
24008993517,14cyclictest27018-21fschecks_count22:45:141
2400799354,4cyclictest81rcu_preempt21:45:220
84122341,4sleep18430-21ssh22:25:281
2400899348,22cyclictest0-21swapper/121:21:271
2400899347,5cyclictest81rcu_preempt19:48:351
2400899344,19cyclictest40950irq/93-i91522:21:061
2400899341,5cyclictest81rcu_preempt22:32:131
24008993414,6cyclictest22-21ksoftirqd/123:35:111
2400799343,4cyclictest81rcu_preempt00:35:260
24007993417,6cyclictest3-21ksoftirqd/023:41:170
24007993416,6cyclictest3-21ksoftirqd/020:10:130
129352341,3sleep081rcu_preempt23:37:270
2400799339,5cyclictest81rcu_preempt22:13:230
2400799335,14cyclictest31850-21munin-run21:10:010
2400799333,17cyclictest0-21swapper/023:25:470
2400799333,17cyclictest0-21swapper/019:38:550
24007993317,5cyclictest3-21ksoftirqd/020:43:130
24007993313,6cyclictest2220-21dbus-daemon19:45:310
2400799331,15cyclictest3883-21taskset00:01:150
118642331,4sleep117937-21kworker/1:000:43:551
62382321,4sleep16250-21rm00:04:431
42712323,25sleep131845-21diskmemload21:14:561
2400899328,5cyclictest40950irq/93-i91520:55:261
2400899326,6cyclictest0-21swapper/121:35:121
2400899325,4cyclictest81rcu_preempt19:51:591
2400899324,4cyclictest81rcu_preempt00:53:041
24008993225,3cyclictest0-21swapper/119:55:171
2400899322,26cyclictest0-21swapper/121:32:121
2400899322,17cyclictest0-21swapper/122:43:281
2400899321,8cyclictest3020-21runrttasks22:16:471
24008993212,8cyclictest22-21ksoftirqd/122:10:531
2400799329,4cyclictest81rcu_preempt22:07:160
2400799328,11cyclictest17094-21kernelversion00:15:260
2400799326,5cyclictest81rcu_preempt21:15:100
2400799326,14cyclictest0-21swapper/022:16:040
2400799323,5cyclictest81rcu_preempt22:35:280
2400799323,4cyclictest81rcu_preempt00:40:250
2400799323,14cyclictest10905-21users21:20:310
24007993217,5cyclictest3-21ksoftirqd/019:41:580
24007993213,5cyclictest12585-21ssh23:03:550
195872321,4sleep119628-21ntp_states20:35:251
271742311,5sleep00-21swapper/023:19:090
2400899313,4cyclictest81rcu_preempt20:11:521
24008993122,5cyclictest21600-21ssh00:20:161
24008993118,7cyclictest17219-21diskstats20:30:151
2400899311,4cyclictest81rcu_preempt21:03:221
2400899311,4cyclictest81rcu_preempt19:45:001
24008993114,14cyclictest22-21ksoftirqd/100:14:271
2400899311,25cyclictest8721-21ssh00:06:191
2400799317,4cyclictest81rcu_preempt21:14:230
2400799316,7cyclictest81rcu_preempt23:48:540
24007993117,5cyclictest3-21ksoftirqd/020:36:380
24007993112,5cyclictest2212-21ssh22:52:590
193462311,26sleep019377-21ntp_states23:10:260
34312301,5sleep00-21swapper/019:53:320
2400899301,8cyclictest1838-21ssh22:52:281
2400899301,4cyclictest81rcu_preempt00:36:121
2400899301,15cyclictest30097-21iostat_ios23:55:211
2400799308,10cyclictest0-21swapper/019:58:270
2400799306,4cyclictest81rcu_preempt23:09:410
2400799306,4cyclictest81rcu_preempt00:33:040
2400799306,4cyclictest81rcu_preempt00:33:040
2400799306,4cyclictest81rcu_preempt00:26:020
2400799301,15cyclictest18718-21ls20:35:010
144192301,5sleep10-21swapper/100:45:431
118152301,26sleep111879-21ssh21:55:271
257662291,5sleep00-21swapper/020:50:480
2400899299,16cyclictest0-21swapper/123:06:091
2400899298,8cyclictest27200-21sort19:30:181
2400899295,4cyclictest81rcu_preempt19:38:191
2400899293,22cyclictest23785-21sed20:45:301
2400899292,13cyclictest6015-21head21:15:301
2400899292,13cyclictest0-21swapper/123:11:161
2400899291,7cyclictest19807-21ssh22:04:251
24008992915,6cyclictest22-21ksoftirqd/122:07:271
2400799295,4cyclictest40950irq/93-i91500:05:230
2400799292,14cyclictest18615-21/usr/sbin/munin00:50:320
24007992913,6cyclictest3-21ksoftirqd/020:46:370
2400799291,20cyclictest0-21swapper/021:03:510
144512291,5sleep00-21swapper/000:45:460
129022291,5sleep00-21swapper/020:19:100
2400899284,7cyclictest201rcuc/121:07:161
2400899282,13cyclictest1088-21iostat23:25:211
24008992817,6cyclictest1437-21/usr/sbin/munin21:45:161
24008992813,12cyclictest22-21ksoftirqd/120:09:591
2400799284,4cyclictest81rcu_preempt21:40:040
146282281,5sleep00-21swapper/020:22:210
146262281,5sleep10-21swapper/120:22:211
2400899278,7cyclictest0-21swapper/120:16:321
2400899273,20cyclictest0-21swapper/121:50:561
2400899273,20cyclictest0-21swapper/121:50:551
2400899272,4cyclictest81rcu_preempt20:27:091
2400799274,5cyclictest81rcu_preempt19:30:010
24007992711,5cyclictest3-21ksoftirqd/020:06:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional