You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 13:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Nov 19, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239409912681,1242cyclictest0-21swapper/120:00:011
239409911051077,24cyclictest24108-21wget19:25:121
239399910741061,10cyclictest0-21swapper/019:25:120
237742635553,42sleep10-21swapper/119:23:591
237112612568,27sleep00-21swapper/019:23:180
2393999134128,3cyclictest0-21swapper/020:00:010
913221040,3sleep00-21swapper/000:40:240
263152990,10sleep12394099cyclictest00:25:141
125422980,8sleep02393999cyclictest00:10:250
2394099772,42cyclictest16441-21ssh23:40:331
2394099761,40cyclictest1440-21taskset22:51:431
2394099752,43cyclictest2220-21dbus-daemon22:24:361
2394099751,40cyclictest19574-21/usr/sbin/munin23:10:321
2394099742,34cyclictest11176-21df21:55:151
2394099741,38cyclictest2553-21chrt00:00:181
2394099741,33cyclictest25433-21ssh23:16:241
2394099741,33cyclictest10393-21ssh21:54:441
2394099732,37cyclictest14784-21fschecks_time21:25:201
2394099732,36cyclictest25247-21ssh00:24:011
2394099732,35cyclictest5583-21taskset00:36:261
2394099731,38cyclictest12864-21fschecks_time22:30:191
2394099731,34cyclictest25012-21ssh22:42:491
2394099731,33cyclictest26805-21ssh23:51:211
2394099722,35cyclictest29691-21ntp_states21:40:261
2394099722,33cyclictest27132-21ssh22:10:591
2394099721,40cyclictest31707-21sh00:30:221
2394099711,39cyclictest8345-21uptime00:05:311
2394099709,29cyclictest27353-21wc20:55:291
2394099702,35cyclictest27927-21chrt19:31:011
2394099702,32cyclictest30976-21irqstats19:40:211
2394099701,36cyclictest29966-21chrt19:37:401
2394099701,36cyclictest29966-21chrt19:37:401
2394099701,36cyclictest23906-21chrt20:46:431
2394099701,34cyclictest15273-21ssh00:46:401
293652690,3sleep00-21swapper/023:20:300
2394099692,32cyclictest9611-21df20:10:161
2394099691,37cyclictest12568-21chrt21:23:001
2394099691,36cyclictest16440-21sh23:07:201
2394099691,33cyclictest21058-21chrt23:45:291
2394099691,32cyclictest18213-21ssh22:02:021
2394099681,39cyclictest27404-21ssh21:38:311
2394099681,38cyclictest18281-21chrt20:32:001
2394099681,36cyclictest28527-21sh23:20:151
2394099681,32cyclictest9825-21grep23:00:271
2394099681,32cyclictest25167-21sed22:10:011
2394099681,32cyclictest20504-21taskset00:52:361
2394099679,28cyclictest0-21swapper/123:58:251
2394099671,39cyclictest14507-21ssh00:12:281
2394099671,32cyclictest11671-21sed23:35:331
23940996712,33cyclictest3020-21runrttasks20:03:451
23940996711,40cyclictest740-21cpu23:25:131
2394099662,31cyclictest1581-21ssh22:18:591
2394099662,30cyclictest26815-21/usr/sbin/munin22:45:281
2394099661,34cyclictest22490-21cut20:45:011
2394099661,32cyclictest19629-21ssh00:17:531
2394099661,32cyclictest19113-21ssh22:36:161
2394099661,31cyclictest10114-21chrt00:40:591
145172650,4sleep00-21swapper/021:25:150
2394099641,41cyclictest5593-21sh22:55:351
2394099641,32cyclictest31956-21taskset21:10:031
2394099633,31cyclictest19016-21df20:35:151
2394099628,31cyclictest966-21ssh21:45:001
2394099621,36cyclictest6590-21sh21:16:211
2394099621,32cyclictest23678-21sed21:35:001
2394099621,32cyclictest1351-21taskset19:48:231
23940996212,36cyclictest31780-21diskmemload22:25:061
2394099611,38cyclictest14979-21/usr/sbin/munin20:25:291
2394099602,37cyclictest28467-21diskstats21:00:161
2394099601,30cyclictest7890-21fschecks_time20:05:181
2394099592,34cyclictest3127-21chrt19:51:081
2394099591,37cyclictest2612-21sshd21:07:041
2394099591,37cyclictest2612-21sshd21:07:041
2394099591,30cyclictest3020-21runrttasks20:17:291
2394099581,36cyclictest14626-21chrt20:23:031
2394099571,37cyclictest5470-21rm23:30:091
2394099541,35cyclictest25221-21cat20:50:261
252942460,8sleep02393999cyclictest00:24:050
176022450,5sleep0111rcuc/023:09:010
195172400,4sleep041ktimersoftd/000:17:430
2393999386,5cyclictest81rcu_preempt21:55:270
2393999381,15cyclictest0-21swapper/020:33:450
2393999375,5cyclictest81rcu_preempt22:39:380
2393999375,5cyclictest0-21swapper/000:52:350
2393999371,13cyclictest30466-21sh22:48:460
134152370,9sleep02393999cyclictest20:20:160
23939993615,5cyclictest0-21swapper/000:39:520
23939993613,6cyclictest29261-21perl21:40:180
2393999355,5cyclictest81rcu_preempt23:10:230
2393999354,4cyclictest81rcu_preempt22:29:220
2393999351,22cyclictest14725-21ssh23:39:490
2393999351,22cyclictest11540-21ssh23:02:110
2393999351,21cyclictest4834-21ssh23:29:260
2393999347,4cyclictest81rcu_preempt21:10:230
2393999344,4cyclictest81rcu_preempt23:48:310
2393999344,4cyclictest81rcu_preempt21:33:420
2393999341,21cyclictest25882-21ssh22:44:060
2393999339,5cyclictest1979-21chrt19:50:160
2393999336,4cyclictest81rcu_preempt22:55:480
2393999335,5cyclictest81rcu_preempt00:05:290
2393999335,4cyclictest81rcu_preempt23:32:140
2393999334,5cyclictest81rcu_preempt22:17:070
2393999333,4cyclictest81rcu_preempt22:50:530
2393999333,4cyclictest81rcu_preempt22:20:260
23939993322,6cyclictest16781-21ssh22:34:540
23939993310,19cyclictest27535-21rm21:38:420
240732321,5sleep00-21swapper/020:48:240
2393999327,4cyclictest81rcu_preempt00:25:470
2393999326,4cyclictest81rcu_preempt21:45:300
2393999325,5cyclictest81rcu_preempt22:05:560
2393999325,4cyclictest81rcu_preempt19:35:290
2393999325,4cyclictest81rcu_preempt19:35:290
2393999324,4cyclictest81rcu_preempt23:40:380
2393999324,4cyclictest81rcu_preempt21:19:170
2393999324,4cyclictest81rcu_preempt00:01:520
2393999323,4cyclictest81rcu_preempt22:03:410
2393999322,5cyclictest81rcu_preempt21:23:540
2393999321,4cyclictest81rcu_preempt23:17:120
2393999321,12cyclictest0-21swapper/023:55:420
2393999314,4cyclictest81rcu_preempt00:31:440
2393999313,4cyclictest81rcu_preempt21:54:160
2393999312,4cyclictest81rcu_preempt22:13:230
2393999312,4cyclictest81rcu_preempt20:00:160
2393999312,4cyclictest81rcu_preempt00:45:210
23939993122,6cyclictest18760-21wget20:35:130
2393999312,12cyclictest31207-21chrt19:40:260
2393999311,4cyclictest81rcu_preempt19:45:140
2393999303,4cyclictest81rcu_preempt23:51:550
23939993011,6cyclictest0-21swapper/020:54:580
114982291,4sleep011508-21/usr/sbin/munin20:15:190
305402281,5sleep00-21swapper/021:05:200
305402281,5sleep00-21swapper/021:05:200
23939992812,13cyclictest0-21swapper/019:30:440
2393999271,5cyclictest0-21swapper/020:25:130
2393999271,18cyclictest0-21swapper/020:08:430
262572261,5sleep00-21swapper/020:55:020
2393999261,16cyclictest0-21swapper/021:03:340
2393999252,17cyclictest21652-21python20:40:330
2393999251,11cyclictest10345-21/usr/sbin/munin20:10:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional