You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 02:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Dec 21, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
270739912461236,7cyclictest0-21swapper/019:25:080
270739912461236,7cyclictest0-21swapper/019:25:070
270749911271076,31cyclictest31590-21sed19:35:001
270749910891072,14cyclictest0-21swapper/119:25:071
270749910891072,14cyclictest0-21swapper/119:25:061
255902561513,32sleep00-21swapper/019:20:150
269892461416,30sleep10-21swapper/119:24:411
2707399155127,24cyclictest0-21swapper/019:35:000
5062850,8sleep02707399cyclictest21:04:550
2707499811,46cyclictest19999-21ssh22:34:501
2707499801,37cyclictest21622-21sh21:29:371
2707499782,39cyclictest13524-21python23:00:311
2707499771,38cyclictest29614-21sed00:25:011
2707499761,7cyclictest12442-21/usr/sbin/munin20:10:141
147082760,7sleep02707399cyclictest22:29:080
2707499741,38cyclictest27464-21sed20:50:001
2707499741,38cyclictest2439-21diskmemload23:45:141
2707499741,37cyclictest31940-21basename21:40:131
2707499731,38cyclictest28794-21ssh23:16:131
2707499721,36cyclictest20649-21seq20:30:231
2707499711,36cyclictest9303-21taskset00:36:301
2707499711,36cyclictest2439-21diskmemload21:30:061
2707499701,6cyclictest138250irq/90-eth023:30:161
2707499701,4cyclictest13794-21cron00:41:001
2707499701,38cyclictest15864-21taskset21:23:161
2707499701,36cyclictest12523-21sh00:06:191
2707499701,35cyclictest8181-21sh00:02:011
2707499701,35cyclictest3620-21cat19:45:191
2707499701,34cyclictest9867-21seq22:56:521
2707499701,34cyclictest12564-21seq21:53:161
2707499701,33cyclictest3281-21cat22:50:211
2707499699,31cyclictest2329-21NetworkManager20:17:501
2707499692,36cyclictest2439-21diskmemload22:41:051
2707499691,34cyclictest8059-21ssh21:48:431
2707499691,34cyclictest5065-21seq22:19:141
2707499691,34cyclictest32089-21cat21:00:241
2707499691,33cyclictest30686-21seq00:25:251
2707499691,33cyclictest16897-21expr00:45:161
27074996912,31cyclictest3302-21runrttasks23:38:431
2707499682,35cyclictest2439-21diskmemload21:18:141
2707499681,6cyclictest31959-21chrt22:46:041
2707499681,5cyclictest2577-21rm23:23:111
2707499681,5cyclictest20731-21seq23:08:351
2707499681,4cyclictest2439-21diskmemload21:58:211
2707499678,38cyclictest0-21swapper/122:25:281
2707499674,40cyclictest28088-21iostat_ios20:50:191
2707499672,35cyclictest2439-21diskmemload23:13:431
2707499671,36cyclictest2439-21diskmemload22:01:021
2707499671,29cyclictest0-21swapper/122:21:181
2707499669,38cyclictest24608-21latency_hist00:55:001
2707499661,6cyclictest28157-21chrt22:09:511
2707499652,42cyclictest2206-21dbus-daemon23:54:331
2707499652,39cyclictest3302-21runrttasks20:25:151
2707499652,37cyclictest2439-21diskmemload00:34:381
2707499651,5cyclictest17042-21cat20:20:251
2707499642,35cyclictest2439-21diskmemload22:39:461
2707499641,42cyclictest21439-21sh23:42:221
2707499641,34cyclictest2439-21diskmemload23:58:401
2707499631,37cyclictest28866-21diskstats22:10:151
2707499621,43cyclictest2206-21dbus-daemon00:18:441
2707499611,37cyclictest3302-21runrttasks00:12:141
2707499611,37cyclictest31190-21latency_hist21:00:001
27074996015,26cyclictest22-21ksoftirqd/121:06:121
2707499601,37cyclictest23198-21chrt20:36:201
2707499601,36cyclictest8717-21chrt23:29:581
320932590,8sleep02707399cyclictest22:46:150
27074995917,24cyclictest22-21ksoftirqd/120:09:511
2707499591,39cyclictest6421-21chrt19:52:521
2707499591,38cyclictest2394-21chrt19:40:581
2707499591,37cyclictest4644-21chrt21:11:031
2707499591,36cyclictest31612-21/usr/sbin/munin19:35:191
117972590,7sleep02707399cyclictest22:59:410
2707499582,37cyclictest27691-21iostat21:35:201
2707499581,37cyclictest10023-21taskset20:01:061
2707499571,37cyclictest7373-21cat19:55:211
2707499561,38cyclictest3302-21runrttasks20:44:031
187242550,9sleep02707399cyclictest22:00:010
2707399444,36cyclictest0-21swapper/021:23:160
57472420,3sleep00-21swapper/019:50:260
27073993914,5cyclictest6792threads21:40:290
27073993823,5cyclictest3-21ksoftirqd/000:51:280
72012370,8sleep07196-21wget00:35:110
27073993728,5cyclictest6013-21df_inode00:00:150
27073993617,6cyclictest3-21ksoftirqd/022:07:480
2707399361,13cyclictest0-21swapper/019:55:150
2707399359,14cyclictest26998-21ssh22:40:540
2707399358,12cyclictest18884-21ssh21:25:380
2707399353,20cyclictest0-21swapper/022:52:210
27073993526,5cyclictest0-21swapper/022:14:350
2707399352,4cyclictest0-21swapper/020:25:360
2707399352,29cyclictest0-21swapper/021:30:160
2707399351,13cyclictest29598-21wc00:25:020
2707399341,20cyclictest23925-21ssh00:18:550
238882341,4sleep023952-21fschecks_count23:45:180
169532341,4sleep017018-21users22:30:310
2707399337,22cyclictest0-21swapper/023:27:140
2707399334,4cyclictest81rcu_preempt23:20:300
2707399334,4cyclictest81rcu_preempt21:46:500
2707399334,4cyclictest81rcu_preempt21:35:520
2707399334,13cyclictest30497-21gdbus22:00:250
2707399331,8cyclictest81rcu_preempt23:34:510
27073993315,9cyclictest0-21swapper/023:19:470
288662321,5sleep00-21swapper/020:51:320
2707399326,6cyclictest5795-21ssh21:12:440
2707399326,13cyclictest0-21swapper/021:17:550
2707399324,4cyclictest81rcu_preempt23:52:390
2707399324,4cyclictest81rcu_preempt00:41:340
2707399323,4cyclictest81rcu_preempt23:39:460
2707399323,4cyclictest81rcu_preempt21:54:380
2707399323,4cyclictest81rcu_preempt00:09:040
2707399321,29cyclictest0-21swapper/022:16:550
2707399321,29cyclictest0-21swapper/000:26:350
2707399317,19cyclictest17486-21diskstats23:05:160
27073993126,3cyclictest0-21swapper/000:13:550
2707399312,15cyclictest7106-21/usr/sbin/munin22:20:280
2707399311,4cyclictest81rcu_preempt23:10:120
2707399311,4cyclictest81rcu_preempt20:49:150
2707399311,4cyclictest81rcu_preempt20:41:350
27073993113,6cyclictest31899-21/usr/sbin/munin19:35:160
23102311,5sleep00-21swapper/021:08:540
103762311,5sleep00-21swapper/020:04:480
2707399307,4cyclictest81rcu_preempt00:45:310
2707399302,4cyclictest81rcu_preempt22:38:300
2707399302,15cyclictest4057-21python19:45:270
2707399301,4cyclictest81rcu_preempt23:59:260
2707399301,4cyclictest81rcu_preempt23:40:320
27073993012,6cyclictest1359-21grep19:40:150
128092301,25sleep012896-21hddtemp_smartct23:00:190
2707399299,7cyclictest22780-21grep20:35:280
2707399291,10cyclictest0-21swapper/000:32:540
122522291,5sleep00-21swapper/020:09:490
27073992818,6cyclictest30171-21grep20:55:270
2707399281,4cyclictest0-21swapper/020:19:360
2707399279,5cyclictest16311-21aten_r4power_vo20:20:140
212962271,5sleep00-21swapper/020:31:050
2707399263,17cyclictest12938-21hddtemp_smartct20:10:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional