You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 08:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Dec 18, 2025 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80299912411207,29cyclictest12944-21fschecks_count19:35:151
80299912291204,21cyclictest8166-21sshd19:25:071
77622562517,29sleep00-21swapper/019:22:460
77782464418,31sleep10-21swapper/119:22:561
802899187168,16cyclictest0-21swapper/019:35:150
802899176166,7cyclictest0-21swapper/019:25:060
1447921260,2sleep014480-21sh00:07:260
3251221170,8sleep1802999cyclictest23:51:031
244721030,3sleep00-21swapper/023:18:190
8642620,4sleep10-21swapper/120:30:111
323962590,9sleep0802899cyclictest20:25:280
161172560,8sleep0802899cyclictest21:45:180
308322430,5sleep0111rcuc/000:25:270
802999419,28cyclictest0-21swapper/119:50:161
8029994124,5cyclictest22-21ksoftirqd/123:10:201
8028994022,6cyclictest3-21ksoftirqd/021:19:220
8028994011,15cyclictest30462-21mailstats20:20:260
76362401,34sleep07645-21ssh22:47:460
321642400,7sleep0802899cyclictest23:50:300
181932400,8sleep1802999cyclictest23:00:031
121502400,8sleep0802899cyclictest21:40:280
8029993829,5cyclictest10809-21perl20:55:151
8028993817,5cyclictest3-21ksoftirqd/022:20:320
8028993817,5cyclictest3-21ksoftirqd/022:20:310
802899381,33cyclictest0-21swapper/021:55:560
802999373,31cyclictest0-21swapper/122:40:161
802999373,11cyclictest0-21swapper/100:13:471
8029993715,11cyclictest22-21ksoftirqd/122:10:501
802999371,30cyclictest15820-21diskmemload23:05:361
104292371,3sleep010439-21ssh00:03:080
104292371,3sleep010439-21ssh00:03:080
802999368,24cyclictest0-21swapper/100:46:501
802999366,19cyclictest20566-21ssh21:15:081
802999364,28cyclictest0-21swapper/100:39:361
802999362,31cyclictest0-21swapper/123:36:561
802899367,4cyclictest81rcu_preempt21:11:350
802899362,29cyclictest15820-21diskmemload23:01:180
8028993611,4cyclictest25620-21df_inode00:20:130
802999356,5cyclictest81rcu_preempt21:55:121
802999356,4cyclictest81rcu_preempt20:43:321
802999352,29cyclictest0-21swapper/122:00:401
802999351,5cyclictest17384-21ssh21:46:151
802899358,13cyclictest15820-21diskmemload22:43:480
8028993526,5cyclictest3275-21cut23:55:160
802899352,14cyclictest3544-21ssh21:30:520
802899352,12cyclictest15820-21diskmemload22:10:280
802899351,30cyclictest15820-21diskmemload00:16:500
802899351,20cyclictest6408-21idleruntime-cro20:45:000
195222351,4sleep119617-21hddtemp_smartct00:50:131
802999349,12cyclictest0-21swapper/122:16:411
802999345,4cyclictest81rcu_preempt00:30:271
802999345,25cyclictest0-21swapper/122:36:411
802999344,4cyclictest81rcu_preempt23:43:391
802999344,4cyclictest81rcu_preempt21:24:201
8029993415,4cyclictest22-21ksoftirqd/100:44:151
802899343,18cyclictest0-21swapper/019:49:160
8028993426,6cyclictest0-21swapper/000:10:360
802899342,28cyclictest0-21swapper/023:21:160
802899342,28cyclictest0-21swapper/023:10:360
802899341,29cyclictest15820-21diskmemload00:41:200
802899341,29cyclictest10904-21ssh23:27:180
137182341,4sleep113763-21ntp_states23:30:241
802999339,6cyclictest24492sh23:18:181
802999335,4cyclictest81rcu_preempt20:24:331
802999334,5cyclictest81rcu_preempt22:56:101
802999334,4cyclictest81rcu_preempt21:40:341
8029993323,6cyclictest19190-21ssh21:13:111
802999332,28cyclictest0-21swapper/122:21:361
802999332,28cyclictest0-21swapper/122:21:351
802999331,29cyclictest23756-21ssh21:54:161
8028993325,4cyclictest2309-21cron21:30:000
8028993316,6cyclictest3-21ksoftirqd/021:51:140
802899331,5cyclictest0-21swapper/020:36:350
8028993313,7cyclictest32070-21ssh22:39:310
802899331,30cyclictest0-21swapper/020:46:360
802899331,29cyclictest2403-21irqbalance23:32:360
802899331,29cyclictest0-21swapper/019:31:160
802899331,19cyclictest7086-21irqstats21:35:210
802899331,13cyclictest0-21swapper/020:55:570
8028993310,13cyclictest3-21ksoftirqd/019:57:230
323422331,28sleep115820-21diskmemload21:27:271
81912321,5sleep00-21swapper/000:36:010
802999324,5cyclictest81rcu_preempt21:35:141
802999324,5cyclictest81rcu_preempt00:05:551
802999324,4cyclictest81rcu_preempt23:46:591
802999323,11cyclictest81rcu_preempt22:26:291
802999321,29cyclictest0-21swapper/123:57:351
802999321,29cyclictest0-21swapper/119:58:361
802999321,27cyclictest25793-21cut00:20:161
802899328,12cyclictest0-21swapper/020:00:230
8028993225,5cyclictest0-21swapper/022:54:350
8028993223,5cyclictest27657-21kworker/0:122:02:360
8028993222,6cyclictest22698-21/usr/sbin/munin23:40:230
802899321,8cyclictest15820-21diskmemload22:56:100
8028993215,6cyclictest3-21ksoftirqd/000:30:510
8028993212,6cyclictest10827-21iostat22:15:190
802899321,18cyclictest4134-21ssh22:07:580
71632321,4sleep17166-21irqstats20:45:201
802999314,4cyclictest81rcu_preempt23:25:161
802999313,4cyclictest81rcu_preempt22:07:021
802999313,4cyclictest81rcu_preempt00:25:091
8029993121,6cyclictest12307-21ssh22:53:021
802999311,5cyclictest81rcu_preempt20:01:441
802999311,28cyclictest0-21swapper/123:21:061
802899318,11cyclictest21848-21ssh00:53:110
802899314,4cyclictest81rcu_preempt23:06:100
8028993126,3cyclictest0-21swapper/023:45:150
8028993115,5cyclictest3-21ksoftirqd/000:49:540
802899311,4cyclictest81rcu_preempt23:35:160
8028993111,6cyclictest20004-21ls19:55:010
8028993111,5cyclictest0-21swapper/022:27:410
8028993110,9cyclictest0-21swapper/021:20:290
210652310,4sleep1201rcuc/100:15:131
802999303,3cyclictest81rcu_preempt20:27:111
802999302,4cyclictest81rcu_preempt22:30:151
802999302,17cyclictest0-21swapper/121:30:411
802999301,4cyclictest81rcu_preempt22:46:211
802999301,26cyclictest0-21swapper/119:31:361
802899306,12cyclictest26740-21sensors20:10:240
8028993023,5cyclictest0-21swapper/021:01:360
8028993013,5cyclictest28440-21ntp_states20:15:260
802899301,27cyclictest0-21swapper/022:33:170
802899301,13cyclictest24613-21grep20:05:240
160862301,5sleep00-21swapper/019:44:060
99092291,5sleep00-21swapper/020:52:250
802999295,4cyclictest81rcu_preempt21:08:461
802999295,4cyclictest81rcu_preempt20:18:441
802999293,3cyclictest81rcu_preempt00:04:561
802999293,3cyclictest81rcu_preempt00:04:561
802999291,16cyclictest30497-21gdbus20:07:221
8028992911,5cyclictest14392-21diskstats21:05:140
7962291,5sleep00-21swapper/020:30:100
179782291,5sleep10-21swapper/119:49:171
160332271,5sleep10-21swapper/119:43:351
136962271,5sleep10-21swapper/121:02:351
802999261,11cyclictest26737-21/usr/sbin/munin20:10:241
802999261,10cyclictest3911-21sed20:35:301
802999252,4cyclictest81rcu_preempt20:51:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional