You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 08:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Dec 01, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
91829912811,1261cyclictest0-21swapper/119:25:111
91829912001154,27cyclictest19868-21perl19:50:201
91819911601123,33cyclictest9603-21df19:25:120
89232562517,30sleep10-21swapper/119:22:551
87712497452,30sleep00-21swapper/019:21:190
918199143119,20cyclictest0-21swapper/019:50:200
499321000,8sleep0918199cyclictest00:53:130
298382890,5sleep129832-21ssh21:55:331
193032830,5sleep1201rcuc/123:25:271
42462810,3sleep14247-21sh22:03:141
258242630,8sleep0918199cyclictest00:07:000
12102630,8sleep0918199cyclictest00:49:380
211552581,30sleep021179-21ntp_states22:20:240
268632550,2sleep126864-21sh21:53:091
177332540,8sleep0918199cyclictest19:45:120
275712490,7sleep0918199cyclictest21:20:170
210982480,8sleep0918199cyclictest21:46:470
86672450,4sleep041ktimersoftd/022:07:410
918299407,4cyclictest81rcu_preempt23:50:331
9181994024,6cyclictest3-21ksoftirqd/020:09:060
34412401,35sleep13455-21sh00:17:311
94872380,4sleep19484-21watchsnmpd20:50:001
918199381,6cyclictest16913-21hostname22:50:140
257352371,3sleep125745-21ssh00:06:551
918199369,12cyclictest3017-21interrupts22:35:220
9181993621,5cyclictest3-21ksoftirqd/023:10:220
191362361,30sleep119146-21ssh21:11:051
179022360,8sleep1918299cyclictest21:44:081
138822360,7sleep00-21swapper/022:46:060
918299357,5cyclictest81rcu_preempt23:19:561
918199352,21cyclictest15405-21users21:40:310
116142350,4sleep1201rcuc/100:25:301
96662340,2sleep09665-21hddtemp_smartct21:35:180
9182993426,5cyclictest17029-21diskmemload22:31:571
9182993423,7cyclictest9105-21ssh21:35:111
918199349,4cyclictest81rcu_preempt22:59:040
918199346,4cyclictest81rcu_preempt23:33:370
9181993418,5cyclictest3-21ksoftirqd/020:32:330
9181993413,6cyclictest27480-21ntp_states23:00:260
6642340,9sleep0918199cyclictest23:40:160
268302341,4sleep126864-21sh21:20:021
154902343,27sleep015598-21fschecks_time00:30:180
918299338,6cyclictest201rcuc/123:47:021
918299338,6cyclictest201rcuc/123:47:021
918299336,23cyclictest0-21swapper/122:58:411
9182993321,7cyclictest22993-21grep21:15:241
918199339,5cyclictest28325-21cut00:10:090
918199335,4cyclictest81rcu_preempt22:17:080
918199334,5cyclictest81rcu_preempt00:03:590
918199332,5cyclictest1734-21awk22:00:250
9181993317,5cyclictest3-21ksoftirqd/021:59:580
9181993316,5cyclictest23095-21ntp_states21:15:270
254072331,5sleep125542-21fschecks_time22:25:191
254072331,5sleep125542-21fschecks_time22:25:181
196502330,8sleep1918299cyclictest22:52:281
12222331,5sleep11232-21ssh00:49:401
918299325,23cyclictest0-21swapper/121:30:161
9182993222,6cyclictest20715-21fschecks_time22:20:161
918299321,8cyclictest6333-21netstat00:20:211
918299321,4cyclictest81rcu_preempt00:34:121
918199329,4cyclictest81rcu_preempt23:20:300
918199325,5cyclictest81rcu_preempt20:22:230
918199324,4cyclictest81rcu_preempt23:17:040
918199324,4cyclictest81rcu_preempt00:15:430
918199323,4cyclictest81rcu_preempt21:11:080
9181993221,6cyclictest698-21ssh22:33:110
918199322,13cyclictest6203-21packagekitd23:30:000
9181993213,5cyclictest14517-21ssh00:29:310
256552321,27sleep025729-21iostat22:25:210
256552321,27sleep025729-21iostat22:25:210
237492321,27sleep123761-21ssh00:04:131
234302321,5sleep123449-21df_inode23:30:141
141502321,27sleep014218-21/usr/sbin/munin21:00:230
918299314,4cyclictest81rcu_preempt20:00:001
918299311,8cyclictest6044-21df_inode22:05:151
9182993118,4cyclictest22-21ksoftirqd/123:11:351
918299311,5cyclictest81rcu_preempt00:10:231
918299311,4cyclictest81rcu_preempt19:43:391
9182993114,5cyclictest22-21ksoftirqd/120:05:221
918199313,15cyclictest0-21swapper/020:47:280
918199312,5cyclictest81rcu_preempt00:44:110
9181993122,5cyclictest3-21ksoftirqd/022:10:110
918199311,9cyclictest10980-21ssh23:50:250
918199311,5cyclictest81rcu_preempt23:05:210
918199311,4cyclictest81rcu_preempt23:39:270
918199311,4cyclictest81rcu_preempt20:38:400
918199311,16cyclictest22219-21ssh00:36:410
9181993111,10cyclictest11351-21cron20:55:010
60872311,5sleep10-21swapper/122:38:511
244692311,5sleep00-21swapper/020:00:570
133342311,5sleep00-21swapper/019:32:420
94982301,25sleep19509-21ssh22:41:451
918299308,18cyclictest0-21swapper/122:15:111
918299302,11cyclictest0-21swapper/123:06:101
918299301,8cyclictest13526-21grep21:00:121
9182993017,4cyclictest22-21ksoftirqd/100:55:011
918199307,5cyclictest81rcu_preempt23:56:460
918199307,11cyclictest0-21swapper/000:21:470
918199306,4cyclictest81rcu_preempt21:33:450
918199305,4cyclictest81rcu_preempt23:45:390
918199305,4cyclictest81rcu_preempt23:45:380
9181993012,5cyclictest32307-21fschecks_time21:25:170
34482301,5sleep10-21swapper/120:31:171
264552301,5sleep10-21swapper/123:00:081
918299296,19cyclictest0-21swapper/123:44:361
918299294,21cyclictest0-21swapper/123:56:191
918299291,5cyclictest81rcu_preempt21:25:551
9182992915,10cyclictest22-21ksoftirqd/123:20:281
918299291,4cyclictest81rcu_preempt20:40:191
918299291,4cyclictest81rcu_preempt19:36:521
9182992913,12cyclictest0-21swapper/122:14:371
9182992911,6cyclictest18057-21if_eth019:45:171
918299290,4cyclictest81rcu_preempt20:35:521
918199292,4cyclictest81rcu_preempt22:41:060
918199292,14cyclictest931-21ntp_states20:25:260
918199291,6cyclictest0-21swapper/021:54:190
171512291,5sleep00-21swapper/019:43:050
168952291,5sleep00-21swapper/021:08:530
128082291,5sleep00-21swapper/020:55:420
918299288,9cyclictest23405-21sort21:50:011
918299286,8cyclictest20074-21aten_r4power_po00:35:141
918299285,4cyclictest81rcu_preempt20:16:581
918299282,4cyclictest81rcu_preempt20:59:541
918299282,12cyclictest3020-21runrttasks00:40:361
9182992818,6cyclictest12055-21grep19:30:121
918299281,4cyclictest81rcu_preempt23:35:221
918299281,14cyclictest12623-21wc22:45:191
9182992810,14cyclictest322392chrt20:23:221
918199281,23cyclictest21284-21aten_r4power_en19:55:100
918199281,19cyclictest0-21swapper/020:17:330
283462281,5sleep00-21swapper/020:12:130
246462281,5sleep10-21swapper/120:02:451
151612281,5sleep00-21swapper/019:37:110
9181992711,5cyclictest3-21ksoftirqd/020:43:330
16812271,5sleep10-21swapper/120:28:331
918299262,10cyclictest10902-21users20:50:311
918299251,4cyclictest81rcu_preempt21:07:321
918299247,5cyclictest40950irq/93-i91520:10:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional