You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-01 - 06:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Nov 01, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
228379912581225,23cyclictest0-21swapper/019:25:030
228389911871160,23cyclictest27313-21latency_hist19:35:001
228389911011062,35cyclictest22940-21latency_hist19:25:011
226522659612,32sleep00-21swapper/019:23:440
2283799124117,4cyclictest0-21swapper/019:35:010
1643721100,4sleep03-21ksoftirqd/022:01:060
195192940,4sleep10-21swapper/123:11:261
31932820,4sleep00-21swapper/022:20:490
22838997668,6cyclictest0-21swapper/119:25:021
176462710,5sleep03-21ksoftirqd/000:51:450
315392700,4sleep00-21swapper/021:44:060
108852690,3sleep00-21swapper/023:35:480
247352610,9sleep12283899cyclictest00:25:211
2283799581,16cyclictest23216-21ntp_states23:15:260
181342550,8sleep12283899cyclictest20:35:171
181342550,8sleep12283899cyclictest20:35:161
138002520,8sleep02283799cyclictest21:25:200
14422510,8sleep12283899cyclictest00:35:171
159622470,8sleep12283899cyclictest00:15:541
79072430,8sleep02283799cyclictest22:25:390
79072430,8sleep02283799cyclictest22:25:390
2283799402,18cyclictest0-21swapper/000:42:280
2283799381,24cyclictest16237-21cstates22:35:140
22838993712,6cyclictest22-21ksoftirqd/123:16:151
217862372,31sleep121804-21ssh21:34:011
22837993614,5cyclictest21656-21memory22:40:260
22837993613,5cyclictest27382-21fschecks_count21:00:150
22837993610,4cyclictest81rcu_preempt21:13:210
145892360,7sleep02283799cyclictest23:40:170
319442351,30sleep131955-21ssh00:33:041
2283899358,5cyclictest0-21swapper/100:12:421
22838993525,6cyclictest10634-21idleruntime20:15:171
22838993516,6cyclictest21254-21cron20:44:591
2283899351,15cyclictest144582sh00:48:551
2283799354,4cyclictest81rcu_preempt22:30:290
2283799352,7cyclictest20201-21ssh23:12:240
2283799351,7cyclictest6337-21ssh00:05:530
2283799351,7cyclictest26956-21ssh23:53:060
22837993511,5cyclictest81rcu_preempt21:55:010
2283799351,15cyclictest0-21swapper/000:02:520
22837993510,13cyclictest28518-21hostname23:55:090
58122341,3sleep02220-21dbus-daemon20:01:120
2283899346,5cyclictest81rcu_preempt23:33:381
2283899344,8cyclictest81rcu_preempt21:10:251
2283899343,5cyclictest81rcu_preempt00:42:241
2283899342,4cyclictest81rcu_preempt23:56:131
2283899342,18cyclictest0-21swapper/122:40:051
2283799349,12cyclictest8364-21sh23:00:180
2283799348,5cyclictest81rcu_preempt22:10:130
2283799345,4cyclictest81rcu_preempt00:49:040
2283799342,20cyclictest16978-21ssh00:17:220
22837993417,6cyclictest4128-21pidof23:30:000
22837993412,7cyclictest25979-21df22:45:160
2283799341,15cyclictest3378-21ssh00:36:320
55672331,28sleep15665-21latency_hist00:05:011
2283899336,4cyclictest81rcu_preempt21:19:171
2283899336,16cyclictest0-21swapper/121:36:271
2283899335,4cyclictest81rcu_preempt22:37:351
2283899332,17cyclictest0-21swapper/122:47:041
2283899331,18cyclictest30708-21ssh21:42:531
2283799334,7cyclictest81rcu_preempt21:30:200
22837993321,8cyclictest15099-21unixbench_singl20:25:320
2283799331,18cyclictest8944-21sh21:20:190
2283799331,10cyclictest29835-21ssh23:22:220
152202331,28sleep130944-21snmpd20:26:111
71802320,23sleep03-21ksoftirqd/023:32:270
27892321,3sleep12799-21ssh23:28:061
2283899325,4cyclictest81rcu_preempt20:07:221
2283899322,16cyclictest0-21swapper/121:59:361
2283899321,4cyclictest81rcu_preempt21:46:101
2283899321,4cyclictest81rcu_preempt21:46:091
2283799328,7cyclictest3020-21runrttasks21:58:020
2283799324,4cyclictest81rcu_preempt00:31:020
2283799321,4cyclictest81rcu_preempt00:26:580
22837993212,7cyclictest32633-21ssh22:51:330
141582320,7sleep00-21swapper/023:05:380
141582320,7sleep00-21swapper/023:05:370
121152321,5sleep00-21swapper/000:12:200
2283899319,10cyclictest0-21swapper/122:19:251
2283899314,6cyclictest22-21ksoftirqd/100:52:301
2283899314,4cyclictest81rcu_preempt20:02:471
22838993112,7cyclictest22-21ksoftirqd/122:09:261
2283899311,11cyclictest24201-21/usr/sbin/munin22:10:301
2283799311,18cyclictest29705-21iostat_ios22:15:200
2283799311,12cyclictest27087-21ssh21:39:400
2283799311,10cyclictest22615-21ssh22:08:040
226132311,4sleep122668-21users20:45:281
171142311,5sleep10-21swapper/122:02:061
2283899304,4cyclictest81rcu_preempt23:51:361
2283899304,4cyclictest81rcu_preempt22:33:431
2283899304,4cyclictest81rcu_preempt20:51:501
2283899303,12cyclictest0-21swapper/123:42:151
22838993018,9cyclictest22-21ksoftirqd/123:00:011
22838993017,9cyclictest22-21ksoftirqd/123:00:331
22838993014,11cyclictest0-21swapper/119:35:291
2283799306,5cyclictest81rcu_preempt21:45:380
2283799306,5cyclictest81rcu_preempt21:45:370
2283799301,4cyclictest81rcu_preempt20:14:100
2283799301,21cyclictest0-21swapper/020:15:490
2283799301,13cyclictest0-21swapper/022:55:290
2283799301,11cyclictest20814-21sh23:46:120
11802301,5sleep10-21swapper/122:53:001
41962291,5sleep00-21swapper/019:59:070
309882291,5sleep00-21swapper/019:44:590
303742291,5sleep00-21swapper/021:07:020
248252291,5sleep00-21swapper/020:53:060
231232291,5sleep00-21swapper/020:50:000
2283899294,4cyclictest81rcu_preempt22:22:221
2283899294,22cyclictest0-21swapper/123:23:031
2283899294,21cyclictest0-21swapper/100:08:281
2283899292,11cyclictest0-21swapper/122:26:391
2283899292,11cyclictest0-21swapper/122:26:381
2283899291,7cyclictest10186-21ntp_states23:35:261
2283899291,5cyclictest81rcu_preempt20:30:221
22838992912,6cyclictest22-21ksoftirqd/121:20:051
22838992910,5cyclictest0-21swapper/123:48:531
2283799293,4cyclictest81rcu_preempt20:55:250
2283799292,7cyclictest20476-21sed00:20:330
2283799292,13cyclictest15761-21/usr/sbin/munin20:30:300
2283799291,4cyclictest81rcu_preempt20:42:340
2283799291,4cyclictest81rcu_preempt19:49:170
22837992912,4cyclictest6204-21gdbus20:06:200
225662291,24sleep10-21swapper/100:23:291
20672291,5sleep10-21swapper/119:52:351
134612291,5sleep00-21swapper/020:22:220
2283899281,6cyclictest17171-21ssh21:29:161
22838992816,8cyclictest2220-21dbus-daemon21:00:131
22838992816,5cyclictest22-21ksoftirqd/123:07:521
22838992816,5cyclictest22-21ksoftirqd/123:07:511
2283799281,4cyclictest81rcu_preempt21:19:040
2283799281,4cyclictest81rcu_preempt19:51:260
2283899275,4cyclictest81rcu_preempt21:06:241
2283899274,5cyclictest40950irq/93-i91519:45:101
2283899274,4cyclictest81rcu_preempt20:22:141
2283899272,4cyclictest81rcu_preempt20:58:091
22838992715,8cyclictest22-21ksoftirqd/121:50:461
2283899271,11cyclictest8252-21wget20:10:121
22837992713,12cyclictest0-21swapper/020:35:420
22837992713,12cyclictest0-21swapper/020:35:420
287132261,5sleep00-21swapper/019:36:050
2283899262,20cyclictest0-21swapper/119:55:251
2283899262,17cyclictest29278-21/usr/sbin/munin19:40:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional