You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 09:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Jan 09, 2026 00:59:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252349912461205,37cyclictest25425-21wget19:25:110
252359911561147,6cyclictest0-21swapper/119:25:101
252359911181098,17cyclictest0-21swapper/119:35:011
251302592546,30sleep10-21swapper/119:24:291
247682465418,32sleep00-21swapper/019:20:440
25234992401,4cyclictest29605-21latency_hist19:35:000
59302800,5sleep1211ktimersoftd/122:55:111
306352740,5sleep00-21swapper/023:54:010
298102660,6sleep129791-21munin-run21:40:011
121792600,8sleep02523499cyclictest00:41:080
287612580,8sleep02523499cyclictest22:45:160
177032580,3sleep0111rcuc/022:00:160
243632440,4sleep015311-21kworker/0:423:14:140
98172430,4sleep0111rcuc/021:19:100
2523499411,36cyclictest0-21swapper/000:31:550
23012411,36sleep02313-21sh22:50:320
23012411,36sleep02313-21sh22:50:310
277522400,5sleep041ktimersoftd/000:24:480
25234994014,6cyclictest192902ssh23:08:550
2523599397,4cyclictest81rcu_preempt21:34:531
2523599387,27cyclictest0-21swapper/100:24:551
2523599384,8cyclictest0-21swapper/122:50:561
2523599384,8cyclictest0-21swapper/122:50:551
155702380,8sleep02523499cyclictest20:20:280
2523499373,15cyclictest15220-21diskstats00:45:160
25234993715,5cyclictest0-21swapper/022:16:530
25234993715,5cyclictest0-21swapper/022:16:530
9422360,4sleep1211ktimersoftd/119:45:001
280722361,31sleep0565-21diskmemload22:10:290
2523599363,31cyclictest0-21swapper/121:07:151
2523499365,11cyclictest0-21swapper/021:10:250
2523499362,30cyclictest0-21swapper/021:41:160
2523599357,7cyclictest32599-21ps23:55:271
2523599351,6cyclictest7849-21kworker/1:023:48:161
2523599351,5cyclictest7822-21fschecks_time23:30:151
2523599351,5cyclictest7822-21fschecks_time23:30:151
2523599351,5cyclictest2286-21ssh00:30:551
2523599351,30cyclictest7749-21diskstats21:50:151
2523499351,21cyclictest22079-21taskset00:18:330
67902341,4sleep16803-21sh22:22:111
303642341,29sleep130369-21irqstats19:35:191
271202341,3sleep1565-21diskmemload22:43:331
2523599345,4cyclictest81rcu_preempt23:26:571
2523599344,4cyclictest81rcu_preempt21:23:541
2523599342,18cyclictest9550-21iostat00:05:171
2523599341,8cyclictest0-21swapper/121:58:161
2523499342,5cyclictest81rcu_preempt21:25:160
2523499342,28cyclictest0-21swapper/023:19:150
2523499341,29cyclictest23276-21ssh21:32:360
25234993411,8cyclictest3244-21iostat_ios21:45:210
194642341,29sleep130497-21gdbus20:31:101
17802341,29sleep01086-21/usr/sbin/munin19:45:220
2523599337,22cyclictest30097-21sh22:13:091
2523599336,4cyclictest81rcu_preempt00:40:171
2523599335,4cyclictest81rcu_preempt20:14:501
2523599334,5cyclictest81rcu_preempt22:25:141
2523599334,4cyclictest81rcu_preempt23:14:571
2523599334,26cyclictest22-21ksoftirqd/123:09:051
2523599332,28cyclictest0-21swapper/123:54:561
2523599332,28cyclictest0-21swapper/122:48:161
2523599331,12cyclictest81rcu_preempt22:30:171
2523499334,4cyclictest81rcu_preempt22:06:370
2523499334,4cyclictest40550irq/92-i91521:56:170
2523499332,15cyclictest0-21swapper/000:52:040
2523499331,29cyclictest9375-21ssh22:58:360
2523499331,14cyclictest23639-21basename22:40:110
19862331,3sleep10-21swapper/123:24:471
167672334,4sleep181rcu_preempt00:46:211
137362331,4sleep00-21swapper/022:30:020
70782321,4sleep07090-21ssh00:35:470
70782321,4sleep07090-21ssh00:35:460
2523599322,5cyclictest81rcu_preempt23:02:281
2523599322,4cyclictest81rcu_preempt23:17:501
25235993223,6cyclictest3115-21sh21:11:311
25235993219,10cyclictest22-21ksoftirqd/122:05:281
2523599321,5cyclictest1968-21lldpad21:45:391
2523599321,29cyclictest0-21swapper/100:26:161
2523599321,28cyclictest20208-21ssh22:35:351
2523599321,28cyclictest18825-21ssh23:40:551
2523599321,27cyclictest1968-21lldpad21:44:391
2523599321,11cyclictest26253-21irqstats20:50:191
2523499325,4cyclictest81rcu_preempt23:57:290
2523499324,4cyclictest81rcu_preempt22:22:390
2523499322,6cyclictest81rcu_preempt23:35:270
2523499322,20cyclictest0-21swapper/023:25:000
2523499322,17cyclictest0-21swapper/022:29:360
2523499321,28cyclictest13129-21ssh21:21:550
2523499321,22cyclictest0-21swapper/000:29:090
2523499321,20cyclictest16686-21fschecks_time20:25:150
68372311,5sleep00-21swapper/020:00:040
2523599313,5cyclictest81rcu_preempt00:11:371
2523599313,5cyclictest16073-21hddtemp_smartct21:25:171
2523599312,17cyclictest0-21swapper/100:00:501
25235993121,6cyclictest8338-21ssh00:37:381
25235993121,6cyclictest8338-21ssh00:37:371
2523599311,5cyclictest19412-21fschecks_count00:50:151
2523599311,4cyclictest81rcu_preempt19:52:281
2523599311,4cyclictest2854-21ssh22:18:321
2523599311,4cyclictest2854-21ssh22:18:311
2523499315,14cyclictest23290-21idleruntime-cro22:40:000
2523499315,13cyclictest5751-21sh00:00:500
2523499314,4cyclictest81rcu_preempt23:26:060
2523499314,4cyclictest81rcu_preempt23:01:560
25234993122,6cyclictest0-21swapper/021:35:560
2523499311,9cyclictest0-21swapper/000:12:070
2523499311,5cyclictest81rcu_preempt20:15:020
2523499311,4cyclictest81rcu_preempt23:40:270
95582300,5sleep0111rcuc/000:05:190
83132301,5sleep10-21swapper/120:02:271
2523599305,4cyclictest81rcu_preempt21:01:501
2523599304,4cyclictest81rcu_preempt20:15:131
2523599302,9cyclictest0-21swapper/100:18:251
25235993025,3cyclictest0-21swapper/123:36:151
2523599301,4cyclictest81rcu_preempt20:42:051
2523599301,4cyclictest1968-21lldpad21:15:381
2523599301,26cyclictest0-21swapper/122:00:561
2523499303,15cyclictest0-21swapper/021:50:220
2523499302,14cyclictest20493-21hddtemp_smartct20:35:160
25234993011,6cyclictest10871-21expr20:10:120
2523499301,15cyclictest32118-21awk21:05:230
2523499301,11cyclictest22224-21ssh23:45:140
25234993010,7cyclictest29268-21munin-run21:00:010
177752301,5sleep10-21swapper/120:28:041
154122301,5sleep115565-21unixbench_multi20:20:281
101882301,5sleep00-21swapper/020:07:260
290252291,5sleep10-21swapper/120:57:461
2523599298,4cyclictest81rcu_preempt20:05:111
2523599295,4cyclictest81rcu_preempt20:38:051
2523599291,18cyclictest0-21swapper/119:45:281
2523499292,4cyclictest81rcu_preempt19:40:310
2523499292,14cyclictest8169-21memory23:30:220
2523499292,14cyclictest8169-21memory23:30:210
2523499291,26cyclictest0-21swapper/020:47:360
25234992911,6cyclictest5551-21irqstats19:55:200
2523499291,15cyclictest0-21swapper/020:53:110
25234992910,6cyclictest29624-21tr21:00:110
63572281,5sleep10-21swapper/119:56:491
2523499281,13cyclictest18960-21ntpq20:30:270
250752281,5sleep10-21swapper/120:45:481
25234992718,6cyclictest3-21ksoftirqd/019:50:120
2523499271,6cyclictest30111-21fschecks_count19:35:150
25234992710,4cyclictest0-21swapper/020:40:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional