You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 11:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Jun 25, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
217909912471212,31cyclictest9784-21strings20:15:240
217919911511134,14cyclictest0-21swapper/119:25:151
217919911371109,24cyclictest26928-21irqstats19:35:221
214872576527,33sleep00-21swapper/019:22:230
217042564518,31sleep10-21swapper/119:24:421
2179099110101,6cyclictest0-21swapper/019:25:150
21790998376,4cyclictest0-21swapper/019:35:220
264352780,4sleep1201rcuc/122:25:241
264352780,4sleep1201rcuc/122:25:231
173912520,3sleep00-21swapper/022:00:300
21791995147,2cyclictest0-21swapper/120:15:241
60822461,4sleep16085-21watchsnmpd22:58:001
193172450,6sleep019315-21sed22:05:280
321122351,30sleep132150-21idleruntime21:15:191
2179099359,13cyclictest27735-21iostat_ios23:55:190
49802341,3sleep05038-21/usr/sbin/munin00:20:230
2179199341,7cyclictest3286-21runrttasks22:20:181
2179099348,13cyclictest19042-21iostat20:40:190
2179099343,16cyclictest7397-21iostat_ios21:35:200
21790993419,5cyclictest3-21ksoftirqd/023:20:150
21790993418,5cyclictest3-21ksoftirqd/021:40:320
2179099341,12cyclictest0-21swapper/021:34:550
167922341,29sleep016873-21python23:25:250
2179099333,17cyclictest0-21swapper/019:30:260
21790993318,4cyclictest3-21ksoftirqd/020:56:390
21790993317,6cyclictest3-21ksoftirqd/019:57:300
21790993317,5cyclictest3-21ksoftirqd/020:04:450
21790993316,6cyclictest3-21ksoftirqd/023:19:320
21790993316,6cyclictest3-21ksoftirqd/021:54:570
2179099331,17cyclictest27343-21cron22:30:000
2179099331,17cyclictest27343-21cron22:29:590
212202331,3sleep021248-21/usr/sbin/munin22:10:290
13622331,4sleep11543-21perl21:20:141
226562320,4sleep0111rcuc/020:50:150
223312321,5sleep122346-21ntp_states23:40:251
21791993214,13cyclictest27790-21df22:30:121
21790993225,5cyclictest0-21swapper/000:25:140
2179099322,13cyclictest295442cpuspeed_turbos22:35:120
21790993217,5cyclictest3-21ksoftirqd/000:43:210
21790993216,6cyclictest3-21ksoftirqd/023:47:490
2179199314,4cyclictest81rcu_preempt20:04:101
2179099316,6cyclictest3-21ksoftirqd/023:05:000
21790993116,5cyclictest3-21ksoftirqd/022:55:530
21790993116,5cyclictest3-21ksoftirqd/000:35:590
21790993115,6cyclictest3-21ksoftirqd/021:05:270
21790993115,5cyclictest3-21ksoftirqd/022:41:420
117172311,26sleep111758-21ntp_states20:20:241
89142301,4sleep18933-21iostat_ios23:05:181
84532301,5sleep10-21swapper/121:39:241
34612301,4sleep13587-21users00:15:301
2179199305,18cyclictest28517-21diskstats19:40:151
2179199301,8cyclictest26264-21df_inode21:00:131
21791993017,7cyclictest16521-21diskstats22:00:151
21791993011,14cyclictest43122chrt22:54:031
2179099307,10cyclictest14559-21cstates21:55:140
21790993016,4cyclictest3-21ksoftirqd/022:19:050
21790993014,6cyclictest3-21ksoftirqd/023:43:000
21790993014,6cyclictest3-21ksoftirqd/022:20:560
21790993014,5cyclictest3-21ksoftirqd/023:08:350
2179099301,3cyclictest0-21swapper/020:14:420
21790993013,5cyclictest3-21ksoftirqd/021:23:510
21790993012,6cyclictest20926-21iostat_ios20:45:210
21790993012,14cyclictest2221-21cron21:15:010
2179099301,15cyclictest2061-21cron00:15:000
133782301,5sleep10-21swapper/123:15:391
113762301,5sleep10-21swapper/100:38:051
69142291,5sleep10-21swapper/120:09:131
44962291,5sleep00-21swapper/021:27:140
316072291,5sleep00-21swapper/019:47:560
296292291,5sleep00-21swapper/019:41:520
266272291,5sleep00-21swapper/023:51:240
2179199298,17cyclictest0-21swapper/119:30:121
2179199295,4cyclictest81rcu_preempt22:37:281
2179199292,4cyclictest81rcu_preempt23:55:521
2179199291,4cyclictest81rcu_preempt19:59:191
21791992910,5cyclictest0-21swapper/121:33:221
2179099299,6cyclictest11811-21ps20:20:260
2179099294,4cyclictest81rcu_preempt00:30:280
2179099291,4cyclictest0-21swapper/023:30:090
21790992912,5cyclictest3-21ksoftirqd/021:18:420
21790992911,6cyclictest11565-21gdbus00:18:140
2179099291,15cyclictest30246-21/usr/sbin/munin00:00:290
21790992911,5cyclictest10642-21basename21:45:120
21790992910,6cyclictest2971-21df_inode22:50:150
21790992910,6cyclictest27585-21aten_r4power_po22:30:100
163292291,5sleep00-21swapper/020:34:220
59012281,5sleep10-21swapper/100:24:431
299552281,5sleep10-21swapper/119:45:001
232652281,5sleep10-21swapper/122:16:521
219742281,5sleep10-21swapper/120:49:201
2179199287,8cyclictest31546-21kernelversion00:05:201
2179199287,5cyclictest81rcu_preempt21:45:171
2179199286,4cyclictest81rcu_preempt00:53:591
2179199285,4cyclictest81rcu_preempt22:10:041
2179199282,4cyclictest81rcu_preempt20:33:001
2179199281,8cyclictest13653-21/usr/sbin/munin00:45:171
21791992818,6cyclictest29146-21wget00:00:121
2179199281,4cyclictest81rcu_preempt21:58:061
21791992811,14cyclictest22-21ksoftirqd/100:41:491
2179099289,5cyclictest11565-21gdbus20:35:400
2179099284,18cyclictest14484-21ntp_states00:45:250
21790992812,5cyclictest3-21ksoftirqd/019:51:280
21790992811,5cyclictest26805-21ntp_states21:00:240
2179099281,13cyclictest13986-21unixbench_multi20:25:280
195752281,5sleep10-21swapper/122:07:361
158182281,4sleep00-21swapper/000:50:140
9852271,5sleep10-21swapper/119:52:341
94182271,5sleep10-21swapper/100:32:151
44822271,5sleep10-21swapper/121:27:061
325882271,5sleep10-21swapper/122:40:471
238742271,5sleep10-21swapper/120:54:371
2179199274,4cyclictest81rcu_preempt21:06:151
2179199273,4cyclictest81rcu_preempt23:31:321
2179199272,12cyclictest0-21swapper/123:54:241
21791992719,5cyclictest17031-21fschecks_time20:35:161
21791992718,5cyclictest7042-21sendmail_mailqu00:25:261
2179199271,13cyclictest7156-21/usr/sbin/munin20:10:131
2179099279,6cyclictest32295-21taskset00:06:350
2179099273,18cyclictest6295-21python20:05:260
21790992713,10cyclictest19906-21diskstats23:35:140
2179099271,14cyclictest10804-21iostat23:10:190
200252271,5sleep10-21swapper/120:43:391
175442271,5sleep10-21swapper/123:29:431
117502271,5sleep10-21swapper/123:13:111
253772261,5sleep10-21swapper/120:55:411
2179199269,5cyclictest40250irq/92-i91523:35:141
2179199264,4cyclictest81rcu_preempt21:13:091
2179199264,18cyclictest1923-21unixbench_singl22:45:281
2179199263,4cyclictest81rcu_preempt23:49:581
2179199262,10cyclictest1014-21memory00:10:201
2179199261,10cyclictest15801-21grep23:25:011
2179099261,13cyclictest11565-21gdbus22:45:460
142552261,4sleep10-21swapper/120:27:181
137962261,5sleep10-21swapper/121:51:131
100862261,5sleep10-21swapper/121:41:411
2179199242,8cyclictest6954-21hddtemp_smartct23:00:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional