You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 10:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sat Jul 04, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320769910771061,13cyclictest0-21swapper/119:28:131
319092765718,31sleep10-21swapper/119:23:491
319922565518,31sleep00-21swapper/019:24:410
3207599250220,15cyclictest0-21swapper/019:28:130
1750521050,8sleep03207599cyclictest21:35:170
207002830,4sleep1201rcuc/121:45:001
166782440,8sleep03207599cyclictest00:25:150
166782440,8sleep03207599cyclictest00:25:150
22352430,5sleep03207599cyclictest20:55:150
3207699381,17cyclictest9690-21tune2fs22:40:171
32075993820,6cyclictest3-21ksoftirqd/021:16:270
295502371,30sleep129570-21ntpq20:40:251
79952360,4sleep03207599cyclictest19:45:010
163992361,31sleep016457-21cut20:05:250
666223413,4sleep122-21ksoftirqd/119:40:191
32076993426,5cyclictest11588-21fschecks_time22:45:151
3207699341,15cyclictest272332ls22:00:211
3207599344,13cyclictest30488-21iostat23:35:180
3207599343,16cyclictest30914-21diskstats20:45:150
32075993418,5cyclictest3-21ksoftirqd/023:22:070
32075993417,6cyclictest3-21ksoftirqd/023:51:100
32075993414,6cyclictest17568-21ntp_states23:00:220
32075993412,8cyclictest1825-21iostat_ios23:45:200
3207599341,21cyclictest6679-21chrt23:58:470
58262331,4sleep15944-21hddtemp_smartct22:30:151
32075993318,5cyclictest3-21ksoftirqd/020:42:360
32075993317,6cyclictest3-21ksoftirqd/019:46:340
32075993317,5cyclictest3-21ksoftirqd/023:18:510
3207599331,28cyclictest1646-21aten_r4power_en22:20:110
271542331,28sleep127327-21perl20:35:161
75782321,27sleep17581-21irqstats00:00:191
66452321,5sleep10-21swapper/123:58:261
44062321,28sleep14429-21hddtemp_smartct21:00:181
3207699325,4cyclictest81rcu_preempt22:21:301
3207599325,4cyclictest81rcu_preempt22:43:000
3207599323,10cyclictest14690-21cron22:55:000
32075993216,6cyclictest3-21ksoftirqd/020:32:360
3207599321,13cyclictest24678-21sed00:45:220
192732321,27sleep00-21swapper/000:30:270
17512321,27sleep11862-21df_inode19:30:031
3207699319,10cyclictest40250irq/92-i91521:12:181
3207599313,15cyclictest605-21users23:40:300
3207599311,6cyclictest11565-21gdbus22:18:030
32075993116,5cyclictest3-21ksoftirqd/022:04:070
32075993112,6cyclictest20782-21df23:10:130
32075993112,6cyclictest10748-21ntp_states19:50:250
32075993110,10cyclictest3-21ksoftirqd/020:37:540
104322311,5sleep10-21swapper/100:08:361
3207699305,4cyclictest81rcu_preempt21:29:501
3207699304,19cyclictest16980-21iostat_ios00:25:211
3207699304,19cyclictest16980-21iostat_ios00:25:201
3207699303,24cyclictest22-21ksoftirqd/120:06:111
32076993016,8cyclictest23388-21diskstats20:25:151
3207699301,3cyclictest0-21swapper/119:40:011
3207599302,15cyclictest0-21swapper/022:28:060
32075993016,4cyclictest3-21ksoftirqd/000:07:020
32075993015,5cyclictest3-21ksoftirqd/000:12:330
32075993014,6cyclictest3-21ksoftirqd/000:39:220
32075993014,5cyclictest3-21ksoftirqd/000:41:070
3207599301,15cyclictest12973-21fschecks_count00:15:150
32075993010,5cyclictest5992-21latency_hist19:40:010
252472301,5sleep10-21swapper/120:30:131
186102301,5sleep10-21swapper/123:05:041
184172301,5sleep10-21swapper/121:36:001
167912301,5sleep10-21swapper/121:33:331
131342301,25sleep113198-21iostat00:15:201
127822301,5sleep00-21swapper/022:49:410
3207699297,4cyclictest81rcu_preempt00:32:381
3207699296,4cyclictest81rcu_preempt20:50:451
3207699295,4cyclictest81rcu_preempt00:42:391
3207699294,3cyclictest81rcu_preempt20:59:211
3207699294,18cyclictest28315-21diskstats23:30:141
3207699294,18cyclictest23038-21diskstats21:50:131
3207699293,10cyclictest19612-21diskstats20:15:141
32076992912,14cyclictest22-21ksoftirqd/100:35:151
3207699291,15cyclictest7819-21/usr/sbin/munin22:35:161
32075992915,4cyclictest3-21ksoftirqd/020:02:430
32075992914,5cyclictest3-21ksoftirqd/020:23:300
32075992911,5cyclictest7266-21df00:00:120
3207599291,15cyclictest4445-21/usr/sbin/munin21:00:180
3207599291,15cyclictest18602-21/usr/sbin/munin20:10:280
32075992910,6cyclictest8345-21python22:35:270
201562291,5sleep00-21swapper/023:08:090
167542291,5sleep00-21swapper/021:33:100
71052281,5sleep00-21swapper/021:05:400
69332281,5sleep00-21swapper/022:32:340
46152281,5sleep10-21swapper/123:51:491
3207699285,4cyclictest81rcu_preempt21:47:421
3207699285,4cyclictest81rcu_preempt00:47:041
3207699284,17cyclictest21095-21iostat_ios23:10:191
3207699283,4cyclictest81rcu_preempt19:46:121
3207699282,12cyclictest3286-21runrttasks00:54:301
3207699282,10cyclictest3872-21df_inode22:25:141
3207699282,10cyclictest21217-21/usr/sbin/munin20:20:301
32076992819,5cyclictest511-21unixbench_multi23:40:281
3207699281,4cyclictest81rcu_preempt23:49:441
3207699281,4cyclictest81rcu_preempt00:10:091
3207599287,12cyclictest0-21swapper/020:51:080
3207599282,13cyclictest3067-21memory19:30:200
3207599282,13cyclictest23741-21sort20:25:210
32075992812,6cyclictest3-21ksoftirqd/000:53:320
32075992812,12cyclictest297882chrt22:06:470
3207599281,17cyclictest0-21swapper/020:18:010
32075992811,5cyclictest15724-21sed00:20:280
32075992811,5cyclictest11565-21gdbus21:43:180
3207599281,14cyclictest14852-21/usr/sbin/munin22:55:090
3207599281,13cyclictest12209-21tune2fs19:55:140
32075992810,5cyclictest11565-21gdbus21:57:060
319602281,5sleep10-21swapper/120:46:101
280162281,5sleep00-21swapper/023:30:080
255622281,5sleep10-21swapper/123:20:411
238462281,5sleep10-21swapper/123:17:311
190352281,5sleep10-21swapper/120:13:501
180502281,5sleep10-21swapper/123:00:481
144692281,5sleep10-21swapper/122:52:431
128252281,5sleep10-21swapper/121:21:181
71152271,5sleep10-21swapper/121:05:481
3207699272,4cyclictest81rcu_preempt22:18:051
3207699271,4cyclictest81rcu_preempt23:25:221
3207699271,22cyclictest9567-21/usr/sbin/munin21:15:271
32076992710,5cyclictest14950-21aten_r4power_vo22:55:101
32075992711,4cyclictest8230-21sort21:10:200
3207599271,13cyclictest11543-21aten_r4power_po21:20:110
315602271,5sleep10-21swapper/122:10:411
268692271,5sleep00-21swapper/023:25:220
262592271,5sleep10-21swapper/121:59:191
208622271,5sleep00-21swapper/021:45:080
146902271,4sleep00-21swapper/021:26:120
132482271,5sleep10-21swapper/119:57:201
113652271,5sleep10-21swapper/119:52:171
3207699263,17cyclictest28985-21iostat_ios22:05:181
3207699261,4cyclictest81rcu_preempt00:20:401
3207699261,11cyclictest14174-21fschecks_time20:00:151
3207599268,6cyclictest30318-21wget22:10:100
3207599261,13cyclictest23251-21/usr/sbin/munin21:50:170
298942261,5sleep10-21swapper/123:35:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional