You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 08:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Thu May 28, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126799911201101,16cyclictest22875-21kworker/0:019:27:330
122752594545,33sleep00-21swapper/019:21:190
122872464370,29sleep10-21swapper/119:21:261
1268099171164,5cyclictest0-21swapper/119:27:331
201752440,9sleep01267999cyclictest22:35:000
1268099377,5cyclictest81rcu_preempt21:55:161
1268099356,26cyclictest29863-21cron21:35:001
12680993528,4cyclictest22-21ksoftirqd/123:40:001
1268099351,6cyclictest22-21ksoftirqd/120:35:281
12679993514,9cyclictest17479-21/usr/sbin/munin21:00:230
12679993514,9cyclictest17479-21/usr/sbin/munin21:00:220
12679993511,11cyclictest29495-21cpuspeed_turbos00:25:110
162172341,9sleep00-21swapper/022:23:370
1268099342,8cyclictest9923-21iostat20:40:181
1267999342,19cyclictest0-21swapper/000:12:280
1267999341,21cyclictest30236-21munin-run20:10:010
1267999331,12cyclictest5065-21runrttasks20:26:300
219832321,3sleep022032-21/usr/sbin/munin19:45:280
198982321,26sleep120004-21users21:05:281
1268099329,8cyclictest28085-21diskstats22:55:141
1268099323,25cyclictest1110-21smartctl00:35:171
12680993226,4cyclictest22-21ksoftirqd/121:45:001
1268099321,6cyclictest308372ls23:00:281
12680993212,8cyclictest22-21ksoftirqd/119:45:281
12679993222,6cyclictest3077-21tune2fs00:40:170
1267999321,6cyclictest81rcu_preempt22:55:290
12679993210,5cyclictest0-21swapper/021:15:250
324792311,5sleep10-21swapper/100:30:351
185742311,4sleep118615-21iostat23:55:191
1268099318,19cyclictest0-21swapper/120:20:261
1268099314,4cyclictest81rcu_preempt20:50:221
1268099314,4cyclictest81rcu_preempt20:03:191
1268099311,4cyclictest81rcu_preempt22:34:321
12680993113,5cyclictest3286-21runrttasks00:18:441
1267999315,23cyclictest5917-21fschecks_count20:30:160
1267999312,16cyclictest0-21swapper/020:44:360
1267999311,4cyclictest81rcu_preempt23:21:250
12679993114,13cyclictest3-21ksoftirqd/022:35:390
12679993111,7cyclictest30138-21fschecks_time23:00:150
1267999311,16cyclictest3268-21latency_hist21:50:000
250282301,25sleep025084-21fschecks_count19:55:150
203512301,5sleep00-21swapper/021:08:580
1268099305,4cyclictest81rcu_preempt23:24:401
1268099304,4cyclictest81rcu_preempt20:13:221
12680993021,6cyclictest11565-21gdbus23:51:161
1268099302,15cyclictest24266-21iostat_ios00:10:191
1268099301,5cyclictest81rcu_preempt22:19:501
1268099301,4cyclictest81rcu_preempt23:19:201
12680993013,4cyclictest22915-21fschecks_time21:15:151
1268099301,16cyclictest13824-21pidof23:42:001
1268099301,16cyclictest0-21swapper/100:05:291
12680993010,15cyclictest101872chrt23:33:301
12679993016,7cyclictest9277-21diskstats22:05:150
11352301,4sleep01256-21df23:10:130
5752291,5sleep00-21swapper/023:07:330
5642291,5sleep10-21swapper/123:07:251
327362291,5sleep00-21swapper/000:33:140
287612291,5sleep00-21swapper/000:20:550
219322291,5sleep00-21swapper/021:10:480
184942291,5sleep00-21swapper/019:35:330
168792291,5sleep00-21swapper/019:33:150
168792291,5sleep00-21swapper/019:33:140
127672291,5sleep10-21swapper/120:48:181
1268099299,7cyclictest11565-21gdbus21:50:221
1268099295,4cyclictest81rcu_preempt21:25:591
1268099293,6cyclictest0-21swapper/100:41:191
1268099293,10cyclictest28132-21memory00:20:221
1268099292,7cyclictest0-21swapper/100:01:101
1268099292,22cyclictest15938-21irqstats19:30:221
1268099292,22cyclictest15938-21irqstats19:30:211
1268099291,4cyclictest81rcu_preempt21:11:091
1268099291,4cyclictest81rcu_preempt21:02:051
1268099291,4cyclictest81rcu_preempt21:02:041
1268099291,15cyclictest6407-21seq00:50:061
1268099291,15cyclictest4176-21hddtemp_smartct20:25:151
1268099291,15cyclictest15657-21memory20:55:221
1268099291,15cyclictest15657-21memory20:55:211
1267999293,14cyclictest22215-21wget22:40:110
12679992912,5cyclictest17111-21iostat_ios22:25:200
12679992912,5cyclictest13695-21iostat_ios20:50:210
12679992912,13cyclictest19595-21hddtemp_smartct19:40:160
1267999291,16cyclictest0-21swapper/021:56:050
12679992911,5cyclictest7690-21awk00:50:280
1267999291,15cyclictest12681-21/usr/sbin/munin23:40:130
12679992911,5cyclictest11811-21irqstats20:45:180
1267999291,15cyclictest10601-21wget23:35:120
12679992911,4cyclictest19920-21/usr/sbin/munin00:00:280
12679992910,6cyclictest4145-21ntpdc21:50:220
11082291,5sleep00-21swapper/020:15:530
69342281,5sleep10-21swapper/120:31:271
314392281,5sleep00-21swapper/021:36:530
258742281,5sleep00-21swapper/021:22:310
238342281,5sleep10-21swapper/122:44:351
163382281,4sleep00-21swapper/020:56:220
163382281,4sleep00-21swapper/020:56:220
159362281,5sleep10-21swapper/122:20:431
156252281,5sleep00-21swapper/023:46:160
12772281,5sleep10-21swapper/120:17:351
1268099288,4cyclictest81rcu_preempt22:05:271
1268099284,3cyclictest81rcu_preempt21:20:301
1268099283,18cyclictest29600-21df00:25:121
1268099283,18cyclictest14568-21diskstats23:45:151
1268099282,3cyclictest81rcu_preempt22:45:281
1268099282,11cyclictest6249-21cron00:50:001
1268099281,4cyclictest81rcu_preempt20:05:291
1268099281,23cyclictest11225-21tune2fs22:10:141
1268099281,15cyclictest20124-21smartctl19:40:261
1267999289,6cyclictest8500-21sort20:35:280
1267999282,14cyclictest4826-21diskstats00:45:160
1267999282,13cyclictest4235-21/usr/sbin/munin23:15:290
1267999281,4cyclictest81rcu_preempt00:35:180
12679992811,5cyclictest16141-21taskset23:50:040
12679992810,6cyclictest13754-21/usr/sbin/munin22:15:270
12679992810,4cyclictest26748-21ntp_states22:50:230
26172271,5sleep10-21swapper/123:13:561
215582271,5sleep10-21swapper/122:35:391
188202271,5sleep10-21swapper/119:38:591
1268099279,5cyclictest40250irq/92-i91519:50:281
1268099274,4cyclictest81rcu_preempt23:26:021
1268099273,17cyclictest7398-21diskstats22:00:131
1268099272,9cyclictest17779-21users22:25:291
1268099272,3cyclictest81rcu_preempt21:36:301
1268099271,3cyclictest81rcu_preempt21:49:511
1267999278,5cyclictest32588-21latency21:40:200
1267999278,5cyclictest24295-21expr22:45:120
1267999271,8cyclictest0-21swapper/020:20:140
1267999271,4cyclictest81rcu_preempt20:02:280
1267999271,14cyclictest24121-21seq19:50:280
1267999271,14cyclictest18490-21fschecks_time23:55:160
1267999271,14cyclictest0-21swapper/021:25:060
1267999271,12cyclictest8453-21cron23:30:000
1268099264,14cyclictest0-21swapper/119:56:341
1267999269,5cyclictest8713-21aten_r4power_vo23:30:110
1267999268,6cyclictest8478-21chrt22:01:290
1267999261,14cyclictest0-21swapper/020:13:360
1267999261,12cyclictest3286-21runrttasks21:33:200
1268099252,19cyclictest26514-21irqstats22:50:201
1267999253,3cyclictest81rcu_preempt00:15:150
12679992416,5cyclictest3286-21runrttasks22:10:210
12679992415,6cyclictest3-21ksoftirqd/000:05:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional