You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 22:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat May 02, 2026 12:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99599911261102,21cyclictest0-21swapper/007:25:150
99609910941073,16cyclictest0-21swapper/109:25:301
99609910861074,9cyclictest0-21swapper/107:25:131
95322620574,31sleep00-21swapper/007:21:030
88022603523,63sleep10-21swapper/107:20:221
9959999573,6cyclictest412-21ssh09:25:300
291712550,5sleep029168-21ssh10:35:280
155602520,3sleep10-21swapper/112:50:151
27782471,3sleep02865-21iostat12:35:200
197072450,4sleep0111rcuc/011:40:140
995999415,16cyclictest17346-21ssh09:45:190
282152415,31sleep128237-21fschecks_count08:10:161
9960993915,15cyclictest22-21ksoftirqd/110:21:581
9959993922,12cyclictest32082-21fschecks_count08:20:160
9959993915,7cyclictest18019-21/usr/sbin/munin09:10:000
9959993914,8cyclictest491-21ssh10:03:250
9959993914,8cyclictest16739-21df07:40:140
3932391,4sleep1406-21sh12:32:341
258822396,29sleep125889-21sh09:18:261
258822396,29sleep125889-21sh09:18:251
996099383,14cyclictest0-21swapper/112:04:441
9960993825,10cyclictest8609-21ssh12:05:091
9960993816,6cyclictest22-21ksoftirqd/110:01:201
9960993816,6cyclictest22-21ksoftirqd/109:35:311
9960993815,6cyclictest22-21ksoftirqd/110:15:531
995999388,18cyclictest17303-21ssh11:36:460
995999381,7cyclictest30742-21tune2fs11:15:170
9959993814,7cyclictest19037-21memory09:10:230
9959993814,7cyclictest18629-21diskstats07:45:150
12092381,4sleep01382-21cat08:25:130
996099372,17cyclictest18004-21diskmemload12:12:041
996099371,7cyclictest24193-21hddtemp_smartct10:30:181
996099371,7cyclictest24193-21hddtemp_smartct10:30:171
9960993715,6cyclictest22-21ksoftirqd/110:40:271
996099371,13cyclictest8258-21ssh11:26:011
995999371,6cyclictest29688-21cat10:00:000
995999371,6cyclictest15005-21taskset09:00:210
995999371,4cyclictest9555-21ssh10:50:220
9959993714,7cyclictest3932-21ntp_states08:30:240
9959993712,13cyclictest23851-21cut11:45:120
995999371,19cyclictest0-21swapper/012:23:540
995999371,14cyclictest22016-21ssh11:05:140
236972371,3sleep123707-21ssh11:06:301
996099362,17cyclictest0-21swapper/111:41:151
996099362,16cyclictest0-21swapper/110:56:381
9960993616,7cyclictest22-21ksoftirqd/109:24:071
9960993615,7cyclictest22-21ksoftirqd/110:54:361
9960993615,7cyclictest22-21ksoftirqd/110:39:291
9960993614,6cyclictest22-21ksoftirqd/109:47:211
996099361,17cyclictest9795-21sed08:45:281
995999369,6cyclictest14024-21grep10:55:230
995999362,12cyclictest11813-21grep08:50:290
995999361,6cyclictest27359-21ssh12:25:320
995999361,6cyclictest27359-21ssh12:25:310
9959993614,7cyclictest11564-21packagekitd09:40:500
9959993613,7cyclictest15519-21/usr/sbin/munin12:50:150
995999361,15cyclictest832-21/usr/sbin/munin11:55:250
995999361,13cyclictest26362-21fschecks_count08:05:190
996099358,17cyclictest6699-21kworker/1:112:43:261
9960993515,6cyclictest22-21ksoftirqd/109:33:261
995999354,13cyclictest5282-21open_files12:00:260
995999352,6cyclictest0-21swapper/011:31:460
995999352,14cyclictest5073-21iostat10:45:210
9959993515,5cyclictest21720-21irqstats09:50:200
995999351,4cyclictest28978-21/usr/sbin/munin11:50:240
9959993513,6cyclictest3891-21diskstats09:30:150
9959993513,5cyclictest640-21/usr/sbin/munin10:40:190
995999351,14cyclictest26986-21ssh11:10:260
995999351,14cyclictest26986-21ssh11:10:250
204052351,4sleep020462-21/usr/sbin/munin10:25:290
199182351,30sleep119928-21ssh09:10:521
103112350,7sleep00-21swapper/011:29:330
996099348,5cyclictest40250irq/92-i91511:55:141
996099342,14cyclictest0-21swapper/111:37:191
996099341,14cyclictest31311-21ssh11:15:271
995999341,6cyclictest5414-21sh10:09:090
995999341,6cyclictest15436-21tune2fs10:20:150
995999341,16cyclictest10678-21ssh12:06:320
995999341,13cyclictest24807-21ssh10:30:280
995999341,13cyclictest24807-21ssh10:30:280
9959993410,7cyclictest28047-21ntp_kernel_pll_09:20:250
272972341,29sleep10-21swapper/109:56:161
135922341,29sleep013664-21python07:30:280
996099332,10cyclictest20766-21sh11:03:481
995999332,13cyclictest17760-21df11:00:120
9959993315,12cyclictest5858-21proc_pri08:35:260
995999331,14cyclictest9779-21ssh10:14:090
995999331,14cyclictest8634-21ssh12:41:380
995999331,13cyclictest3379-21ssh11:20:280
309122331,28sleep131054-21users08:15:301
259022331,4sleep125912-21ssh11:46:461
246032331,29sleep024670-21memory08:00:230
244082338,5sleep124418-21ssh09:53:471
996099326,6cyclictest40250irq/92-i91507:30:011
996099322,13cyclictest40250irq/92-i91512:20:301
9960993216,13cyclictest22-21ksoftirqd/111:54:241
996099321,14cyclictest5336-21ssh12:38:261
995999323,26cyclictest0-21swapper/007:54:560
995999322,13cyclictest21205-21sh12:19:470
995999321,14cyclictest897-21sh12:33:250
995999321,14cyclictest23213-21timerwakeupswit07:55:270
995999321,12cyclictest31657-21latency_hist08:20:010
9959993210,5cyclictest8304-21chrt08:42:030
996099318,4cyclictest4147-21kworker/1:211:24:251
996099315,5cyclictest40250irq/92-i91510:28:081
996099312,12cyclictest0-21swapper/111:30:521
9960993113,4cyclictest40250irq/92-i91507:57:151
995999317,7cyclictest23610-21ntp_states09:15:230
995999317,7cyclictest23610-21ntp_states09:15:230
995999311,26cyclictest13507-21ssh12:10:170
995999311,15cyclictest8371-21ssh09:35:170
995999311,13cyclictest14049-21pidof10:19:010
995999311,13cyclictest11801-21ntp_states12:45:250
995999311,12cyclictest15330-21netstat07:35:230
995999311,12cyclictest13776-21/usr/sbin/munin08:55:300
295092310,8sleep1996099cyclictest12:29:121
295092310,8sleep1996099cyclictest12:29:111
996099309,5cyclictest40250irq/92-i91508:25:121
996099307,5cyclictest0-21swapper/110:48:451
9960993016,10cyclictest15395-21ntp_states07:35:261
996099301,25cyclictest0-21swapper/109:41:061
9960993011,15cyclictest80792chrt10:11:171
995999301,7cyclictest9793-21switchtime08:45:280
125452301,25sleep112555-21ssh12:45:551
996099296,4cyclictest81rcu_preempt07:40:161
996099296,4cyclictest40250irq/92-i91508:40:271
996099291,9cyclictest26393-21fschecks_count08:05:201
9960992912,13cyclictest1853-21cpu10:05:121
996099291,14cyclictest0-21swapper/107:52:251
291832291,5sleep00-21swapper/008:10:310
291272291,5sleep10-21swapper/111:13:331
291272291,5sleep10-21swapper/111:13:321
996099287,5cyclictest28761-21kworker/1:408:35:151
996099282,21cyclictest18115-21sed09:10:021
996099281,8cyclictest18626-21grep12:15:291
198332281,5sleep10-21swapper/107:47:531
139662281,5sleep10-21swapper/108:57:211
120502281,5sleep10-21swapper/108:51:591
996099272,20cyclictest2695-21snmpd08:33:431
257592271,4sleep10-21swapper/108:03:481
156872271,5sleep10-21swapper/109:00:341
996099252,18cyclictest32503-21ntp_kernel_pll_08:20:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional