You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 14:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun May 24, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
88499911701141,25cyclictest6232-21perl08:40:161
88489911331093,22cyclictest9029-21aten_r4power_en07:25:110
88499911041085,15cyclictest9014-21wget07:25:111
71152619540,65sleep00-21swapper/007:20:120
85182529482,32sleep10-21swapper/107:22:071
884899224190,14cyclictest0-21swapper/008:40:160
297712890,4sleep1201rcuc/108:15:291
77182880,3sleep0111rcuc/010:10:160
100322670,5sleep10-21swapper/108:50:171
109952611,34sleep011146-21fschecks_time11:45:160
8849995918,7cyclictest26402-21diskstats11:00:161
884999584,19cyclictest13174-21iostat_ios11:50:201
884999567,14cyclictest0-21swapper/111:09:051
884999561,6cyclictest0-21swapper/109:00:291
884999553,19cyclictest1821-21diskstats09:55:161
8849995515,6cyclictest20739-21runrttasks07:52:181
8849995415,6cyclictest22-21ksoftirqd/112:39:071
8849995412,14cyclictest14815-21/usr/sbin/munin10:30:181
267602540,5sleep0111rcuc/012:25:290
884999521,13cyclictest26810-21switchtime12:25:291
884999504,9cyclictest4163-21diskstats08:35:141
884999504,9cyclictest27618-21/usr/sbin/munin12:30:311
8849995021,6cyclictest18278-21awk07:45:261
8849995013,6cyclictest7569-21df_inode10:10:131
884999501,12cyclictest24438-21if_eth012:20:181
884999501,11cyclictest2225-21dbus-daemon11:22:251
884999493,8cyclictest15645-21diskstats07:40:141
8849994911,8cyclictest23699-21cron12:20:001
8849994911,6cyclictest22-21ksoftirqd/111:56:331
8849994911,6cyclictest22-21ksoftirqd/111:56:331
8849994911,6cyclictest22-21ksoftirqd/109:41:011
884999472,8cyclictest32025-21diskstats11:15:151
884999462,8cyclictest17189-21hddtemp_smartct10:35:171
884999462,8cyclictest17189-21hddtemp_smartct10:35:171
884999461,7cyclictest4184-21/usr/sbin/munin11:25:271
884999461,6cyclictest81rcu_preempt10:55:231
884999461,10cyclictest0-21swapper/111:11:281
884999453,7cyclictest20561-21perl12:10:151
884999451,8cyclictest23082-21wget08:00:121
884999451,7cyclictest1722-21idleruntime-cro08:29:591
884999451,6cyclictest11564-21packagekitd07:39:511
884999451,4cyclictest81rcu_preempt10:47:141
884999451,10cyclictest11329-21kernelversion11:45:211
884999447,5cyclictest40250irq/92-i91511:30:291
884999441,7cyclictest3620-21taskset08:34:091
8849994413,8cyclictest23522-21unixbench_multi10:50:291
8849994411,4cyclictest81rcu_preempt09:20:001
884999431,8cyclictest21580-21grep09:20:231
884999425,5cyclictest40250irq/92-i91510:05:001
884999421,8cyclictest21458-21diskstats07:55:151
31072410,9sleep1884999cyclictest12:50:131
884999391,7cyclictest1670-21ntp_states12:45:231
8848993912,14cyclictest1114-21df12:45:120
8848993911,6cyclictest7517-21irqstats11:35:190
8849993519,6cyclictest22-21ksoftirqd/109:33:161
304552351,30sleep030509-21/usr/sbin/munin09:45:130
289482350,2sleep028949-21iostat_ios09:40:180
8848993412,7cyclictest902-21users09:50:290
310742341,4sleep031092-21/usr/sbin/munin08:20:170
238682341,29sleep011565-21gdbus12:20:100
884899334,4cyclictest81rcu_preempt07:50:160
884899331,20cyclictest23805-21chrt10:52:300
277992331,4sleep00-21swapper/011:04:530
884899327,13cyclictest29524-21basename12:35:100
884899325,4cyclictest81rcu_preempt10:59:220
884899322,15cyclictest31224-21latency_hist12:40:000
8848993215,13cyclictest13118-21sendmail09:00:000
8848993213,5cyclictest16163-21ntpq07:40:240
8848993211,7cyclictest18516-21diskstats12:05:150
884899321,14cyclictest0-21swapper/008:38:490
884899321,14cyclictest0-21swapper/007:35:320
309312321,27sleep031076-21head11:10:290
271842320,7sleep0884899cyclictest08:10:150
884899312,17cyclictest0-21swapper/007:30:210
884899312,15cyclictest0-21swapper/008:34:410
8848993112,6cyclictest23545-21perl08:00:160
8848993112,5cyclictest15831-21python10:30:270
90142301,5sleep00-21swapper/008:46:270
884999307,7cyclictest2225-21dbus-daemon09:27:331
884899306,7cyclictest3286-21runrttasks12:00:220
884899305,12cyclictest40250irq/92-i91507:55:160
884899304,12cyclictest8846-21cyclictest09:20:120
884899302,14cyclictest9452-21df_inode10:15:130
8848993020,5cyclictest23420-21cat09:25:220
884899301,4cyclictest81rcu_preempt09:14:420
884899301,4cyclictest81rcu_preempt08:16:370
8848993012,10cyclictest0-21swapper/010:48:540
8848993011,7cyclictest20915-21ntp_kernel_pll_12:10:260
8848993011,6cyclictest6238-21sed11:30:290
884899301,16cyclictest18242-21/usr/sbin/munin07:45:250
884899301,14cyclictest18932-21/usr/sbin/munin09:15:120
884899301,10cyclictest0-21swapper/010:27:240
8848993010,6cyclictest5237-21cron10:05:000
41342301,5sleep00-21swapper/012:50:450
884999295,4cyclictest81rcu_preempt10:40:441
884999295,4cyclictest81rcu_preempt08:07:081
884999294,9cyclictest17352-21diskstats09:10:141
884999293,3cyclictest81rcu_preempt08:10:171
8849992913,6cyclictest22-21ksoftirqd/112:03:151
884999291,26cyclictest0-21swapper/110:25:111
884899297,11cyclictest14356-21grep09:00:290
884899293,16cyclictest0-21swapper/012:34:160
884899292,14cyclictest12642-21/usr/sbin/munin11:50:100
884899291,13cyclictest3154-21/usr/sbin/munin11:25:280
8848992910,6cyclictest22462-21hddtemp_smartct12:15:170
8848992910,6cyclictest18346-21taskset10:39:240
8848992910,6cyclictest18346-21taskset10:39:230
8848992910,6cyclictest11354-21df_inode10:20:140
8848992910,15cyclictest0-21swapper/011:20:130
168402291,5sleep00-21swapper/009:09:340
15042291,5sleep00-21swapper/008:27:520
884999285,19cyclictest0-21swapper/111:35:141
884999284,4cyclictest81rcu_preempt08:48:091
884999283,4cyclictest81rcu_preempt10:09:011
8849992816,7cyclictest9456-21diskstats10:15:151
8849992813,5cyclictest22-21ksoftirqd/109:51:331
884899283,4cyclictest81rcu_preempt08:54:320
884899282,15cyclictest0-21swapper/009:57:060
7562281,5sleep00-21swapper/011:17:400
294792281,5sleep00-21swapper/011:07:500
259832281,5sleep00-21swapper/009:31:520
201942281,5sleep00-21swapper/010:43:580
161192281,5sleep00-21swapper/011:59:340
161192281,5sleep00-21swapper/011:59:330
102052281,5sleep00-21swapper/011:41:360
884999278,5cyclictest40250irq/92-i91508:20:211
884999276,4cyclictest81rcu_preempt08:58:401
884999275,4cyclictest81rcu_preempt12:08:411
884999275,4cyclictest81rcu_preempt09:48:321
884999275,4cyclictest81rcu_preempt09:38:531
884999273,9cyclictest15770-21iostat_ios09:05:191
884999272,6cyclictest3286-21runrttasks12:40:001
8849992711,6cyclictest22-21ksoftirqd/111:44:361
884899271,13cyclictest5496-21aten_r4power_vo10:05:100
278082271,5sleep00-21swapper/009:36:180
884999266,4cyclictest81rcu_preempt10:20:471
884999263,11cyclictest11565-21gdbus07:30:211
884899261,13cyclictest0-21swapper/008:05:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional