You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 06:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Sep 20, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
318489912691224,24cyclictest32249-21expr19:25:141
318479911851132,48cyclictest32363-21tune2fs19:25:180
314702689641,32sleep00-21swapper/019:21:370
315602666619,31sleep10-21swapper/119:22:331
87052590,8sleep13184899cyclictest00:05:131
140932410,9sleep03184799cyclictest22:51:220
31847993613,12cyclictest3-21ksoftirqd/023:17:000
3184799361,22cyclictest4144-21grep22:25:230
253232360,22sleep122-21ksoftirqd/120:30:191
3184899352,10cyclictest0-21swapper/119:55:131
3184799351,21cyclictest25384-21python21:55:280
17522351,6sleep11810-21if_eth019:30:041
15692351,4sleep11578-21iostat_ios23:45:211
249642341,29sleep025044-21python23:20:280
31848993324,5cyclictest1745-21fschecks_time22:20:171
31848993316,5cyclictest15895-21seq00:24:111
31848993311,5cyclictest55942tr21:05:111
3184799332,26cyclictest32112-21/usr/sbin/munin23:40:180
31847993315,5cyclictest3-21ksoftirqd/020:02:020
3184799331,21cyclictest5403-21sshd19:36:240
3184799331,20cyclictest8807-21chrt21:11:230
31847993311,6cyclictest0-21swapper/023:08:240
127652331,3sleep011565-21gdbus21:23:140
50512320,8sleep13184899cyclictest22:30:001
3184899325,4cyclictest81rcu_preempt23:52:051
3184899325,10cyclictest13421-21memory22:50:241
31848993217,8cyclictest13396-21diskstats21:25:171
31848993214,5cyclictest40250irq/92-i91500:50:111
31848993212,6cyclictest30728-21timerandwakeup23:35:271
3184799323,16cyclictest19032-21python00:30:270
31847993212,6cyclictest21875-21/usr/sbin/munin20:20:290
31847993211,5cyclictest20833-21/usr/sbin/munin00:35:290
31847993210,5cyclictest18225-21python20:10:270
153712321,27sleep015497-21cpuspeed_turbos20:05:140
57812311,26sleep15801-21iostat_ios22:30:181
3184899314,4cyclictest40250irq/92-i91523:40:291
3184899312,25cyclictest20844-21iostat23:10:201
3184899311,4cyclictest81rcu_preempt22:13:161
3184899311,4cyclictest81rcu_preempt21:49:591
31848993113,5cyclictest32579-21load22:15:201
3184799317,12cyclictest81rcu_preempt22:40:000
3184799312,14cyclictest24339-21runrttasks20:27:400
31847993111,8cyclictest1988-21/usr/sbin/munin22:20:230
3184799311,12cyclictest0-21swapper/021:36:290
31847993110,6cyclictest2225-21dbus-daemon19:41:360
95172301,5sleep00-21swapper/019:50:000
75562300,14sleep0111rcuc/000:00:250
3184899305,4cyclictest81rcu_preempt21:43:551
3184899303,20cyclictest17807-21iostat_ios20:10:191
3184899302,4cyclictest81rcu_preempt00:14:151
31848993023,4cyclictest5341-21smartctl23:55:191
3184899301,7cyclictest6532-21iostat_ios19:40:211
3184899301,5cyclictest81rcu_preempt22:09:321
3184899300,4cyclictest81rcu_preempt20:01:261
3184799306,12cyclictest30380-21/usr/sbin/munin20:45:130
3184799305,12cyclictest0-21swapper/022:05:300
31847993022,5cyclictest5722-21/usr/sbin/munin21:05:130
3184799302,11cyclictest0-21swapper/021:40:240
31847993012,5cyclictest17100-21iostat_ios23:00:200
3184799301,24cyclictest9922-21seq19:50:120
300012301,5sleep00-21swapper/020:42:480
243622301,5sleep10-21swapper/121:55:081
217582301,5sleep00-21swapper/023:12:530
52262291,5sleep10-21swapper/121:03:101
3184899295,5cyclictest40250irq/92-i91520:15:181
3184899294,4cyclictest81rcu_preempt19:52:171
3184899294,4cyclictest40250irq/92-i91521:15:301
3184899293,4cyclictest28695-21tr20:40:121
31848992918,7cyclictest16331-21cron23:00:001
31848992910,6cyclictest0-21swapper/100:02:521
3184799299,6cyclictest10464-21/usr/sbin/munin21:15:290
3184799293,14cyclictest5497-21df_inode22:30:140
31847992922,4cyclictest5137-21diskstats23:55:160
3184799292,14cyclictest0-21swapper/023:29:540
3184799291,5cyclictest11646-21wget19:55:130
3184799291,4cyclictest81rcu_preempt20:51:000
31847992912,5cyclictest26854-21iostat22:00:180
31847992911,6cyclictest27078-21taskset00:52:520
31847992911,5cyclictest4527-21ntp_states21:00:270
3184799291,15cyclictest26439-21cron20:35:000
3184799291,15cyclictest25411-21cron00:50:000
31847992910,6cyclictest3337-21grep19:30:290
31847992910,6cyclictest30149-21/usr/sbin/munin23:35:160
31847992910,6cyclictest1190-21basename22:20:010
267372291,4sleep126828-21processes23:25:261
239652291,5sleep00-21swapper/021:52:320
230742291,5sleep00-21swapper/000:40:390
182452291,5sleep10-21swapper/121:36:461
177902291,5sleep10-21swapper/100:29:251
175972291,5sleep00-21swapper/000:27:250
154732290,7sleep03184799cyclictest21:30:180
146012291,5sleep00-21swapper/022:55:080
122332291,5sleep00-21swapper/022:46:320
45312281,5sleep00-21swapper/023:53:300
3184899289,5cyclictest3286-21runrttasks20:54:101
3184899285,4cyclictest81rcu_preempt00:36:381
3184899285,3cyclictest81rcu_preempt22:03:051
3184899284,4cyclictest81rcu_preempt19:48:441
31848992819,5cyclictest24888-21unixbench_multi00:45:291
31848992818,6cyclictest8338-21/usr/sbin/munin22:35:301
3184899281,4cyclictest81rcu_preempt20:25:101
31848992810,5cyclictest40250irq/92-i91523:00:201
3184799283,3cyclictest81rcu_preempt23:47:300
3184799282,13cyclictest30511-21hddtemp_smartct22:10:200
3184799282,13cyclictest20927-21/usr/sbin/munin21:45:140
3184799281,14cyclictest28233-21runrttasks20:39:070
3184799281,14cyclictest14830-21/usr/sbin/munin21:30:000
3184799281,14cyclictest13169-21/usr/sbin/munin00:15:250
3184799281,13cyclictest14265-21/usr/sbin/munin00:20:150
31847992810,6cyclictest11299-21ntp_kernel_pll_00:10:240
31847992810,5cyclictest9308-21tune2fs22:40:150
30702281,5sleep10-21swapper/120:55:361
291262281,5sleep10-21swapper/123:31:161
233612281,5sleep10-21swapper/100:43:331
222932281,5sleep10-21swapper/120:20:531
197092281,5sleep10-21swapper/100:34:541
163042281,5sleep10-21swapper/121:31:031
136682281,5sleep10-21swapper/100:15:471
53352271,4sleep10-21swapper/119:35:431
3184899272,4cyclictest81rcu_preempt20:05:571
3184899271,4cyclictest81rcu_preempt23:21:161
3184899271,11cyclictest20198-21ls23:10:001
3184799272,12cyclictest1980-21df_inode20:55:150
3184799271,4cyclictest81rcu_preempt23:30:240
31847992711,5cyclictest9297-21memory00:05:230
317112271,5sleep10-21swapper/120:46:031
207312271,4sleep00-21swapper/020:19:200
126782271,5sleep10-21swapper/121:22:201
103282271,5sleep10-21swapper/122:41:161
88192261,4sleep10-21swapper/121:11:311
3184899264,3cyclictest81rcu_preempt23:16:431
122862261,5sleep10-21swapper/122:47:061
3184899255,4cyclictest81rcu_preempt20:37:051
3184899253,16cyclictest22789-21diskstats21:50:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional