You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 13:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Dec 09, 2025 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195409912341190,27cyclictest28207-21perl21:10:201
195409911391121,15cyclictest19760-21wget19:25:121
194012669623,30sleep00-21swapper/019:24:150
186982482407,60sleep10-21swapper/119:20:271
1953999148128,15cyclictest0-21swapper/021:10:190
238621010,9sleep01953999cyclictest22:57:180
19539999067,18cyclictest0-21swapper/019:25:110
18972880,9sleep01953999cyclictest22:23:460
314402870,5sleep041ktimersoftd/000:34:580
88772860,9sleep01953999cyclictest21:24:010
187882800,4sleep118789-21sh23:47:461
221842550,3sleep122182-21ssh22:10:291
93792470,5sleep0111rcuc/022:30:310
19540994422,11cyclictest22-21ksoftirqd/122:04:271
78182401,34sleep16470-21/usr/sbin/munin21:55:301
120562400,8sleep11954099cyclictest23:40:281
120562400,8sleep11954099cyclictest23:40:271
19540993914,15cyclictest22-21ksoftirqd/122:22:541
1953999394,18cyclictest3341-21diskstats20:05:160
19539993911,4cyclictest0-21swapper/020:55:170
19540993818,8cyclictest22-21ksoftirqd/123:17:341
1953999382,10cyclictest81rcu_preempt21:15:050
19539993810,6cyclictest22001-21runrttasks23:17:340
1953999374,4cyclictest3020-21runrttasks00:18:080
19539993714,6cyclictest9716-21iostat00:45:220
1954099369,5cyclictest22-21ksoftirqd/121:52:161
19540993610,6cyclictest242142/usr/sbin/munin23:20:131
19539993614,8cyclictest16449-21iostat23:45:200
19540993520,4cyclictest22-21ksoftirqd/123:58:171
1953999351,13cyclictest29793-21ntp_states23:25:270
278612341,3sleep127887-21ntp_states00:30:271
271412341,29sleep127155-21ssh21:42:281
1954099345,12cyclictest0-21swapper/121:28:471
1953999345,13cyclictest6204-21gdbus00:42:520
1953999343,28cyclictest40950irq/93-i91519:40:230
19539993425,6cyclictest12838-21ssh22:00:360
1953999341,7cyclictest27832-21ssh23:24:000
1953999341,20cyclictest24676-21ssh22:13:460
17752341,28sleep01848-21df21:50:150
128822341,4sleep112948-21smartctl20:30:171
128822341,4sleep112948-21smartctl20:30:171
123532341,4sleep181rcu_preempt22:34:471
1954099339,5cyclictest40950irq/93-i91522:06:581
1954099339,11cyclictest0-21swapper/121:20:401
19540993318,4cyclictest22-21ksoftirqd/123:08:011
1953999336,13cyclictest2220-21dbus-daemon19:35:000
1953999334,4cyclictest81rcu_preempt21:05:010
1953999334,4cyclictest81rcu_preempt00:36:360
1953999334,14cyclictest6204-21gdbus23:53:450
19539993328,3cyclictest40950irq/93-i91522:42:260
1953999331,19cyclictest28498-21python22:50:300
89762321,4sleep18990-21ssh23:37:351
47142320,3sleep1201rcuc/123:00:111
1954099326,13cyclictest0-21swapper/123:12:291
1954099325,10cyclictest0-21swapper/121:37:351
1954099323,16cyclictest0-21swapper/122:52:181
1954099321,27cyclictest0-21swapper/100:35:501
19540993211,6cyclictest81rcu_preempt22:17:431
19540993210,18cyclictest0-21swapper/100:09:571
1953999327,5cyclictest81rcu_preempt21:48:260
1953999327,5cyclictest81rcu_preempt21:48:260
1953999327,4cyclictest81rcu_preempt22:15:140
1953999324,4cyclictest81rcu_preempt23:36:100
1953999324,4cyclictest81rcu_preempt00:09:400
1953999323,5cyclictest81rcu_preempt23:59:240
1953999322,16cyclictest0-21swapper/020:18:210
19539993212,5cyclictest26127-21ssh00:29:150
19539993211,4cyclictest2331-21mailstats23:30:280
174242321,5sleep00-21swapper/021:32:250
257892311,4sleep025869-21latency_hist19:40:010
1954099316,13cyclictest40950irq/93-i91522:25:251
1954099312,24cyclictest2143-21ntp_states23:30:251
1954099312,17cyclictest0-21swapper/122:49:471
19540993117,11cyclictest22-21ksoftirqd/123:52:531
1954099311,4cyclictest81rcu_preempt21:04:221
1954099311,4cyclictest81rcu_preempt20:03:271
1954099311,17cyclictest27381-21diskmemload00:14:441
1953999318,6cyclictest0-21swapper/023:13:370
1953999313,15cyclictest0-21swapper/019:48:480
1953999312,24cyclictest11848-21users20:25:320
1953999311,7cyclictest7121-21if_eth021:55:180
1953999311,5cyclictest81rcu_preempt22:05:160
1953999311,25cyclictest12488-21aten_r4power_en20:30:120
1953999311,25cyclictest12488-21aten_r4power_en20:30:110
19539993111,6cyclictest24667-21diskstats21:40:150
178012311,5sleep10-21swapper/121:32:571
144702311,5sleep10-21swapper/122:35:511
310832301,5sleep10-21swapper/100:00:241
1954099305,4cyclictest81rcu_preempt20:54:251
1954099303,18cyclictest0-21swapper/120:12:371
19540993022,6cyclictest0-21swapper/119:37:401
1954099302,15cyclictest23138-21ssh00:25:291
1954099301,7cyclictest29147-21ssh23:25:161
19540993015,12cyclictest22-21ksoftirqd/122:42:561
1954099300,4cyclictest81rcu_preempt00:17:381
1953999309,8cyclictest0-21swapper/020:42:110
1953999309,6cyclictest2220-21dbus-daemon20:54:340
1953999307,13cyclictest81rcu_preempt23:09:440
1953999306,5cyclictest81rcu_preempt21:35:270
1953999304,4cyclictest81rcu_preempt23:42:190
1953999304,4cyclictest81rcu_preempt23:42:180
1953999304,14cyclictest0-21swapper/021:05:300
1953999302,14cyclictest30018-21df_inode19:50:140
1953999302,14cyclictest30018-21df_inode19:50:140
1953999302,14cyclictest0-21swapper/022:28:280
1953999301,4cyclictest81rcu_preempt20:36:150
19539993012,6cyclictest22434-21taskset22:45:080
19539993012,5cyclictest14325-21iostat00:50:240
19539993011,6cyclictest7912-21df00:10:150
19539993011,6cyclictest13132-21df_inode22:35:170
19539993010,5cyclictest4675-21aten_r4power_en23:00:120
7572291,5sleep00-21swapper/019:58:570
1954099295,4cyclictest81rcu_preempt19:32:101
1954099294,4cyclictest81rcu_preempt20:15:451
1954099294,4cyclictest81rcu_preempt19:46:321
1954099294,4cyclictest81rcu_preempt19:40:491
1954099294,11cyclictest22-21ksoftirqd/120:35:241
1954099293,4cyclictest81rcu_preempt20:29:111
19540992914,4cyclictest22-21ksoftirqd/122:58:551
19540992914,4cyclictest22-21ksoftirqd/100:50:331
1954099291,23cyclictest32456-21taskset21:48:111
1954099291,23cyclictest32456-21taskset21:48:101
19540992910,16cyclictest22-21ksoftirqd/100:20:511
19540992910,15cyclictest0-21swapper/100:45:431
1953999293,13cyclictest0-21swapper/000:20:280
19539992911,6cyclictest11339-21rm21:25:330
19539992911,5cyclictest5420-21hddtemp_smartct20:10:180
46902281,5sleep10-21swapper/120:09:181
1954099288,16cyclictest0-21swapper/121:15:441
1954099281,14cyclictest30226-21hddtemp_smartct19:50:171
1954099281,14cyclictest30226-21hddtemp_smartct19:50:171
19539992811,5cyclictest30387-21ssh00:00:120
1953999281,13cyclictest18393-21df20:45:150
231742271,5sleep10-21swapper/120:55:471
1954099271,7cyclictest81rcu_preempt19:56:091
19540992714,5cyclictest22-21ksoftirqd/100:41:201
1953999274,16cyclictest9718-21python20:20:270
19539992710,5cyclictest1341-21df_inode20:00:160
194682271,5sleep10-21swapper/120:46:221
175192271,5sleep10-21swapper/120:40:361
19540992616,6cyclictest25833-21cpuspeed_turbos21:05:141
1954099253,10cyclictest0-21swapper/120:23:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional