You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 13:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Mar 16, 2026 00:59:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250139912641231,16cyclictest0-21swapper/019:26:460
250149910741057,14cyclictest0-21swapper/119:26:561
247292668622,31sleep10-21swapper/119:22:351
247292668622,31sleep10-21swapper/119:22:341
245852503457,32sleep00-21swapper/019:21:030
245852503457,32sleep00-21swapper/019:21:020
321142870,7sleep12501499cyclictest00:30:011
25014995718,6cyclictest22-21ksoftirqd/123:05:261
25014995715,6cyclictest22-21ksoftirqd/122:31:281
25014995617,6cyclictest22-21ksoftirqd/123:20:271
25014995617,6cyclictest22-21ksoftirqd/121:15:101
25014995615,6cyclictest22-21ksoftirqd/123:25:291
25014995615,6cyclictest22-21ksoftirqd/123:25:291
25014995615,6cyclictest22-21ksoftirqd/121:27:351
25014995615,6cyclictest22-21ksoftirqd/121:27:341
25014995614,6cyclictest22-21ksoftirqd/121:44:401
25014995614,6cyclictest22-21ksoftirqd/100:04:351
25014995614,6cyclictest22-21ksoftirqd/100:04:351
25014995614,5cyclictest22-21ksoftirqd/122:01:251
25014995518,15cyclictest22-21ksoftirqd/122:27:131
25014995518,14cyclictest22-21ksoftirqd/119:55:261
25014995517,5cyclictest22-21ksoftirqd/122:40:291
25014995514,7cyclictest22-21ksoftirqd/121:46:561
25014995513,6cyclictest22-21ksoftirqd/100:14:361
25014995510,6cyclictest22-21ksoftirqd/122:08:061
2501499549,5cyclictest22-21ksoftirqd/122:16:501
25014995316,6cyclictest22-21ksoftirqd/121:33:161
25014995315,6cyclictest22-21ksoftirqd/120:15:211
25014995315,18cyclictest22-21ksoftirqd/100:40:141
2501499527,6cyclictest22-21ksoftirqd/122:46:381
2501499527,6cyclictest22-21ksoftirqd/121:38:141
2501499526,6cyclictest22-21ksoftirqd/121:52:051
25014995222,9cyclictest22-21ksoftirqd/122:37:261
25014995218,5cyclictest22-21ksoftirqd/122:20:291
25014995216,7cyclictest22-21ksoftirqd/121:10:101
25014995215,6cyclictest22-21ksoftirqd/122:56:041
25014995215,6cyclictest22-21ksoftirqd/120:55:201
25014995214,9cyclictest22-21ksoftirqd/120:00:161
25014995214,9cyclictest22-21ksoftirqd/120:00:161
25014995214,6cyclictest22-21ksoftirqd/100:31:251
2501499519,6cyclictest22-21ksoftirqd/123:18:441
25014995120,4cyclictest22-21ksoftirqd/121:59:521
25014995118,5cyclictest22-21ksoftirqd/121:23:311
25014995117,6cyclictest22-21ksoftirqd/121:00:151
25014995116,6cyclictest22-21ksoftirqd/123:10:161
25014995116,5cyclictest22-21ksoftirqd/100:45:121
25014995115,7cyclictest22-21ksoftirqd/100:24:371
25014995115,6cyclictest22-21ksoftirqd/123:00:121
25014995114,6cyclictest22-21ksoftirqd/123:35:121
25014995022,4cyclictest22-21ksoftirqd/123:50:301
25014995019,5cyclictest22-21ksoftirqd/122:54:121
25014995015,6cyclictest22-21ksoftirqd/120:10:141
25014994814,4cyclictest22-21ksoftirqd/122:13:381
25014994812,6cyclictest22-21ksoftirqd/123:40:051
25014994812,6cyclictest22-21ksoftirqd/119:54:371
25014994721,4cyclictest22-21ksoftirqd/100:50:211
25014994713,6cyclictest22-21ksoftirqd/120:05:171
25014994713,5cyclictest22-21ksoftirqd/120:25:181
25014994712,6cyclictest22-21ksoftirqd/123:46:521
2501499465,6cyclictest22-21ksoftirqd/123:31:181
25014994622,4cyclictest22-21ksoftirqd/100:08:171
25014994617,11cyclictest22-21ksoftirqd/123:56:231
25014994617,11cyclictest22-21ksoftirqd/123:56:221
25014994614,10cyclictest22-21ksoftirqd/100:36:191
25014994522,4cyclictest22-21ksoftirqd/119:45:251
25014994520,10cyclictest22-21ksoftirqd/100:16:591
2501499444,4cyclictest81rcu_preempt21:05:121
25014994426,4cyclictest22-21ksoftirqd/120:50:281
25014994425,4cyclictest22-21ksoftirqd/120:20:121
25014994413,10cyclictest22-21ksoftirqd/119:40:151
25014994413,10cyclictest22-21ksoftirqd/119:30:161
97382430,19sleep02501399cyclictest20:05:290
25014994324,4cyclictest22-21ksoftirqd/120:40:171
25014994322,4cyclictest22-21ksoftirqd/120:45:291
25014994322,4cyclictest22-21ksoftirqd/120:35:221
2501499429,6cyclictest22-21ksoftirqd/120:30:181
165262420,8sleep02501399cyclictest23:05:380
2501399412,24cyclictest26074-21wget23:50:100
25013994011,14cyclictest0-21swapper/022:17:000
2501499382,6cyclictest22-21ksoftirqd/119:35:231
2501399385,20cyclictest0-21swapper/000:17:040
2501399382,22cyclictest30348-21perl21:40:160
141032381,34sleep014113-21ssh23:37:060
271132371,32sleep027127-21ssh22:44:060
2501399379,15cyclictest4168-21ls22:20:140
2501399371,22cyclictest31732-21ssh23:21:410
8682361,30sleep0970-21/usr/sbin/munin19:45:110
2501399367,13cyclictest30497-21gdbus23:45:420
2501399365,14cyclictest32250-21ntpq19:40:230
25013993614,5cyclictest3-21ksoftirqd/022:10:160
2501399361,31cyclictest0-21swapper/022:25:120
2501399358,4cyclictest0-21swapper/021:55:090
2501399357,13cyclictest30497-21gdbus20:58:520
2501399357,12cyclictest30497-21gdbus23:58:040
2501399357,12cyclictest30497-21gdbus23:58:040
2501399355,4cyclictest81rcu_preempt22:50:130
25013993527,6cyclictest0-21swapper/000:53:550
2501399351,29cyclictest2309-21cron21:50:010
2501399348,13cyclictest0-21swapper/021:11:140
2501399345,13cyclictest30497-21gdbus20:11:120
25013993424,6cyclictest6530-21ls20:00:000
2501399341,5cyclictest24109-21ssh00:20:350
2501399341,4cyclictest81rcu_preempt22:47:490
2501399341,30cyclictest29562-21ssh21:39:590
2501399341,29cyclictest5119-21ssh00:35:160
2501399341,14cyclictest19641-21ssh22:35:270
25013993410,5cyclictest25584-21ntp_states23:15:250
235672341,4sleep023596-21/usr/sbin/munin20:45:110
283612331,4sleep028377-21ntp_states00:25:250
2501399336,4cyclictest81rcu_preempt22:59:210
2501399334,4cyclictest81rcu_preempt23:40:390
2501399334,4cyclictest81rcu_preempt23:12:140
2501399333,4cyclictest81rcu_preempt00:04:140
2501399333,4cyclictest81rcu_preempt00:04:130
25013993319,8cyclictest2525-21iostat_ios23:25:200
25013993319,8cyclictest2525-21iostat_ios23:25:200
25013993318,11cyclictest7838-21ssh21:16:350
2501399331,4cyclictest10756-21ssh00:07:150
25013993314,9cyclictest3-21ksoftirqd/000:42:310
2501399331,30cyclictest0-21swapper/023:00:350
2501399331,30cyclictest0-21swapper/022:02:350
2501399331,30cyclictest0-21swapper/020:39:360
2501399331,16cyclictest20468-21df21:30:130
25013993310,5cyclictest21680-21aten_r4power_cu22:05:100
191442331,28sleep019154-21ssh21:28:560
191442331,28sleep019154-21ssh21:28:560
133482330,4sleep0111rcuc/020:15:290
98652321,28sleep09876-21sh21:52:200
2501399323,4cyclictest81rcu_preempt00:49:230
2501399323,4cyclictest81rcu_preempt00:30:020
2501399323,16cyclictest3134-21df_inode19:50:140
2501399321,5cyclictest0-21swapper/023:30:360
2501399321,29cyclictest0-21swapper/021:04:560
123312321,5sleep00-21swapper/021:21:030
2501399311,4cyclictest81rcu_preempt22:30:550
2501399311,4cyclictest81rcu_preempt20:33:590
309422301,5sleep00-21swapper/019:36:400
2501399302,15cyclictest31695-21iostat_ios21:05:190
25013993010,6cyclictest16668-21ssh00:13:500
2501399291,14cyclictest29399-21turbostat19:35:000
25013992910,6cyclictest26411-21mailstats20:50:270
231102291,5sleep00-21swapper/020:41:590
155432291,5sleep00-21swapper/020:21:310
80142281,5sleep00-21swapper/020:01:300
80142281,5sleep00-21swapper/020:01:300
2501399288,9cyclictest0-21swapper/020:30:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional