You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 06:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Apr 12, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
106459912401209,26cyclictest11083-21diskstats19:25:151
106459912401209,26cyclictest11083-21diskstats19:25:151
106449911501100,36cyclictest11387-21irqstats19:25:210
106449911501100,36cyclictest11387-21irqstats19:25:210
103502693648,29sleep00-21swapper/019:22:290
93722603521,65sleep10-21swapper/119:20:161
3050421360,7sleep01064499cyclictest23:35:200
137482970,3sleep113749-21cat00:25:131
25072890,9sleep11064599cyclictest22:00:111
91232860,4sleep1211ktimersoftd/100:20:151
25812840,7sleep11064599cyclictest23:06:081
212522840,8sleep11064599cyclictest23:25:281
197872790,4sleep1211ktimersoftd/123:24:561
288332740,4sleep0111rcuc/022:26:240
104802740,8sleep00-21swapper/023:15:120
180562620,8sleep01064499cyclictest23:55:300
101412520,7sleep01064499cyclictest22:40:280
204952470,22sleep122-21ksoftirqd/123:58:471
272682450,4sleep1201rcuc/120:05:241
10645994218,6cyclictest22-21ksoftirqd/122:55:221
253232400,3sleep041ktimersoftd/000:36:390
1064599408,28cyclictest0-21swapper/121:31:161
214552390,4sleep041ktimersoftd/021:12:200
1064599396,5cyclictest81rcu_preempt23:33:011
1064599395,5cyclictest0-21swapper/123:51:551
10645993924,12cyclictest32093-21sh21:23:401
10645993910,4cyclictest81rcu_preempt23:11:091
1064599383,6cyclictest22-21ksoftirqd/123:49:221
1064599381,12cyclictest104832rm23:15:111
1064499383,18cyclictest6780-21ntp_states21:30:260
10644993817,5cyclictest0-21swapper/022:20:260
232432370,8sleep01064499cyclictest23:27:560
1064599373,6cyclictest22-21ksoftirqd/122:38:141
1064599371,14cyclictest190072tr00:30:241
1064599361,32cyclictest0-21swapper/122:47:151
1064499363,5cyclictest0-21swapper/000:33:360
10644993623,10cyclictest0-21swapper/021:47:060
1064499361,6cyclictest0-21swapper/023:46:560
64492351,30sleep030497-21gdbus22:36:510
10645993526,4cyclictest22-21ksoftirqd/122:32:531
1064499356,5cyclictest81rcu_preempt19:35:270
1064499352,13cyclictest22590-21ntp_states00:00:250
1064499351,5cyclictest81rcu_preempt22:35:010
1064499351,5cyclictest12288-21diskstats23:50:150
10644993510,13cyclictest25169-21interrupts20:00:180
237772340,3sleep0111rcuc/019:55:290
180882341,5sleep00-21swapper/023:22:290
1064599348,4cyclictest81rcu_preempt21:39:211
1064599341,5cyclictest14845-21/usr/sbin/munin21:00:151
1064599341,22cyclictest0-21swapper/100:43:151
1064599341,13cyclictest81rcu_preempt00:10:131
1064499347,12cyclictest30497-21gdbus20:44:550
1064499346,25cyclictest28663-21fschecks_count23:00:160
10644993427,4cyclictest0-21swapper/022:17:360
10644993427,4cyclictest0-21swapper/022:17:350
1064499341,5cyclictest81rcu_preempt21:25:010
1064499341,29cyclictest32238-21ssh00:44:560
10644993411,12cyclictest991-21runrttasks20:21:050
59532331,4sleep05964-21ssh22:03:200
42912331,4sleep14321-21hddtemp_smartct00:15:171
164262331,3sleep016438-21ssh00:27:450
1064599334,4cyclictest81rcu_preempt22:11:171
1064599333,5cyclictest81rcu_preempt23:43:331
1064599333,4cyclictest81rcu_preempt22:50:051
1064599333,4cyclictest81rcu_preempt22:25:161
1064599333,4cyclictest81rcu_preempt21:51:351
10645993325,5cyclictest0-21swapper/100:08:361
1064599331,8cyclictest12789-21ls20:55:011
1064599331,4cyclictest81rcu_preempt20:38:001
1064599331,4cyclictest81rcu_preempt00:37:421
1064599331,3cyclictest81rcu_preempt22:20:051
10644993324,6cyclictest0-21swapper/023:06:560
1064499331,4cyclictest81rcu_preempt21:51:560
1064499331,30cyclictest0-21swapper/000:46:550
1064499331,20cyclictest9495-21ssh22:06:260
10644993310,10cyclictest26815-21fschecks_count00:05:160
1064599329,4cyclictest22-21ksoftirqd/121:55:291
1064599325,5cyclictest81rcu_preempt21:41:211
1064599324,4cyclictest81rcu_preempt22:16:141
1064599324,4cyclictest81rcu_preempt22:16:131
1064599324,4cyclictest81rcu_preempt00:01:201
1064599324,3cyclictest81rcu_preempt00:48:471
1064599323,4cyclictest81rcu_preempt00:53:191
10645993216,13cyclictest22-21ksoftirqd/123:01:541
1064599321,11cyclictest0-21swapper/121:27:551
10645993211,10cyclictest22-21ksoftirqd/120:40:161
1064499327,7cyclictest0-21swapper/020:53:310
1064499326,12cyclictest5074-21cat00:15:290
1064499323,4cyclictest81rcu_preempt22:46:240
10644993224,5cyclictest13165-21cron00:25:000
1064499322,15cyclictest23590-21aten_r4power_cu21:15:130
1064499322,14cyclictest0-21swapper/021:40:280
1064499321,5cyclictest0-21swapper/019:43:150
1064499321,4cyclictest81rcu_preempt20:10:120
1064499321,29cyclictest0-21swapper/023:13:350
1064499321,29cyclictest0-21swapper/021:35:350
1064499321,29cyclictest0-21swapper/020:06:360
1064499321,26cyclictest3445-21cat00:14:550
1064599317,5cyclictest40550irq/92-i91521:47:491
10645993115,4cyclictest81rcu_preempt21:10:121
1064599311,4cyclictest81rcu_preempt20:24:481
1064599311,27cyclictest0-21swapper/121:16:361
1064499318,11cyclictest3302-21runrttasks20:31:290
1064499317,12cyclictest13534-21cstates19:30:110
1064499314,4cyclictest81rcu_preempt22:57:040
10644993124,5cyclictest0-21swapper/021:01:160
166052301,5sleep10-21swapper/119:37:031
1064599308,7cyclictest2206-21dbus-daemon19:33:251
1064599302,4cyclictest81rcu_preempt22:44:061
1064599302,15cyclictest19781-21ntp_states19:45:251
1064599301,4cyclictest81rcu_preempt22:05:131
1064599301,4cyclictest81rcu_preempt20:56:341
1064499302,14cyclictest19391-21/usr/sbin/munin22:50:210
1064499302,14cyclictest1149-21df21:25:150
10644993019,7cyclictest18440-21diskmemload00:55:010
1064499301,4cyclictest81rcu_preempt21:59:050
10644993013,5cyclictest26757-21ssh23:31:030
1064499301,27cyclictest0-21swapper/020:37:560
10644993012,5cyclictest6490-21ssh23:44:280
10644993011,5cyclictest1651-21wget20:25:120
29972291,5sleep10-21swapper/120:26:201
181702291,5sleep10-21swapper/121:07:181
1064599291,8cyclictest0-21swapper/120:45:191
1064599291,4cyclictest81rcu_preempt23:36:441
1064499297,10cyclictest32037-21ls20:20:010
1064499291,4cyclictest81rcu_preempt20:48:470
10644992910,15cyclictest3302-21runrttasks21:08:230
52472281,5sleep10-21swapper/120:34:581
261972281,5sleep10-21swapper/120:03:551
223502281,5sleep10-21swapper/119:53:061
1064599283,8cyclictest28941-21iostat_ios20:10:201
1064499282,13cyclictest21751-21taskset19:50:270
10644992816,9cyclictest3-21ksoftirqd/022:10:490
1064499281,14cyclictest20441-21chrt19:47:450
1064499281,14cyclictest14199-21grep20:55:290
317702271,5sleep10-21swapper/120:18:171
10645992712,12cyclictest22-21ksoftirqd/119:55:151
1064599252,3cyclictest81rcu_preempt19:43:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional