You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 06:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Apr 03, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151319912941230,59cyclictest15870-21irqstats19:25:200
151329911451109,32cyclictest2645-21snmpd19:25:191
138642657609,32sleep10-21swapper/119:20:181
142012544497,31sleep00-21swapper/019:20:250
223142790,2sleep122315-21sh23:55:291
256362730,6sleep0111rcuc/022:52:240
265302650,2sleep026531-21expr00:00:230
279582590,2sleep00-21swapper/000:35:220
72212500,7sleep01513199cyclictest00:14:320
314852440,8sleep10-21swapper/121:51:051
148572430,4sleep1211ktimersoftd/123:15:111
220242401,3sleep022034-21ssh23:22:020
1513299407,5cyclictest81rcu_preempt22:50:041
109732391,34sleep010987-21ssh00:18:020
89162380,2sleep08917-21sh22:35:180
15132993829,5cyclictest0-21swapper/122:28:561
1513199384,19cyclictest11964-21iostat_ios23:45:220
4222370,5sleep1211ktimersoftd/100:40:241
66272361,31sleep06641-21ssh21:59:580
66272361,31sleep06641-21ssh21:59:580
240502362,4sleep124121-21memory19:45:201
202492361,31sleep019661-21/usr/sbin/munin19:35:190
172452361,4sleep017276-21iostat_ios22:10:200
1513299366,4cyclictest81rcu_preempt00:50:191
1513299364,4cyclictest81rcu_preempt21:40:281
15132993613,10cyclictest26046-21wc21:45:281
1513199364,28cyclictest2309-21cron00:29:590
15131993622,4cyclictest3-21ksoftirqd/021:21:480
1513199361,18cyclictest21613-21cpuspeed_turbos22:15:120
6402350,8sleep11513299cyclictest00:07:071
317492351,4sleep131787-21ntp_states20:05:241
1513299356,8cyclictest2206-21dbus-daemon20:10:291
1513299356,5cyclictest81rcu_preempt23:05:141
1513299356,17cyclictest0-21swapper/121:14:381
1513299354,28cyclictest22943-21diskmemload22:16:151
15132993527,6cyclictest0-21swapper/120:02:161
1513299352,29cyclictest0-21swapper/100:37:351
1513199358,14cyclictest19514-21turbostat19:35:000
1513199352,4cyclictest0-21swapper/023:25:150
183652340,7sleep10-21swapper/122:45:151
162772341,29sleep016359-21ls21:35:280
1513299347,23cyclictest0-21swapper/122:40:491
1513299344,4cyclictest81rcu_preempt22:37:501
1513299344,4cyclictest81rcu_preempt00:27:451
1513299344,27cyclictest1968-21lldpad00:11:061
1513299343,4cyclictest81rcu_preempt22:10:591
1513299341,4cyclictest30596-21ssh22:57:361
1513299341,30cyclictest0-21swapper/120:50:161
1513299341,29cyclictest26588-21diskstats22:20:151
1513199343,28cyclictest0-21swapper/022:06:370
15131993423,6cyclictest2309-21cron23:19:590
1513199341,30cyclictest5456-21tune2fs23:05:160
1513199341,29cyclictest9463-21ssh22:02:010
1513199341,29cyclictest0-21swapper/021:54:360
124272341,4sleep012437-21ssh00:54:220
103632341,4sleep110520-21ssh21:30:121
34942330,5sleep0111rcuc/023:36:050
1513299333,4cyclictest81rcu_preempt23:28:161
1513299333,4cyclictest81rcu_preempt23:23:001
1513299333,4cyclictest81rcu_preempt23:02:591
1513299333,4cyclictest81rcu_preempt21:21:031
1513299333,26cyclictest6843-21tune2fs23:40:151
1513299332,4cyclictest81rcu_preempt22:30:201
15132993322,7cyclictest21390-21munin-run19:40:001
1513299331,5cyclictest81rcu_preempt19:58:211
1513299331,4cyclictest25687-21fschecks_count19:50:161
1513299331,30cyclictest0-21swapper/100:34:551
1513299331,28cyclictest8804-21ssh21:28:151
1513299331,10cyclictest16944-21grep23:50:221
1513199338,22cyclictest0-21swapper/023:43:450
1513199338,12cyclictest16242-21cpu23:50:110
1513199337,23cyclictest0-21swapper/023:01:450
1513199332,28cyclictest0-21swapper/022:32:370
1513199331,29cyclictest14723-21ssh22:40:350
1513199331,27cyclictest30569-21ssh22:57:330
1513199331,18cyclictest30855-21ssh00:05:140
15131993311,10cyclictest0-21swapper/022:45:300
109632331,4sleep010973-21irqstats21:30:210
107812331,28sleep010813-21ntp_states23:10:250
1513299323,4cyclictest81rcu_preempt23:14:161
1513299323,4cyclictest81rcu_preempt00:47:511
15132993223,5cyclictest11668-21sendmail-msp20:40:011
15132993218,4cyclictest22-21ksoftirqd/123:47:511
15132993213,6cyclictest0-21swapper/122:05:201
1513299321,29cyclictest0-21swapper/121:56:161
1513299321,29cyclictest0-21swapper/121:56:151
1513199327,5cyclictest81rcu_preempt21:45:220
1513199327,21cyclictest0-21swapper/000:32:310
15131993223,5cyclictest2309-21cron21:20:000
1513199321,4cyclictest81rcu_preempt22:27:130
1513199321,4cyclictest81rcu_preempt21:40:130
15131993213,7cyclictest0-21swapper/020:00:170
1513199321,29cyclictest0-21swapper/019:40:550
1513199321,17cyclictest16668-21wc20:50:270
1513199320,4cyclictest81rcu_preempt22:22:050
249582311,4sleep081rcu_preempt21:10:560
24342311,5sleep00-21swapper/000:42:380
222312311,4sleep021218-21/usr/sbin/munin21:05:290
1513299312,4cyclictest81rcu_preempt00:01:131
1513299311,4cyclictest81rcu_preempt20:33:191
1513299311,4cyclictest81rcu_preempt00:17:501
1513299311,27cyclictest0-21swapper/123:31:371
1513199313,4cyclictest81rcu_preempt00:48:390
1513199312,14cyclictest21826-21grep23:55:230
1513199311,4cyclictest81rcu_preempt00:21:580
1513299309,6cyclictest2206-21dbus-daemon21:06:141
1513299304,5cyclictest81rcu_preempt21:16:201
1513299304,4cyclictest40550irq/92-i91520:25:211
1513299304,3cyclictest81rcu_preempt00:20:241
1513299302,4cyclictest81rcu_preempt23:35:111
15132993023,5cyclictest0-21swapper/119:40:361
1513299301,6cyclictest81rcu_preempt20:21:341
1513299301,4cyclictest81rcu_preempt22:03:081
15132993013,6cyclictest22-21ksoftirqd/121:35:471
1513299301,27cyclictest0-21swapper/120:45:151
15131993023,5cyclictest0-21swapper/020:11:350
1513199302,17cyclictest0-21swapper/020:20:090
1513199302,14cyclictest8317-21df20:30:120
1513199302,13cyclictest19933-21iostat_ios21:00:190
1513199301,4cyclictest81rcu_preempt20:55:130
15131993013,13cyclictest0-21swapper/021:29:370
1513199301,27cyclictest0-21swapper/023:31:560
1513199301,13cyclictest14666-21sendmail_mailtr20:45:260
77512291,5sleep00-21swapper/020:28:460
249882291,5sleep00-21swapper/019:48:220
15132992924,3cyclictest0-21swapper/120:58:551
1513199293,13cyclictest25603-21df_inode19:50:140
1513199291,15cyclictest32036-21/usr/sbin/munin20:05:280
131102291,5sleep00-21swapper/020:40:430
37182281,5sleep10-21swapper/120:16:031
208432281,5sleep10-21swapper/121:02:531
193292281,5sleep10-21swapper/119:33:161
1513199289,6cyclictest27577-21tune2fs19:55:150
1513199282,13cyclictest10743-21ntp_states20:35:240
1513199273,17cyclictest2586-21diskstats20:15:150
133672251,5sleep10-21swapper/120:43:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional