You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Mar 28, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195889911741165,6cyclictest0-21swapper/119:27:291
195879911271103,6cyclictest0-21swapper/019:27:000
192972521472,35sleep00-21swapper/019:22:310
191772509417,29sleep10-21swapper/119:21:161
40402960,3sleep10-21swapper/120:05:271
107292860,8sleep01958799cyclictest23:05:300
182572840,8sleep01958799cyclictest21:33:300
1958799501,17cyclictest9377-21fschecks_time00:45:150
258362440,8sleep01958799cyclictest00:28:460
247332420,8sleep11958899cyclictest21:00:281
259002410,9sleep11958899cyclictest23:55:151
19588994113,6cyclictest22-21ksoftirqd/100:12:491
152962410,25sleep03-21ksoftirqd/020:35:260
1958799406,31cyclictest0-21swapper/023:39:550
1958799401,5cyclictest81rcu_preempt22:52:090
8942390,4sleep1211ktimersoftd/120:00:001
242082381,3sleep024222-21ssh22:13:010
203692381,4sleep020383-21ssh00:22:510
1958899389,4cyclictest81rcu_preempt22:25:121
19587993822,6cyclictest3-21ksoftirqd/021:49:160
1958899377,4cyclictest81rcu_preempt21:45:141
1958899376,27cyclictest0-21swapper/123:41:361
19588993728,5cyclictest4342-21ssh00:05:351
1958899372,31cyclictest5593-21hddtemp_smartct21:20:161
19587993717,8cyclictest3-21ksoftirqd/000:40:240
19587993712,13cyclictest21762-21diskstats19:30:020
1958899363,31cyclictest0-21swapper/119:46:151
1958899361,6cyclictest8363-21cut22:30:161
19588993616,8cyclictest22-21ksoftirqd/121:50:291
1958899361,16cyclictest218782switchtime23:50:281
1958799369,6cyclictest206342processes21:35:260
19587993618,6cyclictest3-21ksoftirqd/021:10:170
19587993611,12cyclictest30702-21grep00:00:160
1958899357,4cyclictest81rcu_preempt21:38:151
1958899355,5cyclictest81rcu_preempt21:10:321
1958899355,4cyclictest81rcu_preempt22:48:181
1958899355,4cyclictest81rcu_preempt22:19:131
1958899354,4cyclictest81rcu_preempt23:25:311
1958899354,3cyclictest0-21swapper/121:43:351
1958899352,29cyclictest0-21swapper/100:42:161
144482351,5sleep114473-21munin-plugin-st21:29:591
93012341,29sleep027384-21diskmemload21:24:320
1958899345,4cyclictest81rcu_preempt23:16:251
1958899343,5cyclictest81rcu_preempt23:45:351
1958899342,5cyclictest81rcu_preempt22:35:021
1958899341,5cyclictest2403-21irqbalance00:21:351
1958899341,4cyclictest81rcu_preempt23:12:131
1958799343,5cyclictest0-21swapper/023:25:160
19587993426,6cyclictest0-21swapper/020:02:160
19587993425,5cyclictest2309-21cron22:39:590
19587993417,5cyclictest20272-21python23:15:280
19587993413,5cyclictest20960-21df23:50:140
1958799341,21cyclictest8838-21ssh23:04:320
19587993411,10cyclictest0-21swapper/023:42:100
113632341,29sleep111373-21ssh00:47:111
241362330,2sleep024137-21fschecks_count21:00:160
1958899337,5cyclictest81rcu_preempt00:50:121
1958899335,25cyclictest22-21ksoftirqd/122:03:001
1958899334,4cyclictest81rcu_preempt22:05:411
1958899333,4cyclictest81rcu_preempt23:24:161
1958899332,4cyclictest81rcu_preempt22:20:301
1958899332,28cyclictest0-21swapper/122:42:551
1958899332,28cyclictest0-21swapper/122:10:551
1958899331,9cyclictest22-21ksoftirqd/121:31:211
1958899331,5cyclictest0-21swapper/100:01:361
1958899331,28cyclictest16738-21ssh00:19:351
19588993312,17cyclictest0-21swapper/100:25:251
1958799336,4cyclictest81rcu_preempt00:14:030
1958799335,15cyclictest0-21swapper/019:46:200
1958799333,4cyclictest81rcu_preempt21:17:200
19587993319,10cyclictest0-21swapper/022:20:360
19587993317,5cyclictest3-21ksoftirqd/021:40:200
19587993312,5cyclictest3-21ksoftirqd/022:01:540
131512331,28sleep013195-21wc00:15:200
1958899325,5cyclictest81rcu_preempt22:50:261
19588993215,7cyclictest22-21ksoftirqd/121:00:001
1958899321,4cyclictest81rcu_preempt19:41:211
1958899321,28cyclictest6819-21ssh23:01:361
1958799329,11cyclictest32218-21aten_r4power_vo22:55:140
1958799327,14cyclictest0-21swapper/022:15:370
1958799324,5cyclictest81rcu_preempt22:45:170
1958799323,4cyclictest81rcu_preempt22:25:260
19587993217,5cyclictest3-21ksoftirqd/020:25:580
1958799321,4cyclictest81rcu_preempt23:30:390
1958799321,4cyclictest81rcu_preempt22:07:210
1958799321,27cyclictest5969-21ssh00:07:570
1958799321,11cyclictest9352-21tail22:30:300
175752321,5sleep00-21swapper/022:40:070
79572311,3sleep18004-21ssh21:55:301
232852311,5sleep00-21swapper/020:56:410
1958899318,12cyclictest40550irq/92-i91522:57:001
1958899316,4cyclictest81rcu_preempt21:15:371
1958899316,4cyclictest81rcu_preempt20:15:421
1958899312,4cyclictest81rcu_preempt23:37:471
1958899311,4cyclictest81rcu_preempt20:49:341
1958899311,4cyclictest81rcu_preempt19:54:121
1958899311,4cyclictest81rcu_preempt00:30:121
1958899311,17cyclictest6705-21latency_hist20:15:011
1958799313,16cyclictest0-21swapper/000:53:080
1958799312,12cyclictest0-21swapper/021:50:200
1958799311,4cyclictest81rcu_preempt23:14:480
1958799311,4cyclictest81rcu_preempt21:57:270
19587993114,6cyclictest3-21ksoftirqd/020:33:200
1958799311,28cyclictest0-21swapper/023:59:560
1958799311,28cyclictest0-21swapper/000:33:280
1958799311,17cyclictest16585-21sh23:45:220
179722311,3sleep00-21swapper/020:45:000
107122311,26sleep010811-21awk21:25:230
49962300,3sleep04991-21wget20:10:110
1958899306,10cyclictest10393-21ntp_states23:05:261
1958899304,4cyclictest81rcu_preempt21:08:551
19588993016,4cyclictest81rcu_preempt20:00:281
1958899301,4cyclictest81rcu_preempt23:32:161
1958899301,4cyclictest81rcu_preempt20:42:461
1958799302,16cyclictest0-21swapper/021:05:220
1958799302,15cyclictest32670-21/usr/sbin/munin00:35:230
1958799301,27cyclictest0-21swapper/023:20:350
1958799301,27cyclictest0-21swapper/020:20:560
19587993012,5cyclictest32143-21hddtemp_smartct19:55:180
19587993011,6cyclictest20616-21iostat_ios20:50:190
85182291,5sleep00-21swapper/020:19:370
214362291,5sleep10-21swapper/120:51:571
1958899294,3cyclictest81rcu_preempt00:35:481
1958899292,23cyclictest12649-21/usr/sbin/munin20:30:111
19588992921,4cyclictest15607-21chrt20:35:301
1958799293,13cyclictest30263-21hddtemp_smartct19:50:170
1958799293,13cyclictest24410-21df_inode19:35:140
1958799291,17cyclictest19817-21runrttasks20:49:370
122442291,5sleep10-21swapper/120:29:091
1958799281,15cyclictest4476-21taskset20:06:360
1958899274,13cyclictest0-21swapper/120:22:221
1958899273,15cyclictest0-21swapper/119:36:501
1958799271,14cyclictest27409-21runrttasks19:41:420
237742251,5sleep10-21swapper/119:33:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional