You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 17:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Apr 25, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
93949912011191,7cyclictest0-21swapper/107:25:131
93949911201109,7cyclictest3685-21iostat_ios09:30:211
79702663606,34sleep00-21swapper/007:20:180
90212580498,41sleep10-21swapper/107:21:391
939399149129,3cyclictest0-21swapper/007:25:120
1294321270,9sleep0939399cyclictest07:30:250
210732970,7sleep0939399cyclictest07:50:300
171882920,2sleep00-21swapper/012:15:240
308232850,10sleep0939399cyclictest10:00:510
67142830,3sleep16715-21sensors12:40:271
259672750,5sleep0111rcuc/009:55:290
48672740,4sleep0111rcuc/008:35:160
209032740,4sleep0111rcuc/009:13:250
13162740,3sleep11314-21ssh10:05:121
9393996847,16cyclictest0-21swapper/009:30:200
171922680,5sleep1201rcuc/111:38:261
284362460,7sleep1939499cyclictest11:50:311
9393993919,7cyclictest15075-21grep10:20:270
162442390,3sleep10-21swapper/110:21:521
117272390,2sleep011726-21/usr/sbin/munin09:40:120
939499383,23cyclictest0-21swapper/110:03:461
265142381,34sleep126524-21ssh11:49:391
9394993719,4cyclictest22-21ksoftirqd/111:30:091
939399371,7cyclictest25591-21wget08:05:130
123282371,3sleep012334-21ssh12:47:100
9393993612,6cyclictest23147-21ssh09:52:400
78452360,9sleep0939399cyclictest11:27:100
204252361,31sleep120432-21ssh11:41:331
17152361,4sleep117444-21diskmemload11:57:571
939499352,10cyclictest17491-21users09:45:291
939399353,16cyclictest31950-21iostat10:40:200
939399353,16cyclictest31950-21iostat10:40:190
9393993510,7cyclictest0-21swapper/009:15:230
244752350,2sleep124474-21proc_pri08:00:261
939499342,10cyclictest29214-21ssh10:36:551
939499341,11cyclictest316852grep10:40:171
939499341,11cyclictest316852grep10:40:161
939399347,13cyclictest0-21swapper/007:58:310
939399346,13cyclictest11565-21gdbus12:04:440
939399343,16cyclictest22045-21users12:20:300
939399342,20cyclictest16733-21iostat09:45:180
3952341,29sleep0401-21ssh12:34:140
138362341,5sleep00-21swapper/012:11:150
939499335,4cyclictest81rcu_preempt12:46:191
939499335,17cyclictest0-21swapper/109:28:061
939499333,4cyclictest81rcu_preempt10:10:081
939499332,9cyclictest0-21swapper/112:20:191
9394993322,6cyclictest6337-21wget08:40:111
939499331,9cyclictest6755-21unixbench_multi11:25:291
939499331,9cyclictest31448-21ssh12:31:481
9394993319,4cyclictest22-21ksoftirqd/112:02:461
939499331,16cyclictest9683-21ssh10:15:041
939399337,13cyclictest28269-21unixbench_multi10:35:300
939399336,4cyclictest81rcu_preempt11:50:170
939399335,4cyclictest81rcu_preempt10:05:220
939399333,16cyclictest3367-21ntp_states08:30:250
939399332,15cyclictest24105-21hddtemp_smartct08:00:180
9393993313,6cyclictest1824-21irqstats12:35:230
263032331,5sleep126313-21ssh11:10:351
243462331,28sleep124356-21ssh09:16:491
939499326,12cyclictest81rcu_preempt09:10:241
939499322,15cyclictest0-21swapper/111:04:321
939499321,14cyclictest22-21ksoftirqd/111:17:151
939399327,5cyclictest81rcu_preempt10:30:210
939399323,4cyclictest81rcu_preempt09:35:280
9393993222,6cyclictest6503-21ssh12:40:240
939399321,4cyclictest31501-21ssh11:17:040
212652321,27sleep121359-21ntp_kernel_err09:50:271
180942321,5sleep00-21swapper/010:25:010
939499316,4cyclictest81rcu_preempt07:55:171
939499315,4cyclictest81rcu_preempt12:38:531
939499315,23cyclictest0-21swapper/110:31:571
939399312,15cyclictest6446-21ntp_states10:10:240
939399312,15cyclictest19156-21/usr/sbin/munin11:40:220
939399312,15cyclictest16445-21/usr/sbin/munin11:00:130
939399311,9cyclictest10513-21ssh11:30:210
9393993116,8cyclictest20833-21diskstats11:05:160
9393993112,6cyclictest18139-21ssh12:54:440
9393993112,6cyclictest14741-21iostat_ios11:35:200
939399311,19cyclictest11627-21taskset08:53:210
939399311,18cyclictest9522-21pidof08:46:000
9393993110,6cyclictest0-21swapper/009:23:370
271902311,26sleep127237-21latency_hist08:10:011
103122311,5sleep10-21swapper/110:52:451
939499303,4cyclictest81rcu_preempt12:11:431
939499302,16cyclictest0-21swapper/112:15:401
939499302,16cyclictest0-21swapper/109:44:061
9394993016,8cyclictest20433-21iostat_ios07:50:211
939499301,4cyclictest81rcu_preempt11:24:531
939499301,16cyclictest8487-21sensors_temp09:35:271
939499301,10cyclictest0-21swapper/107:40:251
939399307,12cyclictest81rcu_preempt09:29:450
939399307,12cyclictest0-21swapper/011:47:430
939399304,3cyclictest81rcu_preempt10:46:560
939399302,15cyclictest31738-21irqstats08:20:220
939399302,14cyclictest8744-21/usr/sbin/munin12:05:270
939399302,14cyclictest2786-21ssh11:21:000
939399302,14cyclictest26375-21users12:25:310
9393993012,6cyclictest16319-21iostat_ios09:05:210
9393993011,6cyclictest16188-21diskstats07:40:150
939399301,14cyclictest10697-21ssh10:15:250
9393993010,4cyclictest81rcu_preempt11:13:030
321042300,22sleep03-21ksoftirqd/011:55:240
18652301,5sleep10-21swapper/108:25:511
939499299,15cyclictest14358-21rm10:57:171
939499297,18cyclictest0-21swapper/110:48:241
939499294,4cyclictest81rcu_preempt12:29:061
939499291,8cyclictest15403-21ssh12:50:361
939499291,23cyclictest21330-21ssh10:28:111
9394992910,14cyclictest25615-21missed_timers09:55:251
939399292,15cyclictest0-21swapper/007:45:580
939399292,14cyclictest12158-21df10:55:130
939399292,13cyclictest8344-21/usr/sbin/munin10:50:210
939399292,13cyclictest0-21swapper/008:27:530
76942291,5sleep00-21swapper/008:41:340
306622291,5sleep00-21swapper/008:17:020
282362291,24sleep128244-21rm09:20:531
939499285,4cyclictest81rcu_preempt07:37:201
939499284,4cyclictest81rcu_preempt08:48:011
939499284,18cyclictest5101-21memory08:35:221
939499281,4cyclictest81rcu_preempt08:15:131
939499281,15cyclictest19333-21updatedb.mlocat07:46:421
939399281,4cyclictest81rcu_preempt09:01:570
939399281,14cyclictest13975-21apt-config07:35:020
290332281,5sleep00-21swapper/008:14:390
939499274,4cyclictest81rcu_preempt08:50:071
939499272,22cyclictest0-21swapper/111:05:191
939499272,11cyclictest14444-21irqstats09:00:201
939499271,6cyclictest0-21swapper/108:55:191
9394992712,12cyclictest12482-21sort07:30:161
939399272,12cyclictest12477-21/usr/sbin/munin08:55:190
38432271,4sleep10-21swapper/108:30:461
326702271,5sleep10-21swapper/108:23:141
289242271,5sleep10-21swapper/108:13:331
76052261,22sleep17615-21ssh12:05:091
171752261,4sleep10-21swapper/109:07:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional