You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 03:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Jul 20, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
193989912611232,25cyclictest21375-21latency_hist19:30:001
190572710611,32sleep00-21swapper/019:21:590
191102506405,30sleep10-21swapper/119:22:331
1939799263194,42cyclictest21376-21latency_hist19:30:010
222502780,7sleep01939799cyclictest20:55:190
238172580,7sleep11939899cyclictest22:25:181
157282450,5sleep015729-21aten_r4power_en22:05:130
44032381,32sleep04404-21munin-node21:35:120
1939799383,4cyclictest81rcu_preempt23:26:110
1939899372,14cyclictest300622sed22:40:291
1939899366,12cyclictest3286-21runrttasks21:39:041
19398993626,6cyclictest8045-21/usr/sbin/munin00:35:201
1939799361,13cyclictest26654-21awk21:05:310
1939899354,13cyclictest3286-21runrttasks23:51:251
139242351,30sleep113959-21ntp_states00:50:231
1939799341,21cyclictest32140-21python21:20:340
162122340,9sleep01939799cyclictest20:40:120
143942341,29sleep114414-21iostat_ios22:00:191
97372331,28sleep09832-21hddtemp_smartct00:40:170
7352332,5sleep1756-21iostat_ios22:50:181
1939899338,5cyclictest81rcu_preempt20:21:481
19397993315,5cyclictest15112-21wc20:35:280
131642331,4sleep013265-21mailstats20:30:270
194132321,27sleep019575-21perl23:40:170
1939899326,5cyclictest81rcu_preempt00:05:321
19398993223,5cyclictest15698-21/usr/sbin/munin22:05:291
1939799322,17cyclictest0-21swapper/022:15:240
19397993216,5cyclictest3-21ksoftirqd/022:45:570
19397993214,5cyclictest3162-21df20:05:180
1939799321,12cyclictest3013-21unixbench_multi00:20:290
266192311,5sleep10-21swapper/100:00:031
25642310,9sleep11939899cyclictest00:20:241
232312311,5sleep10-21swapper/120:58:151
1939899315,4cyclictest81rcu_preempt23:47:221
19398993122,5cyclictest1527-21cron00:20:011
19398993117,11cyclictest31936-21unixbench_multi22:45:291
19398993117,10cyclictest22-21ksoftirqd/123:20:251
1939799313,5cyclictest81rcu_preempt20:25:180
1939799313,4cyclictest81rcu_preempt21:11:200
19397993123,5cyclictest7641-21cron23:10:000
1939799311,4cyclictest81rcu_preempt19:42:180
19397993112,6cyclictest28163-21perl19:45:140
19397993110,7cyclictest19113-21grep20:45:260
1939799310,4cyclictest81rcu_preempt00:12:500
74932301,5sleep10-21swapper/123:08:281
308072301,5sleep10-21swapper/121:18:461
265192301,5sleep10-21swapper/122:31:591
251762301,5sleep10-21swapper/121:03:501
211422301,5sleep10-21swapper/122:19:491
1939899309,8cyclictest10407-21/usr/sbin/munin20:25:231
1939899305,4cyclictest81rcu_preempt22:36:331
1939899305,4cyclictest81rcu_preempt00:10:081
19398993020,6cyclictest4168-21tr23:00:121
1939899301,4cyclictest40250irq/92-i91521:20:121
19398993012,5cyclictest3286-21runrttasks19:34:401
19398993011,4cyclictest81rcu_preempt00:45:131
19398993011,15cyclictest53372chrt00:29:171
1939799302,4cyclictest81rcu_preempt22:24:160
1939799302,13cyclictest17799-21iostat23:35:200
1939799301,4cyclictest81rcu_preempt22:53:160
19397993013,6cyclictest3-21ksoftirqd/021:50:200
19397993013,5cyclictest29461-21iostat22:40:190
19397993011,6cyclictest24054-21perl21:00:190
1939799301,14cyclictest12523-21grep23:20:270
19397993010,15cyclictest136652chrt00:50:170
149942301,25sleep115046-21ps20:35:261
115342301,5sleep10-21swapper/121:52:431
81632291,5sleep10-21swapper/121:45:051
75812291,5sleep00-21swapper/021:40:340
45652291,5sleep10-21swapper/120:09:451
39822291,5sleep00-21swapper/021:32:210
308292291,5sleep00-21swapper/021:18:590
269332291,5sleep00-21swapper/000:00:180
252502291,5sleep10-21swapper/119:35:591
1939899295,4cyclictest81rcu_preempt20:30:441
1939899292,11cyclictest20374-21users23:40:321
1939899291,9cyclictest13944-21perl23:25:171
1939899291,4cyclictest81rcu_preempt23:17:211
1939899291,4cyclictest81rcu_preempt19:48:211
1939799299,6cyclictest25547-21grep23:55:230
1939799299,6cyclictest25434-21fschecks_count22:30:170
1939799298,10cyclictest0-21swapper/021:56:470
1939799292,23cyclictest29811-21seq00:05:470
19397992914,5cyclictest3-21ksoftirqd/000:26:160
19397992913,5cyclictest3-21ksoftirqd/020:23:400
19397992912,5cyclictest11534-21df_inode00:45:130
1939799291,24cyclictest7946-21taskset20:15:530
1939799291,18cyclictest18955-21taskset22:11:390
1939799291,15cyclictest2769-21memory22:55:220
19397992911,5cyclictest0-21swapper/021:45:180
19397992910,6cyclictest7539-21/usr/sbin/munin00:35:100
11852291,5sleep00-21swapper/000:16:380
91782281,5sleep10-21swapper/123:11:311
5422281,5sleep00-21swapper/019:58:220
312852281,5sleep10-21swapper/119:55:011
268602281,5sleep10-21swapper/121:06:511
260712281,5sleep10-21swapper/123:56:061
228952281,5sleep10-21swapper/122:23:171
215102281,5sleep00-21swapper/020:54:530
19602281,5sleep10-21swapper/121:27:011
1939899286,7cyclictest2225-21dbus-daemon22:59:401
1939899286,4cyclictest81rcu_preempt20:41:401
1939899285,4cyclictest81rcu_preempt21:30:241
1939899285,4cyclictest81rcu_preempt00:33:571
1939899285,4cyclictest81rcu_preempt00:33:571
1939899284,17cyclictest20112-21diskstats20:50:161
1939899281,9cyclictest15334-21/usr/sbin/munin23:30:291
1939899281,7cyclictest2135-21grep20:00:281
1939799289,6cyclictest10609-21ps23:15:260
1939799284,18cyclictest27271-21diskstats22:35:140
1939799283,5cyclictest14535-21wc22:00:210
19397992813,5cyclictest3-21ksoftirqd/023:51:250
19397992813,5cyclictest3-21ksoftirqd/023:13:360
19397992812,6cyclictest3-21ksoftirqd/000:32:440
19397992812,6cyclictest3-21ksoftirqd/000:32:440
1939799281,15cyclictest16472-21/usr/sbin/munin23:30:290
1939799281,14cyclictest23667-21/usr/sbin/munin22:25:150
134492281,5sleep10-21swapper/121:58:031
273352271,5sleep10-21swapper/121:10:071
1939899273,8cyclictest18063-21hddtemp_smartct22:10:171
1939899273,3cyclictest81rcu_preempt00:41:111
1939899272,13cyclictest81rcu_preempt20:45:211
19398992720,5cyclictest22-21ksoftirqd/119:40:291
1939899271,14cyclictest6020-21awk20:10:301
1939799271,17cyclictest0-21swapper/021:25:240
1939799271,14cyclictest21642-21latency23:45:220
1939799271,13cyclictest31140-21taskset19:53:280
1939799271,13cyclictest24592-21latency19:35:220
187782271,5sleep10-21swapper/123:38:351
1939899262,4cyclictest81rcu_preempt20:18:231
1939899261,4cyclictest81rcu_preempt19:53:231
1939799263,16cyclictest21698-21python19:30:020
1939799261,13cyclictest1450-21if_eth020:00:170
1939899259,5cyclictest40250irq/92-i91521:40:161
1939799247,5cyclictest4755-21taskset20:10:080
1939799241,14cyclictest0-21swapper/023:00:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional