You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 09:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Jul 01, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304189912141190,20cyclictest14739-21ntp_states20:05:251
304189911221095,23cyclictest313872sleep119:25:231
299942564518,31sleep10-21swapper/119:21:061
301832519472,31sleep00-21swapper/019:23:050
3041799172163,6cyclictest0-21swapper/020:05:240
30417998775,9cyclictest0-21swapper/019:25:240
63372590,5sleep03041799cyclictest21:10:160
144892550,2sleep014490-21rt-features21:30:260
227742460,4sleep1201rcuc/121:54:551
51692400,25sleep00-21swapper/021:05:290
3041799401,19cyclictest25026-21cron20:35:000
30417993924,5cyclictest3-21ksoftirqd/019:54:440
30417993923,6cyclictest3-21ksoftirqd/019:55:100
30417993923,5cyclictest3-21ksoftirqd/023:56:570
234362391,34sleep123500-21iostat00:50:191
30417993823,5cyclictest3-21ksoftirqd/023:25:040
30417993821,6cyclictest3-21ksoftirqd/021:58:070
48052373,3sleep081rcu_preempt19:40:150
30417993722,6cyclictest3-21ksoftirqd/023:48:560
3041799368,13cyclictest11565-21gdbus22:37:000
30417993614,5cyclictest111rcuc/020:50:010
3041799358,13cyclictest4808-21/usr/sbin/munin22:30:270
3041799358,13cyclictest4808-21/usr/sbin/munin22:30:260
3041799358,12cyclictest2012-21if_eth023:50:190
30417993521,5cyclictest3-21ksoftirqd/022:15:300
30417993519,6cyclictest3-21ksoftirqd/021:39:370
30417993518,6cyclictest3-21ksoftirqd/019:32:150
30417993518,5cyclictest3-21ksoftirqd/022:43:520
30417993418,6cyclictest3-21ksoftirqd/022:28:520
30417993418,6cyclictest3-21ksoftirqd/021:29:390
30417993418,6cyclictest3-21ksoftirqd/020:38:540
123072341,29sleep012320-21df_inode20:00:140
30417993318,5cyclictest3-21ksoftirqd/023:10:190
30417993318,5cyclictest3-21ksoftirqd/022:07:440
30417993318,5cyclictest3-21ksoftirqd/021:00:030
30417993318,5cyclictest3-21ksoftirqd/020:58:200
30417993318,5cyclictest3-21ksoftirqd/020:58:200
30417993315,6cyclictest20020-21grep21:45:240
3041799331,18cyclictest22183-21wc21:50:300
102912331,28sleep110298-21iostat_ios00:15:211
3041899327,5cyclictest308062wc20:50:011
3041899322,4cyclictest81rcu_preempt23:37:391
30417993217,5cyclictest3-21ksoftirqd/023:07:270
30417993217,5cyclictest3-21ksoftirqd/023:03:490
30417993216,6cyclictest3-21ksoftirqd/000:47:580
30417993216,5cyclictest3-21ksoftirqd/000:41:540
30417993215,6cyclictest3-21ksoftirqd/023:40:000
30417993215,6cyclictest3-21ksoftirqd/021:41:390
280692321,4sleep028093-21munin-run23:35:000
256802323,4sleep181rcu_preempt22:00:271
226922320,2sleep022690-21tr23:20:110
3041899316,10cyclictest81rcu_preempt22:36:291
3041899314,24cyclictest23207-21iostat_ios23:20:201
3041899312,15cyclictest19044-21idleruntime-cro21:45:001
30418993117,8cyclictest8159-21iostat_ios22:40:191
30417993117,5cyclictest3-21ksoftirqd/020:10:410
30417993116,5cyclictest3-21ksoftirqd/022:51:520
198572311,3sleep019952-21cut20:20:160
3041899305,4cyclictest81rcu_preempt23:40:581
3041899304,4cyclictest81rcu_preempt22:48:421
3041899303,20cyclictest29197-21iostat_ios22:10:201
3041899302,4cyclictest81rcu_preempt00:47:231
3041899301,5cyclictest81rcu_preempt23:27:231
3041899301,4cyclictest81rcu_preempt00:11:591
3041899301,16cyclictest1435-21/usr/sbin/munin23:50:191
3041799305,4cyclictest40250irq/92-i91522:55:290
3041799302,23cyclictest31123-21df20:50:130
30417993016,4cyclictest3-21ksoftirqd/000:25:310
30417993015,5cyclictest3-21ksoftirqd/022:03:030
30417993015,5cyclictest3-21ksoftirqd/020:25:520
30417993015,5cyclictest3-21ksoftirqd/000:21:240
30417993010,6cyclictest3-21ksoftirqd/019:39:060
266462301,24sleep126655-21df_inode23:30:151
248162301,5sleep10-21swapper/120:32:571
246542301,5sleep10-21swapper/121:59:591
203722301,5sleep10-21swapper/123:13:121
159482301,4sleep115952-21irqstats00:30:211
81112291,5sleep00-21swapper/000:10:110
66672291,5sleep00-21swapper/000:01:130
66672291,5sleep00-21swapper/000:01:120
317882291,5sleep00-21swapper/023:44:220
3041899299,7cyclictest20517-21mailstats20:20:281
3041899294,18cyclictest26016-21ntp_states20:35:251
30418992919,6cyclictest3436-21pidof22:28:011
30418992916,7cyclictest14739-21users00:25:311
3041899291,5cyclictest81rcu_preempt21:14:201
3041899291,4cyclictest81rcu_preempt20:40:311
3041899291,4cyclictest81rcu_preempt00:02:081
3041899291,4cyclictest81rcu_preempt00:02:071
3041899291,14cyclictest12677-21taskset22:51:231
30417992919,6cyclictest10298-21seq21:20:170
30417992915,4cyclictest3-21ksoftirqd/000:52:060
30417992915,4cyclictest3-21ksoftirqd/000:37:340
30417992914,5cyclictest3-21ksoftirqd/022:14:520
30417992913,5cyclictest3-21ksoftirqd/019:48:290
30417992910,6cyclictest28936-21cat20:45:010
120302291,4sleep10-21swapper/120:00:111
92192281,4sleep10-21swapper/121:15:571
42102281,5sleep10-21swapper/119:38:511
37732281,5sleep10-21swapper/121:02:501
317672281,5sleep10-21swapper/122:15:371
3041899285,4cyclictest81rcu_preempt21:46:121
3041899285,4cyclictest81rcu_preempt19:48:191
3041899284,8cyclictest4447-21diskstats21:05:171
3041899284,4cyclictest81rcu_preempt00:38:021
3041899283,4cyclictest81rcu_preempt23:15:081
3041899283,4cyclictest81rcu_preempt22:32:201
3041899283,4cyclictest81rcu_preempt22:32:191
3041899283,3cyclictest81rcu_preempt23:56:111
3041899281,4cyclictest81rcu_preempt21:23:521
3041899281,3cyclictest81rcu_preempt19:56:511
30418992813,10cyclictest17151-21turbostat21:40:001
3041899281,23cyclictest17173-21cpuspeed_turbos23:05:121
3041899281,15cyclictest547-21df_inode20:55:141
3041899281,15cyclictest547-21df_inode20:55:141
3041799282,14cyclictest21313-21irqstats23:15:220
3041799281,6cyclictest11161-21cron22:50:000
30417992812,12cyclictest11565-21gdbus21:15:130
282922281,5sleep10-21swapper/122:08:331
20972281,5sleep10-21swapper/119:32:261
204342281,5sleep10-21swapper/100:40:571
192302281,5sleep00-21swapper/020:18:320
191292281,5sleep10-21swapper/120:17:281
132912281,5sleep10-21swapper/100:24:521
12352281,5sleep10-21swapper/122:20:551
12132281,5sleep10-21swapper/123:49:261
322882271,5sleep10-21swapper/120:52:141
3041899277,16cyclictest0-21swapper/119:40:121
3041899273,8cyclictest14154-21iostat_ios21:30:211
3041899272,9cyclictest22693-21users20:25:301
30418992710,4cyclictest40250irq/92-i91519:50:221
30417992712,5cyclictest3-21ksoftirqd/000:16:380
12342271,5sleep00-21swapper/022:20:550
3041899265,4cyclictest81rcu_preempt23:02:081
3041899263,4cyclictest81rcu_preempt20:14:261
3041899262,10cyclictest12366-21memory21:25:201
145602261,5sleep10-21swapper/122:56:281
73742251,4sleep10-21swapper/100:07:021
3041799254,18cyclictest16525-21sed00:30:300
3041799241,15cyclictest0-21swapper/000:05:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional