You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 06:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Tue May 26, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
76369912361201,24cyclictest0-21swapper/019:28:320
73032604501,87sleep00-21swapper/019:22:030
71682512463,33sleep10-21swapper/119:20:391
395621150,7sleep0763699cyclictest22:05:100
202522750,5sleep0111rcuc/022:45:300
7637995952,4cyclictest0-21swapper/119:28:321
173922580,2sleep017393-21cat22:40:130
65302480,6sleep06532-21fschecks_count20:45:160
105362481,35sleep110583-21ls20:55:211
105362481,35sleep110583-21ls20:55:201
249422460,9sleep1763799cyclictest21:35:011
172102450,4sleep041ktimersoftd/000:05:160
763699351,22cyclictest7872-21cpuspeed_turbos22:15:120
763699351,22cyclictest7872-21cpuspeed_turbos22:15:110
226902341,4sleep122697-21df_inode00:20:151
7637993324,6cyclictest31542-21pidof00:44:001
7637993323,6cyclictest11192-21/usr/sbin/munin23:50:111
763699338,13cyclictest31310-21taskset00:41:350
44012331,28sleep14433-21hddtemp_smartct22:05:171
763799321,4cyclictest81rcu_preempt21:55:281
763799321,18cyclictest26380-21grep20:10:281
763799321,12cyclictest65312tune2fs20:45:161
763699325,5cyclictest81rcu_preempt21:00:270
763699325,15cyclictest0-21swapper/023:08:140
763699324,4cyclictest81rcu_preempt22:55:140
99682311,26sleep19998-21python19:30:041
7637993116,8cyclictest23041-21diskstats22:55:141
763699318,11cyclictest14287-21cut19:40:100
763699315,13cyclictest22880-21fschecks_time00:20:160
763699314,13cyclictest0-21swapper/023:20:260
763699313,4cyclictest81rcu_preempt20:18:470
7636993120,7cyclictest25449-21wget20:10:120
7636993111,6cyclictest13645-21diskstats22:30:150
71772311,5sleep00-21swapper/022:11:210
264542311,5sleep00-21swapper/021:37:260
763799306,4cyclictest81rcu_preempt21:25:341
763799305,4cyclictest81rcu_preempt00:07:351
763799304,19cyclictest1866-21iostat_ios00:50:191
763799303,4cyclictest81rcu_preempt23:20:321
7637993024,4cyclictest22-21ksoftirqd/119:55:011
7637993020,6cyclictest10476-21proc_pri22:20:271
763799301,5cyclictest81rcu_preempt21:48:011
763799301,4cyclictest81rcu_preempt23:11:401
763799301,4cyclictest81rcu_preempt22:53:261
763799301,4cyclictest0-21swapper/119:44:401
763799301,3cyclictest81rcu_preempt20:05:431
763799301,24cyclictest15825-21grep00:00:281
763799300,4cyclictest81rcu_preempt19:57:171
763699309,10cyclictest21357-21open_files00:15:260
763699308,11cyclictest9710-21cpu22:20:120
763699307,12cyclictest40250irq/92-i91523:35:280
763699304,3cyclictest81rcu_preempt22:27:440
763699302,5cyclictest81rcu_preempt20:20:160
763699302,15cyclictest417-21/usr/sbin/munin20:30:110
763699302,14cyclictest29294-21users00:35:310
763699301,4cyclictest81rcu_preempt21:15:190
763699301,4cyclictest81rcu_preempt19:34:450
7636993012,16cyclictest0-21swapper/021:56:330
763699301,16cyclictest0-21swapper/021:25:000
7636993010,7cyclictest12843-21munin-run23:55:000
7636993010,6cyclictest29217-21ntp_states23:10:230
34962300,8sleep0763699cyclictest20:35:290
30342301,5sleep00-21swapper/023:26:120
246382301,5sleep00-21swapper/023:00:090
246382301,5sleep00-21swapper/023:00:080
117652301,4sleep111771-21diskstats22:25:151
93612291,5sleep10-21swapper/120:50:471
763799294,4cyclictest81rcu_preempt23:43:051
763799293,4cyclictest81rcu_preempt20:15:441
763799292,4cyclictest81rcu_preempt00:15:131
7637992915,11cyclictest22-21ksoftirqd/122:35:201
763799291,4cyclictest81rcu_preempt21:15:151
763799291,4cyclictest81rcu_preempt00:11:521
763799291,18cyclictest0-21swapper/121:51:111
7637992911,6cyclictest3286-21runrttasks19:37:511
763699293,4cyclictest81rcu_preempt00:10:210
763699292,14cyclictest8889-21ntp_states20:50:250
763699292,14cyclictest0-21swapper/020:40:020
763699291,15cyclictest27552-21runrttasks00:31:450
763699291,15cyclictest27552-21runrttasks00:31:440
763699291,15cyclictest21470-21iostat_ios22:50:190
7636992910,6cyclictest18647-21ntp_states19:50:240
7636992910,15cyclictest0-21swapper/023:40:200
56502291,6sleep10-21swapper/120:41:161
52582291,5sleep00-21swapper/023:34:440
323372291,5sleep00-21swapper/020:26:140
31462291,5sleep10-21swapper/123:27:231
305692291,5sleep10-21swapper/120:22:191
296002291,5sleep10-21swapper/100:38:331
285002291,5sleep10-21swapper/121:44:011
228742291,5sleep00-21swapper/020:00:340
167492291,5sleep00-21swapper/022:38:030
136682291,5sleep00-21swapper/019:37:450
114962291,5sleep00-21swapper/020:58:240
114962291,5sleep00-21swapper/020:58:230
105652291,5sleep00-21swapper/023:46:060
763799284,18cyclictest31292-21diskstats20:25:171
763799283,4cyclictest81rcu_preempt22:16:281
763799283,4cyclictest81rcu_preempt22:16:271
763799283,4cyclictest81rcu_preempt21:21:511
763799283,4cyclictest81rcu_preempt00:28:131
763799281,9cyclictest22-21ksoftirqd/121:01:531
7637992819,6cyclictest3797-21cut23:30:111
763799281,4cyclictest81rcu_preempt00:47:021
7637992814,4cyclictest22-21ksoftirqd/119:45:221
7637992811,4cyclictest25205-21cpuspeed_turbos21:35:121
763699289,6cyclictest32438-21irqstats00:45:220
763699282,14cyclictest31649-21python21:50:280
763699281,14cyclictest1414-21/usr/sbin/munin00:50:110
7636992810,14cyclictest129862chrt23:55:090
70392281,5sleep10-21swapper/123:38:451
34232281,5sleep00-21swapper/022:01:190
315592281,5sleep10-21swapper/123:15:391
24752282,22sleep12534-21/usr/sbin/munin22:00:181
246942281,5sleep00-21swapper/021:33:380
229142281,5sleep10-21swapper/120:01:001
169592281,5sleep10-21swapper/121:11:251
150202281,5sleep00-21swapper/021:05:520
150092281,5sleep10-21swapper/121:05:451
106962281,5sleep10-21swapper/123:47:271
763799274,4cyclictest81rcu_preempt23:59:341
763799273,4cyclictest81rcu_preempt20:31:091
763799273,18cyclictest17809-21memory22:40:221
763799272,4cyclictest81rcu_preempt22:14:261
763799271,4cyclictest81rcu_preempt22:49:081
7636992718,5cyclictest15298-21fschecks_time00:00:160
763699271,14cyclictest24762-21fschecks_time00:25:180
763699271,13cyclictest3286-21runrttasks19:45:120
763699271,13cyclictest27772-21ps21:40:250
763699271,12cyclictest29152-21grep21:45:160
7636992711,14cyclictest0-21swapper/021:10:080
281242271,5sleep10-21swapper/123:08:571
256532270,2sleep125717-21awk23:00:281
256532270,2sleep125717-21awk23:00:281
763699268,5cyclictest11564-21packagekitd19:55:130
763699261,8cyclictest32021-21sendmail-msp23:20:000
763699261,13cyclictest23887-21cut20:05:160
763699261,12cyclictest21860-21kernelversion21:25:220
763799254,12cyclictest0-21swapper/122:30:571
763799251,9cyclictest2390-21wget20:35:121
7637992513,7cyclictest27243-21sort00:30:281
7637992513,7cyclictest27243-21sort00:30:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional