You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 12:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat May 09, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265929911081098,7cyclictest0-21swapper/019:25:150
265939910941080,10cyclictest26965-21cstates19:25:131
261442794748,30sleep10-21swapper/119:20:531
248232466367,33sleep00-21swapper/019:20:080
93752600,7sleep02659299cyclictest20:00:280
264052480,8sleep02659299cyclictest23:40:100
26593994512,4cyclictest22-21ksoftirqd/100:02:561
326082441,37sleep032764-21fschecks_time22:30:170
26593994413,3cyclictest22-21ksoftirqd/123:59:361
26593994413,3cyclictest22-21ksoftirqd/100:44:051
26593994411,3cyclictest22-21ksoftirqd/120:31:321
26593994313,5cyclictest22-21ksoftirqd/122:03:531
26593994313,4cyclictest22-21ksoftirqd/123:14:501
26593994312,5cyclictest22-21ksoftirqd/123:44:151
26593994312,4cyclictest22-21ksoftirqd/123:19:051
26593994312,3cyclictest22-21ksoftirqd/121:12:501
26593994312,3cyclictest22-21ksoftirqd/120:51:581
26593994312,3cyclictest22-21ksoftirqd/100:48:591
2659399423,10cyclictest0-21swapper/123:31:141
2659399423,10cyclictest0-21swapper/123:31:131
2659399423,10cyclictest0-21swapper/119:59:161
26593994214,8cyclictest22-21ksoftirqd/119:50:131
26593994213,4cyclictest22-21ksoftirqd/121:44:391
26593994213,4cyclictest22-21ksoftirqd/119:43:541
26593994213,4cyclictest22-21ksoftirqd/119:39:581
26593994212,3cyclictest22-21ksoftirqd/100:13:461
2659399412,9cyclictest0-21swapper/122:59:141
26593994116,6cyclictest22-21ksoftirqd/120:25:221
26593994116,5cyclictest22-21ksoftirqd/120:00:171
26593994114,8cyclictest22-21ksoftirqd/100:24:171
26593994112,4cyclictest22-21ksoftirqd/121:58:091
26593994112,4cyclictest22-21ksoftirqd/121:25:061
26593994112,4cyclictest22-21ksoftirqd/120:35:581
26593994112,3cyclictest22-21ksoftirqd/120:48:171
2659399411,12cyclictest0-21swapper/121:50:101
26593994110,3cyclictest22-21ksoftirqd/100:07:151
2659399403,9cyclictest0-21swapper/100:54:301
2659399403,22cyclictest0-21swapper/122:32:531
2659399402,8cyclictest0-21swapper/121:47:121
26593994017,5cyclictest22-21ksoftirqd/121:00:121
26593994013,4cyclictest22-21ksoftirqd/119:48:271
26593994013,4cyclictest22-21ksoftirqd/119:48:271
26593994012,3cyclictest22-21ksoftirqd/120:20:181
2659399391,8cyclictest0-21swapper/123:35:101
2659399391,8cyclictest0-21swapper/119:30:131
26593993916,4cyclictest22-21ksoftirqd/120:55:251
26593993915,6cyclictest22-21ksoftirqd/121:05:101
26593993912,3cyclictest22-21ksoftirqd/121:23:051
26593993911,4cyclictest22-21ksoftirqd/122:50:111
2659399386,5cyclictest24211-21mailstats20:40:251
2659399384,4cyclictest40250irq/92-i91523:50:251
2659399383,13cyclictest0-21swapper/120:09:241
2659399382,9cyclictest0-21swapper/122:20:111
2659399382,5cyclictest28192-21/usr/sbin/munin23:45:231
2659399381,8cyclictest0-21swapper/123:25:111
26593993814,5cyclictest22-21ksoftirqd/122:19:151
26593993813,9cyclictest22-21ksoftirqd/120:13:521
26593993813,4cyclictest22-21ksoftirqd/122:10:131
26593993813,4cyclictest22-21ksoftirqd/121:30:291
26593993813,4cyclictest22-21ksoftirqd/100:37:391
26593993813,4cyclictest22-21ksoftirqd/100:30:161
26593993810,4cyclictest22-21ksoftirqd/122:47:521
26593993714,6cyclictest22-21ksoftirqd/123:22:201
26593993714,5cyclictest22-21ksoftirqd/122:05:531
26593993711,4cyclictest22-21ksoftirqd/123:09:021
2659399367,5cyclictest3286-21runrttasks22:42:371
26593993613,4cyclictest22-21ksoftirqd/121:36:071
26593993612,5cyclictest22-21ksoftirqd/122:25:101
26593993612,4cyclictest22-21ksoftirqd/121:17:281
26593993611,4cyclictest22-21ksoftirqd/123:02:021
26593993611,3cyclictest22-21ksoftirqd/100:26:331
2659299363,14cyclictest18750-21diskstats00:45:140
2659299361,15cyclictest0-21swapper/020:52:450
2659299361,13cyclictest0-21swapper/023:56:480
2659299361,13cyclictest0-21swapper/022:57:520
140112362,5sleep114117-21df20:15:121
26593993513,4cyclictest22-21ksoftirqd/100:15:291
26593993512,4cyclictest22-21ksoftirqd/122:35:111
2659299351,11cyclictest81rcu_preempt21:27:560
26592993418,9cyclictest30368-21diskstats23:50:150
26592993412,7cyclictest5451-21python19:50:270
2659299341,22cyclictest0-21swapper/021:56:260
2659299332,4cyclictest81rcu_preempt20:46:270
26592993322,6cyclictest31139-21/usr/sbin/munin19:35:100
2659299326,13cyclictest2225-21dbus-daemon21:35:290
2659299326,12cyclictest2365-21mailstats00:00:260
26592993215,14cyclictest11600-21missed_timers00:25:210
2659299321,18cyclictest16088-21grep23:10:270
127872321,27sleep011565-21gdbus23:03:020
2659299312,9cyclictest29568-21python22:20:270
2659299312,14cyclictest17900-21diskstats20:25:130
2659299311,4cyclictest81rcu_preempt23:37:490
2659299311,4cyclictest81rcu_preempt23:28:300
2659299311,4cyclictest81rcu_preempt22:44:300
26592993111,6cyclictest13671-21cron20:15:000
26592993110,10cyclictest2401-21NetworkManager20:31:080
191782310,6sleep019138-21fschecks_count23:20:130
111422311,4sleep02695-21snmpd21:31:570
42122301,5sleep00-21swapper/019:49:230
42122301,5sleep00-21swapper/019:49:230
2659299305,4cyclictest81rcu_preempt00:33:330
2659299302,3cyclictest81rcu_preempt00:35:480
2659299302,24cyclictest4356-21df21:15:130
2659299302,14cyclictest22373-21python20:35:260
2659299301,4cyclictest81rcu_preempt22:01:370
2659299301,4cyclictest81rcu_preempt20:23:010
26592993012,5cyclictest28690-21df_inode19:30:010
2659299301,24cyclictest5843-21iostat00:10:180
2659299301,15cyclictest24965-21cron20:45:010
180652301,24sleep00-21swapper/021:50:230
2659299297,11cyclictest30998-21if_eth022:25:160
2659299296,12cyclictest0-21swapper/021:20:240
2659299292,9cyclictest0-21swapper/000:22:500
2659299292,14cyclictest23722-21ntp_states22:05:240
2659299291,4cyclictest81rcu_preempt20:09:220
2659299291,19cyclictest0-21swapper/000:08:300
26592992911,13cyclictest17162-21kernelversion00:40:210
2659299289,15cyclictest28217-21aten_r4power_cu23:45:110
2659299282,4cyclictest81rcu_preempt20:57:300
2659299282,13cyclictest15978-21irqstats21:45:190
26592992815,9cyclictest10050irq/91-xhci_hcd19:45:000
2659299281,4cyclictest81rcu_preempt22:46:410
2659299281,4cyclictest81rcu_preempt22:14:450
2659299281,15cyclictest20842-21hwlatdetect00:50:150
2659299281,14cyclictest362-21cat21:05:100
2659299281,12cyclictest8859-21runrttasks22:51:270
2659299279,6cyclictest18018-21sort23:15:280
2659299273,12cyclictest0-21swapper/022:15:150
2659299272,12cyclictest23804-21users23:30:310
2659299272,12cyclictest23804-21users23:30:300
2659299271,4cyclictest81rcu_preempt21:00:590
2659299271,18cyclictest0-21swapper/023:07:350
2659299271,18cyclictest0-21swapper/019:55:490
26592992711,5cyclictest2345-21iostat_ios22:35:190
26592992710,5cyclictest3015-21/usr/sbin/munin21:10:230
151342271,5sleep00-21swapper/020:15:440
2659299266,17cyclictest7616-21grep00:15:170
2659299261,4cyclictest81rcu_preempt21:41:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional