You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 09:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Apr 14, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293769912522,1246cyclictest29595-21wget19:25:111
293759911851139,20cyclictest3-21ksoftirqd/019:25:110
293769911571133,19cyclictest5795-21ssh21:10:201
290512558514,29sleep00-21swapper/019:22:090
292972459371,73sleep10-21swapper/119:24:461
2937599248224,20cyclictest0-21swapper/021:10:200
36912970,7sleep02937599cyclictest23:55:120
162672920,3sleep00-21swapper/020:12:560
242892860,5sleep00-21swapper/023:10:010
272762850,5sleep041ktimersoftd/023:12:280
29376995116,5cyclictest22-21ksoftirqd/100:43:491
29376994917,5cyclictest22-21ksoftirqd/123:35:331
2937699471,8cyclictest0-21swapper/122:10:381
29376994717,9cyclictest22-21ksoftirqd/100:08:281
2937699463,11cyclictest0-21swapper/121:15:191
2937699462,11cyclictest0-21swapper/122:05:261
29376994616,6cyclictest22-21ksoftirqd/100:36:301
29376994615,6cyclictest22-21ksoftirqd/121:45:041
29376994615,5cyclictest22-21ksoftirqd/122:04:531
29376994614,5cyclictest22-21ksoftirqd/123:20:471
29376994610,7cyclictest20425-21sh22:31:511
29376994610,3cyclictest81rcu_preempt22:27:011
29376994516,6cyclictest22-21ksoftirqd/123:08:581
29376994516,5cyclictest22-21ksoftirqd/123:51:101
29376994510,4cyclictest81rcu_preempt23:56:271
2937699449,3cyclictest81rcu_preempt23:25:141
2937699449,3cyclictest81rcu_preempt22:21:131
2937699444,4cyclictest0-21swapper/100:28:021
29376994418,5cyclictest22-21ksoftirqd/122:18:071
29376994417,4cyclictest22-21ksoftirqd/123:13:101
29376994412,4cyclictest22-21ksoftirqd/121:30:131
29376994410,4cyclictest81rcu_preempt23:46:081
29376994410,3cyclictest22-21ksoftirqd/121:40:211
29376994410,3cyclictest22-21ksoftirqd/121:40:201
2937699433,9cyclictest0-21swapper/123:00:271
2937699433,9cyclictest0-21swapper/121:05:241
2937699433,9cyclictest0-21swapper/121:05:231
2937699433,10cyclictest0-21swapper/100:50:311
2937699433,10cyclictest0-21swapper/100:12:061
2937699432,9cyclictest0-21swapper/123:15:181
29376994316,6cyclictest22-21ksoftirqd/121:51:371
29376994316,5cyclictest22-21ksoftirqd/100:21:351
29376994312,6cyclictest22-21ksoftirqd/121:39:061
29376994312,4cyclictest22-21ksoftirqd/121:59:561
29376994311,3cyclictest22-21ksoftirqd/123:40:161
2937699429,4cyclictest22-21ksoftirqd/121:21:301
2937699426,8cyclictest0-21swapper/123:32:431
29376994216,7cyclictest22-21ksoftirqd/122:53:331
29376994216,5cyclictest22-21ksoftirqd/121:25:341
29376994215,5cyclictest22-21ksoftirqd/100:31:241
29376994214,5cyclictest22-21ksoftirqd/122:36:411
29376994214,5cyclictest22-21ksoftirqd/100:49:581
29376994212,4cyclictest22-21ksoftirqd/100:02:571
29376994211,4cyclictest22-21ksoftirqd/122:41:511
29376994210,4cyclictest22-21ksoftirqd/122:45:121
29376994210,4cyclictest22-21ksoftirqd/120:23:021
29376994210,4cyclictest22-21ksoftirqd/120:05:031
29375994216,4cyclictest0-21swapper/022:58:030
2937699419,4cyclictest81rcu_preempt21:00:151
2937699412,9cyclictest0-21swapper/119:50:211
2937699412,9cyclictest0-21swapper/100:18:311
2937699412,10cyclictest0-21swapper/119:47:541
29376994115,5cyclictest22-21ksoftirqd/119:41:401
29376994110,4cyclictest22-21ksoftirqd/120:31:201
124222410,7sleep00-21swapper/000:37:090
2937699404,5cyclictest26446-21fschecks_time20:40:151
2937699402,9cyclictest0-21swapper/120:46:501
2937699401,10cyclictest0-21swapper/120:56:211
236212400,3sleep041ktimersoftd/000:50:020
2937699398,9cyclictest0-21swapper/119:30:141
29376993914,6cyclictest22-21ksoftirqd/122:56:441
29376993910,4cyclictest22-21ksoftirqd/120:04:151
2937699388,3cyclictest81rcu_preempt20:50:131
2937599382,23cyclictest6707-21ssh00:30:520
2937599382,22cyclictest29636-21df_inode23:15:150
2937699377,4cyclictest81rcu_preempt19:59:391
2937599375,4cyclictest81rcu_preempt22:15:170
2937599373,5cyclictest0-21swapper/021:47:560
2937599371,6cyclictest16877-21fschecks_count21:55:160
2937699363,5cyclictest15737-21mailstats20:10:251
2937699361,5cyclictest7405-21kworker/1:220:39:101
2937599364,4cyclictest81rcu_preempt22:52:220
20592360,3sleep1211ktimersoftd/119:35:191
2937699356,3cyclictest81rcu_preempt20:26:031
2937699354,8cyclictest0-21swapper/120:15:181
2937599351,16cyclictest25902-21awk22:05:000
2937599351,16cyclictest23605-21watchsnmpd20:31:000
2937599344,26cyclictest483-21fschecks_time00:25:150
2937599343,9cyclictest81rcu_preempt21:53:570
2937599342,30cyclictest0-21swapper/021:28:360
2937599342,14cyclictest15444-21ls00:40:220
2937599341,8cyclictest28996-21sed22:40:280
2937599341,29cyclictest25468-21ssh00:17:150
2937599341,21cyclictest26728-21iostat23:45:210
2937599341,20cyclictest14082-21ntp_states00:05:260
29375993323,7cyclictest0-21swapper/023:35:560
29375993315,5cyclictest11257-21sh23:30:000
2937599331,30cyclictest0-21swapper/019:58:350
2937599331,30cyclictest0-21swapper/019:39:560
2937599331,20cyclictest2192-21fschecks_count21:40:170
2937599331,20cyclictest2192-21fschecks_count21:40:160
2937599329,19cyclictest0-21swapper/000:14:290
2937599327,12cyclictest24821-21cstates21:30:140
2937599326,5cyclictest81rcu_preempt21:15:230
2937599322,12cyclictest30408-21/usr/sbin/munin21:35:260
2937599321,4cyclictest81rcu_preempt22:28:510
2937599321,4cyclictest21426-21ssh00:46:360
2937599321,19cyclictest8681-21/usr/sbin/munin22:20:140
2937599321,19cyclictest4277-21/usr/sbin/munin19:40:240
29375993210,5cyclictest29634-21ssh22:08:240
2937599316,5cyclictest81rcu_preempt21:21:340
29375993124,5cyclictest0-21swapper/023:31:150
29375993122,6cyclictest32093-21swap23:50:290
2937599312,15cyclictest19129-21irqstats20:20:210
2937599311,6cyclictest0-21swapper/023:22:040
2937599311,4cyclictest81rcu_preempt22:38:150
2937599311,18cyclictest27928-21/usr/sbin/munin20:45:260
2937599311,18cyclictest17899-21vmstat20:15:310
2937599307,5cyclictest81rcu_preempt23:40:320
2937599304,4cyclictest81rcu_preempt22:45:270
2937599303,4cyclictest81rcu_preempt22:12:070
2937599303,4cyclictest81rcu_preempt19:30:350
29375993023,5cyclictest3-21ksoftirqd/020:58:390
2937599301,5cyclictest31076-21ssh00:23:210
2937599301,4cyclictest81rcu_preempt19:45:110
2937599301,26cyclictest3-21ksoftirqd/020:04:370
2937599301,26cyclictest111-21usb-storage23:02:010
29375993011,7cyclictest9470-21ssh00:00:340
2937599296,11cyclictest0-21swapper/019:51:190
256172291,5sleep00-21swapper/020:37:250
47682281,5sleep00-21swapper/021:09:160
47682281,5sleep00-21swapper/021:09:160
2937599282,13cyclictest0-21swapper/022:30:270
2937599282,12cyclictest0-21swapper/021:00:290
2937599281,4cyclictest81rcu_preempt20:41:290
29375992810,6cyclictest30277-21fschecks_time20:50:160
29375992810,6cyclictest20434-21/usr/sbin/munin20:25:120
29375992810,6cyclictest14057-21grep20:05:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional