You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 06:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Sep 13, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314939912651,3cyclictest0-21swapper/119:25:131
314939911531133,17cyclictest8118-21smartctl21:10:281
314342659612,32sleep00-21swapper/019:24:580
311342466420,31sleep10-21swapper/119:21:491
3149299222182,20cyclictest0-21swapper/019:25:120
248662940,24sleep00-21swapper/021:55:250
195682900,4sleep0111rcuc/021:40:260
31492997857,18cyclictest0-21swapper/021:10:280
11052600,7sleep13149399cyclictest22:20:111
31493994714,6cyclictest22-21ksoftirqd/100:15:211
31493994617,6cyclictest22-21ksoftirqd/121:55:151
31493994610,6cyclictest22-21ksoftirqd/122:10:211
31493994418,5cyclictest22-21ksoftirqd/100:00:571
31493994418,5cyclictest22-21ksoftirqd/100:00:561
3452430,3sleep0111rcuc/022:15:300
31493994318,5cyclictest22-21ksoftirqd/121:49:261
31493994317,4cyclictest22-21ksoftirqd/123:49:471
3149399428,6cyclictest22-21ksoftirqd/122:41:071
3149399427,5cyclictest22-21ksoftirqd/122:30:111
3149399426,6cyclictest22-21ksoftirqd/120:35:241
31493994216,4cyclictest22-21ksoftirqd/100:32:581
3149399416,4cyclictest81rcu_preempt19:45:321
3149399415,6cyclictest22-21ksoftirqd/123:25:211
3149399415,6cyclictest22-21ksoftirqd/100:40:141
31493994115,5cyclictest22-21ksoftirqd/122:08:191
96602401,35sleep19713-21tr21:15:241
3149399406,4cyclictest81rcu_preempt23:00:131
3149399405,6cyclictest22-21ksoftirqd/120:00:211
3149399404,6cyclictest22-21ksoftirqd/100:45:241
31493994024,4cyclictest22-21ksoftirqd/123:37:411
31492994017,8cyclictest18379-21memory00:30:260
3149399396,4cyclictest81rcu_preempt20:20:301
3149399396,4cyclictest81rcu_preempt00:25:111
3149399395,4cyclictest81rcu_preempt20:45:191
31493993911,4cyclictest81rcu_preempt00:10:301
3149399389,10cyclictest22-21ksoftirqd/121:30:211
3149399389,10cyclictest22-21ksoftirqd/120:15:231
3149399386,4cyclictest81rcu_preempt23:05:181
3149399385,4cyclictest81rcu_preempt20:40:201
31493993819,4cyclictest22-21ksoftirqd/123:12:561
3149399381,6cyclictest22-21ksoftirqd/120:54:071
3149399378,10cyclictest22-21ksoftirqd/122:35:141
3149399375,5cyclictest6782-21tail19:40:301
3149399374,6cyclictest22-21ksoftirqd/121:00:141
3149399374,6cyclictest22-21ksoftirqd/121:00:131
3149399374,5cyclictest81rcu_preempt23:54:051
3149399374,4cyclictest81rcu_preempt21:05:161
31493993721,4cyclictest22-21ksoftirqd/100:35:191
31493993718,5cyclictest22-21ksoftirqd/123:21:381
31493993718,4cyclictest22-21ksoftirqd/119:30:181
31493993716,4cyclictest22-21ksoftirqd/122:50:231
3149399362,4cyclictest81rcu_preempt23:15:301
3149399362,4cyclictest26326-21fschecks_time22:00:161
31493993622,4cyclictest22-21ksoftirqd/119:55:211
31493993618,6cyclictest22-21ksoftirqd/123:30:251
3149399361,6cyclictest22-21ksoftirqd/121:25:131
31492993625,7cyclictest1937-21/usr/sbin/munin22:20:250
3149399356,4cyclictest81rcu_preempt23:56:381
3149399353,5cyclictest22-21ksoftirqd/120:10:131
3149399352,4cyclictest81rcu_preempt20:30:111
3149399352,4cyclictest81rcu_preempt20:25:141
31493993520,4cyclictest22-21ksoftirqd/122:25:151
31493993519,4cyclictest22-21ksoftirqd/100:05:211
31493993518,4cyclictest22-21ksoftirqd/119:35:201
3149399351,7cyclictest22-21ksoftirqd/100:53:461
3149399351,6cyclictest22-21ksoftirqd/121:52:021
3149399351,6cyclictest22-21ksoftirqd/119:50:191
3149399351,4cyclictest81rcu_preempt20:55:301
31493993514,10cyclictest22-21ksoftirqd/121:40:561
31493993510,9cyclictest22-21ksoftirqd/122:48:111
31492993510,13cyclictest4044-21taskset23:51:550
31493993420,4cyclictest22-21ksoftirqd/100:20:191
3149399341,6cyclictest22-21ksoftirqd/123:42:051
3149399341,6cyclictest22-21ksoftirqd/121:35:131
3149299343,16cyclictest9989-21python21:15:290
3149399336,4cyclictest81rcu_preempt22:57:101
31493993318,4cyclictest22-21ksoftirqd/121:20:121
31492993313,7cyclictest10803-21df_inode22:45:160
3149299331,20cyclictest15107-21ntpq22:55:290
3149299331,12cyclictest21176-21grep23:10:310
259542334,3sleep081rcu_preempt20:33:350
3149299322,18cyclictest6133-21if_err_eth019:40:190
3149299321,19cyclictest1615-21df20:55:140
3149299321,12cyclictest0-21swapper/021:31:490
3149299319,6cyclictest11565-21gdbus21:46:070
3149299318,7cyclictest19027-21diskstats20:15:160
3149299316,13cyclictest2745-21python19:30:270
3149299315,14cyclictest5670-21ntp_kernel_pll_22:30:230
3149299314,8cyclictest5513-21diskstats21:05:150
3149299314,4cyclictest81rcu_preempt22:41:030
3149299311,5cyclictest81rcu_preempt19:52:290
3149299311,4cyclictest81rcu_preempt23:41:370
3149299311,4cyclictest81rcu_preempt22:53:370
31492993114,13cyclictest25777-21sort00:50:200
31492993112,6cyclictest25858-21/usr/sbin/munin23:25:130
31492993112,6cyclictest17148-21df_inode20:10:150
31492993112,6cyclictest10656-21hddtemp_smartct00:10:230
31492993112,5cyclictest22442-21df_inode21:50:140
3149299311,16cyclictest23511-21cron23:20:000
31492993110,6cyclictest4154-21ntpq21:00:250
31492993110,6cyclictest4154-21ntpq21:00:250
3149399301,4cyclictest81rcu_preempt20:05:271
3149399301,10cyclictest32058-21http_loadtime22:15:191
3149299304,8cyclictest81rcu_preempt21:37:080
3149299303,5cyclictest81rcu_preempt00:20:210
3149299303,12cyclictest11565-21gdbus20:36:020
3149299302,14cyclictest3286-21runrttasks20:53:260
3149299302,13cyclictest26390-21perl22:00:170
3149299301,4cyclictest81rcu_preempt22:26:350
3149299301,4cyclictest81rcu_preempt20:42:470
3149299301,4cyclictest81rcu_preempt00:44:140
3149299301,4cyclictest81rcu_preempt00:01:210
3149299301,4cyclictest81rcu_preempt00:01:200
31492993012,6cyclictest29009-21/usr/sbin/munin22:05:280
31492993012,5cyclictest16672-21/usr/sbin/munin00:25:250
21762301,5sleep00-21swapper/023:48:010
82562291,5sleep00-21swapper/022:37:590
3149299299,6cyclictest16718-21/usr/sbin/munin23:00:180
3149299292,14cyclictest13399-21diskstats20:00:130
3149299292,14cyclictest11417-21/usr/sbin/munin21:20:190
3149299291,5cyclictest81rcu_preempt23:30:260
3149299291,25cyclictest111-21usb-storage23:05:160
31492992911,6cyclictest8914-21/usr/sbin/munin00:05:210
31492992911,5cyclictest30627-21irqstats20:45:230
31492992911,5cyclictest15809-21ntp_states20:05:240
3149299291,14cyclictest5673-21/usr/sbin/munin23:55:290
306952291,5sleep00-21swapper/023:36:320
127622291,5sleep00-21swapper/019:58:190
3149299284,13cyclictest20964-21grep20:20:170
3149299283,19cyclictest23523-21python20:25:280
3149299282,13cyclictest20027-21perl00:35:170
3149299281,14cyclictest8678-21sed19:45:310
31492992810,6cyclictest30894-21unixbench_singl22:10:290
31492992810,6cyclictest11565-21gdbus23:20:020
135502281,5sleep00-21swapper/000:18:000
3149299272,13cyclictest23875-21wget00:45:190
31492992616,6cyclictest4634-21sendmail_mailqu19:35:250
144252261,5sleep00-21swapper/021:29:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional