You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 13:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Apr 08, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
287689911801150,26cyclictest29377-21fschecks_time19:25:171
287679911451125,16cyclictest29511-21irqstats19:25:220
269972509460,29sleep10-21swapper/119:20:071
283722482404,63sleep00-21swapper/019:21:250
298562980,9sleep12876899cyclictest23:15:331
145692790,6sleep12876899cyclictest22:26:361
7002740,3sleep1211ktimersoftd/119:35:001
49192740,8sleep02876799cyclictest23:57:110
115172690,3sleep0111rcuc/023:30:240
28767996511,13cyclictest6637-21sh21:11:270
318212620,5sleep031818-21sh22:10:440
28767996021,6cyclictest19548-21sed00:45:290
47622590,4sleep1201rcuc/122:50:161
2876799592,28cyclictest0-21swapper/023:51:560
263192590,2sleep126318-21ntp_kernel_pll_22:05:251
28767995826,5cyclictest4434-21ssh22:15:560
2876799581,13cyclictest3560-21ssh22:49:290
2876799581,13cyclictest3560-21ssh22:49:290
28767995624,5cyclictest17345-21ssh00:44:070
2876799562,27cyclictest0-21swapper/000:01:160
2876799554,18cyclictest9711-21iostat_ios22:55:200
2876799551,25cyclictest0-21swapper/021:31:080
2876799544,27cyclictest848-21cron21:40:000
2876799509,10cyclictest0-21swapper/021:51:250
182122440,8sleep02876799cyclictest00:10:280
40582410,4chrt0-21swapper/121:42:251
2876799407,5cyclictest97102forks21:15:140
2876799406,31cyclictest10654-21cron21:50:000
211422390,8sleep02876799cyclictest22:34:090
2876899379,4cyclictest81rcu_preempt22:40:211
2876899371,6cyclictest22-21ksoftirqd/121:24:431
2876799375,4cyclictest81rcu_preempt22:39:590
2876799371,13cyclictest20278-21cut23:40:110
271642370,3sleep127163-21kernelversion00:20:201
2876899369,4cyclictest81rcu_preempt23:40:271
2876899363,30cyclictest0-21swapper/119:38:361
28768993610,11cyclictest81rcu_preempt00:01:031
28767993614,6cyclictest14193-21df_inode23:00:130
2876799361,13cyclictest300192ssh23:15:470
182292361,4sleep118391-21ssh00:45:121
2876899355,4cyclictest81rcu_preempt21:31:361
2876899354,4cyclictest81rcu_preempt00:40:161
2876899353,6cyclictest0-21swapper/122:58:561
28768993516,6cyclictest22-21ksoftirqd/100:09:571
2876899351,31cyclictest7922-21tune2fs22:20:151
2876799353,4cyclictest81rcu_preempt22:40:110
2876799351,30cyclictest2995-21ssh00:29:150
42652341,3sleep04361-21hddtemp_smartct00:30:180
2876899345,25cyclictest2305-21cron22:14:591
2876899344,20cyclictest0-21swapper/120:15:321
2876899343,29cyclictest0-21swapper/120:36:161
2876899342,13cyclictest0-21swapper/123:50:311
28768993411,11cyclictest0-21swapper/123:33:231
2876799345,5cyclictest81rcu_preempt23:20:210
2876799344,4cyclictest81rcu_preempt22:53:590
103152341,30sleep010325-21ssh00:35:500
70212331,28sleep17174-21/usr/sbin/munin23:25:321
2876899339,4cyclictest81rcu_preempt22:34:201
2876899338,22cyclictest0-21swapper/123:01:221
2876899334,5cyclictest81rcu_preempt22:45:121
2876899334,5cyclictest81rcu_preempt22:45:121
2876899333,4cyclictest81rcu_preempt22:35:371
2876899333,27cyclictest0-21swapper/100:12:161
28768993326,5cyclictest0-21swapper/120:12:571
2876899332,5cyclictest81rcu_preempt22:00:291
2876899332,4cyclictest81rcu_preempt21:15:111
28768993318,4cyclictest22-21ksoftirqd/123:45:161
2876799339,11cyclictest0-21swapper/020:35:150
2876799333,4cyclictest81rcu_preempt21:55:200
28767993326,5cyclictest0-21swapper/020:27:360
28767993326,4cyclictest0-21swapper/023:47:150
28767993326,4cyclictest0-21swapper/000:51:150
2876799331,4cyclictest23373-21ssh00:15:560
2876799331,29cyclictest0-21swapper/023:07:160
276462331,29sleep027789-21/usr/sbin/munin00:20:280
51812321,27sleep15193-21irqstats21:10:201
2876899327,21cyclictest0-21swapper/121:50:411
2876899325,4cyclictest81rcu_preempt21:37:531
2876899322,4cyclictest0-21swapper/123:56:561
28768993224,6cyclictest0-21swapper/123:24:551
2876899322,17cyclictest0-21swapper/121:59:571
2876899321,29cyclictest0-21swapper/100:16:151
2876899321,28cyclictest0-21swapper/100:34:551
2876899321,10cyclictest0-21swapper/122:17:131
2876799327,12cyclictest0-21swapper/021:24:320
2876799323,4cyclictest81rcu_preempt23:38:050
2876799321,5cyclictest81rcu_preempt22:22:290
2876799321,29cyclictest0-21swapper/022:08:350
130702321,3sleep013159-21memory22:25:240
2876899317,20cyclictest0-21swapper/121:26:411
2876899317,11cyclictest0-21swapper/120:25:231
28768993123,6cyclictest0-21swapper/123:35:351
2876899311,12cyclictest0-21swapper/100:35:151
2876799318,6cyclictest20836-21cat22:00:120
2876799316,21cyclictest0-21swapper/023:11:420
2876799313,4cyclictest81rcu_preempt21:27:160
2876799311,4cyclictest81rcu_preempt00:08:380
28767993112,6cyclictest31620-21/usr/sbin/munin20:55:190
2876799311,19cyclictest4161-21runrttasks19:40:360
2876899306,10cyclictest7563-21vmstat21:45:301
2876899305,4cyclictest81rcu_preempt00:26:161
2876899301,4cyclictest81rcu_preempt19:46:381
2876899301,11cyclictest211462sh23:06:551
28768993010,4cyclictest81rcu_preempt20:30:231
2876799302,4cyclictest81rcu_preempt23:27:280
2876799301,4cyclictest81rcu_preempt21:44:510
2876799301,13cyclictest3189-21grep21:05:210
2876799301,13cyclictest0-21swapper/020:13:560
120852301,5sleep00-21swapper/020:04:510
79762291,5sleep10-21swapper/119:51:161
2876899298,4cyclictest81rcu_preempt20:05:221
2876899298,4cyclictest81rcu_preempt20:05:221
2876899295,4cyclictest81rcu_preempt23:10:281
2876899294,18cyclictest0-21swapper/119:40:221
2876899294,17cyclictest0-21swapper/120:54:591
2876899294,17cyclictest0-21swapper/120:54:581
2876899294,16cyclictest0-21swapper/121:06:481
28768992921,6cyclictest0-21swapper/119:55:351
2876799293,24cyclictest0-21swapper/020:45:370
28767992922,5cyclictest3-21ksoftirqd/020:21:360
2876799292,13cyclictest1135-21df_inode19:35:130
28767992912,5cyclictest26452-21python20:40:270
28767992911,6cyclictest12868-21iostat_ios20:05:200
28767992911,6cyclictest12868-21iostat_ios20:05:190
28767992911,5cyclictest1195-21memory21:00:210
28767992910,5cyclictest1968-21lldpad19:31:060
271252291,5sleep10-21swapper/120:44:471
229792291,5sleep00-21swapper/020:30:500
110502291,5sleep111097-21sed20:00:221
2876899285,4cyclictest81rcu_preempt20:20:591
2876899284,15cyclictest0-21swapper/120:57:171
2876899283,16cyclictest0-21swapper/120:46:331
2876899281,25cyclictest0-21swapper/121:00:151
2876799281,14cyclictest5154-21fschecks_time19:45:160
2876799281,13cyclictest16044-21cut20:15:110
2876899279,15cyclictest0-21swapper/100:50:531
2876799277,6cyclictest0-21swapper/019:50:160
2876799271,15cyclictest0-21swapper/020:50:190
2876799271,15cyclictest0-21swapper/020:50:190
28767992710,5cyclictest10153-21taskset19:59:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional