You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 02:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Mon Sep 14, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203939912651234,25cyclictest18789-21latency_hist10:10:001
203939912561214,35cyclictest0-21swapper/107:25:111
203929912471202,40cyclictest20647-21egrep07:25:110
191172788742,31sleep00-21swapper/007:20:180
201422580536,29sleep10-21swapper/107:22:591
203929910683,19cyclictest0-21swapper/010:10:010
252862760,4sleep125283-21df_inode07:35:161
20393996016,8cyclictest6279-21iostat_ios09:35:201
2039399581,9cyclictest30002-21awk10:40:001
151582570,2sleep015157-21aten_r4power_po10:00:090
2039399566,5cyclictest81rcu_preempt09:10:011
2039399522,9cyclictest3286-21runrttasks08:26:191
20393995214,7cyclictest17931-21iostat_ios08:40:191
2039399521,10cyclictest3286-21runrttasks10:17:251
2039399472,7cyclictest23368-21diskstats07:30:131
2039399442,6cyclictest0-21swapper/110:20:291
313442430,8sleep02039299cyclictest07:50:160
310852400,7sleep02039299cyclictest10:40:250
66722351,30sleep06723-21memory08:10:220
2039299351,4cyclictest81rcu_preempt08:50:120
20393993417,14cyclictest22-21ksoftirqd/111:28:401
172052341,29sleep117210-21irqstats11:30:201
2039399339,20cyclictest7802-21iostat11:05:191
20393993324,6cyclictest8591-21/usr/sbin/munin08:15:231
20393993324,6cyclictest8591-21/usr/sbin/munin08:15:221
2039299332,14cyclictest19088-21irqstats11:35:220
20392993313,6cyclictest8173-21irqstats09:40:200
2039299330,11cyclictest81rcu_preempt07:41:460
119512331,28sleep012015-21switchtime11:15:290
2039299321,23cyclictest0-21swapper/008:18:150
2039299321,23cyclictest0-21swapper/008:18:150
2039399311,4cyclictest81rcu_preempt11:41:161
2039299312,13cyclictest27472-21/usr/sbin/munin09:05:220
2039299311,4cyclictest81rcu_preempt09:02:550
20392993112,5cyclictest0-21swapper/012:25:220
20392993111,7cyclictest9652-21if_eth011:10:170
8492301,5sleep10-21swapper/110:45:331
257932301,25sleep12654-21sshd10:25:371
2039399306,4cyclictest81rcu_preempt09:25:571
2039399304,4cyclictest81rcu_preempt12:40:361
2039399304,4cyclictest81rcu_preempt12:40:361
20393993017,7cyclictest28509-21iostat_ios12:00:201
2039399301,5cyclictest81rcu_preempt12:22:411
2039399301,4cyclictest81rcu_preempt11:37:441
2039299302,15cyclictest31048-21/usr/sbin/munin12:05:290
2039299302,15cyclictest11170-21munin-run09:50:000
2039299302,15cyclictest11170-21munin-run09:49:590
2039299301,4cyclictest81rcu_preempt09:34:290
20392993013,6cyclictest3-21ksoftirqd/010:15:270
20392993012,6cyclictest6184-21/usr/sbin/munin11:00:260
20392993012,5cyclictest2868-21iostat_ios08:00:200
20392993012,5cyclictest18407-21sort11:35:000
2039299301,19cyclictest0-21swapper/008:35:170
2039299301,18cyclictest27017-21latency10:30:190
20392993010,7cyclictest11633-21python12:40:250
20392993010,7cyclictest11633-21python12:40:250
20392993010,16cyclictest5728-21seq08:08:340
72022291,5sleep00-21swapper/009:38:030
205592291,5sleep00-21swapper/008:46:110
2039399296,5cyclictest81rcu_preempt10:30:591
2039399295,4cyclictest81rcu_preempt07:48:501
2039399294,5cyclictest3286-21runrttasks12:29:511
2039399294,4cyclictest81rcu_preempt08:20:481
2039399292,6cyclictest0-21swapper/108:10:111
2039399291,4cyclictest81rcu_preempt08:50:231
20393992912,5cyclictest40250irq/92-i91509:50:101
2039299299,7cyclictest13220-21cut09:55:110
2039299294,13cyclictest24471-21cut11:50:150
2039299293,13cyclictest28978-21switchtime12:00:270
2039299292,14cyclictest32696-21diskstats09:20:150
2039299292,13cyclictest22514-21munin-node07:30:030
2039299291,4cyclictest81rcu_preempt11:29:530
2039299291,15cyclictest3782-21/usr/sbin/munin12:20:210
20392992911,5cyclictest30034-21ls07:45:280
2039299291,15cyclictest29423-21/usr/sbin/munin10:35:310
2039299291,15cyclictest1748-21/usr/sbin/munin10:50:130
2039299291,14cyclictest2930-21/usr/sbin/munin09:25:270
20392992911,13cyclictest138832chrt12:46:180
2039299291,10cyclictest11407-21aten_r4power_po09:50:110
20392992910,11cyclictest0-21swapper/010:47:320
2039299290,4cyclictest81rcu_preempt10:26:250
145142291,5sleep00-21swapper/011:24:250
135582291,5sleep00-21swapper/008:30:060
320672281,5sleep00-21swapper/009:18:300
300842281,5sleep00-21swapper/009:12:270
273802281,5sleep10-21swapper/111:56:261
2039399287,4cyclictest81rcu_preempt10:43:241
2039399285,4cyclictest81rcu_preempt09:48:551
2039399285,4cyclictest81rcu_preempt09:48:551
2039399285,4cyclictest81rcu_preempt08:04:031
2039399284,4cyclictest81rcu_preempt07:52:051
2039399283,4cyclictest81rcu_preempt11:03:411
2039399282,3cyclictest81rcu_preempt09:40:431
20393992819,5cyclictest32734-21cut09:20:161
20393992816,7cyclictest13460-21iostat_ios11:20:191
20393992815,7cyclictest16038-21iostat_ios08:35:201
20393992814,8cyclictest3735-21diskstats10:55:141
2039399281,12cyclictest5442-21seq09:34:131
2039299286,5cyclictest7692-21grep11:05:150
2039299282,13cyclictest0-21swapper/012:35:240
2039299281,3cyclictest81rcu_preempt08:20:010
2039299281,14cyclictest32264-21irqstats12:10:190
2039299281,14cyclictest23036-21aten_r4power_po08:55:090
2039299281,14cyclictest20387-21/usr/sbin/munin11:40:120
2039299281,14cyclictest15488-21ls12:50:270
2039299281,13cyclictest7127-21df12:30:120
2039299281,13cyclictest22262-21/usr/sbin/munin11:45:240
20392992810,6cyclictest23156-21/usr/sbin/munin10:20:170
20392992810,5cyclictest26341-21grep11:55:160
2039299280,4cyclictest81rcu_preempt08:28:000
201612281,5sleep00-21swapper/010:10:500
188042281,5sleep00-21swapper/008:42:320
16512281,5sleep00-21swapper/007:56:300
264572271,5sleep00-21swapper/007:37:310
2039399275,4cyclictest81rcu_preempt12:06:421
2039399273,3cyclictest81rcu_preempt08:33:321
2039399273,17cyclictest4456-21diskstats08:05:151
20393992716,6cyclictest29807-21sed09:10:291
20393992711,5cyclictest40250irq/92-i91512:30:231
20393992710,5cyclictest81rcu_preempt12:40:011
20393992710,5cyclictest40250irq/92-i91509:15:141
2039299273,4cyclictest81rcu_preempt12:15:280
2039299271,13cyclictest4270-21ntp_states10:55:240
2039399265,4cyclictest81rcu_preempt08:56:231
2039399265,4cyclictest81rcu_preempt07:55:321
2039399264,6cyclictest0-21swapper/111:45:241
2039399264,4cyclictest81rcu_preempt10:03:161
2039399264,4cyclictest81rcu_preempt09:00:081
2039399261,4cyclictest81rcu_preempt12:51:391
2039399261,4cyclictest81rcu_preempt12:47:511
2039399261,16cyclictest0-21swapper/111:10:061
20393992610,5cyclictest40250irq/92-i91510:50:131
20393992610,12cyclictest0-21swapper/111:15:291
2039399253,4cyclictest81rcu_preempt07:41:371
2039399252,9cyclictest32264-21irqstats12:10:191
2039399252,4cyclictest81rcu_preempt09:57:461
2039399251,9cyclictest24139-21/usr/sbin/munin11:50:151
20393992516,6cyclictest22-21ksoftirqd/108:45:161
20393992514,5cyclictest19449-21iostat_ios10:10:191
2039399251,20cyclictest1917-21ntp_states12:15:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional