You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 09:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Wed Jul 15, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214879912441217,23cyclictest1585-21hddtemp_smartct19:55:181
214879911491128,17cyclictest22383-21strings19:25:231
198182609561,31sleep00-21swapper/019:20:130
197122484439,30sleep10-21swapper/119:20:021
2148699169147,18cyclictest0-21swapper/019:55:180
221602830,9sleep12148799cyclictest23:40:261
21486998359,19cyclictest0-21swapper/019:25:230
157732820,9sleep12148799cyclictest23:25:131
149352590,8sleep12148799cyclictest23:20:301
308332580,7sleep02148699cyclictest00:05:130
71282570,6sleep12148799cyclictest20:10:141
21487995226,13cyclictest22-21ksoftirqd/122:25:001
21487994915,5cyclictest22-21ksoftirqd/100:45:231
21487994714,4cyclictest22-21ksoftirqd/121:07:181
21487994122,4cyclictest22-21ksoftirqd/119:50:041
21487994121,9cyclictest22-21ksoftirqd/100:15:171
2148799406,4cyclictest81rcu_preempt19:35:281
2148799403,6cyclictest22-21ksoftirqd/120:55:241
21487994024,4cyclictest22-21ksoftirqd/119:45:011
21487994021,4cyclictest22-21ksoftirqd/122:10:011
2148799401,7cyclictest22-21ksoftirqd/123:05:221
2148799396,6cyclictest22-21ksoftirqd/121:18:451
2148799396,4cyclictest81rcu_preempt20:00:111
2148799395,4cyclictest81rcu_preempt23:30:161
21487993921,5cyclictest22-21ksoftirqd/100:07:071
21487993914,15cyclictest22-21ksoftirqd/122:35:261
2148799384,4cyclictest81rcu_preempt20:15:121
2148799383,4cyclictest81rcu_preempt20:25:121
2148799381,7cyclictest22-21ksoftirqd/122:30:231
2148799381,7cyclictest22-21ksoftirqd/121:25:121
2148799381,7cyclictest22-21ksoftirqd/120:30:161
2148799381,7cyclictest22-21ksoftirqd/100:30:211
2148799381,6cyclictest22-21ksoftirqd/123:15:231
21487993815,11cyclictest22-21ksoftirqd/122:25:151
2148799372,6cyclictest22-21ksoftirqd/121:55:231
21487993717,5cyclictest22-21ksoftirqd/122:10:231
2148799371,16cyclictest22-21ksoftirqd/120:45:121
2148699376,18cyclictest0-21swapper/021:35:260
2148799366,4cyclictest81rcu_preempt22:45:181
2148799361,7cyclictest22-21ksoftirqd/121:50:131
2148799361,7cyclictest22-21ksoftirqd/120:40:001
21487993617,4cyclictest22-21ksoftirqd/100:40:161
2148799355,4cyclictest81rcu_preempt21:40:231
2148799352,4cyclictest81rcu_preempt19:30:051
2148799351,6cyclictest22-21ksoftirqd/120:20:121
2148799351,4cyclictest81rcu_preempt23:50:201
2148699351,13cyclictest0-21swapper/019:44:180
2148799343,4cyclictest22-21ksoftirqd/121:00:201
2148799341,7cyclictest22-21ksoftirqd/122:50:171
2148799341,6cyclictest3286-21runrttasks23:45:221
2148799341,6cyclictest22-21ksoftirqd/121:39:331
2148799341,4cyclictest81rcu_preempt23:00:121
2148799341,4cyclictest81rcu_preempt22:40:161
2148699347,5cyclictest81rcu_preempt21:15:160
2148699346,13cyclictest27579-21cut23:55:230
2148699342,17cyclictest15504-21df00:50:130
2148699341,20cyclictest19583-21cat22:10:010
48982331,5sleep14905-21diskstats21:30:151
268602330,4sleep0111rcuc/021:00:310
2148799335,4cyclictest81rcu_preempt22:00:271
21487993319,4cyclictest22-21ksoftirqd/100:20:181
2148799331,4cyclictest81rcu_preempt21:25:011
2148799331,4cyclictest81rcu_preempt00:10:211
2148799331,4cyclictest17522-21kworker/1:122:18:281
21487993312,3cyclictest22-21ksoftirqd/100:51:421
2148699339,12cyclictest2762-21ntp_states00:15:270
2148699339,12cyclictest0-21swapper/021:14:280
2148699338,13cyclictest22927-21taskset22:16:390
2148699331,18cyclictest4425-21pidof20:01:000
2148799323,4cyclictest81rcu_preempt00:00:241
21487993218,4cyclictest22-21ksoftirqd/123:35:221
21487993211,4cyclictest22-21ksoftirqd/100:40:011
2148799321,10cyclictest81rcu_preempt20:50:561
2148699329,6cyclictest12972-21taskset00:43:140
2148699321,21cyclictest0-21swapper/023:05:230
21486993210,9cyclictest0-21swapper/019:35:010
202522321,27sleep020312-21python23:35:290
2148799319,4cyclictest81rcu_preempt23:10:141
2148799315,4cyclictest81rcu_preempt22:58:141
2148799311,18cyclictest18367-21cstates20:40:131
2148799311,18cyclictest18367-21cstates20:40:131
21487993111,6cyclictest22-21ksoftirqd/121:11:581
2148699317,16cyclictest0-21swapper/019:36:160
2148699312,17cyclictest0-21swapper/023:51:150
2148699312,15cyclictest20020-21/usr/sbin/munin20:45:150
2148699311,4cyclictest81rcu_preempt19:47:580
21486993113,6cyclictest8255-21irqstats00:30:200
21486993113,5cyclictest14375-21/usr/sbin/munin20:30:130
21486993111,7cyclictest4089-21munin-run22:55:000
2148799302,4cyclictest81rcu_preempt19:45:131
21487993016,4cyclictest22-21ksoftirqd/123:55:191
2148799301,4cyclictest81rcu_preempt00:25:191
2148699306,12cyclictest81rcu_preempt20:18:000
2148699304,13cyclictest24798-21latency_hist23:50:010
2148699302,16cyclictest0-21swapper/020:59:140
21486993012,5cyclictest23727-21df_inode22:20:130
21486993012,5cyclictest12352-21munin-run20:25:000
2148699301,14cyclictest8364-21cron20:12:590
2148699301,14cyclictest7478-21taskset23:01:050
187902301,5sleep00-21swapper/023:31:280
172242301,5sleep00-21swapper/022:00:580
134402301,5sleep00-21swapper/023:19:320
303902291,5sleep00-21swapper/000:04:350
23562291,5sleep00-21swapper/021:23:470
21487992910,8cyclictest22-21ksoftirqd/120:05:291
2148699299,6cyclictest4979-21grep00:20:290
2148699292,14cyclictest21882-21memory23:40:190
2148699291,4cyclictest81rcu_preempt22:31:390
2148699291,4cyclictest81rcu_preempt21:30:270
21486992912,5cyclictest22216-21/usr/sbin/munin20:50:160
21486992911,5cyclictest14602-21iostat21:55:200
2148699291,13cyclictest30270-21/usr/sbin/munin22:35:270
21486992910,7cyclictest0-21swapper/022:46:560
21486992910,15cyclictest113922chrt23:12:480
211372291,5sleep00-21swapper/022:12:370
170752291,5sleep00-21swapper/023:28:070
13152291,5sleep00-21swapper/000:10:470
119232291,5sleep00-21swapper/021:49:320
2148699282,13cyclictest4380-21sshd21:29:200
2148699281,4cyclictest81rcu_preempt00:25:310
21486992811,6cyclictest17829-21taskset20:38:370
21486992811,5cyclictest0-21swapper/021:40:270
21486992810,5cyclictest28145-21iostat_ios21:05:200
149992281,5sleep00-21swapper/000:49:270
117872281,4sleep10-21swapper/121:48:071
322792271,5sleep00-21swapper/022:40:580
2148699271,17cyclictest0-21swapper/021:54:150
21486992711,5cyclictest0-21swapper/022:27:240
2148699271,14cyclictest564-21sshd19:51:190
2148699271,14cyclictest11564-21packagekitd20:05:500
2148699271,13cyclictest18967-21grep20:40:260
2148699271,13cyclictest18967-21grep20:40:250
109832271,5sleep00-21swapper/000:37:190
2148699266,11cyclictest0-21swapper/022:57:410
21486992615,7cyclictest13591-21sort20:25:290
2148699241,12cyclictest13970-21diskstats23:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional