You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 04:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun May 24, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13709912431205,25cyclictest3350-21cron19:29:591
9062619540,64sleep00-21swapper/019:20:430
12932530486,29sleep10-21swapper/119:24:461
136999154144,6cyclictest3350-21cron19:30:000
2127521230,9sleep1137099cyclictest00:30:301
277312980,2sleep10-21swapper/120:30:261
195572770,4sleep1211ktimersoftd/100:27:001
157992510,9sleep1137099cyclictest20:00:161
309882480,9sleep0136999cyclictest23:30:310
73332370,5sleep17328-21hddtemp_smartct23:55:181
1370993727,6cyclictest1561-21perl23:40:161
136999351,22cyclictest9020-21taskset21:07:270
168982347,4sleep181rcu_preempt22:55:161
325622331,5sleep132603-21iostat22:10:191
137099339,4cyclictest81rcu_preempt22:25:131
1370993313,9cyclictest22-21ksoftirqd/122:20:121
136999331,20cyclictest21113-21grep23:05:220
130882331,28sleep113171-21memory00:10:231
325282321,27sleep132648-21df20:45:141
290762320,4sleep0111rcuc/022:00:250
136999326,13cyclictest4274-21hddtemp_smartct20:55:160
136999326,12cyclictest11853-21cpuspeed_turbos19:50:130
1369993221,6cyclictest13298-21ntpdc00:10:240
1369993212,6cyclictest14645-21df00:15:150
244202311,26sleep124445-21fschecks_count23:15:171
202342311,5sleep10-21swapper/121:36:421
137099318,9cyclictest2225-21dbus-daemon22:41:321
137099313,25cyclictest32244-21iostat_ios23:35:201
1370993122,5cyclictest24376-21iostat_ios00:40:201
137099311,8cyclictest28261-21/usr/sbin/munin22:00:191
136999318,12cyclictest527-21taskset23:36:100
1369993122,6cyclictest27022-21/usr/sbin/munin20:30:150
136999312,16cyclictest0-21swapper/021:17:390
136999312,14cyclictest20457-21users20:10:280
136999311,18cyclictest28824-21cstates20:35:110
319082301,5sleep10-21swapper/120:41:591
185002301,5sleep10-21swapper/121:33:091
185002301,5sleep10-21swapper/121:33:081
161972301,5sleep00-21swapper/022:52:320
137099306,4cyclictest81rcu_preempt20:57:231
137099304,9cyclictest15778-21memory21:25:231
137099304,20cyclictest28171-21iostat_ios00:50:201
1370993019,7cyclictest31354-21head22:05:301
1370993016,11cyclictest22-21ksoftirqd/123:30:291
1369993021,6cyclictest9434-21cron19:43:000
136999302,15cyclictest7499-21diskstats22:30:150
136999302,15cyclictest2323-21/usr/sbin/munin23:40:300
136999302,15cyclictest0-21swapper/020:09:020
136999302,15cyclictest0-21swapper/020:09:010
136999302,14cyclictest10889-21df00:05:140
136999301,14cyclictest0-21swapper/000:02:020
136999301,13cyclictest0-21swapper/000:45:000
85842291,5sleep10-21swapper/122:31:351
69992291,5sleep00-21swapper/021:00:590
67212291,5sleep00-21swapper/022:26:450
65402291,5sleep00-21swapper/023:53:420
62852291,5sleep10-21swapper/123:51:021
54952291,5sleep10-21swapper/119:31:141
46882291,5sleep00-21swapper/023:48:570
323612291,5sleep00-21swapper/020:45:060
294392291,5sleep10-21swapper/123:28:181
168622291,5sleep00-21swapper/000:20:230
168082291,5sleep00-21swapper/020:01:230
164822291,5sleep00-21swapper/021:26:420
137099296,4cyclictest81rcu_preempt20:09:061
137099296,4cyclictest81rcu_preempt20:09:051
137099295,4cyclictest81rcu_preempt19:35:031
137099294,9cyclictest16555-21diskstats00:20:161
137099294,8cyclictest3380-21diskstats23:45:171
137099294,4cyclictest81rcu_preempt22:48:521
137099294,3cyclictest81rcu_preempt00:19:561
137099291,25cyclictest1974-21lldpad00:47:051
137099291,24cyclictest15959-21grep22:50:301
137099291,14cyclictest13228-21aten_r4power_cu21:20:111
136999298,11cyclictest9433-21cut22:35:160
136999292,23cyclictest0-21swapper/023:15:130
136999291,4cyclictest81rcu_preempt22:05:430
136999291,24cyclictest12595-21taskset22:44:020
136999291,19cyclictest0-21swapper/020:40:560
136999291,15cyclictest26893-21/usr/sbin/munin21:55:180
1369992910,6cyclictest7756-21pidof19:40:000
1369992910,6cyclictest21182-21sed00:30:280
1369992910,6cyclictest10701-21users21:10:300
79132281,5sleep10-21swapper/119:40:061
70102281,5sleep10-21swapper/121:01:041
54582281,5sleep00-21swapper/019:30:520
35972281,5sleep10-21swapper/120:54:481
35972281,5sleep10-21swapper/120:54:481
29542281,5sleep00-21swapper/022:16:560
280502281,5sleep10-21swapper/121:59:501
259252281,5sleep10-21swapper/121:52:111
234372281,5sleep10-21swapper/100:38:211
221052281,5sleep10-21swapper/121:41:271
137099281,22cyclictest19094-21iostat_ios23:00:191
136999288,6cyclictest9798-21/usr/sbin/munin19:45:120
136999284,17cyclictest26315-21diskstats23:20:140
136999283,18cyclictest21752-21python21:40:280
136999283,13cyclictest0-21swapper/021:47:140
1369992812,5cyclictest26344-21sort00:45:220
136999281,18cyclictest0-21swapper/022:45:180
1369992811,5cyclictest6858-21wget23:55:120
1369992811,5cyclictest2103-21diskstats20:50:150
1369992811,5cyclictest2103-21diskstats20:50:150
136999281,15cyclictest19630-21chrt00:27:480
136999281,14cyclictest3454-21/usr/sbin/munin22:20:130
136999281,14cyclictest23084-21grep00:35:300
136999281,10cyclictest28319-21fschecks_time23:25:160
116652281,4sleep10-21swapper/119:50:061
105172281,5sleep10-21swapper/122:37:111
261762271,5sleep00-21swapper/021:54:490
224752271,5sleep10-21swapper/120:16:511
217792271,5sleep10-21swapper/123:06:541
205852271,5sleep10-21swapper/120:11:421
137099274,4cyclictest81rcu_preempt21:10:541
137099274,4cyclictest81rcu_preempt20:36:001
137099274,14cyclictest0-21swapper/120:26:031
137099273,17cyclictest8155-21iostat_ios21:05:201
137099272,4cyclictest81rcu_preempt00:00:401
137099272,3cyclictest81rcu_preempt00:08:121
136999278,6cyclictest17254-21df_inode21:30:130
136999278,6cyclictest17254-21df_inode21:30:120
136999272,13cyclictest21563-21hddtemp_smartct20:15:190
136999271,18cyclictest0-21swapper/019:55:030
136999271,14cyclictest27657-21aten_r4power_vo00:50:120
136999271,14cyclictest17863-21users22:55:300
136999271,13cyclictest24214-21grep20:20:300
136999271,13cyclictest22454-21cut23:10:120
136999271,13cyclictest19101-21/usr/sbin/munin23:00:210
136999271,12cyclictest13216-21/usr/sbin/munin21:20:110
127302271,5sleep10-21swapper/121:16:581
110972271,5sleep10-21swapper/119:45:471
234502261,20sleep123486-21proc_pri21:45:291
14262261,4sleep10-21swapper/122:15:071
137099269,5cyclictest81rcu_preempt23:12:081
136999261,14cyclictest0-21swapper/020:27:070
137099259,5cyclictest40250irq/92-i91523:20:251
137099252,8cyclictest14376-21ntp_states19:55:251
136999251,20cyclictest505-21sendmail_mailst22:10:260
136999251,15cyclictest0-21swapper/021:37:120
137099243,5cyclictest23568-21iostat_ios20:20:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional