You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 05:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Dec 28, 2025 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125369911831134,34cyclictest21561-21ntp_states21:10:241
125359911411100,28cyclictest13177-21smartctl19:25:160
125369911271098,25cyclictest13006-21cut19:25:151
121262636590,31sleep00-21swapper/019:21:160
123252462418,29sleep10-21swapper/119:23:221
166322960,4sleep041ktimersoftd/022:45:220
166322960,4sleep041ktimersoftd/022:45:220
283322850,8sleep01253599cyclictest22:24:530
12535998579,3cyclictest21566-21ssh21:10:250
201892800,4sleep10-21swapper/122:15:291
92092790,4sleep00-21swapper/021:30:340
1253599594,19cyclictest22914-21iostat_ios23:25:230
1253599581,19cyclictest3302-21runrttasks22:37:410
12535995716,8cyclictest25788-21diskstats21:15:150
1253599564,9cyclictest9960-21iostat_ios23:45:230
1253599562,5cyclictest16244-21irqstats00:25:220
1253599562,13cyclictest20330-21diskmemload00:48:280
12535995614,6cyclictest20330-21diskmemload23:13:570
1253599561,13cyclictest31942-21ssh21:55:080
1253599552,12cyclictest0-21swapper/021:36:280
1253599549,4cyclictest0-21swapper/022:07:080
1253599549,12cyclictest0-21swapper/023:57:020
1253599542,17cyclictest0-21swapper/023:43:380
1253599542,11cyclictest0-21swapper/023:05:450
12535995411,9cyclictest0-21swapper/000:12:280
1253599541,14cyclictest5609-21cpuspeed_turbos20:30:150
12535995410,4cyclictest0-21swapper/022:59:130
1253599539,6cyclictest1718-21sh22:30:190
1253599539,3cyclictest0-21swapper/022:50:250
1253599538,4cyclictest0-21swapper/000:19:120
1253599536,5cyclictest0-21swapper/023:52:200
1253599536,13cyclictest0-21swapper/000:38:320
1253599533,17cyclictest29496-21timerwakeupswit20:05:320
1253599533,17cyclictest29496-21timerwakeupswit20:05:320
1253599532,19cyclictest0-21swapper/023:35:490
1253599532,18cyclictest0-21swapper/023:16:170
1253599532,17cyclictest0-21swapper/000:02:210
1253599532,13cyclictest20330-21diskmemload00:33:370
1253599529,11cyclictest0-21swapper/022:15:130
1253599527,12cyclictest0-21swapper/021:48:320
1253599522,16cyclictest20330-21diskmemload00:06:330
1253599521,19cyclictest0-21swapper/021:44:270
1253599521,19cyclictest0-21swapper/000:22:560
1253599521,18cyclictest0-21swapper/022:01:530
12535995211,11cyclictest0-21swapper/022:27:430
12535995210,12cyclictest2425-21udevd23:05:000
1253599519,12cyclictest0-21swapper/021:21:110
1253599514,9cyclictest25196-21iostat_ios19:55:210
1253599512,16cyclictest0-21swapper/022:13:430
1253599511,18cyclictest0-21swapper/022:42:200
1253599507,5cyclictest20160-21ssh23:22:280
1253599505,13cyclictest0-21swapper/023:31:550
1253599502,14cyclictest16569-21munin-run20:59:590
1253599501,18cyclictest0-21swapper/021:51:420
1253599501,17cyclictest0-21swapper/000:40:300
1253599501,13cyclictest3188-21sh21:25:170
1253599492,12cyclictest6791-21diskstats00:50:170
1253599492,12cyclictest19802-21ntp_states19:40:260
1253599492,10cyclictest0-21swapper/020:25:140
1253599491,6cyclictest32309-21tr20:15:130
1253599491,5cyclictest2390-21ntpq20:20:230
1253599491,13cyclictest11574-21hddtemp_smartct20:45:180
1253599473,10cyclictest9796-21iostat_ios20:40:190
1253599472,12cyclictest15478-21df19:30:140
12535994516,6cyclictest3-21ksoftirqd/020:54:330
1253599445,9cyclictest17368-21diskstats19:35:150
1253599441,5cyclictest2403-21irqbalance19:47:250
1253599441,11cyclictest28133-21taskset20:04:160
313312420,3sleep1201rcuc/123:00:271
1253599411,12cyclictest23212-21hddtemp_smartct19:50:180
1253599411,10cyclictest18688-21wget21:05:110
74462401,35sleep17457-21ssh23:42:481
82472391,5sleep18258-21sh22:03:511
76402381,33sleep17651-21ssh00:15:571
325872381,5sleep132601-21ssh00:42:051
1253699359,4cyclictest81rcu_preempt22:35:111
1253699356,5cyclictest81rcu_preempt00:45:141
1253699352,29cyclictest0-21swapper/123:50:551
12536993516,6cyclictest14677-21latency_hist20:55:001
302352341,9sleep10-21swapper/120:10:071
153022341,4sleep115313-21ssh23:17:301
1253699345,26cyclictest0-21swapper/100:26:161
1253699342,5cyclictest0-21swapper/122:49:351
1253699342,5cyclictest0-21swapper/122:49:351
1253699342,29cyclictest0-21swapper/100:31:361
1253699342,28cyclictest0-21swapper/122:42:561
12536993412,4cyclictest22-21ksoftirqd/100:05:121
192332331,28sleep119258-21df_inode19:40:151
1253699334,4cyclictest81rcu_preempt22:29:001
1253699334,4cyclictest81rcu_preempt21:47:441
1253699333,4cyclictest81rcu_preempt22:05:411
1253699333,28cyclictest0-21swapper/120:35:351
1253699332,28cyclictest0-21swapper/123:59:351
1253699332,17cyclictest0-21swapper/122:55:241
1253699331,30cyclictest0-21swapper/100:12:161
1253699331,11cyclictest25335-21ssh00:00:401
1253699326,13cyclictest0-21swapper/122:32:371
1253699324,4cyclictest81rcu_preempt23:05:421
1253699324,4cyclictest81rcu_preempt21:17:551
1253699324,25cyclictest22-21ksoftirqd/122:11:051
1253699323,5cyclictest81rcu_preempt23:33:141
1253699323,4cyclictest81rcu_preempt23:26:191
1253699323,4cyclictest81rcu_preempt21:41:531
1253699323,4cyclictest81rcu_preempt21:36:291
12536993225,4cyclictest0-21swapper/123:23:361
12536993221,7cyclictest7397-21ssh21:29:581
1253699321,5cyclictest81rcu_preempt21:23:481
1253699321,5cyclictest81rcu_preempt19:46:251
1253699321,28cyclictest22769-21ssh22:51:351
1253599321,29cyclictest0-21swapper/020:12:550
1253699314,4cyclictest81rcu_preempt22:24:161
1253699313,4cyclictest81rcu_preempt23:12:281
1253699313,4cyclictest81rcu_preempt21:54:281
1253699313,4cyclictest81rcu_preempt21:33:401
1253699311,9cyclictest5660-21cstates20:30:161
1253699311,5cyclictest0-21swapper/121:01:561
1253699311,4cyclictest81rcu_preempt20:03:061
1253599314,24cyclictest0-21swapper/021:00:580
1253699302,24cyclictest0-21swapper/100:53:591
12536993021,5cyclictest680-21tr21:55:311
1253699301,20cyclictest0-21swapper/120:06:361
1253699301,20cyclictest0-21swapper/120:06:351
184562291,4sleep10-21swapper/119:36:351
1253699293,4cyclictest81rcu_preempt23:45:281
1253699293,23cyclictest0-21swapper/100:21:061
1253699292,4cyclictest81rcu_preempt21:05:541
12536992924,3cyclictest0-21swapper/123:36:161
1253699292,23cyclictest1854-21df_inode20:20:141
1253699291,4cyclictest81rcu_preempt00:39:491
1253699284,17cyclictest11376-21diskstats20:45:161
12536992811,5cyclictest40550irq/92-i91520:40:281
1253699280,4cyclictest81rcu_preempt20:57:481
49542271,5sleep10-21swapper/120:26:481
1253699276,7cyclictest0-21swapper/119:50:391
1253599272,20cyclictest7823-21/usr/sbin/munin20:35:190
12352271,5sleep10-21swapper/120:18:331
12536992618,4cyclictest25079-21fschecks_time19:55:171
12536992610,12cyclictest14922-21python19:30:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional