You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 11:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Apr 17, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
240689913021,1296cyclictest24311-21aten_r4power_vo19:25:110
240699911981140,40cyclictest24259-21wget19:25:101
240699911761141,31cyclictest2695-21snmpd20:15:201
240699911761141,31cyclictest2695-21snmpd20:15:201
227932563516,30sleep00-21swapper/019:20:170
239462530486,29sleep10-21swapper/119:24:171
3016421100,8sleep02406899cyclictest22:47:450
240689910887,17cyclictest11903-21irqstats20:15:200
240689910887,17cyclictest11903-21irqstats20:15:200
176262800,8sleep02406899cyclictest21:28:060
294622620,8sleep02406899cyclictest21:00:260
191302470,7sleep12406999cyclictest22:03:031
217242430,6sleep121715-21pidof00:20:001
191132421,37sleep119120-21df_inode20:35:141
77362401,35sleep17746-21ssh22:58:091
2406999391,8cyclictest3286-21runrttasks22:24:261
80592386,6sleep08070-21ssh21:51:030
24068993823,5cyclictest3-21ksoftirqd/022:42:130
2406899371,11cyclictest0-21swapper/020:36:500
119522372,4sleep111963-21sh21:21:551
8392361,31sleep1973-21users22:50:301
24068993615,5cyclictest14134-21/usr/sbin/munin23:05:240
188342360,3sleep018837-21latency00:50:210
188342360,3sleep018837-21latency00:50:200
169212361,3sleep116931-21ssh21:27:061
2406999351,4cyclictest81rcu_preempt23:08:111
24068993512,7cyclictest3-21ksoftirqd/000:17:290
2406899351,22cyclictest3234-21chrt19:51:080
24069993417,4cyclictest22-21ksoftirqd/119:30:271
24069993416,15cyclictest22-21ksoftirqd/122:25:531
2406899349,5cyclictest8108-21df22:25:150
24068993424,6cyclictest8631-21ssh23:32:170
24068993411,7cyclictest24759-21ntp_states23:15:250
253442331,28sleep1117-1kworker/1:1H00:23:161
24069993323,6cyclictest8335-21ssh21:18:431
2406899337,12cyclictest4854-21cut00:35:200
24068993323,6cyclictest30410-21ssh23:20:580
24068993323,6cyclictest24873-21ssh22:09:200
24068993322,6cyclictest3-21ksoftirqd/022:54:570
2406899332,14cyclictest18003-21hddtemp_smartct22:35:170
2406899331,8cyclictest26140-21perl22:10:170
24068993314,6cyclictest5165-21irqstats22:55:200
2406899331,20cyclictest2019-21ssh00:32:280
139742331,9sleep10-21swapper/123:38:021
85542321,3sleep18568-21ssh00:39:481
36912321,27sleep131844-21diskmemload21:14:031
2406999329,19cyclictest0-21swapper/121:33:021
2406999328,13cyclictest40250irq/92-i91523:50:331
2406999326,4cyclictest40250irq/92-i91522:40:291
2406999325,4cyclictest81rcu_preempt20:29:211
24069993226,4cyclictest22-21ksoftirqd/123:15:001
2406999321,12cyclictest117-1kworker/1:1H23:45:201
2406899325,4cyclictest81rcu_preempt22:03:410
2406899324,4cyclictest81rcu_preempt00:29:390
2406899324,11cyclictest5396-21latency21:15:210
2406899321,19cyclictest3253-21df22:20:140
24068993211,6cyclictest0-21swapper/023:52:420
138832321,27sleep013894-21ssh21:57:290
92952312,7sleep10-21swapper/123:00:101
247202311,26sleep024786-21latency21:35:210
2406999319,18cyclictest0-21swapper/100:27:161
2406999317,13cyclictest40250irq/92-i91523:25:591
2406999316,21cyclictest0-21swapper/122:45:501
2406999312,17cyclictest0-21swapper/123:40:091
24069993121,6cyclictest7772-21ssh21:50:371
2406999311,4cyclictest81rcu_preempt23:22:221
2406999311,4cyclictest81rcu_preempt22:39:301
24069993114,10cyclictest22-21ksoftirqd/100:53:261
24069993114,10cyclictest22-21ksoftirqd/100:53:251
24069993110,18cyclictest0-21swapper/121:57:511
2406899314,4cyclictest81rcu_preempt23:37:450
2406899313,14cyclictest16835-21python23:40:310
2406899312,4cyclictest81rcu_preempt23:58:590
2406899312,4cyclictest81rcu_preempt23:29:310
24068993112,5cyclictest14929-21munin-run20:25:000
2406899311,14cyclictest26014-21chrt20:53:080
2406899311,14cyclictest12632-21df_inode00:10:150
24068993110,8cyclictest10162-21needreboot23:00:220
24068993110,5cyclictest30631-21ssh22:15:120
2406899310,4cyclictest81rcu_preempt19:48:470
215582311,5sleep00-21swapper/021:31:500
162832311,26sleep116293-21ssh00:47:261
52122301,6sleep00-21swapper/019:57:060
275242301,25sleep127618-21users20:55:291
2406999309,17cyclictest71642chrt20:02:411
2406999309,10cyclictest22-21ksoftirqd/123:56:591
2406999309,10cyclictest22-21ksoftirqd/121:48:201
2406999306,4cyclictest81rcu_preempt00:09:231
2406999305,4cyclictest81rcu_preempt20:11:311
2406999305,4cyclictest81rcu_preempt19:39:021
2406999305,4cyclictest81rcu_preempt00:34:421
2406999304,13cyclictest81rcu_preempt23:15:151
2406999302,8cyclictest2695-21snmpd20:30:221
2406999301,5cyclictest40250irq/92-i91519:45:231
24069993014,14cyclictest22-21ksoftirqd/123:33:471
2406899309,5cyclictest27370-21latency19:30:200
2406899305,5cyclictest13107-21ssh00:44:290
2406899305,4cyclictest81rcu_preempt00:20:180
2406899304,4cyclictest81rcu_preempt21:22:520
2406899302,4cyclictest81rcu_preempt22:30:040
2406899301,4cyclictest81rcu_preempt23:10:070
2406899301,4cyclictest81rcu_preempt21:10:380
2406899301,13cyclictest7803-21ssh00:05:140
24068993010,6cyclictest3286-21runrttasks20:40:030
143402301,4sleep114462-21users20:20:281
296172291,4sleep10-21swapper/121:01:261
2406999296,10cyclictest0-21swapper/121:40:271
2406999295,4cyclictest81rcu_preempt21:07:531
2406999294,19cyclictest24714-21iostat_ios21:35:201
2406999291,4cyclictest81rcu_preempt00:44:051
2406899292,4cyclictest81rcu_preempt21:45:090
2406899292,4cyclictest81rcu_preempt00:00:360
2406899292,13cyclictest29372-21fschecks_time21:40:160
2406899292,11cyclictest0-21swapper/019:40:230
24068992911,5cyclictest9224-21chrt20:09:350
24068992910,7cyclictest28708-21aten_r4power_vo19:35:100
24068992910,6cyclictest25050-21munin-run23:49:590
24068992910,6cyclictest13744-21ssh00:45:120
145562291,5sleep10-21swapper/122:31:131
126242291,3sleep10-21swapper/100:10:151
53582281,5sleep10-21swapper/119:58:381
2406999289,15cyclictest0-21swapper/122:10:151
2406999284,3cyclictest81rcu_preempt00:01:511
2406999281,6cyclictest7551-21/usr/sbin/munin20:05:281
24069992812,4cyclictest81rcu_preempt22:15:151
2406899285,10cyclictest0-21swapper/020:25:110
2406899281,6cyclictest2695-21snmpd20:10:180
2406899281,18cyclictest0-21swapper/021:05:190
2406899281,17cyclictest0-21swapper/020:33:570
227942281,5sleep10-21swapper/122:06:211
2406999275,4cyclictest81rcu_preempt20:45:531
2406999273,8cyclictest24778-21diskstats20:50:151
24068992710,4cyclictest6691-21python20:00:270
2406999265,4cyclictest81rcu_preempt19:53:341
2406999262,10cyclictest21012-21df_inode20:40:141
24069992610,4cyclictest40250irq/92-i91519:40:121
2406899254,17cyclictest0-21swapper/020:45:150
2406899244,6cyclictest26858-21http_loadtime20:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional