You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sun Sep 13, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
278229911951158,25cyclictest81rcu_preempt07:25:120
278239910801065,12cyclictest0-21swapper/107:25:111
268912564517,32sleep00-21swapper/007:20:270
275802432386,31sleep10-21swapper/107:23:021
3562800,8sleep12782399cyclictest07:35:161
224882590,7sleep02782299cyclictest12:50:180
2782399402,35cyclictest19732-21cron12:45:001
27822994017,7cyclictest1724-21munin-run07:40:010
27823993827,6cyclictest8469-21sshd09:20:261
2782299362,20cyclictest29779-21taskset10:19:190
27822993611,12cyclictest0-21swapper/010:53:220
214902360,9sleep02782299cyclictest09:55:270
203672361,31sleep111038-21snmpd09:54:141
87612350,8sleep02782299cyclictest09:20:500
233632341,29sleep122502-21/usr/sbin/munin10:00:251
67132331,28sleep16740-21ntp_states07:50:251
66462331,4sleep06711-21ntpdc07:50:250
2782299331,20cyclictest20669-21needreboot12:45:220
27822993311,6cyclictest21721-21taskset11:22:230
8342321,27sleep1976-21sed09:00:291
27823993221,7cyclictest2073-21cut09:05:181
2782399321,8cyclictest22551-21tune2fs11:25:151
2782399321,13cyclictest0-21swapper/107:58:471
2782299329,10cyclictest28363-21if_eth011:40:200
2782299322,13cyclictest4827-21/usr/sbin/munin07:45:230
27822993214,6cyclictest3-21ksoftirqd/007:57:280
27822993213,6cyclictest11517-21memory10:55:190
27822993211,6cyclictest32760-21hddtemp_smartct09:00:180
53412311,5sleep10-21swapper/109:14:321
2782399316,13cyclictest40250irq/92-i91511:00:001
2782399312,16cyclictest20555-21diskstats11:20:151
2782399312,15cyclictest31058-21memory08:55:221
27823993112,6cyclictest9341-21fschecks_count10:50:191
2782299316,13cyclictest13453-21taskset12:25:290
2782299316,12cyclictest3286-21runrttasks10:39:340
2782299314,13cyclictest11542-21switchtime12:20:270
2782299313,14cyclictest11038-21snmpd08:28:560
2782299312,14cyclictest7584-21/usr/sbin/munin10:45:180
27822993116,5cyclictest3-21ksoftirqd/010:31:380
27822993115,6cyclictest3-21ksoftirqd/010:25:100
27822993112,7cyclictest7011-21df_inode12:10:150
27822993112,6cyclictest3-21ksoftirqd/011:06:170
27822993112,6cyclictest13374-21df_inode09:35:140
2782299311,19cyclictest7400-21latency_hist09:20:000
27822993111,7cyclictest2615-21grep07:40:220
2782299311,16cyclictest3399-21taskset09:08:530
27822993110,6cyclictest5577-21cut10:40:170
202132311,4sleep120355-21users08:25:301
319062301,25sleep132004-21aten_r4power_vo10:25:121
2782399305,4cyclictest81rcu_preempt12:52:481
2782399305,4cyclictest81rcu_preempt12:21:321
2782399305,3cyclictest81rcu_preempt08:43:571
27823993023,4cyclictest14792-21cron09:40:001
27823993020,6cyclictest17346-21perl09:45:191
2782399301,6cyclictest81rcu_preempt10:40:491
2782399301,5cyclictest81rcu_preempt12:37:491
2782399301,5cyclictest81rcu_preempt10:31:231
27823993015,5cyclictest40250irq/92-i91511:55:011
2782399301,4cyclictest81rcu_preempt11:17:551
2782299305,13cyclictest2225-21dbus-daemon08:21:460
27822993022,5cyclictest16106-21timerwakeupswit09:40:280
2782299302,15cyclictest19566-21ntp_states09:50:280
2782299302,15cyclictest12734-21munin-node11:00:110
27822993013,5cyclictest81rcu_preempt08:40:000
2782299301,25cyclictest25727-21chrt10:06:150
27822993012,5cyclictest19744-21munin-run12:45:010
27822993011,6cyclictest23565-21taskset11:27:040
27822993011,6cyclictest2225-21dbus-daemon09:46:100
27822993010,6cyclictest30315-21sed11:45:200
276112301,5sleep00-21swapper/010:11:210
131232301,5sleep00-21swapper/008:08:270
99632291,5sleep00-21swapper/012:16:250
99632291,5sleep00-21swapper/012:16:240
68402291,5sleep10-21swapper/109:15:381
46402291,5sleep00-21swapper/012:04:370
29912291,4sleep12272-21apt-get07:40:281
279732291,5sleep00-21swapper/008:46:210
2782399296,3cyclictest81rcu_preempt12:31:191
2782399295,4cyclictest81rcu_preempt09:59:381
2782399294,4cyclictest81rcu_preempt10:47:411
2782399294,4cyclictest81rcu_preempt10:37:171
2782399293,4cyclictest81rcu_preempt09:32:151
2782399293,4cyclictest81rcu_preempt08:37:181
2782399292,12cyclictest0-21swapper/111:30:281
2782399291,25cyclictest983-21wget11:55:111
27823992912,13cyclictest10185-21runrttasks08:00:201
2782299292,4cyclictest81rcu_preempt08:55:260
2782299292,14cyclictest25545-21/usr/sbin/munin08:40:240
27822992912,5cyclictest1653-21memory11:55:220
27822992911,6cyclictest9369-21aten_r4power_en09:25:130
27822992911,5cyclictest5673-21ntp_states12:05:240
2782299291,14cyclictest28839-21fschecks_count08:50:160
2782299291,13cyclictest23110-21uname10:00:190
27822992910,6cyclictest330-21awk11:50:320
27822992910,6cyclictest27076-21grep11:35:290
272892291,5sleep10-21swapper/111:36:481
223292291,5sleep10-21swapper/108:31:231
179982291,5sleep00-21swapper/011:12:580
166762291,5sleep00-21swapper/008:16:220
127332291,4sleep112777-21aten_r4power_en11:00:101
82732281,5sleep10-21swapper/112:13:221
298002281,5sleep10-21swapper/110:19:331
2782399284,4cyclictest81rcu_preempt12:18:181
2782399284,4cyclictest81rcu_preempt12:18:171
2782399284,4cyclictest81rcu_preempt11:46:041
2782399283,17cyclictest0-21swapper/112:09:431
2782399281,4cyclictest81rcu_preempt07:49:091
2782299282,13cyclictest9798-21cut08:00:150
27822992813,5cyclictest3-21ksoftirqd/012:37:040
27822992811,5cyclictest4277-21irqstats09:10:200
2782299281,14cyclictest11813-21irqstats09:30:240
259242281,5sleep10-21swapper/110:08:191
253732281,4sleep00-21swapper/011:31:220
188292281,5sleep10-21swapper/108:24:021
150572281,5sleep10-21swapper/108:14:021
138422281,4sleep10-21swapper/112:27:271
131182281,5sleep10-21swapper/108:08:231
278632271,6sleep10-21swapper/110:13:591
2782399274,3cyclictest81rcu_preempt11:40:071
2782399273,4cyclictest81rcu_preempt12:04:511
2782399273,4cyclictest81rcu_preempt07:33:321
2782399273,14cyclictest0-21swapper/108:54:011
2782399271,23cyclictest15769-21fschecks_time08:15:161
2782299274,12cyclictest0-21swapper/008:10:280
2782299272,12cyclictest19186-21ntp_states11:15:250
2782299271,9cyclictest15482-21grep12:30:320
2782299271,13cyclictest20981-21cut08:30:110
2782299271,12cyclictest30504-21/usr/sbin/munin07:30:090
27822992710,5cyclictest30845-21ntpdc10:20:240
164172271,5sleep10-21swapper/109:42:081
109232271,5sleep10-21swapper/109:28:501
2782399263,4cyclictest81rcu_preempt08:46:461
2782399262,4cyclictest81rcu_preempt12:47:021
27823992617,5cyclictest18300-21grep11:15:001
2782399261,10cyclictest14609-21/usr/sbin/munin11:05:121
2782399252,19cyclictest30309-21df10:20:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional