You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 13:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Jun 02, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164179911201111,6cyclictest0-21swapper/119:28:291
159342628533,32sleep00-21swapper/019:20:300
161702620576,30sleep10-21swapper/119:23:001
1641699164155,6cyclictest0-21swapper/019:28:290
3206321120,5sleep132060-21ps00:20:261
284562840,5sleep016414-21cyclictest22:45:220
113452770,4sleep1201rcuc/122:00:171
16417995918,35cyclictest20544-21diskstats22:25:161
259812550,3sleep041ktimersoftd/019:45:310
1641799554,18cyclictest17069-21iostat_ios22:15:211
16417995514,6cyclictest14216-21runrttasks22:07:491
1641799542,17cyclictest0-21swapper/123:20:091
1641799542,11cyclictest0-21swapper/120:30:281
1641799541,19cyclictest0-21swapper/120:05:271
1641799541,19cyclictest0-21swapper/120:05:261
1641799533,8cyclictest23074-21iostat_ios21:05:211
1641799531,16cyclictest31158-21taskset22:52:591
1641799523,8cyclictest25014-21diskstats19:45:151
1641799523,17cyclictest6656-21diskstats00:40:161
1641799522,15cyclictest32163-21df21:30:121
1641799522,10cyclictest0-21swapper/121:50:251
16417995214,3cyclictest0-21swapper/121:20:121
16417995213,4cyclictest0-21swapper/122:46:221
16417995213,4cyclictest0-21swapper/119:50:031
16417995212,6cyclictest0-21swapper/122:13:331
1641799514,8cyclictest3235-21diskstats23:05:161
16417995112,4cyclictest0-21swapper/123:12:341
16417995111,8cyclictest214622chrt19:35:181
16417995111,8cyclictest19670-21iostat_ios19:30:191
1641799511,14cyclictest2695-21snmpd22:34:311
1641799505,12cyclictest0-21swapper/120:25:171
1641799503,9cyclictest7279-21munin-run20:25:001
1641799502,14cyclictest30005-21/usr/sbin/munin21:25:321
16417995014,4cyclictest0-21swapper/122:40:261
16417995013,4cyclictest0-21swapper/121:19:381
16417995012,4cyclictest0-21swapper/100:11:221
16417995011,8cyclictest2225-21dbus-daemon00:27:021
1641799494,8cyclictest11301-21ntp_states23:25:251
1641799493,15cyclictest2695-21snmpd00:02:091
16417994913,5cyclictest3410-21runrttasks20:14:131
16417994912,6cyclictest13560-21perl20:40:181
16417994912,4cyclictest0-21swapper/119:42:521
16417994911,6cyclictest30743-21runrttasks00:17:261
16417994911,5cyclictest15537-21runrttasks23:35:491
1641799487,13cyclictest10743-21iostat00:50:181
1641799483,15cyclictest0-21swapper/120:50:091
1641799483,13cyclictest0-21swapper/123:50:271
1641799483,13cyclictest0-21swapper/123:50:271
1641799483,10cyclictest15776-21ntp_states20:45:261
1641799482,6cyclictest3286-21runrttasks21:00:201
16417994816,5cyclictest25736-21tr00:05:121
16417994811,7cyclictest2225-21dbus-daemon21:40:151
16417994810,7cyclictest0-21swapper/123:40:261
1641799475,9cyclictest1556-21iostat_ios23:00:191
1641799475,13cyclictest0-21swapper/122:35:231
1641799475,10cyclictest2870-21diskstats00:30:151
1641799474,8cyclictest31197-21ntp_states20:00:251
1641799474,8cyclictest18670-21diskstats22:20:161
1641799472,9cyclictest9772-21ntp_states21:55:251
16417994711,8cyclictest2225-21dbus-daemon22:57:381
1641799469,7cyclictest0-21swapper/123:55:251
1641799464,8cyclictest5876-21memory21:45:231
1641799464,8cyclictest13040-21memory23:30:221
1641799462,5cyclictest4335-21memory20:15:221
1641799462,14cyclictest2143-21ntp_states21:35:251
16417994615,5cyclictest22-21ksoftirqd/120:55:531
16417994612,6cyclictest137450irq/90-eth023:15:151
16417994610,7cyclictest2225-21dbus-daemon19:55:191
1641799454,8cyclictest24652-21diskstats21:10:161
1641799445,8cyclictest11773-21iostat_ios20:35:201
1641799444,8cyclictest8864-21iostat_ios00:45:211
1641799443,7cyclictest18697-21memory23:45:241
16417994311,6cyclictest3286-21runrttasks00:37:431
1641699372,21cyclictest5476-21df_inode21:45:150
1641699364,12cyclictest81rcu_preempt23:39:070
321622350,9sleep01641699cyclictest00:20:260
305652351,10sleep00-21swapper/000:15:380
1641699351,21cyclictest6716-21cut23:15:120
16416993316,14cyclictest0-21swapper/020:40:330
1641699331,13cyclictest0-21swapper/022:37:590
5382321,9sleep00-21swapper/022:57:380
1641699323,26cyclictest28940-21kworker/u4:023:00:310
11282321,27sleep01150-21munin-run21:35:000
208692311,25sleep020936-21memory22:25:230
181822311,25sleep018207-21munin-run22:20:000
1641699312,14cyclictest7464-21fschecks_time21:50:160
16416993113,6cyclictest28746-21df19:55:120
16416993112,6cyclictest11394-21if_eth022:00:180
1641699311,15cyclictest24358-21/usr/sbin/munin21:10:180
300722301,24sleep00-21swapper/021:25:120
1641699309,7cyclictest26822-21cut22:40:270
16416993016,11cyclictest3-21ksoftirqd/021:06:540
16416993012,5cyclictest4789-21grep23:10:000
78822291,5sleep00-21swapper/000:43:050
29192291,5sleep00-21swapper/021:37:590
249802291,5sleep00-21swapper/000:01:020
243072291,5sleep00-21swapper/019:42:260
224392291,5sleep00-21swapper/019:37:440
196602291,5sleep00-21swapper/023:49:250
1641699297,12cyclictest0-21swapper/021:15:190
1641699297,11cyclictest25746-21cstates00:05:120
1641699297,10cyclictest16304-21cron22:14:590
1641699296,5cyclictest0-21swapper/019:51:060
1641699294,13cyclictest11565-21gdbus20:06:100
1641699294,13cyclictest11565-21gdbus20:06:090
1641699292,4cyclictest81rcu_preempt23:27:500
1641699292,23cyclictest0-21swapper/022:50:280
1641699292,14cyclictest9897-21iostat_ios20:30:200
16416992918,7cyclictest27509-21wget00:10:130
1641699291,4cyclictest81rcu_preempt00:54:560
1641699291,25cyclictest111-21usb-storage20:03:050
16416992911,6cyclictest1487-21processes00:25:270
16416992911,6cyclictest11565-21gdbus23:53:010
16416992911,6cyclictest11565-21gdbus23:53:010
1641699290,4cyclictest81rcu_preempt22:08:180
68822281,5sleep00-21swapper/020:21:040
63122281,5sleep00-21swapper/023:12:440
47542281,5sleep00-21swapper/021:42:140
40852281,5sleep00-21swapper/000:32:500
33052281,5sleep00-21swapper/020:13:130
291372281,23sleep00-21swapper/021:20:290
230562281,5sleep00-21swapper/023:55:450
200642281,5sleep00-21swapper/020:56:220
1641699282,4cyclictest81rcu_preempt22:24:070
1641699281,14cyclictest13043-21latency_hist20:40:000
16416992810,9cyclictest0-21swapper/023:23:260
16416992810,6cyclictest22387-21cstates22:30:130
203522271,5sleep00-21swapper/019:30:320
182832271,5sleep00-21swapper/020:52:200
1641699277,9cyclictest0-21swapper/023:40:390
1641699275,5cyclictest81rcu_preempt21:55:200
16416992717,6cyclictest3-21ksoftirqd/000:35:060
1641699271,4cyclictest81rcu_preempt20:46:020
1641699271,22cyclictest4637-21awk20:15:270
1641699271,14cyclictest8856-21iostat00:45:200
1641699269,15cyclictest0-21swapper/023:33:070
1641699262,11cyclictest21617-21python21:00:260
16416992617,6cyclictest9147-21turbostat.cron20:30:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional