You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 18:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Tue Dec 02, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
300539912081190,15cyclictest0-21swapper/107:25:121
300539911711141,26cyclictest11581-21udevd07:58:041
296122593517,62sleep10-21swapper/107:20:591
296122593517,62sleep10-21swapper/107:20:591
298002497454,28sleep00-21swapper/007:22:580
298002497454,28sleep00-21swapper/007:22:580
30052992401,5cyclictest30296-21aten_r4power_vo07:25:120
3005299221196,18cyclictest11578-40update-apt-xapi07:58:040
30053997613,40cyclictest2220-21dbus-daemon11:49:371
3005399752,6cyclictest1845-21ssh11:19:491
3005399751,41cyclictest16607-21sh12:40:401
3005399749,41cyclictest2220-21dbus-daemon11:33:031
3005399738,37cyclictest11249-21iostat_ios10:55:221
3005399732,5cyclictest2247-21users10:45:311
3005399731,8cyclictest20938-21iostat_ios11:05:231
3005399701,48cyclictest24847-21fschecks_time12:50:151
3005399698,34cyclictest40950irq/93-i91511:20:191
3005399672,51cyclictest0-21swapper/111:04:581
30053996711,42cyclictest0-21swapper/112:39:201
3005399669,30cyclictest0-21swapper/109:32:501
3005399666,4cyclictest40950irq/93-i91510:50:231
3005399662,47cyclictest3878-21taskset10:14:531
3005399662,37cyclictest0-21swapper/109:05:131
3005399643,7cyclictest12463-21hddtemp_smartct08:00:171
3005399641,5cyclictest16828-21seq11:35:111
3005399641,44cyclictest0-21swapper/112:30:131
3005399641,44cyclictest0-21swapper/112:30:131
3005399641,41cyclictest8327-21kworker/1:210:19:031
30053996411,39cyclictest0-21swapper/109:58:471
3005399639,42cyclictest0-21swapper/109:18:211
187102630,6sleep03005299cyclictest08:15:300
3005399629,36cyclictest236932chrt10:35:141
3005399629,29cyclictest40950irq/93-i91509:42:501
3005399628,6cyclictest24945-21ssh11:10:021
3005399624,4cyclictest0-21swapper/110:20:011
3005399621,6cyclictest19438-21ssh09:23:401
3005399621,6cyclictest19438-21ssh09:23:391
3005399621,5cyclictest9005-21sh09:12:351
3005399621,48cyclictest26068-21sh10:04:101
3005399621,48cyclictest0-21swapper/112:21:041
239112620,8sleep03005299cyclictest10:35:180
3005399615,38cyclictest0-21swapper/112:00:311
3005399613,4cyclictest0-21swapper/111:29:091
3005399611,6cyclictest2393-21taskset11:53:251
3005399611,42cyclictest7656-21ssh11:58:551
30053996112,32cyclictest0-21swapper/109:49:261
3005399604,50cyclictest28734-21diskstats10:40:171
3005399602,5cyclictest20991-21fschecks_count09:25:161
3005399601,8cyclictest20804-21rm10:31:231
3005399601,8cyclictest1615-21ssh09:38:531
3005399601,8cyclictest16089-21ssh10:26:341
30053996016,24cyclictest22-21ksoftirqd/108:18:411
3005399601,46cyclictest17125-21chrt08:11:441
30053996014,30cyclictest21955-21cstates11:40:151
30053996012,35cyclictest0-21swapper/112:09:581
3005399598,39cyclictest5837-21diskmemload12:10:491
3005399593,3cyclictest0-21swapper/112:46:281
3005399591,46cyclictest13185-21latency09:50:221
3005399591,41cyclictest29203-21df08:45:181
3005399591,39cyclictest0-21swapper/112:16:521
30053995812,29cyclictest90542chrt07:50:261
3005399572,7cyclictest0-21swapper/112:27:311
3005399571,9cyclictest4219-21/usr/sbin/munin07:40:271
203982570,2sleep020395-21ps08:20:260
3005399567,28cyclictest40950irq/93-i91508:05:531
3005399563,7cyclictest19996-21hddtemp_smartct08:20:161
3005399562,11cyclictest27057-21cut10:05:141
3005399562,10cyclictest21678-21diskstats08:25:141
3005399561,6cyclictest26218-21sed08:35:361
3005399551,7cyclictest3020-21runrttasks07:45:061
3005399551,5cyclictest30839-21/usr/sbin/munin08:50:121
319312540,2sleep031932-21egrep10:10:130
3005399542,6cyclictest28436-21taskset08:41:481
3005399541,6cyclictest467-21grep07:30:291
3005399541,6cyclictest24211-21fgrep08:30:261
3005399541,6cyclictest1040-21ntp_offset08:55:281
3005399531,6cyclictest30944-21snmpd09:00:111
3005399523,5cyclictest2054-21apt-get07:35:011
3005299481,16cyclictest14387-21taskset09:18:220
50632440,7sleep00-21swapper/011:22:170
62532430,5sleep06251-21ssh09:10:130
30052994027,4cyclictest40950irq/93-i91512:10:080
3005299397,13cyclictest0-21swapper/012:18:120
3005299392,22cyclictest20782-21ntp_states12:45:260
3005299391,25cyclictest14984-21timerwakeupswit08:05:320
79642380,9sleep03005299cyclictest11:25:200
3005299386,5cyclictest81rcu_preempt09:23:400
3005299386,5cyclictest81rcu_preempt09:23:390
3005299371,23cyclictest2333-21cut07:35:150
3005299371,18cyclictest0-21swapper/011:41:170
323392360,8sleep03005299cyclictest11:50:270
3005299361,8cyclictest0-21swapper/010:17:250
30052993615,7cyclictest3-21ksoftirqd/008:00:410
3005299361,12cyclictest27051-21aten_r4power_vo10:05:140
3005299356,4cyclictest81rcu_preempt09:59:420
3005299354,4cyclictest81rcu_preempt10:54:260
3005299352,5cyclictest81rcu_preempt12:05:240
30052993513,7cyclictest18320-21users11:35:330
30052993510,6cyclictest1109-21irqstats12:25:220
56812341,5sleep00-21swapper/007:42:260
3005299349,13cyclictest31391-21iostat08:50:200
3005299348,14cyclictest0-21swapper/010:41:040
3005299344,4cyclictest81rcu_preempt11:30:420
3005299344,4cyclictest81rcu_preempt09:51:000
30052993413,6cyclictest26047-21ntpq11:10:280
30052993412,7cyclictest13932-21ssh12:38:490
3005299341,21cyclictest22766-21ssh10:34:160
3005299341,13cyclictest0-21swapper/011:04:060
73932331,5sleep00-21swapper/007:45:390
3005299338,4cyclictest81rcu_preempt09:45:390
3005299337,4cyclictest81rcu_preempt11:05:200
3005299336,5cyclictest81rcu_preempt10:48:170
3005299336,13cyclictest2856-21kernelversion09:00:220
3005299335,4cyclictest81rcu_preempt09:40:180
3005299334,4cyclictest81rcu_preempt09:36:410
3005299333,4cyclictest81rcu_preempt10:29:430
299872331,28sleep030132-21cstates11:15:140
3005299327,5cyclictest81rcu_preempt10:21:080
3005299326,5cyclictest81rcu_preempt12:40:130
3005299326,5cyclictest81rcu_preempt10:57:000
3005299325,5cyclictest81rcu_preempt08:35:240
3005299323,4cyclictest81rcu_preempt09:26:400
3005299321,20cyclictest16338-21/usr/sbin/munin08:10:220
3005299321,19cyclictest4177-21diskstats11:55:160
3005299321,15cyclictest0-21swapper/011:49:110
276372321,3sleep00-21swapper/008:40:230
3005299313,4cyclictest81rcu_preempt12:50:180
3005299312,4cyclictest81rcu_preempt09:31:030
3005299311,4cyclictest81rcu_preempt12:33:500
3005299311,4cyclictest81rcu_preempt12:33:490
3005299311,16cyclictest28723-21/usr/sbin/munin12:20:210
16302311,5sleep00-21swapper/007:31:050
3005299302,7cyclictest81rcu_preempt10:00:130
302502291,3sleep00-21swapper/008:46:020
3005299296,12cyclictest8625-21ssh12:00:060
3005299291,4cyclictest81rcu_preempt08:26:550
3005299291,14cyclictest23635-21fschecks_count08:30:150
30052992813,13cyclictest0-21swapper/007:51:550
3005299271,17cyclictest0-21swapper/008:56:470
30052992710,5cyclictest4155-21aten_r4power_en09:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional