You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 19:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Aug 30, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230209911501135,12cyclictest0-21swapper/107:25:121
230209910811072,6cyclictest0-21swapper/107:50:191
215472532482,33sleep00-21swapper/007:20:200
227962463417,31sleep10-21swapper/107:23:241
2301999229209,15cyclictest0-21swapper/007:25:110
2301999168138,14cyclictest0-21swapper/007:50:190
93182960,2sleep19319-21hwlatdetect09:20:181
89212890,4sleep1201rcuc/112:40:381
134592800,8sleep02301999cyclictest11:39:130
65082770,3sleep1211ktimersoftd/112:05:181
2302099712,55cyclictest18987-21ssh12:51:471
2302099705,43cyclictest31117-21diskmemload10:50:521
2302099681,14cyclictest23346-21taskset08:47:391
23020996811,36cyclictest0-21swapper/108:00:161
23020996610,3cyclictest0-21swapper/112:25:171
2302099651,47cyclictest16564-21ssh09:27:471
23020996418,26cyclictest22-21ksoftirqd/108:05:441
138302640,7sleep12302099cyclictest08:21:361
2302099638,3cyclictest0-21swapper/110:34:551
2302099637,7cyclictest40950irq/93-i91509:31:541
23020996316,28cyclictest22-21ksoftirqd/108:18:031
23020996310,35cyclictest0-21swapper/110:58:391
2302099628,41cyclictest0-21swapper/111:35:311
2302099623,6cyclictest18773-21ssh10:36:571
23020996211,33cyclictest0-21swapper/110:02:091
23020996210,5cyclictest31117-21diskmemload11:50:391
2302099619,40cyclictest0-21swapper/111:58:571
2302099611,8cyclictest23634-21tune2fs09:35:191
2302099611,8cyclictest23634-21tune2fs09:35:181
23020996117,25cyclictest22-21ksoftirqd/109:13:021
2302099611,5cyclictest19524-21grep11:45:161
2302099611,16cyclictest25169-21munin-node07:30:011
2302099607,41cyclictest0-21swapper/110:23:301
2302099606,42cyclictest0-21swapper/111:25:471
2302099601,5cyclictest22433-21runrttasks12:21:141
2302099601,40cyclictest14965-21ssh12:47:401
23020996012,31cyclictest0-21swapper/110:41:411
2302099601,11cyclictest29249-21sed09:40:301
2302099591,9cyclictest4856-21diskmemload12:03:421
2302099591,9cyclictest4856-21diskmemload12:03:411
2302099591,15cyclictest4565-21kworker/1:011:20:111
2302099591,15cyclictest19702-21chrt08:39:041
2302099591,14cyclictest25831-21taskset11:18:111
23020995910,5cyclictest13362-21taskset12:12:051
2302099584,11cyclictest0-21swapper/110:15:201
2302099582,8cyclictest24237-21hddtemp_smartct08:50:181
2302099582,7cyclictest21259-21users08:40:411
2302099582,6cyclictest13269-21diskstats11:05:191
2302099582,13cyclictest2333-21taskset09:46:121
2302099582,11cyclictest0-21swapper/108:55:181
2302099581,6cyclictest17831-21ssh11:43:331
2302099581,52cyclictest19419-21taskset11:10:511
23020995810,5cyclictest0-21swapper/111:00:171
2302099577,6cyclictest91552chrt10:26:581
2302099573,5cyclictest0-21swapper/112:34:041
2302099572,4cyclictest0-21swapper/110:09:341
2302099572,13cyclictest0-21swapper/112:39:401
2302099571,5cyclictest9334-21latency_hist11:35:011
23020995710,5cyclictest29502-21seq09:05:131
23020995710,5cyclictest27801-21cpuspeed_turbos07:35:121
2302099567,5cyclictest29064-21taskset10:47:521
2302099563,8cyclictest16794-21iostat08:30:211
2302099561,6cyclictest12206-21runrttasks09:56:251
2302099561,5cyclictest16551-21awk12:15:251
2302099558,6cyclictest15773-21seq08:27:171
2302099553,4cyclictest0-21swapper/109:54:331
23020995515,35cyclictest7514-21ssh09:18:391
159982550,2sleep016000-21uname10:00:270
2302099542,7cyclictest27803-21df_inode09:00:151
2302099541,5cyclictest25767-21cut10:10:341
2302099522,6cyclictest29805-21df07:40:151
2302099516,5cyclictest0-21swapper/107:55:281
69342490,8sleep00-21swapper/009:17:470
2302099493,7cyclictest31706-21diskstats07:45:201
228852490,7sleep00-21swapper/011:48:540
2302099472,7cyclictest8675-21/usr/sbin/munin08:10:331
269562400,8sleep02301999cyclictest09:38:540
269562400,8sleep02301999cyclictest09:38:530
85572392,33sleep08730-21grep11:00:260
23019993910,17cyclictest3-21ksoftirqd/011:56:310
2301999382,15cyclictest11357-21python09:55:340
23019993811,13cyclictest22583-21ssh10:40:330
2301999372,11cyclictest0-21swapper/010:18:080
23019993711,5cyclictest18910-21hddtemp_smartct09:30:170
23019993624,8cyclictest31117-21diskmemload12:50:230
2301999362,11cyclictest0-21swapper/010:27:170
2301999361,14cyclictest20872-21cron10:40:010
23019993515,5cyclictest27590-21ssh10:45:440
2301999351,22cyclictest2320-21ssh10:54:100
207362350,9sleep02301999cyclictest10:05:260
2301999347,5cyclictest81rcu_preempt10:20:160
2301999346,4cyclictest81rcu_preempt12:08:430
2301999346,4cyclictest81rcu_preempt08:30:130
2301999343,4cyclictest81rcu_preempt10:12:310
2301999342,5cyclictest81rcu_preempt09:45:200
2301999342,4cyclictest81rcu_preempt11:30:010
2301999341,21cyclictest2758-21tr12:35:140
2301999341,20cyclictest3020-21runrttasks08:42:260
233942331,5sleep00-21swapper/008:48:090
2301999334,5cyclictest81rcu_preempt11:18:340
2301999334,4cyclictest81rcu_preempt12:46:220
2301999334,4cyclictest81rcu_preempt12:12:080
2301999334,4cyclictest81rcu_preempt09:50:340
2301999333,16cyclictest24659-21irqstats11:50:260
23019993319,5cyclictest3-21ksoftirqd/012:44:110
23019993313,7cyclictest3-21ksoftirqd/012:03:100
23019993313,7cyclictest3-21ksoftirqd/012:03:090
23019993313,6cyclictest18058-21df11:10:170
23019993312,6cyclictest0-21swapper/012:28:250
2301999323,4cyclictest81rcu_preempt12:30:350
2301999323,4cyclictest81rcu_preempt11:20:140
2301999322,4cyclictest81rcu_preempt09:27:170
2301999322,25cyclictest15105-21memory11:40:230
23019993216,5cyclictest9070-21/usr/sbin/munin09:20:160
2301999321,19cyclictest17217-21ssh12:15:420
2301999320,4cyclictest81rcu_preempt12:20:370
81952311,5sleep00-21swapper/008:06:480
2301999318,12cyclictest81rcu_preempt09:00:000
2301999317,5cyclictest81rcu_preempt11:30:200
2301999315,4cyclictest81rcu_preempt07:55:300
2301999314,4cyclictest81rcu_preempt11:08:390
2301999312,5cyclictest81rcu_preempt10:55:130
2301999312,14cyclictest15153-21ntp_states08:25:260
2301999311,4cyclictest81rcu_preempt10:33:550
23019993113,6cyclictest2190-21sh09:13:050
2301999311,19cyclictest12499-21cut08:20:140
2301999311,17cyclictest10564-21aten_r4power_cu08:15:130
2301999311,14cyclictest28590-21ssh09:40:200
2301999301,4cyclictest81rcu_preempt09:00:230
2301999301,18cyclictest0-21swapper/008:50:310
2301999299,16cyclictest6204-21gdbus07:36:170
2301999292,15cyclictest30082-21memory09:05:230
2301999292,14cyclictest29821-21diskstats07:40:160
2301999292,12cyclictest5982-21users08:00:310
2301999282,13cyclictest25267-21hddtemp_smartct07:30:030
2301999281,14cyclictest32118-21/usr/sbin/munin07:45:270
99902271,5sleep00-21swapper/008:10:570
2301999271,13cyclictest18945-21/usr/sbin/munin08:35:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional