You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 19:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Fri Apr 26, 2024 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
54539912401191,23cyclictest0-21swapper/007:25:130
54549911801155,19cyclictest20917-21file08:01:331
50562526427,84sleep00-21swapper/007:21:240
53892461418,29sleep10-21swapper/107:24:541
545499281232,28cyclictest5888-21diskstats07:25:131
54539912198,20cyclictest0-21swapper/008:01:340
145422490,2sleep014541-21kernelversion10:40:220
545499469,6cyclictest22-21ksoftirqd/110:54:051
91582450,5sleep0545399cyclictest11:50:370
5454994525,4cyclictest22-21ksoftirqd/110:15:161
545499449,4cyclictest81rcu_preempt11:55:101
545499448,6cyclictest22-21ksoftirqd/112:16:321
5454994415,4cyclictest22-21ksoftirqd/112:10:161
545499438,6cyclictest22-21ksoftirqd/110:39:501
545499438,6cyclictest21095-21/usr/sbin/munin12:25:211
545499435,6cyclictest22-21ksoftirqd/109:43:501
5454994318,15cyclictest22-21ksoftirqd/110:05:311
545499429,5cyclictest2981-21/usr/sbin/munin08:45:201
545499428,6cyclictest2376-21NetworkManager12:09:461
545499428,6cyclictest22-21ksoftirqd/111:43:121
545499428,6cyclictest22-21ksoftirqd/111:43:111
545499428,6cyclictest22-21ksoftirqd/108:15:531
545499427,4cyclictest81rcu_preempt11:05:121
545499426,6cyclictest22-21ksoftirqd/112:21:501
545499426,6cyclictest22-21ksoftirqd/109:35:291
5454994217,6cyclictest22-21ksoftirqd/108:30:031
5453994222,4cyclictest40950irq/93-i91510:31:000
545499419,6cyclictest18543-21perl09:25:201
545499419,6cyclictest18543-21perl09:25:191
545499417,6cyclictest22-21ksoftirqd/111:28:141
545499417,5cyclictest22-21ksoftirqd/112:40:261
545499415,4cyclictest81rcu_preempt10:31:491
545499408,6cyclictest22-21ksoftirqd/109:57:281
545499408,6cyclictest22-21ksoftirqd/107:58:251
545499408,5cyclictest22-21ksoftirqd/108:29:091
545499408,5cyclictest22-21ksoftirqd/108:13:501
545499408,5cyclictest14426-21hddtemp_smartct10:40:171
545499407,6cyclictest3020-21runrttasks11:13:551
545499407,6cyclictest22-21ksoftirqd/112:02:591
545499407,6cyclictest22-21ksoftirqd/110:00:181
5454994026,4cyclictest22-21ksoftirqd/107:45:341
5454994025,4cyclictest22-21ksoftirqd/111:30:211
5454994024,4cyclictest22-21ksoftirqd/109:30:191
5454994024,4cyclictest22-21ksoftirqd/107:50:341
5454994010,4cyclictest81rcu_preempt12:35:111
5454994010,4cyclictest81rcu_preempt09:50:231
545499399,4cyclictest81rcu_preempt11:40:001
545499399,4cyclictest81rcu_preempt10:55:151
545499397,5cyclictest32163-21irqstats08:35:201
545499396,6cyclictest12234-21sh07:40:131
545499395,5cyclictest29482-21sh12:45:281
5454993925,4cyclictest22-21ksoftirqd/112:30:111
5454993925,4cyclictest22-21ksoftirqd/110:10:131
5454993925,4cyclictest22-21ksoftirqd/110:10:131
5454993924,4cyclictest22-21ksoftirqd/112:50:211
5454993924,4cyclictest22-21ksoftirqd/111:20:141
5454993923,4cyclictest22-21ksoftirqd/111:45:141
5454993923,4cyclictest22-21ksoftirqd/107:35:221
5454993915,4cyclictest22-21ksoftirqd/111:00:471
545399391,4cyclictest81rcu_preempt11:05:240
545499387,6cyclictest15302-21smartctl-wrappe09:15:331
545499387,5cyclictest3020-21runrttasks09:05:101
545499386,6cyclictest22-21ksoftirqd/111:50:391
545499386,6cyclictest22-21ksoftirqd/108:55:551
545499386,4cyclictest81rcu_preempt09:20:191
545499385,8cyclictest22-21ksoftirqd/108:07:281
545499385,6cyclictest22-21ksoftirqd/109:49:211
545499384,6cyclictest8697-21tr09:00:091
545499381,7cyclictest201rcuc/109:10:111
5454993810,4cyclictest81rcu_preempt08:22:371
5453993819,4cyclictest40950irq/93-i91509:20:130
54092381,5sleep15460-21iostat08:50:181
545499377,6cyclictest22-21ksoftirqd/108:40:171
545499375,6cyclictest22-21ksoftirqd/111:15:041
545499374,4cyclictest81rcu_preempt10:25:081
74232360,3sleep041ktimersoftd/008:55:250
545499366,4cyclictest81rcu_preempt10:20:121
545499366,4cyclictest81rcu_preempt07:30:031
545499364,6cyclictest22-21ksoftirqd/110:45:131
545399361,4cyclictest81rcu_preempt09:35:150
545399353,17cyclictest9890-21apt-get07:35:010
545399345,4cyclictest81rcu_preempt11:25:130
545399341,15cyclictest0-21swapper/011:34:420
545399341,14cyclictest0-21swapper/007:33:070
545399334,5cyclictest22343-21head12:25:310
545399332,5cyclictest81rcu_preempt10:45:130
545399331,5cyclictest5524-21runrttasks11:41:140
545399331,5cyclictest5524-21runrttasks11:41:140
545399331,4cyclictest81rcu_preempt12:10:240
5453993311,9cyclictest3-21ksoftirqd/008:40:270
106812331,26sleep010802-21df09:05:120
545399327,12cyclictest18391-21ntp_kernel_pll_07:55:270
545399326,14cyclictest13003-21/usr/sbin/munin09:10:220
545399324,4cyclictest81rcu_preempt08:45:100
545399323,4cyclictest81rcu_preempt11:00:110
545399322,4cyclictest81rcu_preempt12:00:280
545399321,4cyclictest81rcu_preempt10:54:530
545399321,20cyclictest2921-21/usr/sbin/munin10:10:130
545399321,20cyclictest2921-21/usr/sbin/munin10:10:130
5453993211,6cyclictest25491-21/usr/sbin/munin11:10:150
152392320,3sleep0111rcuc/009:15:310
545399316,4cyclictest81rcu_preempt09:51:380
545399315,13cyclictest14872-21switchtime07:45:360
545399314,4cyclictest81rcu_preempt08:12:190
545399313,3cyclictest81rcu_preempt08:26:250
545399312,14cyclictest27000-21cron08:20:010
5453993119,4cyclictest40950irq/93-i91512:45:130
545399311,4cyclictest81rcu_preempt12:35:260
545399311,4cyclictest81rcu_preempt08:52:300
545399311,17cyclictest502-21ls10:05:010
545399311,17cyclictest19664-21wget10:55:110
5453993110,3cyclictest18265-21gzip12:15:280
545399308,7cyclictest680-21aten_r4power_en10:05:110
545399308,5cyclictest0-21swapper/009:48:320
545399302,4cyclictest81rcu_preempt12:50:160
545399302,23cyclictest29473-21hddtemp_smartct11:20:160
545399301,4cyclictest81rcu_preempt07:50:260
545399301,3cyclictest81rcu_preempt11:15:100
5453993010,6cyclictest29419-21cut09:55:090
545399300,4cyclictest81rcu_preempt09:33:330
111432301,5sleep00-21swapper/011:56:080
545399296,12cyclictest9870-21seq10:28:400
545399296,12cyclictest31025-21taskset08:31:070
545399293,4cyclictest81rcu_preempt09:41:010
545399293,13cyclictest14385-21/usr/sbin/munin12:05:260
545399292,8cyclictest81rcu_preempt11:47:470
545399291,4cyclictest81rcu_preempt10:20:330
545399291,19cyclictest0-21swapper/008:05:080
5453992911,5cyclictest19662-21cron09:28:590
5453992911,5cyclictest19662-21cron09:28:590
545399291,14cyclictest12595-21latency07:40:200
545399291,13cyclictest23990-21/usr/sbin/munin12:30:320
545399291,12cyclictest32368-21ntpdc08:35:250
545399288,10cyclictest3-21ksoftirqd/008:20:210
5453992819,6cyclictest5561-21cat10:15:350
5453992811,5cyclictest27013-21ls12:40:120
5453992810,5cyclictest9236-21iostat09:00:190
545399279,5cyclictest12874-21ntp_states10:35:280
36722261,5sleep00-21swapper/011:36:500
5453992511,4cyclictest3-21ksoftirqd/012:20:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional