You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-24 - 02:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6s.osadl.org (updated Fri Feb 23, 2024 12:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911680,5ptp4l241ktimersoftd/111:51:491
32725911050,2ptp4l241ktimersoftd/114:08:131
32725911010,2ptp4l241ktimersoftd/114:01:151
3272591990,1ptp4l241ktimersoftd/116:14:531
3272591980,2ptp4l241ktimersoftd/114:05:591
3272591980,1ptp4l241ktimersoftd/114:42:161
124942880,3sleep00-21swapper/016:34:120
3272591850,1ptp4l241ktimersoftd/116:48:011
3272591820,1ptp4l241ktimersoftd/113:06:591
3272591800,1ptp4l241ktimersoftd/114:12:101
3272591790,1ptp4l241ktimersoftd/115:05:591
3272591740,1ptp4l241ktimersoftd/116:25:021
1052699743,8cyclictest3842-21apt-get17:06:511
1052699740,7cyclictest24389-21ssh16:05:341
1052699715,36cyclictest17585-21apt-get16:41:491
3272591680,1ptp4l241ktimersoftd/114:40:411
199442670,2sleep019943-21cut15:12:030
132962600,7sleep01052599cyclictest14:17:000
1052699591,37cyclictest28172-21ssh16:55:241
1052699555,41cyclictest4380-21apt-get14:51:501
1052699555,40cyclictest30685-21apt-get12:41:461
1052699548,41cyclictest11267-21idleruntime-cro15:01:281
3272591530,1ptp4l241ktimersoftd/116:32:051
1052699535,40cyclictest16399-21snmp_o5powerctl15:07:151
1052699530,9cyclictest25066-21irqstats12:26:551
1052699520,9cyclictest17155-21ssh15:54:461
1052699520,8cyclictest1926-21/usr/sbin/munin15:32:181
1052699520,8cyclictest1529-21/usr/sbin/munin17:02:111
1052699520,7cyclictest19779-21processes15:12:011
1052699515,38cyclictest18926-21snmp_o5powerctl13:27:081
1052699515,37cyclictest4831-21apt-get12:56:491
1052699515,36cyclictest6952-21apt-get13:01:501
1052699514,38cyclictest22213-21apt-get12:21:451
1052699514,36cyclictest25967-21apt-get15:21:491
1052699510,9cyclictest9553-21ssh16:31:061
1052699510,8cyclictest5654-21unixbench_multi15:37:141
1052699510,7cyclictest15193-21/usr/sbin/munin17:21:511
1052699510,7cyclictest12890-21munin-node12:01:271
1052699510,7cyclictest11609-21/usr/sbin/munin15:46:541
1052699510,6cyclictest3906-21unixbench_singl12:52:111
1052699510,6cyclictest15259-21sed16:37:151
1052699510,6cyclictest13873-21runrttasks14:17:211
1052699510,6cyclictest13015-21chrt13:13:401
1052699505,37cyclictest8935-21snmp_o5powerctl15:42:071
1052699505,37cyclictest21002-21snmp_o5powerctl12:17:081
1052699505,36cyclictest19890-21apt-get13:31:491
1052699504,36cyclictest26457-21apt-get12:31:471
10526995011,35cyclictest29770-21switchtime12:37:091
1052699500,8cyclictest25038-21ssh16:06:461
1052699500,8cyclictest13410-21ssh17:18:271
1052699500,8cyclictest11899-21python11:57:031
1052699500,7cyclictest3932-21ssh14:51:131
1052699500,7cyclictest2353-21ssh16:20:421
1052699500,7cyclictest10835-21ssh17:16:151
1052699500,6cyclictest29535-21sh15:26:501
1052699500,6cyclictest21495-21ssh14:29:131
1052699500,6cyclictest20958-21ssh16:00:421
1052699500,6cyclictest17083-21grep12:07:271
1052699500,5cyclictest29496-21phc2sys13:52:001
3272591490,1ptp4l241ktimersoftd/115:17:301
3272591490,1ptp4l241ktimersoftd/114:24:301
1052699492,42cyclictest23365-21memory14:32:001
1052699490,7cyclictest30735-21sh16:57:431
1052699490,7cyclictest22496-21if_enp4s013:36:521
1052699490,6cyclictest28456-21cat13:51:281
1052699490,6cyclictest19178-21users12:12:111
3272591470,1ptp4l241ktimersoftd/113:26:271
1052699465,33cyclictest24321-21apt-get13:41:471
10526994515,25cyclictest14583-21ptp4l-jitter13:17:041
1052699450,6cyclictest360-21apt-get12:46:471
101922415,24sleep00-21swapper/011:53:260
1052599401,8cyclictest30441-21munin-run13:56:270
1052599395,9cyclictest121rcu_preempt15:42:280
1052599393,4cyclictest121rcu_preempt14:22:270
1052599381,8cyclictest121rcu_preempt14:54:360
1052599376,5cyclictest121rcu_preempt14:11:540
10525993724,7cyclictest18966-21ssh15:57:040
10525993717,5cyclictest9-21ksoftirqd/017:00:380
60742361,29sleep06098-21awk16:26:300
311072361,29sleep031113-21ssh14:42:180
1052599368,4cyclictest121rcu_preempt14:40:180
1052599367,20cyclictest8172-21apt-get14:56:500
1052599366,4cyclictest121rcu_preempt12:20:380
1052599361,4cyclictest121rcu_preempt16:19:100
1052599353,12cyclictest14672-21python13:17:050
1052599352,7cyclictest27192-21snmp_o5powerctl15:22:080
1052599351,9cyclictest121rcu_preempt15:51:560
1052599351,4cyclictest121rcu_preempt14:06:060
1052599343,8cyclictest121rcu_preempt17:05:570
1052599342,7cyclictest23149-21snmp_o5powerctl13:37:050
1052599342,6cyclictest22397-21df_inode12:21:500
1052599342,27cyclictest5388-21snmp_o5powerctl15:37:060
1052599341,6cyclictest19894-21seq13:31:510
1052599341,6cyclictest12847-21snmp_o5powerctl15:02:080
1052599341,5cyclictest31749-21runrttasks15:29:000
10525993414,6cyclictest9-21ksoftirqd/017:07:050
72982331,27sleep07357-21needreboot16:27:000
1052599336,4cyclictest121rcu_preempt16:01:590
1052599332,26cyclictest28141-21apt-get16:11:370
10525993321,7cyclictest10639-21unixbench-2d13:07:150
10525993222,5cyclictest9-21ksoftirqd/012:28:510
1052599322,25cyclictest12562-21snmp_o5powerctl13:12:040
1052599322,24cyclictest26449-21apt-get13:46:470
10525993221,6cyclictest9-21ksoftirqd/013:05:290
10525993221,6cyclictest9-21ksoftirqd/012:15:080
10525993219,8cyclictest9-21ksoftirqd/015:47:070
10525993213,13cyclictest13048-21ssh17:17:360
148532311,3sleep030435-21diskmemload17:21:320
1052599317,15cyclictest15134-21apt-get15:06:520
1052599314,9cyclictest20348-21python14:27:050
10525993122,4cyclictest9-21ksoftirqd/013:30:110
1052599312,24cyclictest32766-21apt-get14:46:340
10525993121,6cyclictest9-21ksoftirqd/016:10:300
10525993121,6cyclictest9-21ksoftirqd/013:46:180
10525993121,6cyclictest9-21ksoftirqd/013:01:040
10525993121,6cyclictest9-21ksoftirqd/012:33:140
10525993121,6cyclictest9-21ksoftirqd/012:06:440
1052599311,7cyclictest121rcu_preempt13:22:090
10525993112,6cyclictest23804-21wc15:17:170
1052599311,25cyclictest18857-21snmp_o5powerctl16:42:090
10525993110,17cyclictest0-21swapper/012:41:570
95182301,3sleep00-21swapper/017:13:090
1052599307,13cyclictest13792-21apt-get16:36:500
1052599305,9cyclictest121rcu_preempt12:38:280
1052599305,3cyclictest121rcu_preempt13:56:480
1052599302,23cyclictest25712-21munin-run14:36:280
10525993020,5cyclictest9-21ksoftirqd/012:03:030
10525993019,7cyclictest9-21ksoftirqd/016:48:530
10525993019,6cyclictest1623-21grep15:32:070
10525993018,6cyclictest3742-21timerandwakeup12:52:100
1052599294,18cyclictest26476-21snmp_o5powerctl16:52:090
10525992919,6cyclictest9-21ksoftirqd/014:10:480
1052599281,9cyclictest2266-21/usr/sbin/munin12:51:260
10525992815,8cyclictest11796-21ptp4l11:57:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional