You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-21 - 22:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6s.osadl.org (updated Sun Jul 21, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911130,2ptp4l241ktimersoftd/112:56:511
32725911080,2ptp4l241ktimersoftd/115:00:251
32725911060,2ptp4l241ktimersoftd/116:35:171
2518021040,7sleep1365199cyclictest16:13:241
32725911030,1ptp4l241ktimersoftd/117:43:591
32725911020,3ptp4l241ktimersoftd/112:41:521
3272591990,2ptp4l241ktimersoftd/113:41:541
109752930,3sleep10-21swapper/115:56:331
3272591910,1ptp4l241ktimersoftd/115:44:421
3270691880,8getstats365199cyclictest15:36:551
178432880,8sleep1365199cyclictest14:32:011
3272591870,1ptp4l241ktimersoftd/117:15:211
3272591870,1ptp4l241ktimersoftd/113:56:481
3272591840,1ptp4l241ktimersoftd/116:44:571
3272591830,2ptp4l241ktimersoftd/115:29:481
3272591810,2ptp4l241ktimersoftd/117:37:381
3272591810,2ptp4l241ktimersoftd/116:28:541
3272591810,2ptp4l241ktimersoftd/116:01:571
3272591810,23ptp4l10642-21kworker/1:018:01:541
3272591780,3ptp4l13639-21kworker/1:016:46:511
213342760,3sleep00-21swapper/016:08:380
3272591750,2ptp4l241ktimersoftd/117:21:031
3272591730,1ptp4l241ktimersoftd/116:58:541
3272591710,1ptp4l241ktimersoftd/115:46:561
34692694,9sleep00-21swapper/012:45:060
3272591670,6ptp4l241ktimersoftd/115:12:551
3272591670,1ptp4l241ktimersoftd/115:07:501
3272591660,1ptp4l241ktimersoftd/116:09:341
3272591640,1ptp4l241ktimersoftd/116:20:341
3272591630,1ptp4l241ktimersoftd/117:36:301
3272591630,1ptp4l241ktimersoftd/117:21:561
3272591630,1ptp4l241ktimersoftd/114:02:031
365099586,14cyclictest29031-21apt-get17:41:420
3650995823,6cyclictest3337-21/usr/sbin/munin13:57:040
365099575,13cyclictest14552-21apt-get16:41:410
3272591560,3ptp4l25316-21kworker/1:113:39:131
3650995521,6cyclictest9-21ksoftirqd/014:20:320
3272591540,4ptp4l24330-21kworker/1:015:03:421
3272591540,1ptp4l241ktimersoftd/113:52:551
365099536,12cyclictest12472-21apt-get14:21:380
3272591530,4ptp4l20639-21kworker/1:114:41:501
3272591530,1ptp4l241ktimersoftd/113:12:011
3272591520,1ptp4l241ktimersoftd/118:11:421
3272591520,1ptp4l241ktimersoftd/117:54:171
365099515,13cyclictest9410-21apt-get17:16:430
3272591510,1ptp4l241ktimersoftd/114:53:301
3272591500,3ptp4l3434-21kworker/1:212:49:321
3272591500,3ptp4l13752-21kworker/1:114:27:161
365199492,13cyclictest25-21ksoftirqd/117:06:511
3272591490,1ptp4l241ktimersoftd/117:27:361
3272591490,1ptp4l241ktimersoftd/117:02:221
3272591490,1ptp4l241ktimersoftd/112:52:071
3272591480,1ptp4l241ktimersoftd/117:50:281
3272591480,1ptp4l241ktimersoftd/116:37:191
3272591480,1ptp4l241ktimersoftd/116:25:501
3272591480,1ptp4l241ktimersoftd/114:50:441
3272591480,1ptp4l241ktimersoftd/114:50:441
3272591480,1ptp4l241ktimersoftd/114:23:021
3272591480,1ptp4l241ktimersoftd/113:47:161
3272591480,1ptp4l241ktimersoftd/113:27:411
3272591480,18ptp4l241ktimersoftd/115:33:181
3272591470,1ptp4l241ktimersoftd/118:08:471
3272591470,1ptp4l241ktimersoftd/115:21:551
3272591470,1ptp4l241ktimersoftd/115:18:031
3272591470,1ptp4l241ktimersoftd/114:36:371
174642470,5sleep0101ktimersoftd/017:26:460
365099461,9cyclictest27850-21latency_hist15:36:280
3272591460,1ptp4l241ktimersoftd/114:11:471
3272591450,1ptp4l241ktimersoftd/117:57:131
3272591450,1ptp4l241ktimersoftd/113:20:211
365099446,5cyclictest121rcu_preempt12:46:520
3272591440,1ptp4l241ktimersoftd/115:53:571
3272591440,1ptp4l241ktimersoftd/113:06:411
3272591440,1ptp4l241ktimersoftd/113:01:471
365099431,8cyclictest16170-21latency_hist18:06:310
3272591430,1ptp4l241ktimersoftd/113:25:271
3272591430,14ptp4l241ktimersoftd/114:11:051
3272591420,1ptp4l241ktimersoftd/114:19:191
3272591410,1ptp4l241ktimersoftd/113:34:041
199642400,8sleep0365099cyclictest14:36:550
365099390,12cyclictest22814-21diskmemload15:49:520
3272591390,1ptp4l241ktimersoftd/116:52:371
365099382,4cyclictest121rcu_preempt17:23:110
365099382,4cyclictest121rcu_preempt15:26:290
294322380,9sleep0365099cyclictest16:19:030
365099371,4cyclictest121rcu_preempt17:31:440
365099369,5cyclictest327332ssh14:59:060
365099364,4cyclictest121rcu_preempt15:54:280
365099363,4cyclictest121rcu_preempt15:19:120
3650993624,7cyclictest6704-21ssh15:07:050
365099362,10cyclictest10570-21runrttasks13:01:060
365099361,32cyclictest42450irq/96-enp4s0-r18:08:520
295252360,5sleep029528-21timerandwakeup15:37:090
365099345,8cyclictest121rcu_preempt15:23:090
365099344,4cyclictest121rcu_preempt18:00:390
365099343,8cyclictest121rcu_preempt17:38:270
365099342,6cyclictest9392-21snmp_o5powerctl14:12:030
365099342,6cyclictest26794-21snmp_o5powerctl13:36:580
3650993418,9cyclictest30117-21apt-get17:01:430
145702340,6sleep0101ktimersoftd/014:26:380
365099338,4cyclictest121rcu_preempt16:02:040
365099336,4cyclictest121rcu_preempt16:32:060
365099336,20cyclictest11117-21apt-get15:56:430
365099332,6cyclictest28904-21snmp_o5powerctl13:41:590
365099332,6cyclictest18344-21snmp_o5powerctl13:16:580
365099331,8cyclictest121rcu_preempt16:26:560
3650993311,17cyclictest23017-21/usr/sbin/munin14:46:420
3650993311,17cyclictest23017-21/usr/sbin/munin14:46:420
365099322,5cyclictest29635-21apt-get13:46:310
3650993222,6cyclictest9-21ksoftirqd/016:24:000
3650993222,5cyclictest9-21ksoftirqd/017:53:360
3650993221,8cyclictest9-21ksoftirqd/016:11:450
3650993221,6cyclictest9-21ksoftirqd/013:32:390
365099322,10cyclictest27869-21snmp_o5powerctl14:51:580
109852320,3sleep00-21swapper/013:01:390
365099312,6cyclictest906-21snmp_o5powerctl13:51:590
365099312,6cyclictest23595-21snmp_o5powerctl16:51:590
3650993121,6cyclictest9-21ksoftirqd/017:48:100
3650993121,6cyclictest9-21ksoftirqd/014:45:060
3650993120,7cyclictest9-21ksoftirqd/017:12:030
365099311,5cyclictest121rcu_preempt16:57:020
365099311,4cyclictest121rcu_preempt17:06:560
365099311,25cyclictest19294-21apt-get13:21:380
365099308,7cyclictest220862sed16:51:290
365099302,6cyclictest16211-21snmp_o5powerctl13:11:580
365099302,23cyclictest9757-21irqstats15:11:500
3650993020,6cyclictest9-21ksoftirqd/012:56:080
3650993020,5cyclictest9-21ksoftirqd/014:08:540
3650993018,8cyclictest17842-21snmp_o5powerctl14:32:010
365099301,23cyclictest31865-21ssh15:41:460
365099300,27cyclictest0-21swapper/015:04:090
365099296,14cyclictest20311-21apt-get18:11:430
3650992920,5cyclictest9-21ksoftirqd/013:30:160
3650992919,5cyclictest9-21ksoftirqd/014:04:590
3650992917,7cyclictest14113-21snmp_o5powerctl13:06:590
365099291,10cyclictest12406-21ssh16:38:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional