You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 14:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot7s.osadl.org (updated Sun Dec 10, 2023 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110122477412,52sleep00-21swapper/019:05:220
113092464398,52sleep10-21swapper/119:08:381
119992500,2sleep0131rcuc/021:55:140
32752440,2sleep10-21swapper/122:59:391
1158199404,29cyclictest0-21swapper/123:15:001
1158199403,31cyclictest0-21swapper/121:09:561
1158199403,31cyclictest0-21swapper/100:30:001
1158199395,28cyclictest0-21swapper/121:39:591
1158199393,6cyclictest0-21swapper/120:10:021
1158199393,30cyclictest0-21swapper/123:45:001
1158199384,28cyclictest0-21swapper/122:09:581
1158199383,27cyclictest0-21swapper/122:35:001
1158199374,27cyclictest0-21swapper/121:54:581
1158199373,30cyclictest0-21swapper/100:05:031
1158199372,6cyclictest0-21swapper/121:25:001
1158199352,5cyclictest0-21swapper/120:24:581
11581993513,19cyclictest26552-21cat23:59:391
1158199343,6cyclictest0-21swapper/121:59:581
1158199343,5cyclictest0-21swapper/100:35:031
1158199342,5cyclictest0-21swapper/121:49:581
1158199342,5cyclictest0-21swapper/120:59:581
1158199333,6cyclictest0-21swapper/119:15:021
1158199333,6cyclictest0-21swapper/119:10:001
1158199333,5cyclictest0-21swapper/120:54:591
1158199333,4cyclictest0-21swapper/100:15:001
1158199331,5cyclictest0-21swapper/123:35:021
1158199329,6cyclictest8919-21basename23:14:381
1158199326,6cyclictest5542-21seq00:26:411
1158199323,5cyclictest0-21swapper/123:20:021
1158199322,7cyclictest30838-21apt-get00:10:011
1158199322,6cyclictest31446-21apt-get20:00:001
11581993211,7cyclictest22829-21snmpd22:43:521
11581993210,5cyclictest24394-21seq23:52:501
1158199313,7cyclictest18304-21apt-get20:49:591
1158199313,5cyclictest0-21swapper/119:54:591
1158199312,7cyclictest16003-21apt-get19:20:001
1158199312,6cyclictest25732-21apt-get19:45:011
1158199309,4cyclictest22829-21snmpd20:21:511
1158199308,6cyclictest2680-21seq20:08:071
1158199307,7cyclictest12580-21awk20:35:001
1158199306,6cyclictest25702-21seq22:32:441
1158199306,6cyclictest14159-21cat23:25:191
1158199306,5cyclictest22829-21snmpd19:49:391
1158199305,6cyclictest2344-21timerandwakeup22:55:151
1158199304,6cyclictest3461-21unixbench_singl00:20:201
1158199302,6cyclictest16022-21apt-get20:43:001
1158199302,6cyclictest15038-21apt-get23:30:001
1158199301,10cyclictest6667-21lockfile-create20:19:391
1158199301,10cyclictest28845-21/usr/sbin/munin21:15:131
1158199297,5cyclictest20482-21awk22:20:021
1158199296,6cyclictest30287-21cut22:45:021
1158199296,6cyclictest16645-21cat20:45:011
1158199294,6cyclictest18461-21apt-get22:14:581
1158199293,5cyclictest5301-21apt-get23:05:011
1158199292,5cyclictest10645-21apt-get20:30:001
1158199291,10cyclictest27979-21users00:00:251
1158199291,10cyclictest22829-21snmpd22:50:131
1158199286,6cyclictest21811-21aten2_r4power_v19:35:041
1158199283,7cyclictest14667-21apt-get22:05:011
1158199282,6cyclictest29958-21apt-get21:19:591
1158199281,9cyclictest7039-21apt-get21:44:591
1158199281,9cyclictest25329-21munin-run19:44:381
1158199281,8cyclictest3997-21ntpq21:35:111
1158199263,5cyclictest0-21swapper/122:25:011
1158199262,6cyclictest24231-21apt-get21:04:581
1158199262,6cyclictest18858-21apt-get23:40:011
1158199262,6cyclictest1325-21apt-get21:30:031
1158099257,8cyclictest3030-21apt-get20:10:020
1158199245,7cyclictest22829-21snmpd19:29:291
1158199242,5cyclictest19804-21apt-get19:30:011
1158099248,9cyclictest12-21ksoftirqd/022:35:090
1158099247,8cyclictest12-21ksoftirqd/022:13:480
1158099239,9cyclictest12-21ksoftirqd/023:05:000
1158099237,8cyclictest12-21ksoftirqd/022:42:310
1158099237,5cyclictest12-21ksoftirqd/021:50:000
1158099236,8cyclictest12-21ksoftirqd/000:07:070
1158099229,3cyclictest141rcu_preempt22:55:000
1158099228,3cyclictest141rcu_preempt00:20:010
1158099228,2cyclictest141rcu_preempt20:40:140
1158099226,8cyclictest12-21ksoftirqd/023:09:490
1158099226,7cyclictest12-21ksoftirqd/022:50:090
1158099226,6cyclictest4554-21/usr/sbin/munin00:25:080
1158099226,5cyclictest12-21ksoftirqd/023:20:090
1158099225,8cyclictest12-21ksoftirqd/021:20:040
1158099225,7cyclictest12-21ksoftirqd/022:15:350
1158099225,5cyclictest12-21ksoftirqd/023:00:150
1158099224,8cyclictest12-21ksoftirqd/020:25:120
1158099220,8cyclictest12-21ksoftirqd/020:35:070
1158099220,4cyclictest0-21swapper/023:40:270
1158099219,3cyclictest141rcu_preempt22:20:160
1158099218,7cyclictest141rcu_preempt23:35:070
1158099218,7cyclictest141rcu_preempt23:15:030
1158099218,3cyclictest141rcu_preempt22:30:070
1158099218,3cyclictest141rcu_preempt21:05:010
1158099218,3cyclictest141rcu_preempt20:45:020
1158099216,9cyclictest12-21ksoftirqd/019:20:160
1158099216,5cyclictest12-21ksoftirqd/023:29:590
1158099216,3cyclictest141rcu_preempt20:15:160
1158099215,8cyclictest12-21ksoftirqd/020:53:130
1158099215,7cyclictest12-21ksoftirqd/022:28:430
1158099215,7cyclictest12-21ksoftirqd/000:35:110
1158099215,5cyclictest12-21ksoftirqd/019:35:110
1158099215,10cyclictest12-21ksoftirqd/000:15:220
1158099214,8cyclictest12-21ksoftirqd/022:46:580
1158099214,8cyclictest12-21ksoftirqd/022:08:420
1158099214,7cyclictest12-21ksoftirqd/023:51:070
1158099214,7cyclictest12-21ksoftirqd/021:10:070
1158099214,7cyclictest12-21ksoftirqd/020:55:030
1158099214,5cyclictest7989-21/usr/sbin/munin21:45:110
1158099213,7cyclictest12-21ksoftirqd/019:10:040
1158099212,7cyclictest12-21ksoftirqd/019:45:010
1158099212,4cyclictest0-21swapper/000:00:010
1158099212,3cyclictest141rcu_preempt21:30:160
1158099211,8cyclictest12-21ksoftirqd/023:57:130
1158099211,8cyclictest12-21ksoftirqd/019:30:140
1158099210,7cyclictest12-21ksoftirqd/019:40:030
1158099208,2cyclictest28267-21latency19:50:070
1158099206,8cyclictest12-21ksoftirqd/021:39:270
1158099206,8cyclictest12-21ksoftirqd/019:25:050
1158099206,7cyclictest12-21ksoftirqd/021:25:030
1158099206,5cyclictest29318-21users21:15:170
1158099205,5cyclictest12-21ksoftirqd/000:12:190
1158099204,7cyclictest12-21ksoftirqd/019:16:220
1158099203,5cyclictest12-21ksoftirqd/022:00:070
1158099201,6cyclictest12-21ksoftirqd/000:30:070
1158099201,5cyclictest6845-21apt-get20:19:570
1158099201,5cyclictest0-21swapper/023:45:000
1158099200,9cyclictest12-21ksoftirqd/020:00:000
1158099200,5cyclictest0-21swapper/021:40:070
1158099200,5cyclictest0-21swapper/019:55:010
11580991911,6cyclictest22829-21snmpd20:59:430
1158099190,5cyclictest0-21swapper/023:25:100
1158099190,5cyclictest0-21swapper/020:30:050
1158099190,5cyclictest0-21swapper/020:05:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional