You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-07 - 15:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot7s.osadl.org (updated Thu Dec 07, 2023 12:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
270612462376,70sleep00-21swapper/007:07:440
271392458394,51sleep10-21swapper/107:08:361
214232650,2sleep10-21swapper/111:05:021
173872570,2sleep017391-21cpuspeed_turbos09:30:010
2741199363,27cyclictest0-21swapper/007:45:000
218052360,2sleep10-21swapper/109:40:081
2741199343,5cyclictest0-21swapper/009:39:570
2741199340,7cyclictest21193-21aten2_r4power_e11:05:000
2741199340,7cyclictest13987-21ls07:55:120
2741299334,8cyclictest0-21swapper/110:55:021
2741299334,7cyclictest0-21swapper/108:24:591
2741199334,23cyclictest0-21swapper/010:39:570
2741199333,4cyclictest0-21swapper/010:34:590
2741199330,6cyclictest25170-21cat09:50:000
2741199330,6cyclictest18644-21sshd08:09:560
2741199328,6cyclictest23195-21df09:45:020
2741199323,25cyclictest0-21swapper/011:14:590
2741199322,5cyclictest0-21swapper/010:24:590
2741199322,5cyclictest0-21swapper/010:24:590
2741199322,27cyclictest15321-21aten2_r4power_e09:25:010
2741199319,19cyclictest31342-21cat11:30:060
2741199317,5cyclictest26857-21dpkg11:19:560
2741199315,7cyclictest27704-21cstates07:10:000
2741199313,6cyclictest0-21swapper/007:29:570
2741199313,24cyclictest0-21swapper/008:54:590
2741199306,7cyclictest12173-21grep09:15:080
2741199305,6cyclictest15304-21date10:49:390
2741199302,9cyclictest2260-21apt-get11:39:570
2741199302,6cyclictest28812-21apt-get09:59:580
2741199302,5cyclictest0-21swapper/008:14:580
2741199301,5cyclictest0-21swapper/010:59:590
27411993011,17cyclictest22829-21snmpd11:35:560
27411993011,17cyclictest22829-21snmpd11:35:560
27411993010,18cyclictest6503-21tr11:50:010
2741299298,13cyclictest22829-21snmpd08:04:581
2741199298,4cyclictest13675-21df09:19:590
2741199293,4cyclictest0-21swapper/010:14:580
2741199293,4cyclictest0-21swapper/008:49:570
2741199292,7cyclictest16748-21apt-get08:04:590
2741199292,6cyclictest0-21swapper/011:09:590
2741199292,5cyclictest14845-21apt-get07:59:580
2741199292,4cyclictest0-21swapper/012:34:590
2741199292,3cyclictest0-21swapper/010:04:590
2741199292,3cyclictest0-21swapper/008:45:010
2741199291,4cyclictest0-21swapper/007:15:000
27411992910,17cyclictest22829-21snmpd11:57:030
2741299283,8cyclictest0-21swapper/112:14:581
2741299283,15cyclictest9133-21diskmemload09:34:581
2741199287,5cyclictest12594-21tune2fs12:05:030
2741199286,7cyclictest7830-21if_err_enp2s007:40:270
2741199286,4cyclictest12809-21latency_hist07:54:380
2741199284,6cyclictest21631-21cat12:29:380
2741199282,6cyclictest0-21swapper/010:29:580
2741199282,5cyclictest0-21swapper/007:19:570
2741199282,3cyclictest0-21swapper/011:59:580
2741199281,9cyclictest26896-21runrttasks09:55:020
2741199281,9cyclictest23263-21ntp_offset08:20:090
2741199281,8cyclictest11051-21http09:14:380
2741199280,9cyclictest405-21cstates10:10:000
111762280,5chrt141rcu_preempt09:14:381
2741199274,5cyclictest5658-21/usr/sbin/munin07:35:030
2741199274,5cyclictest30801-21cut08:40:030
2741199274,5cyclictest28810-21cut11:25:010
2741199273,6cyclictest14107-21apt-get12:10:000
2741199272,6cyclictest0-21swapper/011:44:560
2741199272,5cyclictest17323-21apt-get10:55:020
2741199272,3cyclictest0-21swapper/012:29:570
2741199272,3cyclictest0-21swapper/008:59:560
2741199271,8cyclictest19823-21ntpq09:35:070
2741199271,7cyclictest18523-21kernelversion12:20:050
2741199271,6cyclictest4001-21apt-get10:19:580
2741199271,11cyclictest16002-21apt-get12:14:590
2741199270,8cyclictest2512-21/usr/sbin/munin07:25:110
2741199262,6cyclictest24621-21apt-get08:24:590
2741199262,4cyclictest26524-21apt-get08:30:000
2741199261,9cyclictest28434-21taskset08:35:010
2741199261,7cyclictest15689-21cstates10:50:010
2741199251,6cyclictest7460-21tr09:04:590
2741299243,13cyclictest9133-21diskmemload09:24:591
2741299238,13cyclictest19467-21cstates11:00:011
2741299216,9cyclictest0-21swapper/112:19:571
2741299216,8cyclictest0-21swapper/107:59:581
2741299214,8cyclictest0-21swapper/109:29:581
27412992111,7cyclictest5305-21cron08:59:381
2741299208,9cyclictest0-21swapper/110:44:101
2741299204,7cyclictest0-21swapper/109:19:561
27412992013,4cyclictest3105-21switchtime10:15:131
27412992011,7cyclictest27455-21cat09:55:081
27412992011,6cyclictest972-21ntp_states10:10:081
2741299201,15cyclictest20011-21/usr/sbin/munin12:25:011
2741299201,13cyclictest2209-21apt-get11:39:431
27412992010,8cyclictest22829-21snmpd09:45:141
27412992010,7cyclictest22829-21snmpd09:05:411
31132191,2sleep122829-21snmpd07:28:361
2741299199,8cyclictest22829-21snmpd07:42:191
2741299199,7cyclictest13261-21cat07:55:021
2741299198,9cyclictest22829-21snmpd12:05:151
2741299198,6cyclictest10982-21users10:35:161
2741299196,7cyclictest0-21swapper/107:49:581
2741299195,8cyclictest0-21swapper/111:29:561
2741299194,8cyclictest0-21swapper/109:49:571
2741299194,7cyclictest0-21swapper/111:34:561
2741299194,7cyclictest0-21swapper/111:34:561
2741299193,6cyclictest0-21swapper/109:14:581
2741299192,6cyclictest23831-21ntp_states11:10:101
27412991913,3cyclictest17217-21cat10:54:391
27412991912,5cyclictest22829-21snmpd12:37:011
27412991911,6cyclictest29320-21cat11:25:071
27412991911,6cyclictest22829-21snmpd12:12:001
27412991911,6cyclictest22829-21snmpd11:54:451
27412991911,6cyclictest22829-21snmpd11:15:311
27412991911,6cyclictest22829-21snmpd10:49:371
27412991911,6cyclictest22829-21snmpd09:02:211
27412991911,6cyclictest22829-21snmpd08:44:151
27412991911,6cyclictest22829-21snmpd07:31:161
27412991910,7cyclictest22829-21snmpd11:20:051
27412991910,7cyclictest1557-21grep08:49:391
2741299189,7cyclictest22146-21perl12:30:021
2741299187,10cyclictest27513-21kworker/1:107:45:271
2741299187,10cyclictest16404-21kworker/1:208:17:511
2741299186,10cyclictest20703-21kworker/1:211:48:051
2741299184,6cyclictest0-21swapper/109:59:581
2741299183,9cyclictest0-21swapper/110:19:591
2741299182,15cyclictest27513-21kworker/1:107:37:091
2741299182,15cyclictest27513-21kworker/1:107:24:091
2741299182,15cyclictest16404-21kworker/1:208:12:331
2741299182,11cyclictest10305-21apt-get11:59:591
2741299181,13cyclictest7803-21apt-get10:29:581
2741299181,11cyclictest23293-21apt-get08:20:131
2741299181,10cyclictest5867-21apt-get11:49:421
27412991810,6cyclictest31267-21cat10:05:051
27412991810,6cyclictest29077-21sort08:35:081
27412991810,6cyclictest22829-21snmpd10:28:001
27412991810,6cyclictest22829-21snmpd10:28:001
27412991810,6cyclictest22829-21snmpd07:17:451
2741299173,6cyclictest0-21swapper/108:30:001
2741299172,11cyclictest1706-21apt-get08:49:581
27412991711,4cyclictest22829-21snmpd07:13:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional