You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-23 - 05:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack4slot7s.osadl.org (updated Thu Mar 23, 2023 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
213142456394,47sleep10-21swapper/119:07:371
214242454375,63sleep00-21swapper/019:08:490
73472580,2sleep00-21swapper/022:44:350
154082420,2chrt15411-21cut21:40:001
21672994014,12cyclictest20458-21seq20:29:550
21672993913,8cyclictest3368-21diskmemload23:29:550
21672993912,13cyclictest26405-21ls22:09:360
21672993911,12cyclictest12495-21python00:20:070
21672993910,12cyclictest2461-21ls22:30:020
2167299384,22cyclictest3368-21diskmemload21:29:560
21672993812,10cyclictest496-21runrttasks22:10:240
21672993811,12cyclictest18039-21ls23:10:090
21672993713,10cyclictest24240-21runrttasks23:27:400
21672993713,10cyclictest1022-21runrttasks19:39:150
21672993712,12cyclictest3418-21munin-run23:59:350
21672993712,10cyclictest1673-21fschecks_time19:39:530
21672993711,12cyclictest30338-21cpuspeed_turbos20:54:500
21672993711,10cyclictest21858-21ls23:20:050
21672993615,8cyclictest13378-21/usr/sbin/munin00:24:590
21672993614,8cyclictest496-21runrttasks22:24:520
21672993613,9cyclictest3368-21diskmemload23:34:550
21672993613,10cyclictest496-21runrttasks00:30:030
21672993612,8cyclictest28579-21irqstats19:25:000
21672993612,10cyclictest19901-21taskset20:25:440
21672993611,12cyclictest27809-21munin-run19:24:350
21672993611,11cyclictest21134-21cstates21:54:580
21672993611,10cyclictest23029-21cstates21:59:530
21672993610,14cyclictest17600-21tr20:20:080
2167299359,10cyclictest0-21swapper/019:59:490
21672993513,8cyclictest8887-21taskset22:46:270
21672993513,8cyclictest8887-21taskset22:46:270
21672993512,9cyclictest15373-21expr23:04:570
21672993512,10cyclictest19382-21basename23:15:000
21672993511,8cyclictest4699-21ls21:10:020
21672993511,8cyclictest11727-21hddtemp_smartct22:54:580
21672993511,10cyclictest6365-21ls19:50:040
21672993510,11cyclictest7696-21apt-get00:09:540
21672993510,11cyclictest22034-21cat19:10:010
21672993510,10cyclictest8208-21ls19:55:010
21672993510,10cyclictest6778-21ls00:05:120
21672993510,10cyclictest17517-21df00:34:530
2167299349,11cyclictest17489-21irqstats21:45:040
2167299349,10cyclictest19460-21memory21:49:560
2167299349,10cyclictest0-21swapper/021:24:530
21672993413,9cyclictest496-21runrttasks21:00:040
21672993413,7cyclictest29867-21taskset22:16:180
21672993412,8cyclictest29855-21/usr/sbin/munin19:30:020
21672993412,8cyclictest25314-21ls20:40:020
21672993412,8cyclictest10358-21python22:50:060
21672993411,9cyclictest28764-21df_inode23:40:010
21672993411,9cyclictest15857-21ps21:40:080
21672993410,8cyclictest26789-21hddtemp_smartct20:45:000
21672993410,11cyclictest3770-21apt23:59:540
21672993410,10cyclictest32516-21cstates23:50:010
21672993410,10cyclictest23798-21smart_sda19:14:370
21672993410,10cyclictest10308-21ls00:14:590
21672993313,8cyclictest3324-21dpkg19:44:530
21672993312,8cyclictest496-21runrttasks22:34:420
21672993312,8cyclictest15710-21python20:15:000
21672993312,8cyclictest14525-21taskset23:00:360
21672993312,8cyclictest13529-21hddtemp_smartct21:34:550
21672993311,9cyclictest6175-21sed21:15:050
21672993311,9cyclictest11519-21irqstats20:04:560
21672993311,8cyclictest7695-21df21:19:540
21672993311,10cyclictest30358-21aten2_r4power_c23:44:490
21672993310,9cyclictest28806-21irqstats20:49:560
21672993310,9cyclictest23390-21ls20:35:010
21672993310,9cyclictest23390-21ls20:35:010
21672993310,8cyclictest31052-21ls22:20:000
21672993310,10cyclictest1548-21apt-config21:04:360
21672993310,10cyclictest13772-21mailstats20:10:020
21673992814,9cyclictest3507-1kworker/u5:123:44:481
2167399240,4cyclictest0-21swapper/122:44:571
2167399240,4cyclictest0-21swapper/122:44:571
2167399229,2cyclictest22-21ksoftirqd/122:30:111
2167399221,5cyclictest0-21swapper/121:03:071
21673992211,9cyclictest24134-21kworker/1:122:26:121
2167399220,5cyclictest0-21swapper/121:36:161
2167399211,5cyclictest22-21ksoftirqd/119:34:551
2167399211,5cyclictest0-21swapper/123:27:091
2167399211,4cyclictest0-21swapper/100:12:521
21673992112,7cyclictest22829-21snmpd19:41:161
21673992111,8cyclictest22829-21snmpd23:55:031
21673992110,4cyclictest4770-21kworker/1:219:12:521
2167399210,8cyclictest8053-21/usr/sbin/munin21:20:001
2167399210,5cyclictest0-21swapper/123:54:311
2167399203,8cyclictest141rcu_preempt19:54:591
2167399201,6cyclictest0-21swapper/121:25:201
2167399201,6cyclictest0-21swapper/119:27:321
2167399201,4cyclictest0-21swapper/121:12:531
2167399201,4cyclictest0-21swapper/120:45:511
2167399201,4cyclictest0-21swapper/120:43:181
21673992011,8cyclictest22-21ksoftirqd/121:54:571
21673992011,7cyclictest22829-21snmpd23:40:021
2167399200,5cyclictest0-21swapper/122:40:501
2167399200,5cyclictest0-21swapper/120:00:201
2167399200,5cyclictest0-21swapper/119:32:441
2167399200,4cyclictest0-21swapper/123:32:051
2167399200,4cyclictest0-21swapper/122:14:241
2167399191,5cyclictest0-21swapper/100:00:121
2167399191,4cyclictest0-21swapper/100:22:561
2167399191,3cyclictest141rcu_preempt22:20:071
21673991911,6cyclictest22829-21snmpd23:00:071
21673991911,6cyclictest22829-21snmpd21:46:441
21673991911,6cyclictest22829-21snmpd21:08:491
21673991911,6cyclictest22829-21snmpd20:31:571
2167399191,14cyclictest15311-21apt-get00:29:531
21673991910,7cyclictest22829-21snmpd19:50:101
21673991910,7cyclictest10935-21apt-get20:04:501
2167399190,5cyclictest0-21swapper/123:24:061
2167399190,5cyclictest0-21swapper/122:35:221
2167399190,5cyclictest0-21swapper/120:25:271
2167399190,4cyclictest0-21swapper/120:22:361
2167399190,2cyclictest141rcu_preempt22:55:081
2167399189,7cyclictest6717-21sed00:05:111
21673991811,5cyclictest22829-21snmpd20:18:561
21673991810,6cyclictest31650-21seq20:57:431
21673991810,6cyclictest26812-21needreboot19:19:571
21673991810,6cyclictest22829-21snmpd22:15:421
21673991810,6cyclictest22829-21snmpd22:05:141
21673991810,6cyclictest13734-21/usr/sbin/munin00:24:551
21673991810,6cyclictest10056-21grep22:50:021
2167399180,4cyclictest0-21swapper/121:51:271
2167399180,4cyclictest0-21swapper/120:12:571
2167399180,4cyclictest0-21swapper/119:47:151
227662170,4sleep122-21ksoftirqd/121:59:521
2167399179,6cyclictest9902-21df00:14:541
2167399179,6cyclictest22829-21snmpd20:38:421
2167399179,6cyclictest22829-21snmpd20:38:421
2167399179,6cyclictest18115-21grep00:35:031
2167399178,7cyclictest26463-21seq23:34:361
2167399176,9cyclictest12316-21kworker/u4:023:09:561
21673991711,4cyclictest25267-21timerwakeupswit19:15:011
21673991711,4cyclictest24134-21kworker/1:123:14:561
21673991711,4cyclictest22829-21snmpd21:29:381
21673991710,5cyclictest23584-21kworker/1:020:49:561
21673991710,5cyclictest22829-21snmpd21:15:491
21673991710,5cyclictest16796-21cron23:09:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional