You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot7s.osadl.org (updated Sat Aug 13, 2022 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132112526472,41sleep10-21swapper/119:09:181
128572487406,68sleep00-21swapper/019:05:260
146022800,1chrt14599-21python19:10:041
70792620,1chrt7076-21tune2fs20:14:561
21852460,2sleep00-21swapper/021:25:060
1349499302,20cyclictest27439-21diskmemload00:04:580
13498992810,12cyclictest22-21ksoftirqd/119:49:521
1349899274,13cyclictest27439-21diskmemload21:29:551
47732240,2sleep012-21ksoftirqd/021:34:400
1349499245,8cyclictest12-21ksoftirqd/019:20:040
1349499243,7cyclictest12-21ksoftirqd/000:09:570
251912230,1chrt25189-21mailstats22:25:030
1349899234,12cyclictest34750irq/90-enp1s0-r20:59:561
1349499237,6cyclictest12-21ksoftirqd/000:39:220
1349499234,8cyclictest12-21ksoftirqd/020:30:130
1349499234,6cyclictest12-21ksoftirqd/023:54:540
1349499234,6cyclictest12-21ksoftirqd/000:24:390
1349499233,7cyclictest12-21ksoftirqd/023:29:540
1349499233,7cyclictest12-21ksoftirqd/023:20:060
1349499233,7cyclictest12-21ksoftirqd/021:14:390
1349499233,6cyclictest12-21ksoftirqd/019:40:060
1349499233,6cyclictest12-21ksoftirqd/000:19:090
1349499230,7cyclictest188-21systemd-journal19:26:510
191002220,2sleep119104-21needreboot22:10:021
1349899221,4cyclictest0-21swapper/121:54:151
1349899221,4cyclictest0-21swapper/100:31:521
13498992214,6cyclictest27439-21diskmemload23:18:171
1349899220,6cyclictest0-21swapper/121:21:511
1349899220,5cyclictest0-21swapper/123:04:541
1349899220,5cyclictest0-21swapper/120:08:401
1349899220,4cyclictest0-21swapper/119:35:041
1349499224,7cyclictest12-21ksoftirqd/021:04:520
1349499223,8cyclictest12-21ksoftirqd/020:54:550
1349499223,8cyclictest12-21ksoftirqd/020:49:580
1349499223,8cyclictest12-21ksoftirqd/020:25:010
1349499223,8cyclictest12-21ksoftirqd/019:15:000
1349499223,7cyclictest12-21ksoftirqd/021:55:050
1349499223,7cyclictest12-21ksoftirqd/020:34:570
1349499223,6cyclictest12-21ksoftirqd/023:44:550
1349499223,6cyclictest12-21ksoftirqd/022:54:520
1349499223,6cyclictest12-21ksoftirqd/021:14:530
1349499223,6cyclictest12-21ksoftirqd/019:59:580
1349499223,6cyclictest12-21ksoftirqd/000:25:040
1349499223,5cyclictest12-21ksoftirqd/021:40:050
1349499222,9cyclictest12-21ksoftirqd/023:35:000
1349499222,9cyclictest12-21ksoftirqd/023:10:080
1349499222,9cyclictest12-21ksoftirqd/022:30:090
1349499222,9cyclictest12-21ksoftirqd/000:00:000
1349499222,8cyclictest12-21ksoftirqd/023:40:050
1349499222,8cyclictest12-21ksoftirqd/023:40:050
1349499222,8cyclictest12-21ksoftirqd/022:59:560
1349499222,8cyclictest12-21ksoftirqd/022:49:580
1349499222,8cyclictest12-21ksoftirqd/021:50:060
1349499222,8cyclictest12-21ksoftirqd/020:14:510
1349499222,8cyclictest12-21ksoftirqd/020:04:560
1349499222,7cyclictest30876-21taskset19:50:100
1349499222,7cyclictest12-21ksoftirqd/019:34:380
1349499222,6cyclictest12-21ksoftirqd/023:05:000
1349499222,6cyclictest12-21ksoftirqd/000:29:570
1349499221,15cyclictest28021-21seq22:34:520
1349499220,8cyclictest12-21ksoftirqd/022:09:570
1349499220,7cyclictest12-21ksoftirqd/022:44:590
1349499220,6cyclictest12-21ksoftirqd/020:45:020
1349899217,11cyclictest5508-21cpuspeed_turbos00:24:541
1349899211,7cyclictest19919-21apt-get19:24:521
1349899211,5cyclictest0-21swapper/121:14:021
1349899211,5cyclictest0-21swapper/120:37:011
1349899211,4cyclictest0-21swapper/123:12:121
1349899211,4cyclictest0-21swapper/120:50:221
1349899211,4cyclictest0-21swapper/100:08:231
1349899210,5cyclictest0-21swapper/122:16:051
1349899210,5cyclictest0-21swapper/122:16:051
1349899210,17cyclictest8615-21latency_hist21:44:401
1349499213,8cyclictest12-21ksoftirqd/023:50:000
1349499213,8cyclictest12-21ksoftirqd/022:05:000
1349499213,8cyclictest12-21ksoftirqd/019:44:570
1349499213,7cyclictest12-21ksoftirqd/023:24:570
1349499213,7cyclictest12-21ksoftirqd/022:40:030
1349499213,7cyclictest12-21ksoftirqd/022:14:510
1349499213,7cyclictest12-21ksoftirqd/022:14:510
1349499213,7cyclictest12-21ksoftirqd/020:39:520
1349499213,7cyclictest12-21ksoftirqd/020:09:570
1349499213,7cyclictest12-21ksoftirqd/019:55:030
1349499213,7cyclictest12-21ksoftirqd/019:09:560
1349499213,6cyclictest12-21ksoftirqd/022:19:420
1349499213,5cyclictest12-21ksoftirqd/021:44:520
1349499213,5cyclictest12-21ksoftirqd/019:36:060
1349499212,8cyclictest12-21ksoftirqd/021:00:070
1349499212,8cyclictest12-21ksoftirqd/020:19:510
1349499212,5cyclictest12-21ksoftirqd/021:29:590
1349499211,8cyclictest12-21ksoftirqd/021:19:530
1349499211,7cyclictest12-21ksoftirqd/023:14:520
1349499210,7cyclictest12-21ksoftirqd/021:59:590
1349899208,9cyclictest34850irq/91-enp1s0-r00:09:541
1349899203,11cyclictest0-21swapper/121:44:511
1349899201,8cyclictest19642-21snmpd00:00:111
1349899201,4cyclictest0-21swapper/121:07:141
1349899201,4cyclictest0-21swapper/119:47:321
13498992011,7cyclictest5553-21ntpq20:10:011
13498992010,8cyclictest34850irq/91-enp1s0-r00:34:561
13498992010,7cyclictest24156-21apt-get23:49:511
1349899200,6cyclictest0-21swapper/123:56:251
1349899200,5cyclictest0-21swapper/121:36:531
1349899200,5cyclictest0-21swapper/120:41:521
1349899200,4cyclictest0-21swapper/123:42:161
1349899200,4cyclictest0-21swapper/123:42:161
1349899200,4cyclictest0-21swapper/123:36:351
1349899200,4cyclictest0-21swapper/122:26:011
1349899200,4cyclictest0-21swapper/122:21:561
1349899200,4cyclictest0-21swapper/119:58:121
1349899200,4cyclictest0-21swapper/119:17:191
1349899200,17cyclictest2094-21kworker/1:019:29:421
1349899199,6cyclictest15108-21hddtemp_smartct23:24:581
1349899197,10cyclictest2094-21kworker/1:019:22:241
1349899196,11cyclictest13513-21grep23:20:021
1349899194,8cyclictest0-21swapper/121:14:511
1349899192,15cyclictest16123-21kworker/1:122:49:581
1349899191,5cyclictest21899-21apt-get20:54:511
1349899191,4cyclictest0-21swapper/119:41:001
13498991911,6cyclictest29826-21grep22:39:391
13498991911,6cyclictest19642-21snmpd20:47:331
13498991911,6cyclictest19642-21snmpd20:28:531
13498991911,6cyclictest19642-21snmpd20:20:051
1349899191,16cyclictest16123-21kworker/1:122:54:521
13498991910,7cyclictest19642-21snmpd23:03:221
1349899190,4cyclictest0-21swapper/120:03:121
1349899188,8cyclictest19642-21snmpd22:01:501
1349899188,7cyclictest17005-21fschecks_time23:29:591
1349899188,4cyclictest34850irq/91-enp1s0-r00:24:381
1349899181,15cyclictest16123-21kworker/1:122:39:401
1349899180,4cyclictest0-21swapper/123:46:131
1349899180,4cyclictest0-21swapper/122:45:201
1349899179,6cyclictest26912-21ntpq22:30:041
1349899176,9cyclictest16123-21kworker/1:122:04:541
13498991712,3cyclictest13645-21grep20:30:111
13498991711,4cyclictest1906-21mii-tool00:14:591
1349899170,7cyclictest14234-21http21:59:391
1349899168,6cyclictest1267-21fschecks_count21:24:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional