You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-30 - 18:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot7s.osadl.org (updated Mon Jan 30, 2023 12:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
263282496429,45sleep00-21swapper/007:07:060
262082430353,62sleep10-21swapper/107:05:481
2655326224,26sleep126707-21awk07:09:331
53662570,2sleep10-21swapper/110:24:521
154092550,3sleep00-21swapper/009:25:040
68842390,1sleep06887-21if_enp1s007:40:010
2673299286,3cyclictest141rcu_preempt09:15:031
2673299285,3cyclictest141rcu_preempt11:24:331
2673299265,8cyclictest141rcu_preempt11:24:581
2673299264,8cyclictest141rcu_preempt11:38:141
2673299258,5cyclictest22-21ksoftirqd/111:03:471
2673299257,7cyclictest22-21ksoftirqd/110:21:491
2673299254,8cyclictest141rcu_preempt11:59:511
2673299254,8cyclictest141rcu_preempt11:40:091
26732992511,3cyclictest31298-21snmpd12:08:571
26732992511,2cyclictest34750irq/90-enp1s0-r11:49:541
26732992510,4cyclictest22-21ksoftirqd/109:28:051
2673199258,2cyclictest141rcu_preempt10:14:340
2673299246,3cyclictest141rcu_preempt07:50:041
2673299245,2cyclictest141rcu_preempt09:59:551
2673299242,3cyclictest141rcu_preempt11:58:181
2673299242,18cyclictest0-21swapper/109:49:521
26732992412,2cyclictest34750irq/90-enp1s0-r11:49:041
2673299237,2cyclictest141rcu_preempt11:33:531
2673299236,3cyclictest141rcu_preempt10:40:001
2673299236,2cyclictest141rcu_preempt09:19:521
2673299235,5cyclictest141rcu_preempt10:58:231
2673299232,8cyclictest141rcu_preempt09:54:501
26732992314,7cyclictest29278-21basename07:14:551
2673299230,8cyclictest141rcu_preempt12:15:051
2673199235,15cyclictest1395-21/usr/sbin/munin10:14:550
2673299226,2cyclictest141rcu_preempt10:15:001
2673299225,3cyclictest141rcu_preempt07:59:481
2673299223,6cyclictest141rcu_preempt08:29:491
26731992211,9cyclictest11050-21cat09:14:570
312302211,2sleep10-21swapper/107:19:511
2673299212,3cyclictest141rcu_preempt10:34:341
2673299212,13cyclictest0-21swapper/108:09:521
26732992112,7cyclictest18914-21ntpq09:35:001
26732992111,8cyclictest34850irq/91-enp1s0-r09:44:511
2673199212,14cyclictest20061-21apt-get09:39:550
2673299209,3cyclictest9982-21awk07:49:331
2673299207,9cyclictest22-21ksoftirqd/108:54:501
26732992011,7cyclictest31298-21snmpd10:54:221
26732992011,7cyclictest31298-21snmpd10:37:451
26732992011,7cyclictest31298-21snmpd07:29:181
26732992011,7cyclictest13509-21which10:44:571
26732992010,8cyclictest31298-21snmpd09:04:551
26732992010,3cyclictest22-21ksoftirqd/108:44:421
26732992010,3cyclictest22-21ksoftirqd/108:35:541
26732992010,3cyclictest22-21ksoftirqd/108:20:111
26732992010,3cyclictest22-21ksoftirqd/107:57:101
2673199204,14cyclictest32621-21vmstat08:45:050
26731992013,4cyclictest131rcuc/008:04:500
26731992011,7cyclictest4364-21grep07:34:340
26731992011,7cyclictest31298-21snmpd12:26:250
26731992011,7cyclictest31298-21snmpd11:29:500
26731992011,7cyclictest31298-21snmpd11:06:490
26731992011,7cyclictest31298-21snmpd10:48:370
26731992011,7cyclictest31298-21snmpd10:35:000
26731992011,7cyclictest31298-21snmpd07:57:490
26731992011,2cyclictest12-21ksoftirqd/007:52:160
26731992010,8cyclictest6334-21kworker/u4:210:33:360
26731992010,3cyclictest12-21ksoftirqd/012:23:420
26731992010,3cyclictest12-21ksoftirqd/011:39:100
26731992010,3cyclictest12-21ksoftirqd/010:19:490
26731992010,3cyclictest12-21ksoftirqd/009:59:480
26731992010,3cyclictest12-21ksoftirqd/009:54:480
26731992010,3cyclictest12-21ksoftirqd/009:49:560
26731992010,3cyclictest12-21ksoftirqd/008:37:330
2673299199,3cyclictest22-21ksoftirqd/112:33:051
2673299199,3cyclictest22-21ksoftirqd/109:11:331
2673299199,3cyclictest22-21ksoftirqd/108:19:261
2673299194,13cyclictest20847-21taskset11:04:531
2673299193,14cyclictest24809-21timerwakeupswit08:25:021
26732991911,6cyclictest3355-21awk07:29:591
26732991911,6cyclictest31298-21snmpd09:01:401
26732991911,6cyclictest31298-21snmpd07:42:041
26732991911,6cyclictest31298-21snmpd07:38:371
26732991911,6cyclictest31298-21snmpd07:38:371
26732991911,6cyclictest19327-21df_inode12:25:001
26732991910,3cyclictest22-21ksoftirqd/112:38:321
26732991910,3cyclictest22-21ksoftirqd/112:09:431
26732991910,3cyclictest22-21ksoftirqd/111:12:261
26732991910,3cyclictest22-21ksoftirqd/110:07:581
26732991910,3cyclictest22-21ksoftirqd/108:50:081
26732991910,2cyclictest22-21ksoftirqd/109:41:091
26732991910,2cyclictest22-21ksoftirqd/108:39:561
26731991911,6cyclictest31298-21snmpd11:44:140
26731991911,6cyclictest31298-21snmpd11:00:040
26731991911,6cyclictest31298-21snmpd08:43:300
26731991911,6cyclictest15707-21awk10:49:590
26731991911,6cyclictest10868-21kworker/u4:112:06:520
26731991910,7cyclictest6987-21pluginstate10:29:340
26731991910,7cyclictest31298-21snmpd11:45:140
26731991910,7cyclictest31298-21snmpd09:10:070
26731991910,7cyclictest31298-21snmpd07:26:150
26731991910,7cyclictest14075-21ntpq12:10:060
26731991910,3cyclictest12-21ksoftirqd/011:21:380
26731991910,3cyclictest12-21ksoftirqd/009:47:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional