You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 19:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron N2930 @1833 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #4, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack4slot7s.osadl.org (updated Sun Jul 03, 2022 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117182465405,46sleep00-21swapper/007:06:240
115882460395,52sleep10-21swapper/107:05:101
75072750,3sleep00-21swapper/008:19:580
36142560,2sleep10-21swapper/109:34:571
108672540,2sleep10-21swapper/108:29:431
121612490,3sleep00-21swapper/009:55:100
132042470,2chrt13203-21diskstats08:34:591
317202450,2chrt26026-21diskmemload10:48:291
1219899269,9cyclictest22-21ksoftirqd/107:41:061
1219899256,2cyclictest22-21ksoftirqd/109:04:591
12198992411,4cyclictest23979-21kworker/1:110:34:401
12198992211,9cyclictest30537-21/usr/sbin/munin12:10:041
12198992211,3cyclictest25610-21snmpd12:37:581
12197992211,3cyclictest12-21ksoftirqd/012:34:550
12197992210,3cyclictest12-21ksoftirqd/012:04:560
1219899218,7cyclictest22-21ksoftirqd/109:47:361
1219899214,13cyclictest0-21swapper/107:59:541
12198992110,3cyclictest22-21ksoftirqd/111:25:051
12197992112,7cyclictest6658-21nfs_client12:30:040
12197992111,3cyclictest12-21ksoftirqd/011:45:080
12197992111,3cyclictest12-21ksoftirqd/011:38:500
12197992111,3cyclictest12-21ksoftirqd/010:15:080
12197992111,3cyclictest12-21ksoftirqd/008:50:010
12197992110,3cyclictest12-21ksoftirqd/012:14:550
12197992110,3cyclictest12-21ksoftirqd/011:59:500
12197992110,3cyclictest12-21ksoftirqd/010:55:080
12197992110,3cyclictest12-21ksoftirqd/010:39:560
12197992110,3cyclictest12-21ksoftirqd/010:30:090
12197992110,3cyclictest12-21ksoftirqd/010:24:580
12197992110,3cyclictest12-21ksoftirqd/010:05:000
12197992110,3cyclictest12-21ksoftirqd/009:54:430
12197992110,3cyclictest12-21ksoftirqd/009:45:090
12197992110,3cyclictest12-21ksoftirqd/009:35:060
12197992110,3cyclictest12-21ksoftirqd/009:24:550
12197992110,3cyclictest12-21ksoftirqd/009:14:550
12197992110,3cyclictest12-21ksoftirqd/009:14:420
12197992110,3cyclictest12-21ksoftirqd/009:05:000
12197992110,3cyclictest12-21ksoftirqd/009:04:430
12197992110,3cyclictest12-21ksoftirqd/008:45:030
12197992110,3cyclictest12-21ksoftirqd/008:30:020
12197992110,3cyclictest12-21ksoftirqd/008:19:430
12197992110,3cyclictest12-21ksoftirqd/008:14:430
12197992110,3cyclictest12-21ksoftirqd/007:59:550
12197992110,3cyclictest12-21ksoftirqd/007:45:060
12197992110,3cyclictest12-21ksoftirqd/007:40:110
12197992110,3cyclictest12-21ksoftirqd/007:30:070
12197992110,3cyclictest12-21ksoftirqd/007:25:050
12197992110,3cyclictest12-21ksoftirqd/007:19:560
12197992110,3cyclictest12-21ksoftirqd/007:14:460
12197992110,3cyclictest12-21ksoftirqd/007:10:060
12197992110,2cyclictest12-21ksoftirqd/008:54:530
1219899207,11cyclictest20732-21tr10:19:581
1219899202,16cyclictest4888-21kworker/1:011:30:021
12198992011,7cyclictest25610-21snmpd12:15:131
12198992011,7cyclictest25610-21snmpd12:00:011
1219799209,3cyclictest12-21ksoftirqd/011:54:560
1219799209,3cyclictest12-21ksoftirqd/011:49:590
1219799209,3cyclictest12-21ksoftirqd/011:29:430
1219799209,3cyclictest12-21ksoftirqd/011:22:220
1219799209,3cyclictest12-21ksoftirqd/009:29:550
1219799209,3cyclictest12-21ksoftirqd/008:24:570
12197992012,6cyclictest18954-21apt-get11:39:560
12197992010,3cyclictest12-21ksoftirqd/012:24:570
12197992010,3cyclictest12-21ksoftirqd/012:20:040
12197992010,3cyclictest12-21ksoftirqd/011:24:540
12197992010,3cyclictest12-21ksoftirqd/011:14:530
12197992010,3cyclictest12-21ksoftirqd/011:10:020
12197992010,3cyclictest12-21ksoftirqd/011:04:540
12197992010,3cyclictest12-21ksoftirqd/010:59:540
12197992010,3cyclictest12-21ksoftirqd/010:49:580
12197992010,3cyclictest12-21ksoftirqd/010:44:560
12197992010,3cyclictest12-21ksoftirqd/010:34:540
12197992010,3cyclictest12-21ksoftirqd/010:19:510
12197992010,3cyclictest12-21ksoftirqd/010:09:540
12197992010,3cyclictest12-21ksoftirqd/009:59:550
12197992010,3cyclictest12-21ksoftirqd/009:39:550
12197992010,3cyclictest12-21ksoftirqd/009:19:530
12197992010,3cyclictest12-21ksoftirqd/008:39:540
12197992010,3cyclictest12-21ksoftirqd/008:35:000
12197992010,3cyclictest12-21ksoftirqd/008:04:530
12197992010,3cyclictest12-21ksoftirqd/007:54:540
12197992010,3cyclictest12-21ksoftirqd/007:49:550
12197992010,2cyclictest12-21ksoftirqd/007:35:000
1219899199,8cyclictest470-21dbus-daemon09:59:431
1219899199,8cyclictest16727-21/usr/sbin/munin07:20:021
1219899198,9cyclictest13107-21wget09:59:561
1219899194,10cyclictest21847-21python11:45:081
1219899192,13cyclictest1546-21apt-get09:29:551
12198991913,3cyclictest22-21ksoftirqd/109:29:431
12198991913,3cyclictest22-21ksoftirqd/109:19:571
12198991911,6cyclictest25610-21snmpd11:50:221
12198991911,6cyclictest25610-21snmpd10:56:321
12198991911,6cyclictest25610-21snmpd10:12:401
12198991911,6cyclictest25610-21snmpd08:55:461
12198991911,6cyclictest25610-21snmpd07:28:411
1219899191,16cyclictest19386-21missed_timers10:15:031
12198991910,7cyclictest25610-21snmpd12:23:321
1219899190,17cyclictest5966-21sed09:40:031
12197991910,2cyclictest12-21ksoftirqd/012:09:540
1219899185,8cyclictest14890-21apt-get10:04:541
1219899185,11cyclictest10887-21awk09:54:431
1219899184,7cyclictest16695-21apt-get08:44:551
1219899183,7cyclictest7177-21apt-get08:19:541
1219899183,11cyclictest3851-21apt-get12:24:541
1219899183,11cyclictest22505-21apt-get10:24:541
1219899183,10cyclictest28665-21apt-get12:04:541
1219899182,13cyclictest3410-21apt-get10:59:551
1219899182,12cyclictest24838-21apt-get11:54:541
12198991811,5cyclictest25610-21snmpd10:40:111
12198991811,5cyclictest25610-21snmpd08:53:551
12198991810,6cyclictest28818-21cat09:15:011
12198991810,6cyclictest25610-21snmpd08:18:181
12198991810,6cyclictest25610-21snmpd07:37:261
12198991810,6cyclictest22409-21apt-get08:59:551
12198991810,5cyclictest14719-21basename07:15:041
1219899179,6cyclictest27535-21sed07:45:091
1219899179,6cyclictest21269-21cat07:30:031
1219899178,7cyclictest25610-21snmpd12:30:561
1219899178,6cyclictest25610-21snmpd11:43:491
1219899174,9cyclictest26213-21apt-get09:09:551
1219899174,7cyclictest26026-21diskmemload10:49:541
1219899173,10cyclictest26308-21apt-get10:34:551
1219899173,10cyclictest17034-21apt-get11:34:551
1219899172,12cyclictest5312-21apt-get11:04:551
1219899172,12cyclictest14798-21apt-get08:39:541
1219899172,11cyclictest7212-21apt-get11:09:541
12198991711,4cyclictest22-21ksoftirqd/107:54:551
12198991710,5cyclictest25610-21snmpd07:52:051
12198991710,5cyclictest1417-21kworker/1:208:10:021
1219899170,8cyclictest10938-21sshd08:29:501
1219899165,8cyclictest25610-21snmpd07:09:551
1219899165,7cyclictest0-21swapper/108:04:541
1219899164,4cyclictest0-21swapper/111:14:531
12198991610,3cyclictest22-21ksoftirqd/111:19:441
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional