You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 20:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3825 @1333 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rack9slot4s.osadl.org (updated Sun Jul 03, 2022 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142439912401199,36cyclictest18793-21date07:35:010
142449911201109,7cyclictest16136-21munin-run07:30:001
141412695648,31sleep00-21swapper/007:24:300
140572461353,48sleep10-21swapper/107:23:381
14244992361,231cyclictest18696-21apt-get07:35:011
142439911676,19cyclictest16204-21munin-node07:30:000
98032420,8sleep01424399cyclictest12:50:270
1424399411,13cyclictest11729-21grep08:40:170
1424399377,12cyclictest31539-21ls12:25:010
14243993610,13cyclictest13757-21needreboot10:10:260
1424399351,23cyclictest7374-21basename09:55:130
1424399349,13cyclictest5208-21taskset08:22:010
1424399349,13cyclictest5208-21taskset08:22:000
20442331,28sleep12057-21df08:15:131
1424499332,18cyclictest31713-21users08:05:321
327482320,8sleep11424499cyclictest09:35:251
1424399328,12cyclictest4306-21mailstats11:10:280
1424399322,26cyclictest26658-21apt-get07:55:180
1424399322,11cyclictest26280-21cron09:20:000
14243993217,5cyclictest3-21ksoftirqd/010:37:350
14243993216,5cyclictest3-21ksoftirqd/008:52:250
14243993212,7cyclictest6461-21/usr/sbin/munin08:25:260
239412311,5sleep10-21swapper/112:04:571
187902311,5sleep00-21swapper/011:50:190
1424499315,4cyclictest81rcu_preempt10:56:121
1424499314,4cyclictest81rcu_preempt09:46:251
14244993110,17cyclictest0-21swapper/111:00:211
1424399312,16cyclictest0-21swapper/007:40:160
14243993114,5cyclictest3-21ksoftirqd/008:32:400
1424399311,18cyclictest28960-21switchtime12:15:310
65692301,5sleep10-21swapper/112:43:131
46822301,5sleep10-21swapper/111:11:061
312402301,5sleep10-21swapper/112:22:041
257632301,5sleep10-21swapper/110:42:011
198382301,3sleep019910-21python09:00:290
145132301,5sleep10-21swapper/108:45:381
1424499305,12cyclictest40750irq/92-i91509:19:431
1424499304,4cyclictest81rcu_preempt08:41:341
1424499301,8cyclictest24162-21sendmail10:39:591
1424499301,5cyclictest81rcu_preempt11:42:421
1424499301,5cyclictest0-21swapper/111:22:101
1424499301,4cyclictest81rcu_preempt10:32:581
1424499301,25cyclictest16807-21cat08:54:551
1424399308,11cyclictest3-21ksoftirqd/007:51:320
1424399306,12cyclictest0-21swapper/012:42:560
1424399303,4cyclictest81rcu_preempt11:29:300
1424399302,15cyclictest484-21/usr/sbin/munin08:10:210
1424399302,15cyclictest0-21swapper/007:37:560
14243993015,5cyclictest3-21ksoftirqd/010:17:050
1424399301,4cyclictest81rcu_preempt10:51:190
14243993014,6cyclictest3-21ksoftirqd/008:45:020
14243993014,5cyclictest3-21ksoftirqd/010:01:480
14243993014,5cyclictest3-21ksoftirqd/009:48:450
14243993012,14cyclictest5715-21grep11:15:180
1424399301,18cyclictest1923-21grep08:15:130
14243993011,7cyclictest31914-21seq08:07:300
12912301,5sleep00-21swapper/009:39:080
86632291,5sleep00-21swapper/011:23:080
313212291,5sleep00-21swapper/010:55:490
300542291,5sleep00-21swapper/008:02:450
297122291,5sleep00-21swapper/009:26:330
275672291,5sleep00-21swapper/012:13:290
266932291,5sleep10-21swapper/109:20:151
244892291,5sleep10-21swapper/107:49:041
239792291,5sleep00-21swapper/009:10:570
221042291,5sleep00-21swapper/009:06:020
203172291,5sleep00-21swapper/010:29:150
160962291,5sleep00-21swapper/011:41:510
1424499294,4cyclictest81rcu_preempt10:19:041
1424499294,4cyclictest81rcu_preempt08:35:031
1424499294,4cyclictest81rcu_preempt08:34:441
1424499294,19cyclictest23265-21iostat_ios09:10:231
1424499294,15cyclictest0-21swapper/111:26:571
1424499292,23cyclictest10567-21apt12:55:001
14244992913,6cyclictest22-21ksoftirqd/107:35:121
1424499291,16cyclictest9064-21munin-plugin-st10:00:001
1424399292,6cyclictest12674-21latency_hist11:35:000
1424399291,24cyclictest6839-21copy12:45:050
1424399291,15cyclictest25611-21users10:40:330
1424399291,15cyclictest24452-21runrttasks07:48:410
14243992910,7cyclictest17103-21/usr/sbin/munin10:20:160
14243992910,6cyclictest26070-21apt-get10:45:110
117242291,4sleep111802-21load10:05:231
83952281,5sleep10-21swapper/112:47:061
46302281,5sleep00-21swapper/012:37:520
318662281,5sleep10-21swapper/109:34:081
31012281,5sleep00-21swapper/009:42:030
30392281,5sleep00-21swapper/011:08:480
298862281,4sleep10-21swapper/108:01:011
292002281,5sleep10-21swapper/112:15:561
28042281,4sleep10-21swapper/112:33:391
278192281,5sleep10-21swapper/110:48:331
255852281,5sleep00-21swapper/012:07:270
255682281,5sleep10-21swapper/112:07:161
181272281,5sleep00-21swapper/011:48:240
143242281,5sleep00-21swapper/011:38:120
14252281,4sleep10-21swapper/108:13:231
1424499285,4cyclictest81rcu_preempt10:02:381
1424499284,17cyclictest6061-21ntp_states11:15:271
1424499284,15cyclictest0-21swapper/111:06:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional