You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-20 - 02:21

Intel(R) Atom(TM) Processor E3940 @ 1.60GHz, Linux 5.2.21-rt13 (Profile)

Latency plot of system in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot3 (updated Wed Oct 02, 2019 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35452246171,19sleep20-21swapper/219:07:562
36162244170,45sleep10-21swapper/119:08:501
36182233169,54sleep30-21swapper/319:08:523
35132223193,19sleep00-21swapper/019:07:300
69442510,8sleep2321ktimersoftd/223:10:192
3912994919,6cyclictest33-21ksoftirqd/221:35:042
3912994844,2cyclictest33-21ksoftirqd/221:20:142
3912994742,3cyclictest33-21ksoftirqd/221:10:172
391299472,3cyclictest121rcu_preempt21:18:232
3912994621,3cyclictest33-21ksoftirqd/222:55:012
391299460,7cyclictest33-21ksoftirqd/222:38:372
3912994541,3cyclictest33-21ksoftirqd/200:10:012
3912994540,3cyclictest33-21ksoftirqd/219:45:132
3912994540,2cyclictest33-21ksoftirqd/220:20:172
3912994523,8cyclictest33-21ksoftirqd/222:15:092
3912994440,2cyclictest33-21ksoftirqd/223:39:592
3912994439,3cyclictest33-21ksoftirqd/220:50:062
3912994420,3cyclictest33-21ksoftirqd/221:40:162
3912994414,6cyclictest33-21ksoftirqd/221:10:002
391299440,5cyclictest121rcu_preempt22:05:172
3911994439,3cyclictest25-21ksoftirqd/122:10:061
3912994339,2cyclictest33-21ksoftirqd/220:35:092
3912994338,3cyclictest33-21ksoftirqd/222:20:182
3912994338,3cyclictest33-21ksoftirqd/220:00:122
3912994320,4cyclictest33-21ksoftirqd/221:33:352
3912994320,3cyclictest33-21ksoftirqd/221:50:082
3912994318,3cyclictest33-21ksoftirqd/223:46:382
3912994317,5cyclictest33-21ksoftirqd/200:03:402
3912994314,3cyclictest33-21ksoftirqd/222:30:102
3912994314,3cyclictest33-21ksoftirqd/222:30:092
3912994238,3cyclictest33-21ksoftirqd/200:32:042
3912994221,9cyclictest33-21ksoftirqd/220:55:192
3912994218,4cyclictest33-21ksoftirqd/222:56:002
3912994216,4cyclictest33-21ksoftirqd/219:15:132
256792420,1sleep10-21swapper/123:55:171
3912994137,2cyclictest33-21ksoftirqd/223:05:162
3912994136,3cyclictest33-21ksoftirqd/220:41:092
3912994117,3cyclictest33-21ksoftirqd/223:35:002
3912994117,3cyclictest33-21ksoftirqd/222:28:142
3912994117,3cyclictest33-21ksoftirqd/222:28:132
3912994116,3cyclictest33-21ksoftirqd/223:50:072
3912994115,7cyclictest33-21ksoftirqd/223:55:182
391399401,2cyclictest0-21swapper/322:05:063
3912994036,3cyclictest33-21ksoftirqd/223:25:072
3912994015,5cyclictest33-21ksoftirqd/219:27:502
3912994014,4cyclictest33-21ksoftirqd/219:55:152
3912994014,4cyclictest33-21ksoftirqd/219:55:152
3912994013,6cyclictest33-21ksoftirqd/200:20:002
391299396,3cyclictest33-21ksoftirqd/220:30:102
391299395,7cyclictest33-21ksoftirqd/200:05:152
3912993917,7cyclictest33-21ksoftirqd/220:05:082
3912993917,3cyclictest33-21ksoftirqd/219:35:362
3912993914,3cyclictest33-21ksoftirqd/219:30:152
3912993913,3cyclictest33-21ksoftirqd/220:10:072
3910993933,3cyclictest9-21ksoftirqd/021:55:060
3910993931,5cyclictest9-21ksoftirqd/019:40:080
391299389,5cyclictest33-21ksoftirqd/222:40:202
3912993829,2cyclictest33-21ksoftirqd/223:40:142
3912993829,2cyclictest33-21ksoftirqd/221:45:052
3912993819,7cyclictest33-21ksoftirqd/220:47:032
3912993817,3cyclictest33-21ksoftirqd/200:27:042
3912993814,3cyclictest33-21ksoftirqd/223:17:092
391399371,5cyclictest23841-21chrt22:35:073
391399370,3cyclictest16475-21grep22:15:153
391299371,5cyclictest33-21ksoftirqd/219:40:092
3912993715,3cyclictest33-21ksoftirqd/219:50:182
3912993715,3cyclictest33-21ksoftirqd/219:12:382
3912993712,5cyclictest33-21ksoftirqd/223:25:002
391299371,1cyclictest0-21swapper/223:00:102
3912993710,4cyclictest33-21ksoftirqd/222:10:032
3910993731,3cyclictest9-21ksoftirqd/023:24:590
3913993614,19cyclictest4221-21sed23:05:093
3913993612,21cyclictest20891-21cat19:50:113
3913993611,21cyclictest8993-21grep19:20:133
391299366,10cyclictest33-21ksoftirqd/222:00:072
3912993633,2cyclictest33-21ksoftirqd/222:45:082
3912993631,3cyclictest33-21ksoftirqd/220:15:112
3911993614,18cyclictest1370-21snmpd19:57:011
3911993614,18cyclictest1370-21snmpd19:57:001
3913993512,20cyclictest17207-21sed23:35:173
391399350,3cyclictest22816-21sendmail_mailqu22:30:173
391399350,3cyclictest22816-21sendmail_mailqu22:30:163
3913993417,13cyclictest10119-21apt-get19:25:043
3913993416,15cyclictest1370-21snmpd19:13:373
391299344,2cyclictest33-21ksoftirqd/200:37:372
3912993423,2cyclictest33-21ksoftirqd/221:25:122
3912993417,9cyclictest33-21ksoftirqd/200:21:322
391099346,3cyclictest121rcu_preempt22:15:180
3910993428,4cyclictest20610-21fschecks_count23:45:100
391399339,21cyclictest23519-21fschecks_count21:15:103
3913993327,4cyclictest41-21ksoftirqd/323:10:273
3913993314,16cyclictest1141-21/usr/sbin/munin00:15:113
3912993330,2cyclictest33-21ksoftirqd/221:00:162
391299330,5cyclictest33-21ksoftirqd/221:57:082
3911993328,3cyclictest241ktimersoftd/120:40:011
391099333,4cyclictest9-21ksoftirqd/021:15:180
391099332,7cyclictest9-21ksoftirqd/022:55:100
391099332,7cyclictest121rcu_preempt23:40:090
391399324,7cyclictest7884-21gltestperf21:55:113
3913993226,4cyclictest27990-21cat21:25:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional