You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-28 - 10:14

Intel(R) Atom(TM) CPU E3845 @ 1.91GHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackdslot4.osadl.org (updated Tue Sep 28, 2021 00:46:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
914821800,8sleep33077199cyclictest23:20:113
1208911790,6ptp4l401ktimersoftd/319:06:413
565981280,43rtkit-daemon11374-21apache219:07:250
1210621030,24sleep341-21ksoftirqd/322:45:023
151942980,5sleep3401ktimersoftd/319:30:053
120891880,2ptp4l25584-21/usr/sbin/munin23:40:143
301812788,19sleep20-21swapper/219:08:122
3014327810,56sleep10-21swapper/119:07:431
252542710,2sleep00-21swapper/022:20:130
317732590,6sleep231777-21ptp4l-jitter00:25:262
271442570,4sleep00-21swapper/021:45:000
56598560,17rtkit-daemon547-21irqbalance22:37:172
3077199552,49cyclictest20333-21cut21:35:093
3077199546,13cyclictest4082-21timerandwakeup21:15:123
120891540,2ptp4l5244-21unixbench_singl23:15:123
3077199536,9cyclictest2081-21chrt21:50:303
3077199534,6cyclictest41-21ksoftirqd/320:15:033
3077199523,6cyclictest41-21ksoftirqd/321:30:253
3077199513,6cyclictest41-21ksoftirqd/321:55:143
3077199513,6cyclictest41-21ksoftirqd/320:10:263
3077199502,6cyclictest41-21ksoftirqd/319:20:023
56598490,10rtkit-daemon0-21swapper/222:56:222
3077199494,6cyclictest41-21ksoftirqd/319:15:063
3077199493,6cyclictest41-21ksoftirqd/322:00:103
3077199483,6cyclictest41-21ksoftirqd/300:25:123
3077199483,5cyclictest41-21ksoftirqd/323:02:083
3077199483,5cyclictest41-21ksoftirqd/319:50:193
3077199483,5cyclictest41-21ksoftirqd/319:50:193
3077199482,6cyclictest41-21ksoftirqd/321:45:283
56598470,10rtkit-daemon0-21swapper/220:09:262
3077199473,8cyclictest401ktimersoftd/300:22:333
3077199473,6cyclictest41-21ksoftirqd/300:00:103
120891470,1ptp4l401ktimersoftd/321:40:133
3077199464,8cyclictest30081-21chrt21:05:333
3077199464,8cyclictest30081-21chrt21:05:333
3077199463,6cyclictest41-21ksoftirqd/319:45:093
3077199454,6cyclictest41-21ksoftirqd/323:35:313
3077199453,6cyclictest41-21ksoftirqd/320:40:093
30769994539,4cyclictest25-21ksoftirqd/120:45:121
120891450,1ptp4l401ktimersoftd/322:36:483
30769994333,4cyclictest25-21ksoftirqd/122:25:021
30769994333,4cyclictest25-21ksoftirqd/122:25:021
120891430,1ptp4l401ktimersoftd/319:14:483
120891420,1ptp4l401ktimersoftd/320:05:293
3077199416,7cyclictest41-21ksoftirqd/322:25:253
3077199416,7cyclictest41-21ksoftirqd/322:25:253
3077199416,7cyclictest41-21ksoftirqd/320:30:183
30769994134,4cyclictest25-21ksoftirqd/119:45:011
120891410,1ptp4l401ktimersoftd/322:42:133
3077199406,7cyclictest41-21ksoftirqd/321:20:303
3077199404,4cyclictest41-21ksoftirqd/321:00:323
3077199403,6cyclictest41-21ksoftirqd/323:30:183
30770994035,3cyclictest0-21swapper/219:10:022
3077199396,7cyclictest41-21ksoftirqd/320:45:213
3077199394,7cyclictest41-21ksoftirqd/320:50:133
30769993933,4cyclictest25-21ksoftirqd/122:10:011
30769993933,4cyclictest25-21ksoftirqd/121:40:151
30769993932,4cyclictest25-21ksoftirqd/123:10:041
30769993932,4cyclictest25-21ksoftirqd/122:05:161
30769993932,4cyclictest25-21ksoftirqd/120:10:001
30769993932,4cyclictest25-21ksoftirqd/100:15:301
3077199385,8cyclictest41-21ksoftirqd/319:35:323
3077199385,7cyclictest41-21ksoftirqd/320:20:113
3077199385,4cyclictest41-21ksoftirqd/320:35:073
3077199383,5cyclictest41-21ksoftirqd/320:00:163
3077199383,3cyclictest41-21ksoftirqd/320:25:213
30769993833,3cyclictest25-21ksoftirqd/100:30:101
30769993831,4cyclictest25-21ksoftirqd/121:30:051
30768993832,3cyclictest9-21ksoftirqd/020:38:430
2775023829,3sleep09-21ksoftirqd/019:45:080
3077199375,7cyclictest41-21ksoftirqd/323:55:283
3077199375,7cyclictest41-21ksoftirqd/320:55:323
30770993732,3cyclictest33-21ksoftirqd/219:40:002
30770993731,4cyclictest33-21ksoftirqd/220:35:132
30770993729,5cyclictest33-21ksoftirqd/223:18:172
3077099371,8cyclictest121rcu_preempt22:25:192
3077099371,8cyclictest121rcu_preempt22:25:182
30769993731,4cyclictest25-21ksoftirqd/100:00:091
30768993730,4cyclictest9-21ksoftirqd/021:35:140
30771993629,4cyclictest41-21ksoftirqd/300:15:113
3077199361,5cyclictest0-21swapper/322:57:393
30770993631,3cyclictest33-21ksoftirqd/200:35:092
30770993630,4cyclictest33-21ksoftirqd/223:45:152
30770993630,4cyclictest33-21ksoftirqd/220:40:152
30770993628,5cyclictest1114-21sshd23:32:212
30769993630,4cyclictest25-21ksoftirqd/121:45:271
30769993630,4cyclictest25-21ksoftirqd/119:55:121
30769993629,4cyclictest25-21ksoftirqd/120:20:021
30769993629,4cyclictest25-21ksoftirqd/119:20:011
30768993630,4cyclictest9-21ksoftirqd/023:20:000
30768993630,4cyclictest9-21ksoftirqd/022:55:100
30768993630,4cyclictest9-21ksoftirqd/000:25:110
3077199355,6cyclictest41-21ksoftirqd/300:10:143
3077199353,7cyclictest41-21ksoftirqd/319:58:083
30771993528,4cyclictest41-21ksoftirqd/323:14:573
30771993528,4cyclictest41-21ksoftirqd/300:35:113
30770993530,3cyclictest33-21ksoftirqd/220:55:302
30770993529,3cyclictest33-21ksoftirqd/220:00:112
30770993528,4cyclictest33-21ksoftirqd/222:15:032
30770993528,4cyclictest33-21ksoftirqd/220:50:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional