You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-02 - 01:09

x86 Intel Atom E3845 @1910 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackdslot3.osadl.org (updated Thu Jun 01, 2023 12:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255911780,6ptp4l401ktimersoftd/307:09:163
217562980,4sleep1384599cyclictest10:05:371
825591930,2ptp4l27711-21df_abs08:00:293
825591930,2ptp4l18838-21irqstats07:40:373
825591930,2ptp4l18838-21irqstats07:40:363
825591870,2ptp4l31046-21taskset08:05:443
3846998772,7cyclictest33-21ksoftirqd/211:25:202
3847998217,13cyclictest13326-21apt-get07:30:203
3845998175,3cyclictest25-21ksoftirqd/110:35:191
3847998017,12cyclictest17333-21if_err_enp1s011:05:213
3847998017,12cyclictest14078-21runrttasks12:05:413
3847997917,13cyclictest18951-21seq11:10:133
3847997917,13cyclictest18951-21seq11:10:123
3847997914,20cyclictest5663-21ls09:30:393
3847997914,14cyclictest1920-21mailstats11:40:373
3846997966,7cyclictest33-21ksoftirqd/209:05:212
3847997717,13cyclictest11751-21runrttasks12:00:563
3847997716,15cyclictest24658-21if_enp4s012:30:283
3847997715,13cyclictest21871-21grep11:15:243
3847997714,14cyclictest16159-21grep08:45:183
3847997711,25cyclictest0-21swapper/311:25:003
3847997617,13cyclictest7037-21cpu09:35:213
3847997616,13cyclictest206-21systemd-journal11:34:563
3847997615,12cyclictest15034-21cat09:50:393
3847997614,14cyclictest5245-21cat08:20:393
3847997613,15cyclictest32370-21/usr/sbin/munin08:10:293
3847997613,14cyclictest12977-21meminfo10:55:343
3845997668,4cyclictest25-21ksoftirqd/109:30:211
3845997667,5cyclictest25-21ksoftirqd/108:55:211
3847997514,15cyclictest22479-21latency_hist07:50:003
3847997514,11cyclictest5395-21diskstats10:40:243
3847997513,15cyclictest206-21systemd-journal12:16:343
3847997511,15cyclictest569-21in:imuxsock07:50:333
3847997417,12cyclictest206-21systemd-journal07:15:503
3847997417,11cyclictest16354-21sshd11:04:303
3847997415,14cyclictest13426-21sed08:40:003
3847997413,14cyclictest21950-21expr12:25:233
3847997413,14cyclictest18612-21latency_hist10:00:003
3847997412,14cyclictest12869-21phc2sys-jitter09:45:543
3847997411,19cyclictest0-21swapper/310:15:343
3845997466,4cyclictest25-21ksoftirqd/112:05:171
3847997317,11cyclictest22603-21ls10:05:573
3847997313,14cyclictest6561-21/usr/sbin/munin08:25:173
3847997313,14cyclictest3578-21meminfo10:35:323
3847997313,13cyclictest1123-21snmpd08:50:233
3847997313,13cyclictest1123-21snmpd08:50:233
3847997312,14cyclictest25036-21taskset10:10:533
3847997217,9cyclictest2861-21hddtemp_smartct09:25:323
3847997216,12cyclictest206-21systemd-journal09:24:013
3847997214,18cyclictest32188-21taskset10:27:493
3847997213,14cyclictest9127-21sshd10:46:303
3847997212,19cyclictest1123-21snmpd10:51:473
3847997212,18cyclictest569-21in:imuxsock08:15:243
3847997212,13cyclictest22599-21seq08:59:063
3847997115,17cyclictest2988-21apt-get11:45:183
3847997115,15cyclictest9392-21df_inode08:30:263
3847997115,13cyclictest26561-21ptp4l-jitter09:05:403
3847997112,14cyclictest4481-21hwlatdetect07:10:193
3847997014,12cyclictest26258-21cat11:25:223
3847997013,14cyclictest9969-21mailstats07:20:333
3847997013,14cyclictest27304-21grep12:35:273
3847997012,14cyclictest206-21systemd-journal10:33:393
3845997062,4cyclictest25-21ksoftirqd/109:15:161
3847996917,12cyclictest1123-21snmpd09:17:043
3847996914,13cyclictest29711-21seq10:20:583
3847996914,11cyclictest12141-21/usr/sbin/munin07:25:363
3847996913,19cyclictest10347-21/usr/sbin/munin09:40:423
3847996912,13cyclictest1123-21snmpd12:20:183
3847996911,13cyclictest569-21in:imuxsock10:00:343
3847996814,11cyclictest28618-21ls09:10:463
3847996812,16cyclictest1123-21snmpd07:37:153
3847996812,14cyclictest1123-21snmpd07:58:523
3847996812,13cyclictest1123-21snmpd11:56:373
351826838,13sleep233-21ksoftirqd/207:09:312
3847996713,13cyclictest1123-21snmpd09:04:233
3846996754,6cyclictest33-21ksoftirqd/210:10:152
88022660,5sleep11131-21lldpd08:30:001
3847996616,12cyclictest1123-21snmpd12:12:273
3846996655,5cyclictest33-21ksoftirqd/209:50:192
3845996657,5cyclictest25-21ksoftirqd/107:20:171
3845996555,5cyclictest25-21ksoftirqd/109:10:231
3847996413,13cyclictest30589-21/usr/sbin/munin11:35:233
3847996311,12cyclictest1123-21snmpd11:52:553
3845996356,4cyclictest25-21ksoftirqd/112:30:171
384799629,11cyclictest0-21swapper/308:41:293
327062620,4sleep01131-21lldpd10:30:220
57698610,23rtkit-daemon12827-21taskset07:27:470
57698590,19rtkit-daemon1131-21lldpd11:27:411
3846995953,3cyclictest33-21ksoftirqd/210:30:212
3845995947,7cyclictest25-21ksoftirqd/108:00:231
3845995945,9cyclictest25-21ksoftirqd/107:25:211
57698570,2rtkit-daemon0-21swapper/012:29:390
57698570,17rtkit-daemon1131-21lldpd09:06:110
3846995744,7cyclictest33-21ksoftirqd/207:30:222
3846995546,4cyclictest33-21ksoftirqd/208:05:162
3845995544,5cyclictest25-21ksoftirqd/111:30:191
3845995524,22cyclictest25-21ksoftirqd/109:47:121
3846995347,3cyclictest33-21ksoftirqd/209:39:592
3846995314,5cyclictest33-21ksoftirqd/212:15:262
3845995341,6cyclictest25-21ksoftirqd/111:05:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional