You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-20 - 03:29

Intel(R) Celeron(R) CPU N3350 @ 1.10GHz, Linux 5.9.1-rt18 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot4.osadl.org (updated Sun Jun 20, 2021 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275499302,22cyclictest14432-21apt-get23:30:181
2754992917,7cyclictest23541-21apt-get22:10:161
275499262,5cyclictest6164-21apt-get19:20:141
275499262,20cyclictest20161-21apt-get23:50:131
275499261,23cyclictest13690-21apt-esm-hook19:45:211
275399262,16cyclictest7278-21apt-get23:05:150
275499243,15cyclictest29270-21apt-get22:30:121
2754992416,4cyclictest27651-40apt-check00:15:091
2754992412,7cyclictest22262-21apt-get20:15:131
275399243,14cyclictest14611-21apt-esm-hook21:40:130
275399242,15cyclictest23722-21apt-esm-hook20:20:140
275399242,15cyclictest22102-40apt-check22:05:120
275499239,10cyclictest13007-21apt-get23:25:131
275499232,15cyclictest5999-21apt-get21:10:221
275499232,15cyclictest25884-21apt-get00:10:121
275499232,14cyclictest31971-21apt-get00:30:131
2754992317,3cyclictest22102-40apt-check22:05:091
275499231,4cyclictest26418-21apt-get22:20:141
2754992314,7cyclictest20790-21cat22:00:201
275499231,19cyclictest1183-21lsb_release20:54:591
275399232,15cyclictest30709-21apt-esm-hook22:35:130
275399232,15cyclictest26567-21apt-get20:30:150
275399232,15cyclictest13664-40apt-check19:45:140
275399232,15cyclictest11591-21apt-esm-hook23:20:140
275399232,14cyclictest5985-40apt-check21:10:110
275399232,14cyclictest2987-21apt-esm-hook22:50:140
275399232,14cyclictest29440-21apt-get20:40:110
275399232,14cyclictest20171-21apt-esm-hook23:50:130
275399232,14cyclictest17997-21apt-esm-hook20:00:150
275499224,11cyclictest30867-21apt-get20:45:121
275499222,14cyclictest9017-21apt-get19:30:161
275499222,14cyclictest7425-21apt-get21:15:121
275499222,14cyclictest7289-21apt-esm-hook23:05:161
275499222,14cyclictest27844-21apt-get22:25:151
275499222,14cyclictest2784-21apt-get21:00:151
275499222,14cyclictest19413-21apt-get20:05:141
275499222,14cyclictest17311-21apt-get23:40:141
275499222,14cyclictest16027-21apt-get21:45:141
275499222,14cyclictest13155-21apt-get21:35:141
275499222,13cyclictest11728-21apt-get21:30:141
275499222,13cyclictest10302-21apt-get21:25:161
2754992214,6cyclictest10793-21gltestperf19:35:171
2754992214,5cyclictest17458-21apt-get21:50:131
275499220,3cyclictest1519-40apt-check22:45:081
275399227,9cyclictest27993-21apt-get20:35:160
275399222,14cyclictest30877-21apt-esm-hook20:45:130
275399222,14cyclictest29120-21apt-get00:20:130
275399222,14cyclictest27666-21apt-get00:15:200
275399222,14cyclictest23551-21apt-esm-hook22:10:170
275399222,14cyclictest17321-21apt-esm-hook23:40:140
275399222,14cyclictest10452-21apt-esm-hook19:35:150
275399222,13cyclictest4725-21apt-esm-hook19:15:140
275399222,13cyclictest29280-21apt-esm-hook22:30:130
275399222,13cyclictest22272-21apt-esm-hook20:15:120
275399222,13cyclictest18747-21apt-esm-hook23:45:140
275399221,15cyclictest16024-21/usr/sbin/munin21:45:320
275499218,8cyclictest71050irq/130-enp2s023:45:131
275499217,9cyclictest4715-21apt-get19:15:141
275499217,10cyclictest26567-21apt-get20:30:151
275499212,14cyclictest23042-21apt-esm-hook00:00:141
275499212,14cyclictest1321-21apt-get20:55:161
275499212,13cyclictest999-21apt-get00:35:131
275499212,13cyclictest8877-21apt-get21:20:121
275499212,13cyclictest32145-21apt-get22:40:141
275499212,13cyclictest30544-21apt-get00:25:141
275499212,13cyclictest29450-21apt-esm-hook20:40:111
275499212,13cyclictest20836-21apt-get20:10:151
275499212,13cyclictest11581-21apt-get23:20:141
275499212,13cyclictest10140-21apt-esm-hook23:15:151
275499211,3cyclictest8500-1kworker/1:1H23:15:011
275499211,17cyclictest18883-21apt-get21:55:121
275499211,13cyclictest24968-21apt-get22:15:151
275399215,11cyclictest4215-21apt-get21:05:210
275399212,14cyclictest17458-21apt-get21:50:130
275399212,13cyclictest8887-21apt-esm-hook21:20:120
275399212,13cyclictest6780-21snmp_o5powerctl23:00:230
275399212,13cyclictest3296-21apt-esm-hook19:10:130
275399212,13cyclictest32155-21apt-esm-hook22:40:120
275399212,13cyclictest31981-21apt-esm-hook00:30:120
275399212,13cyclictest30554-21apt-esm-hook00:25:140
275399212,13cyclictest25894-21apt-esm-hook00:10:120
275399212,13cyclictest20341-21apt-esm-hook22:00:160
275399212,13cyclictest18894-21apt-esm-hook21:55:130
275399212,13cyclictest16542-21apt-esm-hook19:55:140
275399212,13cyclictest13017-21apt-esm-hook23:25:140
275399212,13cyclictest1009-21apt-esm-hook00:35:130
275399212,12cyclictest32302-21apt-esm-hook20:50:170
275399212,12cyclictest13165-21apt-esm-hook21:35:150
275499202,13cyclictest7590-21apt-get19:25:141
275499202,13cyclictest3286-21apt-get19:10:131
275499202,13cyclictest2977-21apt-get22:50:141
275499202,13cyclictest23712-21apt-get20:20:151
275499202,13cyclictest11890-21apt-get19:40:141
275499202,12cyclictest17987-21apt-get20:00:141
275499202,12cyclictest15107-21apt-get19:50:161
2754992015,3cyclictest5678-21apt23:00:001
275499201,13cyclictest15859-21apt-get23:35:121
275499200,3cyclictest30398-21munin-run00:25:001
275399202,13cyclictest15117-21apt-esm-hook19:50:150
275399202,13cyclictest11900-21apt-esm-hook19:40:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional