You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 21:59

Intel(R) Celeron(R) CPU N3350 @ 1.10GHz, Linux 5.9.1-rt18 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Fri Oct 15, 2021 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
414399293,18cyclictest13656-21mandb07:40:001
414399291,22cyclictest28023-21apt-get12:10:161
414399282,21cyclictest29572-21apt-get08:35:151
4142992812,9cyclictest2932-21apt-get08:55:150
414399272,17cyclictest19-21ksoftirqd/107:40:021
4143992716,7cyclictest11931-21apt-get09:25:131
4143992716,6cyclictest1814-21apt-get10:40:191
414399271,21cyclictest17967-21apt-get11:35:171
414399262,5cyclictest19421-21apt-get11:40:171
414399262,19cyclictest9003-21apt-get11:05:121
4143992616,6cyclictest17679-21apt-get09:45:181
4143992614,7cyclictest16536-21apt-get11:30:201
4143992614,6cyclictest9042-21apt-get09:15:211
414399255,9cyclictest19541-21apt-get08:00:161
414399252,7cyclictest11863-21apt-get11:15:161
414399252,5cyclictest25161-21apt-get12:00:141
414399250,21cyclictest29823-21apt-esm-hook12:15:191
414299259,9cyclictest18090-21apt-get07:55:140
4142992510,10cyclictest23829-21apt-get08:15:140
414399242,4cyclictest26593-21apt-get12:05:151
414399241,3cyclictest18999-1kworker/1:0H10:25:001
414399241,19cyclictest29529-21apt-get10:25:151
414399241,14cyclictest10450-21apt-esm-json-ho11:10:151
414399240,1cyclictest10802-21apt-get07:30:211
414399240,17cyclictest7478-21sort11:00:001
414399240,16cyclictest16148-21grep09:40:001
414299242,14cyclictest1492-21apt-get08:50:170
414399239,10cyclictest3178-21apt-get12:35:151
414399232,15cyclictest20849-21apt-get11:45:141
414399232,14cyclictest4687-21apt-get10:50:151
414399232,14cyclictest2932-21apt-get08:55:151
414399232,13cyclictest16659-21apt-get07:50:191
414399231,3cyclictest7572-21apt-get11:00:151
414399231,19cyclictest25197-40apt-check10:10:081
4143992310,9cyclictest1745-21apt-get12:30:131
414299233,13cyclictest10445-21apt-esm-hook11:10:150
414299232,14cyclictest9014-21apt-esm-hook11:05:130
414299232,14cyclictest31269-21apt-get12:20:130
414299232,14cyclictest22400-21apt-get08:10:180
414299232,14cyclictest13798-21apt-get07:40:200
414299232,14cyclictest11942-21apt-esm-hook09:25:150
414399228,10cyclictest26639-21apt-get10:15:111
414399227,8cyclictest6012-21latency_hist07:15:001
414399222,3cyclictest0-21swapper/110:30:141
414399222,14cyclictest25296-21apt-esm-hook08:20:151
414399222,14cyclictest19119-21apt-esm-hook09:50:131
414399222,14cyclictest15238-21apt-esm-hook07:45:131
414399222,12cyclictest22002-21apt-esm-hook10:00:151
414399220,9cyclictest6024-1kworker/1:3H11:30:011
414399220,4cyclictest2786-21munin-run08:55:001
414299228,10cyclictest6105-21apt-get07:15:170
414299222,14cyclictest17967-21apt-get11:35:160
414299222,14cyclictest11863-21apt-get11:15:170
414299222,13cyclictest29540-21apt-esm-hook10:25:150
414299222,13cyclictest25224-21apt-esm-hook10:10:200
414299222,13cyclictest21991-21apt-get10:00:140
414299222,13cyclictest20860-21apt-esm-hook11:45:150
414299222,13cyclictest20538-21apt-get09:55:210
414299222,13cyclictest13328-21apt-esm-hook11:20:130
414299222,13cyclictest12324-21apt-get07:35:160
414299221,16cyclictest32388-21apt-get10:35:140
414399215,10cyclictest4391-21apt-get09:00:141
414399212,14cyclictest13317-21apt-get11:20:111
414399212,13cyclictest9003-21apt-esm-hook07:25:221
414399212,13cyclictest7562-21apt-get07:20:171
414399212,13cyclictest32466-21apt-esm-hook08:45:141
414399212,13cyclictest18090-21apt-get07:55:141
414399212,13cyclictest16259-21apt-esm-hook09:40:181
414399212,13cyclictest10498-21apt-get09:20:141
4143992111,5cyclictest23421-21apt-get10:05:161
414399211,14cyclictest32710-21apt-esm-hook12:25:141
414399211,14cyclictest13362-21apt-get09:30:141
4143992110,4cyclictest19-21ksoftirqd/108:20:001
414299214,10cyclictest32454-21apt-get08:45:150
414299212,13cyclictest7573-21apt-esm-hook07:20:170
414299212,13cyclictest5821-21apt-get09:05:130
414299212,13cyclictest3260-21apt-esm-hook10:45:120
414299212,13cyclictest31025-21apt-get08:40:150
414299212,13cyclictest22281-21apt-get11:50:130
414299212,13cyclictest20970-21apt-get08:05:170
414299212,13cyclictest1801-40apt-check10:40:110
414299212,13cyclictest17690-21apt-esm-hook09:45:180
414299212,13cyclictest1756-21apt-esm-hook12:30:140
414299212,13cyclictest16522-40apt-check11:30:120
414299212,13cyclictest10509-21apt-esm-hook09:20:130
414299211,4cyclictest0-21swapper/008:00:160
414299211,14cyclictest26604-21apt-esm-hook12:05:150
414299211,14cyclictest19108-21apt-get09:50:140
414299211,14cyclictest15227-21apt-get07:45:140
414399202,13cyclictest23719-21apt-esm-hook11:55:131
414399202,12cyclictest6105-21apt-get07:15:171
414399202,12cyclictest5832-21apt-esm-hook09:05:131
414399202,12cyclictest20981-21apt-esm-hook08:05:171
414399201,8cyclictest3249-21apt-get10:45:121
4143992015,3cyclictest1599-21snmpd08:14:311
4143992013,5cyclictest32290-21cron08:45:011
414399200,5cyclictest22459-21df_inode11:50:141
414399200,4cyclictest32548-21munin-run12:25:011
414299202,13cyclictest4699-21apt-esm-hook10:50:140
414299202,13cyclictest29572-21apt-get08:35:150
414299202,12cyclictest8990-21apt-get07:25:210
414299202,12cyclictest7583-21apt-esm-hook11:00:150
414299202,12cyclictest28142-21apt-get08:30:160
414299202,12cyclictest28098-21apt-get10:20:160
414299202,12cyclictest26713-21apt-get08:25:140
414299202,12cyclictest26713-21apt-get08:25:140
414299202,12cyclictest25172-21apt-esm-hook12:00:140
414299201,14cyclictest29808-21apt-get12:15:190
414299201,13cyclictest32699-21apt-get12:25:140
414299200,4cyclictest30972-21apt-get10:30:140
414399192,12cyclictest32399-21apt-esm-hook10:35:141
414399192,12cyclictest26724-21apt-esm-hook08:25:151
414399192,12cyclictest26724-21apt-esm-hook08:25:141
414399191,14cyclictest8187-21snmp_o5powerctl09:10:331
414399190,6cyclictest29457-21cat08:35:001
414299193,9cyclictest23708-21apt-get11:55:130
414299192,12cyclictest9055-21apt-esm-hook09:15:210
414299192,11cyclictest7264-21apt-esm-hook09:10:190
414299191,14cyclictest14302-21snmp_o5powerctl09:30:260
414299191,13cyclictest25284-21apt-get08:20:150
414299191,13cyclictest19432-21apt-esm-hook11:40:170
414299191,12cyclictest3189-21apt-esm-hook12:35:160
414299191,12cyclictest26650-21apt-esm-hook10:15:130
414299191,12cyclictest16670-21apt-esm-hook07:50:180
414299191,12cyclictest14802-21apt-esm-hook09:35:150
414299191,12cyclictest14759-21apt-esm-hook11:25:140
414299191,12cyclictest10802-21apt-get07:30:150
414399181,13cyclictest20538-21apt-get09:55:201
414299182,11cyclictest28034-21apt-esm-hook12:10:170
414299181,13cyclictest5331-21snmp_o5powerctl09:00:360
414299181,12cyclictest4686-21apt-esm-hook07:10:190
414299181,12cyclictest23432-21apt-esm-hook10:05:180
414299173,8cyclictest16248-21apt-get09:40:170
414299172,11cyclictest6129-21apt-esm-hook10:55:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional