You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-01-23 - 21:37

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.4.59-rt36 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot5.osadl.org (updated Sat Jan 23, 2021 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1062699230,1cyclictest10691-21/usr/sbin/munin08:35:180
1062799220,8cyclictest11849-21apt-get10:05:041
1062799220,8cyclictest0-21swapper/111:07:101
1062699221,11cyclictest9916-21apt-get10:00:060
1062799214,16cyclictest15740-21/usr/sbin/munin07:25:151
1062799211,10cyclictest24857-21apt-get09:15:031
1062799201,11cyclictest17110-21apt-get08:55:061
1062799200,9cyclictest22778-21diskmemload10:24:031
1062799200,19cyclictest29930-21meminfo10:50:091
10626992020,0cyclictest0-21swapper/010:17:050
1062699200,19cyclictest26126-21meminfo07:50:090
1062799194,14cyclictest22778-21diskmemload10:58:521
1062799190,18cyclictest26060-21meminfo10:40:081
1062799190,18cyclictest13647-21meminfo11:35:111
10626991917,1cyclictest0-21swapper/010:10:000
1062699190,18cyclictest5552-21meminfo08:20:080
1062699190,18cyclictest32126-21meminfo08:05:080
1062699190,18cyclictest18329-21meminfo07:30:080
1062699190,12cyclictest0-21swapper/009:35:040
1062799182,12cyclictest22778-21diskmemload12:06:121
1062799180,17cyclictest9410-21meminfo08:30:091
1062799180,17cyclictest4757-21meminfo09:45:091
1062799180,17cyclictest31335-21meminfo09:30:091
1062799180,17cyclictest23340-21meminfo12:00:101
10626991816,1cyclictest27304-21lxcfs07:55:200
10627991717,0cyclictest0-21swapper/108:02:571
1062799170,16cyclictest2573-21meminfo12:30:121
1062799170,16cyclictest22778-21diskmemload10:17:031
1062799170,16cyclictest22183-21meminfo10:30:141
1062799170,16cyclictest11708-21meminfo11:30:071
1062799170,16cyclictest10575-21meminfo10:00:141
1062699174,6cyclictest20736-21kworker/u4:109:12:120
1062699171,6cyclictest0-21swapper/012:10:040
10626991712,4cyclictest22778-21diskmemload09:40:100
1062699170,9cyclictest5991-21kworker/u4:511:24:380
1062699170,9cyclictest22680-21apt-get12:00:030
1062699170,9cyclictest0-21swapper/007:45:040
1062699170,7cyclictest17473-21kworker/u4:211:07:510
1062699170,16cyclictest14465-21meminfo07:20:080
1062799168,2cyclictest22778-21diskmemload11:56:321
1062799165,7cyclictest29585-21ls12:15:191
1062799161,8cyclictest23460-21apt-get10:35:031
1062799160,15cyclictest6689-21meminfo09:50:101
1062799160,15cyclictest3599-21meminfo08:15:091
1062799160,15cyclictest27199-21meminfo12:10:091
1062799160,15cyclictest13297-21meminfo08:40:111
1062699167,7cyclictest10610-21kworker/u4:211:30:580
1062699165,6cyclictest30437-21apt-get12:20:040
1062699165,6cyclictest18650-21kworker/u4:412:27:350
1062699164,10cyclictest22916-21kworker/u4:009:56:290
1062699164,10cyclictest21118-21kworker/u4:010:29:190
1062699163,12cyclictest21118-21kworker/u4:011:16:400
1062699161,6cyclictest30838-21kworker/u4:312:33:270
1062699160,9cyclictest0-21swapper/008:25:040
1062699160,7cyclictest26245-21kworker/u4:410:10:300
1062699160,7cyclictest0-21swapper/009:05:040
1062699160,5cyclictest0-21swapper/011:40:030
1062799155,6cyclictest20988-21apt-get09:05:041
1062799153,7cyclictest25476-21apt-get07:50:041
1062799152,9cyclictest22778-21diskmemload09:26:181
1062799152,9cyclictest17752-21/usr/sbin/munin11:45:111
1062799151,9cyclictest0-21swapper/112:37:021
1062799151,6cyclictest22778-21diskmemload10:10:031
10627991515,0cyclictest0-21swapper/109:10:401
1062799150,7cyclictest32378-21apt-get12:25:091
1062699158,5cyclictest21610-21apt-get07:40:070
1062699153,8cyclictest22916-21kworker/u4:009:16:560
1062699153,8cyclictest17473-21kworker/u4:211:00:270
1062699153,7cyclictest16870-21apt-get11:45:040
10626991514,1cyclictest0-21swapper/010:45:100
10626991513,1cyclictest24612-21/usr/sbin/munin12:05:070
1062799148,5cyclictest27739-21idleruntime10:45:061
1062799145,6cyclictest8306-21chrt11:19:341
1062799145,6cyclictest21610-21apt-get07:40:071
1062799145,3cyclictest0-21swapper/110:26:091
1062799144,6cyclictest14571-21apt-get08:45:031
1062799142,6cyclictest8516-21apt-get11:20:041
1062799142,6cyclictest0-21swapper/109:20:031
1062799142,5cyclictest30437-21apt-get12:20:041
1062799142,4cyclictest0-21swapper/109:36:111
1062799140,9cyclictest22778-21diskmemload09:59:311
1062799140,5cyclictest6830-21apt-get08:25:041
1062799140,0cyclictest22778-21diskmemload11:54:321
1062699145,6cyclictest22172-21ls10:30:130
1062699144,8cyclictest20736-21kworker/u4:110:50:160
1062699144,8cyclictest0-21swapper/008:10:040
1062699144,7cyclictest287452sleep009:25:030
1062699143,5cyclictest16358-21cron08:50:000
1062699142,7cyclictest20736-21kworker/u4:109:45:240
1062699142,5cyclictest0-21swapper/009:00:030
1062699141,6cyclictest0-21swapper/008:15:030
1062699141,1cyclictest0-21swapper/009:33:270
1062699140,7cyclictest0-21swapper/007:25:050
1062699140,12cyclictest0-21swapper/012:16:030
1062799137,4cyclictest65-21kswapd007:55:001
1062799134,8cyclictest722-21apt-get11:00:041
1062799133,7cyclictest978-21apt-get08:10:041
1062799133,7cyclictest5031-21/usr/sbin/munin11:10:111
1062799133,5cyclictest19648-21apt-get07:35:041
1062799132,3cyclictest19055-21apt-get09:00:031
1062799132,10cyclictest0-21swapper/107:30:031
1062799131,7cyclictest12366-21runrttasks08:38:521
1062799131,6cyclictest836-21munin-run08:10:001
1062799131,6cyclictest15227-21seq07:21:041
1062799131,3cyclictest0-21swapper/109:40:061
10627991311,1cyclictest23542-21apt-get07:45:041
1062699133,6cyclictest12643-21apt-get08:40:040
1062699133,5cyclictest24607-21ls10:35:150
1062699131,6cyclictest5991-21kworker/u4:511:25:010
1062699131,5cyclictest0-21swapper/009:20:150
1062699131,3cyclictest22916-21kworker/u4:009:53:060
1062699130,8cyclictest20731-21apt-get11:55:030
1062699130,6cyclictest12992-21apt-get11:35:050
1062699130,12cyclictest18314-21meminfo10:20:080
1062699130,11cyclictest31208-21apt-get10:55:030
1062799121,6cyclictest4902-21apt-get08:20:041
1062799121,5cyclictest22778-21diskmemload11:42:011
1062699127,2cyclictest1895-21runrttasks07:12:250
1062699124,4cyclictest10610-21kworker/u4:212:37:550
1062699123,8cyclictest14616-21kworker/u4:011:51:500
1062699123,8cyclictest0-21swapper/007:35:040
1062699120,7cyclictest0-21swapper/008:30:040
104122122,3sleep10-21swapper/107:09:361
1062799114,3cyclictest22778-21diskmemload11:25:071
1062799111,5cyclictest12598-21munin-node07:15:011
1062699114,3cyclictest29544-21apt-get08:00:040
1062699113,5cyclictest528-21rs:main0
1062699113,1cyclictest0-21swapper/011:10:060
1062699110,7cyclictest16528-21taskset08:50:220
1062699110,5cyclictest17914-21ntp_states08:55:140
96372103,3sleep00-21swapper/007:05:160
1062799106,3cyclictest10634-21apt-get07:10:041
1062699102,3cyclictest12739-21missed_timers07:15:010
106279992,4cyclictest1895-21runrttasks08:52:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional