You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-04 - 21:54

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot5.osadl.org (updated Wed Aug 04, 2021 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324052360,1sleep132410-21cut08:00:151
1199699330,32cyclictest14183-21meminfo08:35:290
64442320,0sleep00-21swapper/012:25:180
1199699290,28cyclictest501-21meminfo08:00:230
1199699290,28cyclictest25838-21meminfo09:05:210
1199699260,25cyclictest12673-21meminfo07:10:180
1199799250,24cyclictest27194-21meminfo11:55:271
1199799250,24cyclictest19136-21meminfo07:25:241
1199799250,24cyclictest15245-21meminfo07:15:261
1199699250,24cyclictest3189-21meminfo09:30:260
1199799240,23cyclictest14858-21meminfo10:00:191
1199799230,22cyclictest17191-21meminfo07:20:181
1199699233,5cyclictest15691-21ntp_offset11:25:310
1199799220,21cyclictest30429-21meminfo10:40:321
1199699220,21cyclictest7073-21meminfo09:40:190
1199699220,21cyclictest21943-21meminfo08:55:210
1199699211,8cyclictest2321-21runrttasks08:24:310
1199699210,20cyclictest13591-21meminfo11:20:180
1199699210,20cyclictest1219-21meminfo09:25:250
1199799201,4cyclictest26955-21diskmemload12:06:501
1199799200,20cyclictest25276-21meminfo11:50:401
1199799200,19cyclictest5817-21meminfo11:00:261
1199699200,4cyclictest26955-21diskmemload09:21:050
1199699192,3cyclictest2321-21runrttasks08:07:520
1199699192,2cyclictest11225-21runrttasks12:37:220
1199699191,6cyclictest29065-21apt-get09:15:150
1199699190,19cyclictest28455-21meminfo10:35:220
1199699190,19cyclictest2595-21meminfo12:15:270
1199699190,18cyclictest7756-21meminfo11:05:250
1199699190,18cyclictest12228-21meminfo08:30:180
1199799180,13cyclictest26533-21/usr/sbin/munin10:30:331
1199699184,2cyclictest2321-21runrttasks08:13:310
1199699182,3cyclictest24433-21munin-run11:50:000
1199699180,9cyclictest3889-21apt-get12:20:140
1199699180,5cyclictest0-21swapper/010:20:160
1199799170,17cyclictest4446-21meminfo08:10:191
1199799170,17cyclictest1926-21meminfo10:50:321
1199699175,4cyclictest2321-21runrttasks10:54:130
1199699174,3cyclictest18765-21apt-get11:35:190
1199699170,16cyclictest27779-21meminfo09:10:210
1199799160,15cyclictest5117-21meminfo09:35:191
1199799160,15cyclictest10282-21meminfo08:25:181
1199699165,3cyclictest0-21swapper/010:05:260
1199699163,1cyclictest28649-21kworker/u4:111:34:350
1199699162,4cyclictest0-21swapper/012:30:250
1199699161,5cyclictest1811-21latency_hist12:15:000
1199699160,15cyclictest9018-21meminfo09:45:190
1199799150,15cyclictest18751-21meminfo10:10:291
1199699152,2cyclictest0-21swapper/008:40:230
1199699151,2cyclictest21402-21find07:30:330
1199699151,1cyclictest2321-21runrttasks07:39:070
1199699150,1cyclictest0-21swapper/010:40:180
1199699150,14cyclictest21371-21meminfo11:40:230
11997991412,1cyclictest4961-21switchtime12:20:281
1199699144,4cyclictest2321-21runrttasks07:47:080
1199699142,5cyclictest32434-21kworker/u4:410:01:370
1199799132,3cyclictest0-21swapper/109:57:511
1199799131,6cyclictest9067-21ls09:45:211
1199799131,11cyclictest27113-21meminfo07:45:181
1199799130,13cyclictest19422-21meminfo11:35:261
1199799130,11cyclictest5730-21seq08:15:151
1199699135,3cyclictest32659-21processes10:45:310
1199699131,7cyclictest6471-21grep08:15:220
1199699131,3cyclictest2321-21runrttasks10:17:510
1199699131,3cyclictest14386-21timerwakeupswit07:15:010
1199799125,6cyclictest5824-21apt-get12:25:111
1199799122,7cyclictest30338-21apt-get07:55:141
1199799120,7cyclictest23949-21mandb07:36:141
1199799120,12cyclictest25179-21meminfo07:40:221
1199699124,7cyclictest27100-21kworker/u4:309:54:070
1199799114,2cyclictest0-21swapper/109:00:191
1199799113,7cyclictest8195-21cron09:44:591
1199799113,5cyclictest2321-21runrttasks08:39:491
1199799112,5cyclictest28649-21kworker/u4:112:35:091
1199799112,4cyclictest23541-21runrttasks10:22:501
1199799111,8cyclictest23917-21apt-get10:25:141
1199799111,7cyclictest0-21swapper/109:10:161
1199799111,6cyclictest8581-21ntp_states12:30:261
1199799110,5cyclictest0-21swapper/109:30:211
1199799110,2cyclictest0-21swapper/111:05:261
1199799110,11cyclictest17473-21meminfo11:30:211
1199699114,6cyclictest0-21swapper/011:50:280
1199699112,6cyclictest23253-21apt-get09:00:190
1199699112,4cyclictest26787-21tune2fs11:55:200
1199699111,6cyclictest0-21swapper/007:40:230
1199699110,4cyclictest0-21swapper/007:30:000
1199699110,10cyclictest18059-21meminfo08:45:160
1199799103,3cyclictest26955-21diskmemload10:45:221
1199799103,3cyclictest23425-21/usr/sbin/munin11:45:271
1199799102,6cyclictest17408-21apt-get08:45:111
1199799102,2cyclictest0-21swapper/110:05:151
1199799101,6cyclictest31029-21runrttasks09:20:131
1199799101,6cyclictest20027-21apt-get10:15:181
1199799100,7cyclictest20716-21apt-get11:40:161
1199799100,7cyclictest12205-21fschecks_count07:10:151
1199799100,5cyclictest10393-21taskset11:10:431
1199799100,10cyclictest19999-21meminfo08:50:161
1199699102,4cyclictest27893-21kworker/u4:012:04:450
119979997,2cyclictest21-21ksoftirqd/111:26:021
119979996,2cyclictest28844-21cut12:00:201
119979996,2cyclictest13052-21tr11:20:131
119979991,7cyclictest10300-21apt-get09:50:141
119979991,6cyclictest0-21swapper/109:15:151
119979991,5cyclictest521-21apt-get09:25:201
119979991,4cyclictest0-21swapper/108:55:151
119979990,9cyclictest16129-21meminfo08:40:191
119979990,5cyclictest0-21swapper/108:30:221
119969994,2cyclictest0-21swapper/008:50:130
119969993,2cyclictest30896-21if_err_ecat012:05:220
119969992,3cyclictest0-21swapper/009:55:130
119969991,6cyclictest18084-21apt-get10:10:150
119969991,4cyclictest4464-21apt-get09:35:140
119969990,5cyclictest30421-21cpuspeed_turbos07:55:140
11709292,4sleep00-21swapper/007:08:540
10704291,4sleep110043-21/usr/sbin/munin07:05:201
119979986,1cyclictest9348-21chrt08:23:501
119979986,1cyclictest1583-21chrt12:13:171
119979986,1cyclictest123782sleep111:16:061
119979983,2cyclictest20507-21cpuspeed_turbos07:30:231
119979981,6cyclictest28908-21if_eth207:50:181
119979981,2cyclictest0-21swapper/110:35:151
119979980,8cyclictest3852-21meminfo10:55:231
119979980,2cyclictest3393-21taskset08:07:361
119969986,1cyclictest12402-21taskset11:16:220
119969984,1cyclictest4779-21kworker/u4:411:10:490
119969983,2cyclictest0-21swapper/008:25:160
119969982,5cyclictest0-21swapper/010:30:190
119969982,3cyclictest0-21swapper/011:00:170
119969981,4cyclictest25601-21taskset10:29:080
119979976,1cyclictest25247-21wc09:05:161
119979976,1cyclictest2002-21cat12:15:171
119969976,1cyclictest29235-21pmu-power07:50:220
119969970,4cyclictest29179-1kworker/u5:010:55:090
119969965,1cyclictest16687-21expr07:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional