You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-25 - 03:59

x86 Intel Celeron G3900 @2800 MHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot5.osadl.org (updated Sat Jun 25, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33999280,27cyclictest6959-21meminfo22:10:160
33999250,24cyclictest17383-21meminfo00:00:170
34099240,23cyclictest30987-21meminfo00:35:171
34099240,23cyclictest25721-21meminfo21:35:161
33999240,23cyclictest10161-21meminfo20:55:160
34099220,22cyclictest9602-21meminfo23:40:161
33999210,21cyclictest4344-21meminfo20:40:170
33999210,21cyclictest29043-21meminfo00:30:160
34099200,19cyclictest26415-21meminfo23:00:151
33999200,20cyclictest358-21meminfo20:30:170
34099180,17cyclictest2643-21meminfo19:15:001
33999180,18cyclictest20589-21meminfo22:45:210
33999173,10cyclictest22548-21apt-get00:15:120
33999170,17cyclictest19906-21meminfo21:20:170
340991612,2cyclictest15187-21diskmemload23:50:441
34099160,16cyclictest28351-21meminfo23:05:151
33999161,10cyclictest20765-21kworker/u4:421:55:470
33999160,16cyclictest21263-21meminfo00:10:180
33999160,15cyclictest31555-21meminfo21:50:170
33999160,15cyclictest30880-21meminfo20:25:160
33999160,15cyclictest15422-21meminfo23:55:140
34099142,8cyclictest3106-21/usr/sbin/munin22:00:171
34099142,7cyclictest4785-21kworker/u4:023:59:331
34099140,14cyclictest11544-21meminfo23:45:171
34099140,13cyclictest13398-21meminfo19:40:161
33999147,5cyclictest19109-21/usr/sbin/munin19:55:160
33999140,14cyclictest27099-21meminfo00:25:170
34099136,1cyclictest2321-21runrttasks22:37:041
34099133,6cyclictest19250-21/usr/sbin/munin21:20:131
34099132,4cyclictest0-21swapper/100:12:571
34099130,2cyclictest0-21swapper/123:19:571
34099130,13cyclictest7642-21meminfo23:35:161
34099130,12cyclictest23109-21meminfo20:05:181
33999133,6cyclictest0-21swapper/019:30:110
33999132,8cyclictest6834-21grep20:45:230
33999131,6cyclictest0-21swapper/019:35:110
33999130,12cyclictest5617-21meminfo19:20:140
34099122,5cyclictest0-21swapper/123:29:211
34099121,6cyclictest18730-21diskstats19:55:141
34099121,10cyclictest5820-21/usr/sbin/munin23:30:181
34099121,10cyclictest11874-21/usr/sbin/munin21:00:141
34099120,6cyclictest0-21swapper/120:10:171
34099120,6cyclictest0-21swapper/100:00:121
34099120,12cyclictest29616-21meminfo21:45:151
34099120,12cyclictest23780-21meminfo21:30:151
34099120,10cyclictest17423-21ntp_states19:50:181
33999123,7cyclictest25609-21grep20:10:210
33999122,5cyclictest160462sleep019:45:400
33999120,12cyclictest7557-21meminfo19:25:160
33999120,12cyclictest13482-21meminfo23:50:160
33999120,11cyclictest3763-21meminfo23:25:170
34099115,5cyclictest20662-21strings22:45:221
34099114,5cyclictest30228-21apt-get20:25:111
34099114,3cyclictest25085-21head22:55:221
34099111,5cyclictest0-21swapper/121:57:141
34099110,6cyclictest4369-21apt-get22:05:121
34099110,11cyclictest6285-21meminfo20:45:191
34099110,11cyclictest15337-21meminfo19:45:171
34099110,10cyclictest14057-21meminfo21:05:151
33999115,5cyclictest23547-21ls20:05:220
33999115,4cyclictest21853-21/usr/sbin/munin21:25:210
33999114,4cyclictest14496-21grep21:05:200
33999113,4cyclictest9735-21grep23:40:180
33999113,3cyclictest2321-21runrttasks20:52:360
33999111,7cyclictest23809-21apt-get22:55:120
33999111,4cyclictest2321-21runrttasks22:52:010
339991110,1cyclictest29642-21apt-get23:10:120
33999110,10cyclictest21169-21meminfo20:00:170
322802112,2sleep00-21swapper/019:06:200
313672111,7sleep131474-21latency19:05:171
34099106,2cyclictest0-21swapper/120:40:191
34099102,8cyclictest32409-21chrt21:52:131
34099102,7cyclictest19082-21munin-run21:20:001
34099102,5cyclictest0-21swapper/120:35:111
34099102,3cyclictest18249-21fschecks_time22:40:121
34099102,3cyclictest0-21swapper/123:10:131
34099101,6cyclictest1273-21cstates23:20:141
34099101,5cyclictest8847-21apt-get19:30:111
34099101,4cyclictest0-21swapper/120:30:111
34099100,9cyclictest22519-21meminfo22:50:161
34099100,10cyclictest16004-21meminfo21:10:161
33999105,4cyclictest17045-21/usr/sbin/munin19:50:140
33999103,6cyclictest7788-21/usr/sbin/munin23:35:180
33999102,6cyclictest0-21swapper/022:35:220
33999102,5cyclictest0-21swapper/020:40:000
33999101,9cyclictest0-21swapper/022:18:590
33999101,6cyclictest0-21swapper/023:01:010
33999101,5cyclictest15353-21apt-get21:10:110
33999100,10cyclictest5699-21meminfo23:30:160
33999100,10cyclictest3659-21meminfo19:15:170
3409997,1cyclictest10828-21users20:55:211
3409994,3cyclictest0-21swapper/122:20:171
3409992,6cyclictest0-21swapper/100:30:101
3409992,2cyclictest10787-21apt-get19:35:111
3409991,8cyclictest22953-21seq21:29:561
3409991,5cyclictest0-21swapper/119:10:111
3409991,5cyclictest0-21swapper/100:22:341
3409991,2cyclictest0-21swapper/120:00:181
3409990,5cyclictest0-21swapper/100:15:131
3409990,4cyclictest5956-21kworker/u4:422:16:341
3399993,5cyclictest11917-21kworker/u4:122:43:220
3399992,6cyclictest565-21fschecks_count19:10:130
3399991,3cyclictest0-21swapper/023:15:120
3399990,9cyclictest27677-21meminfo21:40:150
3409986,1cyclictest298152sleep120:22:231
3409986,1cyclictest278142sleep100:25:421
3409986,1cyclictest26967-21expr20:15:151
3409982,2cyclictest27823-21ntp_states21:40:171
3409981,5cyclictest0-21swapper/100:05:181
3409981,4cyclictest0-21swapper/122:10:211
3409980,4cyclictest0-21swapper/122:32:071
3409980,2cyclictest12146-21/usr/sbin/munin22:25:121
3399986,1cyclictest186362sleep021:15:300
3399985,2cyclictest20765-21kworker/u4:421:34:550
3399984,2cyclictest4620-21fschecks_time22:05:130
3399983,2cyclictest2426-21apt-get22:00:110
3399982,5cyclictest15187-21diskmemload23:05:140
3399981,4cyclictest0-21swapper/022:20:110
3399981,3cyclictest0-21swapper/020:15:100
3399980,8cyclictest12801-21meminfo22:25:150
3399980,7cyclictest30226-21sed21:45:200
3399980,5cyclictest0-21swapper/021:04:320
3409976,1cyclictest7752-21forks20:50:131
3409976,1cyclictest5582-21latency19:20:151
3409975,1cyclictest6895-21taskset19:25:081
3399976,1cyclictest32129-21cat00:40:000
3399976,1cyclictest28379-21expr20:20:120
3399975,1cyclictest155802sleep022:32:000
3399975,1cyclictest1327-21taskset23:20:140
3399973,2cyclictest24509-21apt-get00:20:110
3399973,2cyclictest14526-21apt19:45:000
3399972,1cyclictest19688-21kworker/u4:323:49:080
3399964,2cyclictest19258-21grep00:05:230
3399960,5cyclictest25068-21apt-get21:35:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional