You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-29 - 09:04

x86 Intel Celeron G3900 @2800 MHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot5.osadl.org (updated Wed Jun 29, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5752340,1sleep00-21swapper/020:25:280
1282599260,25cyclictest26677-21meminfo23:30:161
1282499240,23cyclictest23433-21meminfo21:55:210
1282599210,20cyclictest27579-21meminfo20:05:241
1282599210,13cyclictest690-21apt-esm-hook22:25:111
1282499210,20cyclictest29876-21meminfo22:15:170
1282499210,20cyclictest25006-21meminfo19:55:240
1282499200,20cyclictest2890-21meminfo20:35:250
1282599190,19cyclictest9852-21meminfo00:10:161
1282599170,16cyclictest13070-21meminfo22:55:231
1282599163,4cyclictest11711-21diskmemload00:01:531
1282599160,16cyclictest19877-21meminfo19:35:241
12824991614,1cyclictest0-21swapper/021:43:010
1282499160,16cyclictest5460-21meminfo20:45:220
1282499160,15cyclictest20840-21meminfo23:15:170
1282599151,9cyclictest11711-21diskmemload21:55:381
1282599150,15cyclictest7232-21meminfo22:40:161
1282599150,15cyclictest11114-21meminfo22:50:161
12824991510,4cyclictest22344-21/usr/sbin/munin19:45:220
1282499150,15cyclictest8017-21meminfo20:55:230
1282499150,15cyclictest32510-21meminfo23:45:150
1282499150,15cyclictest16968-21meminfo23:05:200
1282499150,14cyclictest28615-21meminfo23:35:160
1282599140,13cyclictest31839-21meminfo22:20:191
1282499140,14cyclictest15703-21meminfo00:25:160
1282499140,13cyclictest13865-21meminfo19:15:010
1282599132,8cyclictest5280-21meminfo22:35:211
1282599132,10cyclictest11711-21diskmemload22:32:231
1282599131,9cyclictest18189-21sort23:10:001
1282599130,9cyclictest12279-21runrttasks21:14:341
1282599130,5cyclictest24274-21kworker/u4:122:00:071
1282599130,1cyclictest11711-21diskmemload00:19:421
1282499130,13cyclictest24739-21meminfo23:25:160
1282599121,10cyclictest10738-21kworker/u4:400:38:001
1282599120,12cyclictest7924-21meminfo00:05:251
1282499124,3cyclictest2321-21runrttasks22:49:120
1282499123,8cyclictest27008-21sshd22:08:520
1282499122,8cyclictest18939-21apt-get00:35:120
1282499122,5cyclictest0-21swapper/000:15:160
1282499121,6cyclictest31898-21munin-run20:25:010
1282599114,5cyclictest25478-21seq23:25:581
1282599114,4cyclictest13705-21latency19:15:001
1282599111,5cyclictest23563-21taskset23:21:141
1282599111,5cyclictest0-21swapper/120:25:181
1282599110,10cyclictest10231-21chrt22:49:231
1282499113,4cyclictest7101-21munin-run00:05:000
1282499113,3cyclictest13123-21apt-get00:20:190
1282499112,7cyclictest30629-21/usr/sbin/munin23:40:170
1282499111,7cyclictest7428-21df_inode00:05:190
1282499110,9cyclictest14285-21sendmail21:20:000
1282499110,11cyclictest15022-21meminfo23:00:160
1282499110,11cyclictest1367-21meminfo22:25:160
1282599108,1cyclictest24351-21apt-get19:55:181
1282599108,1cyclictest0-21swapper/123:38:311
1282599104,4cyclictest21906-21grep19:45:191
1282599102,6cyclictest14293-21munin-run21:20:001
1282599102,4cyclictest26849-21taskset22:07:091
1282599101,4cyclictest607-21ls23:45:201
1282599101,4cyclictest0-21swapper/121:45:161
1282599100,3cyclictest0-21swapper/100:25:411
1282599100,10cyclictest10595-21meminfo21:05:241
1282499104,2cyclictest2321-21runrttasks20:40:540
1282499102,6cyclictest13326-21/usr/sbin/munin22:55:250
1282499102,5cyclictest2321-21runrttasks21:34:540
1282499102,2cyclictest0-21swapper/021:25:160
1282499101,2cyclictest0-21swapper/022:20:140
128259998,1cyclictest29476-21apt-get20:15:171
128259998,1cyclictest21-21ksoftirqd/119:15:001
128259992,5cyclictest2321-21runrttasks22:13:051
128259992,3cyclictest0-21swapper/122:15:121
128259991,5cyclictest30334-21if_ecat023:40:141
128259990,8cyclictest18534-21fw_packets23:10:141
128249994,4cyclictest11860-21kworker/u4:322:52:010
128249993,5cyclictest26925-21apt-get20:05:190
128249993,2cyclictest0-21swapper/019:35:270
128249992,6cyclictest18270-21wc21:35:230
128249992,4cyclictest26181-21df23:30:120
128249992,2cyclictest17637-21ls00:30:150
128249991,5cyclictest0-21swapper/020:15:300
12524292,5sleep10-21swapper/119:08:471
11543291,4sleep010879-21/usr/sbin/munin19:05:250
128259986,1cyclictest9017-21seq20:58:521
128259986,1cyclictest267252sleep120:04:511
128259986,1cyclictest24053-21seq19:53:461
128259986,1cyclictest190402sleep119:34:591
128259986,1cyclictest16793-21chrt21:29:261
128259983,3cyclictest13459-21munin-node23:15:111
128259983,3cyclictest0-21swapper/119:23:051
128259983,3cyclictest0-21swapper/100:20:191
128259982,2cyclictest0-21swapper/123:50:121
128259982,1cyclictest27511-21kworker/u4:123:59:101
128259980,7cyclictest6653-21ls20:50:001
128259980,7cyclictest18299-21meminfo21:35:231
128259980,6cyclictest0-21swapper/121:50:061
128249986,1cyclictest2805-21chrt23:50:530
128249986,1cyclictest237542sleep019:50:320
128249986,1cyclictest188152sleep019:32:340
128249986,1cyclictest18117-21chrt19:26:410
128249986,1cyclictest14536-21taskset21:21:010
128249986,1cyclictest12829-21taskset19:10:030
128249985,2cyclictest0-21swapper/023:11:450
128249984,2cyclictest0-21swapper/023:55:220
128249983,3cyclictest23487-21taskset23:20:250
128249982,3cyclictest2321-21runrttasks22:01:250
128249981,6cyclictest20221-21apt-get21:45:160
128249981,6cyclictest1963-21chrt20:34:040
128249981,5cyclictest0-21swapper/019:20:110
128249980,4cyclictest0-21swapper/020:15:000
128249980,3cyclictest0-21swapper/022:40:110
14602270,0sleep10-21swapper/121:21:461
128259976,1cyclictest2786-21taskset20:35:231
128259976,1cyclictest21429-21taskset19:42:591
128259976,1cyclictest18375-21seq19:29:301
128259976,1cyclictest17781-21ntpdc00:30:171
128259975,1cyclictest4181-21chrt20:40:131
128259974,1cyclictest288442sleep120:10:061
128259971,4cyclictest9303-21seq21:00:061
128259971,4cyclictest0-21swapper/123:00:111
128249976,1cyclictest9311-21taskset21:00:110
128249976,1cyclictest3312-21cat22:30:160
128249976,1cyclictest22158-21chrt21:50:150
128249976,1cyclictest21439-21taskset19:43:060
128249976,1cyclictest11954-21taskset21:11:020
128249975,1cyclictest26326-21taskset20:00:320
128249973,3cyclictest5269-21ls22:35:200
128249972,4cyclictest10001-21/usr/sbin/munin21:05:190
128249972,1cyclictest10249-21switchtime00:10:200
128259966,0cyclictest6769-21taskset20:50:351
128259965,1cyclictest200392sleep121:44:571
128259965,1cyclictest17115-21taskset21:31:131
128259965,0cyclictest314522sleep120:20:281
128249965,1cyclictest67302sleep020:50:090
128249960,4cyclictest27499-21cut22:10:140
128259951,3cyclictest2058-21munin-run20:35:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional