You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-30 - 20:30

x86 Intel Celeron G3900 @2800 MHz, Linux 6.1.12-rt7 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot5.osadl.org (updated Tue May 30, 2023 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200262640,1sleep1161rcu_preempt12:10:181
502399510,49cyclictest28859-21meminfo11:05:310
502499490,47cyclictest25135-21meminfo10:55:271
502399480,46cyclictest32550-21meminfo11:15:250
502499450,43cyclictest965-21meminfo09:50:211
502399450,43cyclictest16703-21meminfo09:05:250
502399440,42cyclictest28011-21meminfo12:30:240
502399440,42cyclictest17391-21meminfo07:40:310
502499420,40cyclictest1858-21meminfo08:25:251
502399420,40cyclictest7608-21meminfo11:35:290
502499410,39cyclictest24967-21meminfo08:00:221
502499400,38cyclictest11147-21meminfo08:50:331
502399400,38cyclictest3706-21meminfo08:30:230
502399400,38cyclictest17712-21meminfo10:35:230
502399400,38cyclictest16893-21meminfo12:00:300
502399390,38cyclictest7201-21meminfo07:15:010
502499380,37cyclictest24312-21meminfo12:20:241
502399380,36cyclictest5560-21meminfo08:35:190
502399380,36cyclictest18738-21meminfo12:05:220
502499370,36cyclictest22277-21meminfo09:20:241
502399370,35cyclictest15509-21meminfo07:35:210
502499360,35cyclictest26166-21meminfo12:25:271
502399360,34cyclictest9920-21meminfo07:20:250
502399360,34cyclictest20588-21meminfo12:10:220
502499350,34cyclictest24135-21meminfo09:25:311
502499350,34cyclictest22436-21meminfo12:15:221
502399350,33cyclictest30519-21meminfo08:15:250
502499340,33cyclictest11310-21meminfo11:45:171
502499340,32cyclictest9283-21meminfo08:45:221
502399340,33cyclictest5638-21meminfo07:10:370
502399340,33cyclictest13167-21meminfo11:50:220
502499330,32cyclictest19585-21meminfo10:40:251
502399330,32cyclictest31546-21meminfo09:45:260
502399330,32cyclictest21259-21meminfo07:50:270
502499320,31cyclictest4736-21meminfo10:00:261
502499320,31cyclictest13619-21meminfo07:30:231
502399320,31cyclictest30710-21meminfo11:10:310
502399320,30cyclictest7429-21meminfo08:40:220
502399320,30cyclictest2047-21meminfo11:20:250
502399320,30cyclictest14019-21meminfo10:25:270
502499310,30cyclictest19404-21meminfo07:45:241
502499310,29cyclictest23280-21meminfo10:50:231
502399310,30cyclictest2873-21meminfo09:55:280
502399310,30cyclictest25977-21meminfo09:30:260
502399310,30cyclictest11769-21meminfo07:25:250
502399310,29cyclictest5752-21meminfo11:30:270
502499300,29cyclictest13166-21meminfo11:50:211
502399300,29cyclictest20404-21meminfo09:15:240
502399290,27cyclictest23103-21meminfo07:55:250
502499280,27cyclictest2874-21meminfo09:55:291
502499270,26cyclictest6585-21meminfo10:05:201
502499270,26cyclictest3899-21meminfo11:25:281
502399270,26cyclictest28669-21meminfo08:10:230
502399270,26cyclictest24970-21meminfo08:00:230
502399270,25cyclictest29861-21meminfo12:35:230
502399260,25cyclictest27000-21meminfo11:00:250
502399260,25cyclictest15045-21meminfo11:55:390
502499250,24cyclictest14853-21meminfo09:00:261
502499240,23cyclictest15866-21meminfo10:30:261
502399230,22cyclictest9472-21meminfo11:40:270
502399230,22cyclictest15863-21meminfo10:30:270
502499220,21cyclictest32389-21meminfo08:20:231
502499210,20cyclictest29862-21meminfo12:35:231
502399210,20cyclictest29693-21meminfo09:40:230
502399210,20cyclictest12166-21meminfo10:20:250
502499200,19cyclictest2046-21meminfo11:20:251
502399200,19cyclictest10295-21meminfo10:15:270
502499190,18cyclictest18558-21meminfo09:10:271
502499190,17cyclictest11770-21meminfo07:25:251
502399190,18cyclictest8448-21meminfo10:10:260
502399190,18cyclictest12983-21meminfo08:55:250
5024991715,1cyclictest0-21swapper/111:15:261
502399170,16cyclictest26819-21meminfo08:05:240
502499165,4cyclictest3140-21apt-get08:30:181
502399160,15cyclictest27831-21meminfo09:35:270
502399151,8cyclictest0-21swapper/008:50:180
502499149,4cyclictest0-21swapper/111:03:441
502499142,9cyclictest19833-21/usr/sbin/munin09:15:281
502399147,5cyclictest10745-21apt-get11:45:120
502399141,6cyclictest17816-21diskmemload10:50:160
502399141,10cyclictest22642-21latency_hist10:50:000
48282141,9sleep13017-21perf07:09:561
502499138,3cyclictest6864-21apt-get08:40:171
502499137,5cyclictest12924-21cut08:55:231
502499132,6cyclictest909-21kworker/u4:2+xprtiod11:39:461
502499131,11cyclictest16322-21/usr/sbin/munin12:00:361
5024991311,1cyclictest0-21swapper/109:45:221
502399138,1cyclictest245382sleep010:55:010
502399137,2cyclictest19676-21munin-run09:15:000
502399133,6cyclictest0-21swapper/009:25:200
502399130,12cyclictest6586-21meminfo10:05:210
502499129,2cyclictest9187-21chrt10:11:091
502499129,2cyclictest29455-21taskset08:11:371
502499129,2cyclictest17241-21cat07:40:291
502499129,2cyclictest12949-21chrt10:21:371
502499129,2cyclictest10125-21taskset07:20:271
502499126,3cyclictest22896-21seq07:55:211
502499123,6cyclictest0-21swapper/109:30:261
502499120,11cyclictest11119-21chrt10:17:031
502399129,2cyclictest5477-21taskset10:01:050
502399129,2cyclictest23937-21sort12:20:200
502399121,5cyclictest8717-21apt-get08:45:170
5023991211,1cyclictest13696-21needreboot07:30:240
502499119,1cyclictest9221-21latency_hist07:20:011
502499119,1cyclictest5640-21seq07:10:371
502499119,1cyclictest28942-21cut11:05:321
502499119,1cyclictest22096-21chrt07:52:151
502499119,1cyclictest21984-21grep10:45:281
502499119,1cyclictest18958-21tr12:05:251
502499119,1cyclictest18517-21seq10:36:481
502499119,1cyclictest15303-21cat07:35:191
502499118,2cyclictest8878-21taskset11:40:021
502499118,2cyclictest30659-21latency11:10:311
502499118,2cyclictest30010-21egrep08:15:201
502499118,2cyclictest28126-21cut09:35:321
502499118,2cyclictest17019-21wc09:05:281
502499118,2cyclictest14596-21cat11:55:271
502499113,7cyclictest28242-21awk12:30:271
502499113,3cyclictest0-21swapper/111:30:191
502499111,6cyclictest0-21swapper/110:25:211
502499110,10cyclictest29386-21cut09:40:201
502399119,1cyclictest3312-21chrt11:25:100
502399119,1cyclictest22980-21grep12:15:280
502399119,1cyclictest19121-21grep10:40:210
502399118,2cyclictest22132-21cat09:20:230
502399118,2cyclictest18808-21taskset07:45:010
502399118,2cyclictest16065-21wc09:05:000
502399118,2cyclictest1050-21grep09:50:210
502399113,5cyclictest26706-21grep12:25:330
502399110,10cyclictest1358-21tr08:25:210
40342112,5sleep04114-21/usr/sbin/munin07:05:260
502499108,1cyclictest5091-21expr08:35:151
502499108,1cyclictest26958-21ntpq08:05:261
502399108,1cyclictest31804-21chrt08:20:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional