You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-26 - 12:37

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot5.osadl.org (updated Wed Jan 26, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2736299290,28cyclictest8738-21meminfo21:05:260
2736299260,25cyclictest20429-21meminfo21:35:230
2736399250,24cyclictest32141-21meminfo22:05:251
2736399240,23cyclictest11879-21meminfo19:50:241
2736399230,22cyclictest8324-21meminfo23:50:241
2736399220,21cyclictest24335-21meminfo21:45:221
2736399220,21cyclictest10682-21meminfo21:10:211
2736299220,21cyclictest5615-21meminfo22:20:230
2736299220,21cyclictest2472-21meminfo23:35:250
2736399210,20cyclictest6374-21meminfo23:45:211
2736299211,14cyclictest9277-21apt-get19:45:160
2736299210,20cyclictest21615-21meminfo20:15:240
2736399200,20cyclictest13825-21meminfo19:55:241
2736299200,19cyclictest1695-21meminfo22:10:220
2736399190,19cyclictest6789-21meminfo21:00:231
2736399190,18cyclictest4436-21meminfo23:40:251
2736299190,19cyclictest23917-21meminfo00:30:220
2736299190,18cyclictest26278-21meminfo21:50:220
2736399180,17cyclictest26277-21meminfo21:50:211
2736399180,17cyclictest14180-21meminfo00:05:251
2736299180,8cyclictest26651-21idleruntime-cro20:30:010
2736299180,18cyclictest25098-21meminfo23:10:250
2736299180,17cyclictest18485-21meminfo21:30:220
2736399170,17cyclictest30954-21meminfo23:25:211
2736299170,17cyclictest28044-21meminfo19:10:200
2736299170,16cyclictest6026-21meminfo19:35:240
2736299170,16cyclictest19668-21meminfo20:10:230
2736299170,16cyclictest15360-21meminfo22:45:230
2736399160,16cyclictest30206-21meminfo22:00:321
2736399160,12cyclictest13593-21/usr/sbin/munin22:40:251
2736299166,7cyclictest32748-21tr20:45:200
2736299160,16cyclictest7555-21meminfo22:25:210
2736299160,15cyclictest29680-21meminfo19:15:020
2736299160,15cyclictest29011-21meminfo23:20:220
2736299153,10cyclictest3779-21apt-get23:40:190
27362991510,2cyclictest77680irq/130-ecat0-r21:11:230
2736399145,8cyclictest1282-21sh19:25:001
2736399144,7cyclictest9610-21apt-get23:55:161
2736299146,7cyclictest11973-21apt-get21:15:150
2736299140,1cyclictest0-21swapper/023:56:190
2736299140,14cyclictest7989-21meminfo19:40:230
2736299140,13cyclictest32572-21meminfo19:20:220
2736299140,13cyclictest24338-21meminfo21:45:230
2736299140,13cyclictest21972-21meminfo00:25:230
2736399135,5cyclictest28352-21/usr/sbin/munin23:20:181
2736399133,6cyclictest27581-21apt-get21:55:211
2736399130,13cyclictest9503-21meminfo22:30:231
2736399130,12cyclictest12231-21meminfo00:00:221
2736299135,5cyclictest0-21swapper/000:24:340
2736299134,4cyclictest23520-21munin-run21:45:000
2736299133,8cyclictest12756-21apt-get22:40:160
2736299133,7cyclictest0-21swapper/022:05:190
2736299130,12cyclictest25873-21meminfo00:35:240
2736299130,12cyclictest17730-21meminfo20:05:250
2736399121,9cyclictest24616-21/usr/sbin/munin23:10:191
2736399121,8cyclictest15618-21runrttasks21:24:051
2736299123,2cyclictest12013-21tr19:50:270
2736299122,7cyclictest32248-21apt-get23:30:190
2736299122,5cyclictest0-21swapper/020:20:170
2736299122,4cyclictest26811-21apt-get20:30:180
2736299121,6cyclictest22476-21kworker/u4:323:06:520
2736299120,8cyclictest0-21swapper/000:10:170
2736299120,12cyclictest31374-21meminfo20:40:220
2736399119,2cyclictest21-21ksoftirqd/120:28:581
2736399114,1cyclictest2321-21runrttasks23:33:501
2736399113,7cyclictest1048-21ntp_states20:45:271
2736399111,6cyclictest9854-21diskmemload21:25:291
2736399110,11cyclictest22391-21meminfo21:40:211
2736299114,3cyclictest0-21swapper/021:20:210
2736299112,8cyclictest22336-21munin-run23:05:000
2736299112,5cyclictest0-21swapper/021:25:170
2736299110,5cyclictest13815-21/usr/sbin/munin19:55:240
2736299110,11cyclictest27043-21meminfo23:15:240
2736299110,10cyclictest15787-21meminfo20:00:250
2736299110,10cyclictest0-21swapper/000:05:200
2736399104,4cyclictest22500-21apt-get23:05:181
2736399102,6cyclictest0-21swapper/122:25:251
2736399102,5cyclictest0-21swapper/100:18:421
2736399101,8cyclictest0-21swapper/121:39:401
2736399101,7cyclictest0-21swapper/119:10:161
2736399101,5cyclictest12563-21cron22:40:001
2736399100,9cyclictest12627-21meminfo21:15:201
2736299103,5cyclictest31008-21ls23:25:220
2736299103,4cyclictest2876-21/usr/sbin/munin20:50:230
2736299103,4cyclictest27574-21kworker/u4:022:01:320
2736299103,3cyclictest2321-21runrttasks23:50:250
2736299102,3cyclictest6426-21ls23:45:210
2736299101,5cyclictest0-21swapper/022:35:180
2736299100,6cyclictest0-21swapper/000:00:160
273639993,2cyclictest0-21swapper/123:15:291
273639993,2cyclictest0-21swapper/100:35:121
273639993,1cyclictest27463-21/usr/sbin/munin20:30:231
273639992,6cyclictest22772-21perf20:20:001
273639990,7cyclictest3373-21/usr/sbin/munin22:15:191
273639990,3cyclictest20528-21kworker/u4:023:03:351
273629992,5cyclictest2321-21runrttasks20:36:070
273629992,3cyclictest9854-21diskmemload22:56:190
273629991,4cyclictest5961-21munin-run21:00:000
273629990,9cyclictest9502-21meminfo22:30:230
273629990,9cyclictest4082-21meminfo19:30:230
273629990,9cyclictest2138-21meminfo19:25:250
273629990,9cyclictest17301-21meminfo22:50:230
27164292,5sleep00-21swapper/019:09:520
273639986,1cyclictest9387-21tr19:45:171
273639986,1cyclictest36532sleep120:51:211
273639986,1cyclictest18844-21tr21:30:261
273639986,1cyclictest1229-21sort22:10:171
273639985,2cyclictest1662-21snmpd00:20:261
273639983,2cyclictest0-21swapper/119:35:251
273639982,2cyclictest8113-21ntpq19:40:251
273639982,2cyclictest0-21swapper/122:45:171
273639982,2cyclictest0-21swapper/122:20:241
273639981,3cyclictest0-21swapper/119:25:301
273639980,7cyclictest23421-21sh00:30:171
273639980,4cyclictest0-21swapper/100:25:181
273639980,3cyclictest0-21swapper/120:40:161
273629982,4cyclictest0-21swapper/021:00:400
273629981,5cyclictest0-21swapper/022:15:180
273629980,4cyclictest28737-21timerwakeupswit21:55:330
19233280,1sleep0121rcuc/000:20:000
273639976,1cyclictest8540-21if_err_ecat021:05:221
273639976,1cyclictest30443-21cat19:15:211
273639976,1cyclictest2154-21grep23:35:211
273639976,1cyclictest20122-21cat20:10:271
273639976,1cyclictest18063-21seq22:51:191
273639975,2cyclictest12193-21kworker/u4:222:56:181
273639975,1cyclictest5156-21run-parts20:55:271
273639975,1cyclictest3543-21grep19:30:191
273639975,1cyclictest29270-21cat20:35:231
273639975,1cyclictest18831-21chrt20:09:581
273639973,3cyclictest0-21swapper/120:01:051
273639971,2cyclictest22919-21apt-get20:20:151
273639970,7cyclictest16122-21meminfo00:10:231
25391272,2sleep10-21swapper/119:05:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional