You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-21 - 10:13

Intel(R) Celeron(R) CPU G3900 @ 2.80GHz, Linux 5.10.35-rt39 (Profile)

Latency plot of system in rack #c, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot5.osadl.org (updated Fri Jan 21, 2022 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1088399280,27cyclictest14126-21meminfo19:15:221
1088299280,28cyclictest22690-21meminfo21:00:240
1088299260,25cyclictest14896-21meminfo20:40:240
1088399242,22cyclictest1575-21meminfo00:15:231
1088399240,23cyclictest25830-21meminfo19:45:221
1088299240,23cyclictest7093-21meminfo20:20:220
1088399230,4cyclictest3252-21cut20:10:241
1088399230,3cyclictest3876-21cron23:00:001
1088299230,23cyclictest763-21meminfo22:50:220
1088399220,22cyclictest17601-21meminfo22:10:231
1088399220,21cyclictest29710-21meminfo19:55:211
1088399214,2cyclictest0-21swapper/122:07:341
1088399210,2cyclictest13080-21/usr/sbin/munin20:35:251
1088399210,20cyclictest765-21meminfo22:50:221
1088399210,20cyclictest11626-21kworker/u4:023:21:001
1088399210,0cyclictest0-21swapper/100:05:191
1088299210,20cyclictest8614-21meminfo23:10:210
1088399202,17cyclictest5721-21runrttasks23:03:451
1088399200,20cyclictest18371-21meminfo23:35:241
1088399200,19cyclictest9037-21meminfo20:25:221
1088399200,19cyclictest31252-21meminfo22:45:231
1088299200,19cyclictest25399-21meminfo22:30:220
1088299200,19cyclictest1996-21meminfo21:30:230
1088299200,19cyclictest12975-21meminfo19:15:000
1088399191,7cyclictest16183-21apt-get20:45:161
1088399191,1cyclictest27077-21seq23:57:521
1088399190,2cyclictest5279-21sh20:15:241
1088299190,19cyclictest31253-21meminfo22:45:230
1088299190,18cyclictest7852-21meminfo21:45:230
1088299190,18cyclictest32015-21meminfo00:10:220
1088399183,1cyclictest29309-21taskset21:16:331
1088399182,4cyclictest23812-21munin-run21:05:001
1088399180,18cyclictest16092-21meminfo19:20:221
1088399180,17cyclictest28129-21meminfo00:00:221
1088399180,17cyclictest16426-21meminfo23:30:241
1088299180,18cyclictest12533-21meminfo23:20:230
1088299180,17cyclictest21924-21meminfo19:35:230
1088399173,2cyclictest20341-21tr19:30:261
1088399170,17cyclictest24219-21meminfo23:50:231
1088399170,17cyclictest20725-21meminfo20:55:221
1088399170,16cyclictest32429-21meminfo21:25:211
1088399170,16cyclictest19547-21meminfo22:15:231
1088299170,16cyclictest7438-21meminfo00:30:220
1088299170,16cyclictest26577-21meminfo21:10:220
1088299170,16cyclictest21510-21meminfo22:20:220
1088399160,5cyclictest22819-21ls23:45:281
1088399160,3cyclictest0-21swapper/120:00:161
1088399160,16cyclictest5905-21meminfo21:40:221
1088399160,16cyclictest27344-21meminfo22:35:221
1088299160,16cyclictest19978-21meminfo19:30:210
1088299160,15cyclictest27772-21meminfo19:50:230
1088299160,15cyclictest14475-21meminfo23:25:210
1088299160,15cyclictest11570-21meminfo19:10:250
1088399153,1cyclictest19673-21apt-get23:40:151
1088399153,11cyclictest2354-21cron20:10:011
1088399153,0cyclictest0-21swapper/100:10:221
1088399152,12cyclictest11067-21uname20:30:211
1088399151,9cyclictest13054-21apt-get22:00:151
1088399150,3cyclictest9128-21taskset21:50:101
1088399150,15cyclictest9394-21meminfo00:35:241
1088399150,15cyclictest3946-21meminfo21:35:241
1088399150,14cyclictest23454-21meminfo22:25:211
1088299150,9cyclictest17716-21apt-get23:35:190
1088299150,15cyclictest29311-21meminfo22:40:240
1088399144,9cyclictest6438-21apt-get20:20:171
1088399142,11cyclictest15599-21cron23:30:001
1088399142,11cyclictest0-21swapper/121:48:261
1088399140,14cyclictest0-21swapper/120:40:181
1088299144,5cyclictest0-21swapper/021:53:120
1088299143,4cyclictest0-21swapper/019:40:180
1088299140,14cyclictest20327-21meminfo23:40:210
1088399134,8cyclictest0-21swapper/121:13:441
1088399134,6cyclictest18123-21apt-get20:50:151
1088399133,3cyclictest25751-21diskmemload21:55:221
1088399131,3cyclictest9568-21chrt23:13:201
1088399131,1cyclictest7805-21idleruntime-cro23:10:001
1088399131,10cyclictest0-21swapper/123:15:161
1088299135,7cyclictest17380-21apt-get19:25:160
1088299131,6cyclictest0-21swapper/019:45:160
1088299130,12cyclictest6670-21meminfo23:05:230
1088399123,9cyclictest24299-21kworker/u4:022:30:581
1088399123,8cyclictest31614-21munin-run21:25:001
1088399121,2cyclictest22180-21wc19:35:271
1088399121,1cyclictest0-21swapper/100:30:001
1088299124,4cyclictest2321-21runrttasks20:15:380
1088299120,8cyclictest24126-21users22:25:270
1088299120,11cyclictest22276-21meminfo23:45:230
1088399116,5cyclictest3134-21awk21:35:001
1088399113,2cyclictest24085-21tr21:05:181
1088399112,6cyclictest2892-21apt-get00:20:171
1088399112,2cyclictest2321-21runrttasks22:40:171
1088299113,7cyclictest2321-21runrttasks00:25:010
1088299112,4cyclictest25751-21diskmemload21:15:270
1088299111,9cyclictest24274-21needreboot23:50:250
1088299110,11cyclictest18779-21meminfo20:50:220
1088399105,1cyclictest7424-21expr00:30:221
1088399105,1cyclictest27811-21sed19:50:241
1088399104,1cyclictest11038-21ls19:10:201
1088399103,2cyclictest23217-21taskset19:40:101
1088299108,1cyclictest9902-21apt-get23:15:150
1088299107,2cyclictest0-21swapper/022:15:280
1088299105,1cyclictest25751-21diskmemload21:36:550
1088299104,5cyclictest8957-21fschecks_count00:35:200
1088299104,3cyclictest2321-21runrttasks22:57:460
1088299104,2cyclictest0-21swapper/020:55:160
1088299102,7cyclictest26317-21ntp_states23:55:250
1088299102,6cyclictest15004-21apt-get22:05:190
1088299102,3cyclictest29056-21apt-get19:55:140
1088299101,7cyclictest517-21apt-get20:05:200
108839993,2cyclictest22644-21awk22:25:001
108839992,1cyclictest0-21swapper/119:25:161
108829995,3cyclictest0-21swapper/022:00:160
108829990,9cyclictest11749-21meminfo21:55:230
108829990,5cyclictest0-21swapper/023:32:120
108829990,5cyclictest0-21swapper/000:10:000
108829990,2cyclictest0-21swapper/000:20:170
10679292,4sleep00-21swapper/019:09:500
9895282,2sleep10-21swapper/119:05:271
15592280,0sleep00-21swapper/019:20:180
108829986,1cyclictest4062-21chrt23:00:120
108829986,1cyclictest3261-21head20:10:240
108829986,1cyclictest31287-21taskset21:21:420
108829986,1cyclictest27603-21cstates00:00:170
108829985,3cyclictest28496-21basename22:40:000
108829985,2cyclictest1244-21head00:15:190
108829984,2cyclictest13324-21swap20:35:280
108829982,4cyclictest0-21swapper/020:00:250
108829982,2cyclictest2321-21runrttasks20:25:270
108829981,3cyclictest0-21swapper/021:44:090
108829981,2cyclictest17844-21taskset20:48:540
108829980,8cyclictest24629-21meminfo21:05:220
108829980,7cyclictest32547-21tr21:25:230
108829976,1cyclictest17108-21df22:10:190
108829976,1cyclictest10313-21chrt20:30:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional