You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-04-15 - 01:04

Intel(R) Celeron(R) CPU G1620 @ 2.70GHz, Linux 5.4.59-rt36 (Profile)

Latency plot of system in rack #8, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Wed Apr 14, 2021 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2460599175,6cyclictest16750-21ssh11:51:071
2460599170,16cyclictest628-21irqbalance11:07:091
2460499170,1cyclictest31984-21x2gosqlitewrapp10:38:490
2460599165,6cyclictest22526-21ssh11:27:561
2460599160,12cyclictest9302-21x2golistsession10:18:311
2460599155,5cyclictest24735-21ssh10:03:151
2460599154,5cyclictest31225-21ssh12:05:041
2460599153,6cyclictest26456-21readlink07:11:261
2460599153,6cyclictest12404-21readlink11:19:151
2460599153,6cyclictest10484-21readlink09:20:501
2460599153,5cyclictest25932-21awk11:30:141
2460599150,7cyclictest25529-21x2golistsession11:01:101
2460599150,6cyclictest16484-21x2gosqlitewrapp11:22:221
2460599150,11cyclictest31633-21x2gosqlitewrapp11:35:171
2460599150,11cyclictest24159-21x2golistsession10:31:051
2460599150,10cyclictest18173-21latency_hist07:55:001
2460499150,14cyclictest0-21swapper/009:55:190
2460599144,5cyclictest28503-21ssh12:01:521
2460599144,5cyclictest21763-21ssh10:58:341
2460599144,5cyclictest19931-21ssh10:27:441
2460599143,6cyclictest32602-21readlink07:22:461
2460599143,6cyclictest22995-21readlink08:01:061
2460599143,5cyclictest604-21nscd09:31:181
2460599141,7cyclictest16083-21x2gosqlitewrapp10:24:571
2460599141,6cyclictest30915-21x2gosqlitewrapp12:33:251
2460599140,7cyclictest4448-21x2gosqlitewrapp09:15:181
2460599140,7cyclictest32719-21x2gosqlitewrapp09:12:121
2460599140,7cyclictest30935-21x2golistsession10:37:311
2460599140,7cyclictest22024-21x2gosqlitewrapp11:55:441
2460599140,7cyclictest2180-21x2gosqlitewrapp08:21:001
2460599140,7cyclictest17243-21x2golistsession08:48:141
2460599140,7cyclictest11600-21x2golistsession12:15:181
2460599140,7cyclictest10512-21x2gosqlitewrapp10:48:271
2460599140,6cyclictest6700-21x2gosqlitewrapp12:11:091
2460599140,6cyclictest3480-21x2golistsession07:29:161
2460599140,6cyclictest23137-21x2gosqlitewrapp08:58:361
2460599140,6cyclictest16981-21x2golistsession09:55:331
2460599140,6cyclictest13757-21x2gosqlitewrapp10:50:311
2460599140,5cyclictest4883-21x2gosqlitewrapp12:39:251
2460599140,1cyclictest14988-21ssh09:25:091
2460599140,12cyclictest4247-21ntp_states11:40:101
2460599140,12cyclictest14186-21x2gosqlitewrapp09:54:041
2460599133,6cyclictest18991-21sh12:22:321
2460599131,8cyclictest1410-21lxpanel09:45:021
2460599131,10cyclictest31158-21x2gosqlitewrapp08:15:131
2460599131,10cyclictest24535-21x2gosqlitewrapp08:05:041
2460599130,7cyclictest8299-21x2gosqlitewrapp07:35:251
2460599130,7cyclictest7967-21x2gosqlitewrapp08:31:001
2460599130,7cyclictest5709-21x2gosqlitewrapp07:31:371
2460599130,7cyclictest5051-21x2gosqlitewrapp08:25:551
2460599130,7cyclictest3755-21x2golistsession11:10:271
2460599130,7cyclictest28697-21x2gosqlitewrapp07:15:121
2460599130,7cyclictest27270-21x2gosqlitewrapp09:05:081
2460599130,7cyclictest27034-21x2golistsession08:10:031
2460599130,7cyclictest26980-21x2golistsession09:35:291
2460599130,7cyclictest25542-21x2gosqlitewrapp09:01:341
2460599130,7cyclictest19412-21x2gosqlitewrapp08:50:191
2460599130,7cyclictest1511-21x2golistsession09:42:121
2460599130,7cyclictest14789-21x2gosqlitewrapp07:48:051
2460599130,7cyclictest13771-21x2golistsession08:40:561
2460599130,7cyclictest13333-21x2gosqlitewrapp11:48:541
2460599130,7cyclictest11210-21x2gosqlitewrapp07:40:241
2460599130,7cyclictest10778-21x2golistsession08:35:411
2460599130,6cyclictest21094-21x2gosqlitewrapp12:25:011
2460599130,6cyclictest19307-21ntp_states07:55:101
2460599130,6cyclictest1742-21x2golistsession10:40:101
2460599130,11cyclictest1652-21x2gosqlitewrapp10:10:521
2460599130,0cyclictest0-21swapper/110:05:101
2460499130,12cyclictest0-21swapper/012:24:080
2460499130,12cyclictest0-21swapper/011:26:190
2460499130,12cyclictest0-21swapper/009:42:090
2460499120,11cyclictest0-21swapper/009:45:390
2460499120,0cyclictest0-21swapper/011:24:490
2460499120,0cyclictest0-21swapper/010:07:390
24604991111,0cyclictest0-21swapper/009:34:490
2460499110,0cyclictest0-21swapper/011:41:290
24604991010,0cyclictest0-21swapper/012:30:590
24604991010,0cyclictest0-21swapper/012:28:180
246049990,8cyclictest5999-21x2gosqlitewrapp07:32:460
246049988,0cyclictest0-21swapper/010:30:290
246049988,0cyclictest0-21swapper/010:13:590
246049985,2cyclictest5939-21x2golistsession09:17:120
246049985,2cyclictest4362-21x2gosqlitewrapp10:42:490
246049985,2cyclictest25057-21sort07:10:050
246049985,2cyclictest18844-21sensors_volt10:55:150
246049985,2cyclictest12828-21x2golistsession09:23:470
246049985,2cyclictest11560-21x2gosqlitewrapp10:49:470
246049981,2cyclictest31394-21x2gosqlitewrapp11:06:260
246049981,2cyclictest22920-21x2golistsession10:00:580
246049980,8cyclictest29325-21diskmemload12:09:480
246049975,1cyclictest9957-21ssh12:15:030
246049975,1cyclictest29325-21diskmemload11:15:150
246049975,1cyclictest27562-21ntp_states09:05:110
246049975,1cyclictest25872-21df12:00:060
246049975,1cyclictest24184-21gltestperf09:00:050
246049975,1cyclictest2127-21x2golistsession08:20:490
246049975,1cyclictest19988-21x2golistsession07:55:470
246049975,1cyclictest15510-21wget07:50:030
246049975,1cyclictest12541-21ssh09:52:010
246049975,1cyclictest11488-21x2golistsession08:38:300
246049974,2cyclictest5944-21x2golistsession10:15:080
246049974,2cyclictest5349-21awk12:10:090
246049974,2cyclictest27145-21x2golistsession09:35:410
246049974,2cyclictest26239-21ssh11:02:030
246049974,2cyclictest25374-21ntp_states11:30:100
246049973,2cyclictest705-21Xorg10:54:480
246049973,2cyclictest705-21Xorg08:25:500
246049972,2cyclictest29325-21diskmemload11:55:180
246049972,1cyclictest111rcu_preempt11:14:060
246049971,2cyclictest18227-21x2gosqlitewrapp10:25:350
246049971,1cyclictest111rcu_preempt09:25:050
246049970,6cyclictest2513-21x2gosqlitewrapp11:39:220
246049970,2cyclictest2088-21x2golistsession12:35:550
246049970,1cyclictest8990-21munin-run08:35:000
246049964,2cyclictest25702-21x2gosqlitewrapp08:05:190
246049964,1cyclictest9-21ksoftirqd/008:46:280
246049964,1cyclictest9-21ksoftirqd/007:15:110
246049964,1cyclictest720-21x2gocleansessio08:16:220
246049964,1cyclictest21710-21ntp_kernel_pll_08:55:110
246049964,1cyclictest21236-21/usr/sbin/munin08:00:040
246049964,1cyclictest1852-21x2golistsession07:25:110
246049964,1cyclictest14416-21/usr/sbin/munin11:50:080
246049963,2cyclictest7147-21sort07:35:080
246049963,2cyclictest31646-21readlink07:20:120
246049963,2cyclictest27994-21x2gopath08:10:100
246049963,2cyclictest13504-21x2gopath07:45:100
246049963,2cyclictest10158-21grep07:40:060
246049960,5cyclictest9-21ksoftirqd/008:50:100
246049960,5cyclictest29739-21cpuspeed_turbos09:10:060
246049960,5cyclictest11511-21cat10:20:090
246049960,5cyclictest10063-21x2golistsession11:45:130
246049960,1cyclictest13017-21x2golistsession08:40:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional