The Wayback Machine - https://web.archive.org/web/20211025210709/https://github.com/golang/go/issues/47855
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/tools/gopls: high memory consumption #47855

Open
OrlovM opened this issue Aug 20, 2021 · 5 comments
Open

x/tools/gopls: high memory consumption #47855

OrlovM opened this issue Aug 20, 2021 · 5 comments
Assignees
@findleyr
Labels
gopls/performance gopls Tools
Milestone
gopls/unplanned

Comments

@OrlovM
Copy link

@OrlovM OrlovM commented Aug 20, 2021 •
edited

What version of Go are you using (go version)?

$ go version
go version go1.17 linux/amd64

Does this issue reproduce with the latest release?

Yes. I have the latest versions of gopls and go.

What operating system and processor architecture are you using (go env)?

go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/mikhail/.cache/go-build"
GOENV="/home/mikhail/.config/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/mikhail/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/mikhail/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GOVCS=""
GOVERSION="go1.17"
GCCGO="gccgo"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD="/dev/null"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build4125386380=/tmp/go-build -gno-record-gcc-switches"

What did you do?

Opened cockroachDB repository in vim(same thing with neovim) with vim-go plugin and gopls enabled.
I've removed everything but vim-go and gopls from the .vimrc and disabled all other plugins. But the result is the same.

What did you expect to see?

Normal memory consumption. For example, Jetbrains Goland uses ~2GB when this project is open

What did you see instead?

gopls consumes about 9GB of memory, sometimes more than 14GB.

gopls.30806-8GiB-withnames.zip

gopls.3081-14GiB-withnames.zip
@gopherbot gopherbot added this to the Unreleased milestone Aug 20, 2021
@heschi
Copy link
Contributor

@heschi heschi commented Aug 25, 2021

In general gopls can be fairly memory hungry on large projects. This is an ongoing area of research. cc @findleyr.

FWIW, glancing at the attached zip, github.com/cockroachdb/cockroach/pkg/workload/geospatial is probably costing you 500+ MB all by itself. That package contains a very large composite literal that is very expensive to parse and type check. Removing that composite literal from gopls' scope, perhaps by changing its representation or excluding it from the build with a build tag, might be well worth the effort.

@OrlovM
Copy link
Author

@OrlovM OrlovM commented Aug 25, 2021

@heschi I've added a new archive. Please take a look at it.
gopls consumes more memory during use.
Isn't there any memory leak?

@heschi
Copy link
Contributor

@heschi heschi commented Aug 25, 2021

No. I don't see any signs of a memory leak.

If you want, you can try setting https://github.com/golang/tools/blob/master/gopls/doc/settings.md#memorymode-enum. Use it at your own risk.

@OrlovM
Copy link
Author

@OrlovM OrlovM commented Aug 26, 2021

So this is normal behavior?
Why is there such a big difference in memory consumption compared to JB Goland?

@hyangah
Copy link
Contributor

@hyangah hyangah commented Aug 27, 2021

I'd say the high memory usage is expected currently - Goland and gopls take different approaches.

Gopls dev team is currently working on improvement in this area. The "DegradeClosed" memory mode @heschi shared is one of the directions we are exploring. Please give it a try (warning: still experimental). Feedback and bug reports for the DegradeClosed mode are greatly appreciated!

@hyangah hyangah removed this from the Unreleased milestone Aug 27, 2021
@hyangah hyangah added this to the gopls/on-deck milestone Aug 27, 2021
@hyangah hyangah removed this from the gopls/on-deck milestone Aug 27, 2021
@hyangah hyangah added this to the gopls/unplanned milestone Aug 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@findleyr findleyr

Labels
gopls/performance gopls Tools
Projects
None yet
Milestone
gopls/unplanned
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
5 participants
@hyangah @gopherbot @heschi @findleyr @OrlovM