Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage: possible goroutine leak from pebble #92026

Closed
stevendanna opened this issue Nov 17, 2022 · 2 comments
Closed

storage: possible goroutine leak from pebble #92026

stevendanna opened this issue Nov 17, 2022 · 2 comments
Assignees
Labels
A-storage Relating to our storage engine (Pebble) on-disk storage. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-storage Storage Team

Comments

@stevendanna
Copy link
Collaborator

stevendanna commented Nov 17, 2022

Describe the problem

After a few thousand runs of various logic tests on stress:

=== RUN   TestCCLLogic_redact_descriptor
    test_log_scope.go:161: test logs captured to: /home/ssd/go/src/github.com/cockroachdb/cockroach/tmp/_tmp/effab48683274210e068775452544fff/logTestCCLLogic_redact_descriptor224268157
    test_log_scope.go:79: use -show-logs to present logs inline
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
*
* INFO: Running test with the default test tenant. If you are only seeing a test case failure when this message appears, there may be a problem with your test case running within tenants.
*
[00:56:18] --- done: /home/ssd/.cache/bazel/_bazel_ssd/8d7b887d1ed310166524748df3a7b647/sandbox/linux-sandbox/2172/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/logictestccl/tests/fakedist-disk/fakedist-disk_test_/fakedist-disk_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/logictestccl/testdata/logic_test/redact_descriptor with config fakedist-disk: 6 tests, 0 failures
[00:56:19] --- total progress: 6 statements
--- total: 6 tests, 0 failures
    logic.go:3977: -- test log scope end --
    generated_test.go:95: Leaked goroutine: goroutine 11041 [select]:
        github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked.func1()
                github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:302 +0xe5
        created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFS).startTickerLocked
                github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:297 +0x7a

Jira issue: CRDB-21527

Epic CRDB-20293

@stevendanna stevendanna added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-storage Storage Team labels Nov 17, 2022
@blathers-crl blathers-crl bot added the A-storage Relating to our storage engine (Pebble) on-disk storage. label Nov 17, 2022
@jbowens
Copy link
Collaborator

jbowens commented Nov 18, 2022

Typically this is the result of not closing the Engine (at least synchronously, with test end). That or using the Engine's filesystem functions after the Engine has already been closed.

@nicktrav nicktrav self-assigned this Dec 5, 2022
@nicktrav
Copy link
Collaborator

nicktrav commented Dec 7, 2022

Going to close this one out as as dupe of #92504 and #92903.

@nicktrav nicktrav closed this as completed Dec 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-storage Relating to our storage engine (Pebble) on-disk storage. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-storage Storage Team
Projects
None yet
Development

No branches or pull requests

3 participants