Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: arm64 inconsistencies #2027

Open
dezren39 opened this issue Oct 29, 2023 · 3 comments
Open

[BUG]: arm64 inconsistencies #2027

dezren39 opened this issue Oct 29, 2023 · 3 comments
Labels
kind/bug Something is broken.

Comments

@dezren39
Copy link

What version of Badger are you using?

v3.2103.2

What version of Go are you using?

charmbracelet/charm#32

Have you tried reproducing the issue with the latest release?

No

What is the hardware spec (RAM, CPU, OS)?

arm64

What steps will reproduce the bug?

try to open
try to open again
it errors

Expected behavior and actual result.

try to open
try to open again
it doesn't error on second try

Additional information

Error: while opening memtables error: while opening fid: 3 error: while updating skiplist error: mremap size mismatch: r

charmbracelet/charm#242

Error: During db.vlog.open error: while truncating last value log file: /root/.local/share/charm/cloud.charm.sh/kv/charm.sh.kv.user.default/000004.vlog error: mremap size mismatch: requested: 20 got: 20000000

Error: while opening memtables error: while opening fid: 9 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728

Error: while opening memtables error: while opening fid: 2 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728

Error: while opening memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 148 got: 134217728

@dezren39 dezren39 added the kind/bug Something is broken. label Oct 29, 2023
@dkorunic
Copy link

I have hit this same issue with github.com/dgraph-io/badger/[email protected] on both ARM32 and ARM64 architecture, resulting in data corruption:

Unable to open database: could not open database: while opening memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 20 got: 134217728"

From what I see, similar issues in Ristretto are most likely related:

mangalaman93 pushed a commit to dgraph-io/ristretto that referenced this issue Dec 11, 2023
In #281 mmap size check has been disabled for the ARM64 arch. 

But we at [anytype](https://github.com/anyproto) quite often face the
same problem on the arm arch on Android devices (armeabi-v7a target)
with the [latest badger
v4.2.0](https://github.com/dgraph-io/badger/releases/tag/v4.2.0) and
[latest ristretto v0.1.1](https://github.com/dgraph-io/ristretto).

```memtables error: while opening fid: 1 error: while updating skiplist error: mremap size mismatch: requested: 1479692 got: 67108864```

This PR extends the #281 to cover all arm architectures.

Here is one more mention of this issue
dgraph-io/badger#2027 (comment)

It would also make sense to create the PR on top of v0.1.1 release, but there is not release branch to base on
Copy link

This issue has been stale for 60 days and will be closed automatically in 7 days. Comment to keep it open.

@github-actions github-actions bot added the Stale label Jul 15, 2024
@dkorunic
Copy link

Lack of response is quite indicative so far..

@github-actions github-actions bot removed the Stale label Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something is broken.
Development

No branches or pull requests

2 participants