Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(externalMagic): Introduce external magic number #1745

Merged
merged 4 commits into from
Sep 16, 2021

Conversation

ahsanbarkati
Copy link
Contributor

@ahsanbarkati ahsanbarkati commented Sep 16, 2021

Currently, badger writes a magic number in the manifest. It helps badger to decide if its current version is compatible with the data on the disk or not. But now the internal data storage of badger is not changed but the data format for dgraph has changed. This causes a problem if someone starts dgraph-2109 on an older dgraph directory. This change adds an external magic number to badger which will help avoid data corruption by causing panic if opening Dgraph on the wrong directory.

There are 8 magic bytes in the manifest.
Prior to this change:

0-4: magic text
4-8: badgerMagicNumber

After this change:

0-4: magic text
4-6: externalMagicNumber
6-8: badgerMagicNumber

This change is Reviewable

Copy link
Contributor

@NamanJain8 NamanJain8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some nit picks. Please address the comments before merging.

manifest.go Show resolved Hide resolved
options.go Outdated Show resolved Hide resolved
options.go Outdated Show resolved Hide resolved
y/y.go Show resolved Hide resolved
badger/cmd/info.go Outdated Show resolved Hide resolved
@ahsanbarkati ahsanbarkati merged commit 2a9a524 into master Sep 16, 2021
@ahsanbarkati ahsanbarkati deleted the ahsan/external-magic branch September 16, 2021 09:56
joshua-goldstein pushed a commit that referenced this pull request Feb 6, 2023
Badger writes a magic number in the manifest. It helps badger to decide if its current version is compatible with the data on the disk or not. But now the internal data storage of badger is not changed but the data format for dgraph has changed. This causes a problem if someone starts dgraph-2109 on an older dgraph directory. This change adds an external magic number to badger which will help avoid data corruption by causing panic if opening Dgraph on the wrong directory.

There are 8 magic bytes in the manifest.
Prior to this change:

0-4: magic text
4-8: badgerMagicNumber
After this change:

0-4: magic text
4-6: externalMagicNumber
6-8: badgerMagicNumber
(cherry picked from commit 2a9a524)
joshua-goldstein added a commit that referenced this pull request Feb 8, 2023
Badger writes a magic number in the manifest. It helps badger to decide if its current version is compatible with the data on the disk or not. But now the internal data storage of badger is not changed but the data format for dgraph has changed. This causes a problem if someone starts dgraph-2109 on an older dgraph directory. This change adds an external magic number to badger which will help avoid data corruption by causing panic if opening Dgraph on the wrong directory.

There are 8 magic bytes in the manifest.
Prior to this change:

0-4: magic text
4-8: badgerMagicNumber
After this change:

0-4: magic text
4-6: externalMagicNumber
6-8: badgerMagicNumber
(cherry picked from commit 2a9a524)
joshua-goldstein added a commit that referenced this pull request Feb 8, 2023
Badger writes a magic number in the manifest. It helps badger to decide if its current version is compatible with the data on the disk or not. But now the internal data storage of badger is not changed but the data format for dgraph has changed. This causes a problem if someone starts dgraph-2109 on an older dgraph directory. This change adds an external magic number to badger which will help avoid data corruption by causing panic if opening Dgraph on the wrong directory.

There are 8 magic bytes in the manifest.
Prior to this change:

0-4: magic text
4-8: badgerMagicNumber
After this change:

0-4: magic text
4-6: externalMagicNumber
6-8: badgerMagicNumber
(cherry picked from commit 2a9a524)
mangalaman93 pushed a commit that referenced this pull request Feb 9, 2023
mangalaman93 pushed a commit to dgraph-io/dgraph that referenced this pull request Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants