Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split posting lists recursively. #4867

Merged
merged 5 commits into from
Mar 11, 2020
Merged

Split posting lists recursively. #4867

merged 5 commits into from
Mar 11, 2020

Conversation

martinmr
Copy link
Contributor

@martinmr martinmr commented Feb 27, 2020

Currently, split posting lists are split in one go. This means that the
resulting splits will be added to the list even if they are still too
big. This change recursively splits the parts of the lists until all of
them are smaller than the threshold.


This change is Reviewable

Docs Preview: Dgraph Preview

Currently, split posting lists are split in one go. This means that the
resulting splits will be added to the list even if they are still too
big. This change recursively splits the parts of the lists until all of
them are smaller than the threshold.
posting/list.go Outdated Show resolved Hide resolved
Copy link
Contributor

@manishrjain manishrjain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm: Small comment.

Reviewable status: 0 of 2 files reviewed, 2 unresolved discussions (waiting on @manishrjain and @martinmr)


posting/list.go, line 1247 at r2 (raw file):

func (out *rollupOutput) recursiveSplit() {
	// Call splitUpList. Otherwise the map of startUids to parts won't be initialized.
	out.splitUpList()

Do you need to call this here?

Copy link
Contributor Author

@martinmr martinmr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: 0 of 2 files reviewed, 2 unresolved discussions (waiting on @golangcibot and @manishrjain)


posting/list.go, line 1221 at r1 (raw file):

Previously, golangcibot (Bot from GolangCI) wrote…

File is not gofmt-ed with -s (from gofmt)

		}

Done.


posting/list.go, line 1247 at r2 (raw file):

Previously, manishrjain (Manish R Jain) wrote…

Do you need to call this here?

Done. Simplified the logic.

@martinmr martinmr merged commit 5fcb59b into master Mar 11, 2020
martinmr added a commit that referenced this pull request Jun 12, 2020
Currently, split posting lists are split in one go. This means that the
resulting splits will be added to the list even if they are still too
big. This change recursively splits the parts of the lists until all of
them are smaller than the threshold.
martinmr added a commit that referenced this pull request Jul 9, 2020
Currently, split posting lists are split in one go. This means that the
resulting splits will be added to the list even if they are still too
big. This change recursively splits the parts of the lists until all of
them are smaller than the threshold.
@joshua-goldstein joshua-goldstein deleted the martinmr/recursive-splits branch August 11, 2022 20:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants