Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use sparse bitset to store docs in SingleValueDocValuesFieldUpdates [LUCENE-8599] #9645

Closed
asfimport opened this issue Dec 10, 2018 · 6 comments

Comments

@asfimport
Copy link

asfimport commented Dec 10, 2018

Using a sparse bitset in SingleValueDocValuesFieldUdpates allows storing
which documents have an update much more efficient and prevents the need
to sort the docs array altogether that showed to be a significant bottleneck
in #9644. Using the spares bitset yields another 10x performance improvement
in applying updates versus the changes proposed in #9644.


Migrated from LUCENE-8599 by Simon Willnauer (@s1monw), resolved Dec 10 2018
Pull requests: apache/lucene-solr#522

@asfimport
Copy link
Author

asfimport commented Dec 10, 2018

ASF subversion and git services (migrated from JIRA)

Commit ef61b54 in lucene-solr's branch refs/heads/master from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ef61b54

LUCENE-8599: Use sparse bitset to store docs in SingleValueDocValuesFieldUpdates

Using a sparse bitset in SingleValueDocValuesFieldUdpates allows storing
which documents have an update much more efficient and prevents the need
to sort the docs array altogether that showed to be a significant bottleneck
in #9644. Using the spares bitset yields another 10x performance improvement
in applying updates versus the changes proposed in #9644.

@asfimport
Copy link
Author

asfimport commented Dec 10, 2018

ASF subversion and git services (migrated from JIRA)

Commit 300d093 in lucene-solr's branch refs/heads/branch_7x from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=300d093

LUCENE-8599: Use sparse bitset to store docs in SingleValueDocValuesFieldUpdates

Using a sparse bitset in SingleValueDocValuesFieldUdpates allows storing
which documents have an update much more efficient and prevents the need
to sort the docs array altogether that showed to be a significant bottleneck
in #9644. Using the spares bitset yields another 10x performance improvement
in applying updates versus the changes proposed in #9644.

@asfimport
Copy link
Author

asfimport commented Dec 11, 2018

ASF subversion and git services (migrated from JIRA)

Commit ef61b54 in lucene-solr's branch refs/heads/jira/http2 from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=ef61b54

LUCENE-8599: Use sparse bitset to store docs in SingleValueDocValuesFieldUpdates

Using a sparse bitset in SingleValueDocValuesFieldUdpates allows storing
which documents have an update much more efficient and prevents the need
to sort the docs array altogether that showed to be a significant bottleneck
in #9644. Using the spares bitset yields another 10x performance improvement
in applying updates versus the changes proposed in #9644.

@asfimport
Copy link
Author

ASF subversion and git services (migrated from JIRA)

Commit 61e4486 in lucene-solr's branch refs/heads/master from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=61e4486

LUCENE-8599: Add hasNoValue bitset to ramBytesUsed calculation

@asfimport
Copy link
Author

ASF subversion and git services (migrated from JIRA)

Commit 7a6f03c in lucene-solr's branch refs/heads/branch_7x from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=7a6f03c

LUCENE-8599: Add hasNoValue bitset to ramBytesUsed calculation

@asfimport
Copy link
Author

ASF subversion and git services (migrated from JIRA)

Commit 61e4486 in lucene-solr's branch refs/heads/jira/http2 from @s1monw
https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=61e4486

LUCENE-8599: Add hasNoValue bitset to ramBytesUsed calculation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant