Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[columnar] [bug] panic query on select count(*) from .. #170

Merged
merged 1 commit into from
Oct 17, 2023
Merged

Conversation

mkaruza
Copy link
Contributor

@mkaruza mkaruza commented Oct 11, 2023

  • When stripe assignment for next parallel worker is executing we iterate sequentially to find next stripe that will be used. That could be expensive - especially if number of stripes for table is big. During this loop we are holding shared mutex that will abort if held to long.

  • Fixed by using second column from index to faster assign stripe for worker.

@millken
Copy link

millken commented Oct 13, 2023

When can this PR be merged?

Copy link
Contributor

@JerrySievert JerrySievert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you please add a test for the regression?

@mkaruza
Copy link
Contributor Author

mkaruza commented Oct 16, 2023

can you please add a test for the regression?

This PR only addresses part of code that could potentially be critical and one to blame based on bug report output and infromation. I was not able to reproduce issue so no test could be created. PR changes execution of parallel worker assignments, so any test that is already in regression and execute parallel execution is one that is testing this PR.

* When stripe assignment for next parallel worker is executing we
  iterate sequentially to find next stripe that will be used. That
  could be expensive - especially if number of stripes for table is big.
  During this loop we are holding shared mutex that will abort if held
  to long.

* Fixed by using second column from index to faster assign
  stripe for worker.
@wuputah
Copy link
Member

wuputah commented Oct 16, 2023

rebased, can merge if build passes.

@wuputah wuputah merged commit 35b0553 into main Oct 17, 2023
@wuputah wuputah deleted the github#168 branch October 17, 2023 00:26
This was referenced Oct 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants