Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log reindex bulk request completion #75935

Merged

Conversation

DaveCTurner
Copy link
Contributor

Today we log at DEBUG when we receive a scroll response and send the
bulk request but do not log the completion of the bulk request or the
start of the next scroll request. This makes it impossible to tell from
the logs how long these things are taking.

This commit adds the missing logging.

Today we log at `DEBUG` when we receive a scroll response and send the
bulk request but do not log the completion of the bulk request or the
start of the next scroll request. This makes it impossible to tell from
the logs how long these things are taking.

This commit adds the missing logging.
@DaveCTurner DaveCTurner added >enhancement v8.0.0 :Distributed Indexing/Reindex Issues relating to reindex that are not caused by issues further down v7.15.0 labels Aug 2, 2021
@DaveCTurner DaveCTurner requested a review from martijnvg August 2, 2021 12:07
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Aug 2, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍
Maybe also add the task id to the scroll returned [] documents a scroll id of [ debug log?

@DaveCTurner
Copy link
Contributor Author

I think this message is redundant (unless we care about the scroll ID which I reckon we almost always don't) so I just pushed it down to TRACE.

@martijnvg
Copy link
Member

I think this message is redundant (unless we care about the scroll ID which I reckon we almost always don't) so I just pushed it down to TRACE.

Ok, that is also good with me.

@DaveCTurner DaveCTurner merged commit 35b016c into elastic:master Aug 2, 2021
@DaveCTurner DaveCTurner deleted the 2021-08-02-log-reindex-bulk-completion branch August 2, 2021 14:57
DaveCTurner added a commit that referenced this pull request Aug 2, 2021
Today we log at `DEBUG` when we receive a scroll response and send the
bulk request but do not log the completion of the bulk request or the
start of the next scroll request. This makes it impossible to tell from
the logs how long these things are taking.

This commit adds the missing logging.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Indexing/Reindex Issues relating to reindex that are not caused by issues further down >enhancement Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.15.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants