-
Notifications
You must be signed in to change notification settings - Fork 3.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
execinfra: remove MetadataTest* processors #57838
Conversation
What's the motivation for removing this now rather than waiting until we have the testing you mention in your comment? |
The motivation is that these processors are not that useful - the only thing they can test is that some metadata is propagated through the row-based flow, note that they don't test whether all necessary metadata is emitted (for example, whether I believe having the testing framework I mentioned for the vectorized engine and having these processors are orthogonal issues since they would work in different scenarios, so the question is whether it is ok to remove these processors at all without introducing some other testing mechanism for the row-based flow and when it is ok to do so. I think it is ok to remove these processors without putting anything in their place since they already don't provide much value, but it is not urgent to do so, so we can keep this PR in the backlog for now if you prefer. |
Ok, let's put it on the backlog for now. |
This commit removes `MetadataTestSender` and `MetadataTestReceiver` processors since they no longer provide much value. I believe they were introduced when we added a `ProducerMetadata` as a return parameter to `Next` method in order to ensure that at least some artificial metadata is propagated correctly throughout the whole flow. The main goal of this commit is the removal of `fakedist-metadata` and `5node-metadata` logic test configs in order to speed up the CI time. The justification for removal of these processors without putting in their place is that these processors are not that useful - the only thing they can test is that *some* metadata is propagated through the row-based flows. Note that they don't test whether all necessary metadata is emitted (for example, whether `LeafTxnFinalState`). We've using the vectorized engine as the default for a while now, and these processors don't get planned with the vectorized flows. Thus, it seems silly to have a logic test config like `fakedist-metadata` that is part of the default configs. Release note: None
I revived this PR and would like to push it over the line. Previously, there was a pushback from Alfonso that we shouldn't remove testing infra without putting anything in place, but I'm arguing that the existing testing infra that is being removed here has essentially zero value:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 22 of 22 files at r1, all commit messages.
Reviewable status: complete! 1 of 0 LGTMs obtained (waiting on @michae2)
TFTR! bors r+ |
Build succeeded: |
This commit removes
MetadataTestSender
andMetadataTestReceiver
processors since they no longer provide much value. I believe they were
introduced when we added a
ProducerMetadata
as a return parameter toNext
method in order to ensure that at least some artificial metadatais propagated correctly throughout the whole flow.
The main goal of this commit is the removal of
fakedist-metadata
and5node-metadata
logic test configs in order to speed up the CI time.The justification for removal of these processors without putting anything
in their place is that these processors are not that useful - the only
thing they can test is that some metadata is propagated through the
row-based flows. Note that they don't test whether all necessary
metadata is emitted (for example, whether
LeafTxnFinalState
). We'vebeen using the vectorized engine as the default for a while now, and these
processors don't get planned with the vectorized flows. Thus, it seems
silly to have a logic test config like
fakedist-metadata
that is partof the default configs.
Addresses: #57268.
Release note: None