-
Notifications
You must be signed in to change notification settings - Fork 24.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Transform][Rollup] remove unnecessary list indirection #75459
Conversation
Pinging @elastic/ml-core (Team:ML) |
Pinging @elastic/es-analytics-geo (Team:Analytics) |
@elasticmachine update branch |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall, I like the idea, it does simplify execution paths.
...ugin/transform/src/main/java/org/elasticsearch/xpack/transform/transforms/latest/Latest.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The stream stuff seems like a good choice to me. It looks like it doesn't close over anything sneaky - just the response object which we keep around anyway.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
...ugin/core/src/test/java/org/elasticsearch/xpack/core/indexing/AsyncTwoPhaseIndexerTests.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
...m/src/test/java/org/elasticsearch/xpack/transform/transforms/TransformIndexerStateTests.java
Outdated
Show resolved
Hide resolved
...nsform/src/test/java/org/elasticsearch/xpack/transform/transforms/TransformIndexerTests.java
Outdated
Show resolved
Hide resolved
3484f66
to
0cb6c0a
Compare
💔 Backport failed
To backport manually run: |
#75829) Remove an unnecessary indirection and refactor progress tracking. Both rollup and transform process documents as stream, however in the AsyncTwoPhaseIndexer takes a List of index requests. This change removes the unnecessary temporary container and makes upcoming transform enhancements easier.
Remove an unnecessary indirection and refactor progress tracking. Both rollup and transform process documents as stream, however in the AsyncTwoPhaseIndexer takes a List of index requests. This change removes the unnecessary temporary container and makes upcoming transform enhancements easier.
Remove an unnecessary indirection and refactor progress tracking. Both rollup and transform process documents as stream, however in the
AsyncTwoPhaseIndexer
takes aList
of index requests. This change removes the unnecessary temporary container. This simplification makes upcoming transform enhancements easier.Main changes are in 15afd31
The 2nd commit only applies spotless formatting to files belonging to the transform codebase.