Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Transform] Allow transforms to use PIT with remote clusters again #104518

Closed
droberts195 opened this issue Jan 18, 2024 · 1 comment · Fixed by #105192
Closed

[Transform] Allow transforms to use PIT with remote clusters again #104518

droberts195 opened this issue Jan 18, 2024 · 1 comment · Fixed by #105192
Labels
>enhancement :ml/Transform Transform Team:ML Meta label for the ML team

Comments

@droberts195
Copy link
Contributor

In #99803 we disabled the use of PIT for transforms with remote source indices. This was done because, at that time, PIT could be very inefficient and unreliable in the presence of many thousands of source indices, and CCS scenarios are most likely to have thousands of source indices.

Now that #104288 has been fixed it should be safe to revert the changes of #99803. This isn't desperately urgent but should not be forgotten. We should aim to do it for 8.13 if there's time.

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml/Transform Transform Team:ML Meta label for the ML team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants