Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Presto sidecar process type #22829

Closed
tdcmeehan opened this issue May 24, 2024 · 0 comments · Fixed by #22854 or #22856
Closed

Add Presto sidecar process type #22829

tdcmeehan opened this issue May 24, 2024 · 0 comments · Fixed by #22854 or #22856
Assignees
Labels
feature request prestissimo Presto Native Execution

Comments

@tdcmeehan
Copy link
Contributor

tdcmeehan commented May 24, 2024

To support RFC-0003, a new process type is introduced, the sidecar. The purpose of the sidecar is to provide a series of endpoints to inform the Presto coordinator of the capabilities of the underlying workers, and to provide a mechanism for the coordinator to use that functionality. In order to support constant folding without relying on coincidental implementations of user-defined functions in Java, for example, either expressions or functions must be executed in C++, and the sidecar can support this. Likewise, the sidecar can be used to inform the coordinator of the function registry and worker-level session properties.

This issue is to add support for the Presto sidecar. It will be implemented as a new process type in Presto, alongside the worker, coordinator, and resource manager. The sidecar will announce itself to the discovery service, as other services do. The coordinator will have some small changes made to change its behavior when the sidecar is expected but not running, for example, it may queue or fail queries.

The sidecar will be externally managed, as with other process types in Presto. It is expected that external orchestration will ensure the sidecar is running. Eventually, the Presto Helm chart will be updated for native clusters to utilize the sidecar, and external users must eventually opt to use the sidecar.

The code for the sidecar will be in the existing presto-native-execution module and will share code with the C++ worker process developed there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request prestissimo Presto Native Execution
Projects
Status: Done
1 participant