Add release notes for 0.252 #16013
Merged
Add release notes for 0.252 #16013
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
|
mayankgarg1990
suggested changes
Apr 27, 2021
|
|
||
| General Changes | ||
| _______________ | ||
| * Fix hanging join operator when spill is enabled and the probe side finishes before the hash builder starts. |
There was a problem hiding this comment.
Fix the join operator to prevent hanging when spill is enabled and the probe side finishes before the hash builder starts
There was a problem hiding this comment.
*spilling is enabled
| _______________ | ||
| * Fix hanging join operator when spill is enabled and the probe side finishes before the hash builder starts. | ||
| * Add file based password authenticator plugin. | ||
| * Add new spilling strategy to spill when the user + system + revocable memory on a node exceeds max_total_memory_per_node. This can be enabled by setting ``experimental.spiller.task-spilling-strategy`` to ``PER_QUERY_MEMORY_LIMIT``. |
There was a problem hiding this comment.
Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. This can be enabled by setting the system configuration ``....`` to ``...``.
| * Fix hanging join operator when spill is enabled and the probe side finishes before the hash builder starts. | ||
| * Add file based password authenticator plugin. | ||
| * Add new spilling strategy to spill when the user + system + revocable memory on a node exceeds max_total_memory_per_node. This can be enabled by setting ``experimental.spiller.task-spilling-strategy`` to ``PER_QUERY_MEMORY_LIMIT``. | ||
| * Add support for logging formatted prepared query. This could be enabled by setting session property ``log_formatted_query_enabled`` to ``true``. |
There was a problem hiding this comment.
This can be enabled ...
| * Add file based password authenticator plugin. | ||
| * Add new spilling strategy to spill when the user + system + revocable memory on a node exceeds max_total_memory_per_node. This can be enabled by setting ``experimental.spiller.task-spilling-strategy`` to ``PER_QUERY_MEMORY_LIMIT``. | ||
| * Add support for logging formatted prepared query. This could be enabled by setting session property ``log_formatted_query_enabled`` to ``true``. | ||
| * Add support for passthrough Elasticsearch queries. |
There was a problem hiding this comment.
Move to elasticsearch connector
There was a problem hiding this comment.
We should frame this better -
Add support for running Presto queries over the results of Elasticsearch queries. See :doc:`connector/elasticsearch` on how to use it
@aweisberg to confirm if I rephrased this correctly
There was a problem hiding this comment.
Yes sort of. We already supported it. The difference is these are passthrough in that you don't need to escape the query contents because they are base32 encoded.
Maybe
Add support for running base32 encoding ElasticSearch queries that are passed through. See :doc:`connector/elasticsearch` on how to use it
| * Add support for returning partial results for the queries by setting `partial_results_enabled` session property. Additionally `partial_results_max_execution_time_multiplier`, `partial_results_completion_ratio_threshold` session properties can be set to configure the max execution time multiplier and minimum completion ratio threshold for the queries. | ||
| * Add automatic query retry functionality for transient failures. This can be enabled by setting per-query-retry-limit to a non-zero integer to indicate the per query retry count. | ||
| * Store dictionary elements in Segmented Slice. | ||
| * Update /v1/info/state API to mark coordinator active when 1) state is not shutting down, 2) active workers >= minimum required workers. |
There was a problem hiding this comment.
Add support to coordinator endpoint ``/v1/info/state`` to return ``ACTIVE`` when the coordinator is not shutting down and the cluster has the minimum required workers.
|
|
||
| Hive Changes | ||
| ____________ | ||
| * Enable timeout by default in Alluxio. |
There was a problem hiding this comment.
Update Alluxio cache config property ``cache.alluxio.timeout-enabled`` to be ``true`` by default.
|
|
||
| JDBC Changes | ||
| ____________ | ||
| * Implement ``toString()`` for ``java.sql.Array`` results. |
There was a problem hiding this comment.
Add support to serialize ``PrestoArray`` to a string.
| Presto On Spark Changes | ||
| _______________________ | ||
| * Improve bucketed table write parallelism. | ||
| * Fix a bug when Presto on Spark doesn't start because the temporary storage is not initialized |
|
|
||
| General Changes | ||
| _______________ | ||
| * Fix hanging join operator when spill is enabled and the probe side finishes before the hash builder starts. |
There was a problem hiding this comment.
*spilling is enabled
| **Highlights** | ||
| ============== | ||
| * Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. | ||
| * Add support for logging formatted prepared query. |
There was a problem hiding this comment.
Is this highlight worthy ?
|
|
||
| **Highlights** | ||
| ============== | ||
| * Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. |
There was a problem hiding this comment.
Is this highlight worthy?
| ============== | ||
| * Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. | ||
| * Add support for logging formatted prepared query. | ||
| * Add support to coordinator endpoint ``/v1/info/state`` to return ``ACTIVE`` when the coordinator is not shutting down and the cluster has the minimum required workers. |
There was a problem hiding this comment.
Is this highlight worthy ?
For me highlights is something significantly new. These things are listed in the section just below - so we don't need to highlight everything.
| * Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. | ||
| * Add support for logging formatted prepared query. | ||
| * Add support to coordinator endpoint ``/v1/info/state`` to return ``ACTIVE`` when the coordinator is not shutting down and the cluster has the minimum required workers. | ||
| * Add support for returning partial results for the queries and max execution time multiplier and minimum completion ratio threshold for the queries. |
There was a problem hiding this comment.
Add support for returning partial results should be enough
| ============== | ||
| * Add support for returning partial results. | ||
| * Add automatic query retry functionality for transient failures. | ||
| * Add support for running base32 encoding ElasticSearch queries that are passed through. |
There was a problem hiding this comment.
Fix this one as well
| * Fix the join operator to prevent hanging when spilling is enabled and the probe side finishes before the hash builder starts | ||
| * Add new spilling strategy to spill when a combination of user, system and recovable memory on a node exceeds ``max_total_memory_per_node``. This can be enabled by setting the system configuration ``experimental.spiller.task-spilling-strategy`` to ``PER_QUERY_MEMORY_LIMIT``. | ||
| * Add support for logging formatted prepared query. This can be enabled by setting session property ``log_formatted_query_enabled`` to ``true``. | ||
| * Add support for returning partial results for the queries by setting ``partial_results_enabled`` session property. Additionally ``partial_results_max_execution_time_multiplier``, ``partial_results_completion_ratio_threshold`` session properties can be set to configure the max execution time multiplier and minimum completion ratio threshold for the queries. |
There was a problem hiding this comment.
nit: there is an extra space before session properties can be
|
|
||
| General Changes | ||
| _______________ | ||
| * Fix the join operator to prevent hanging when spilling is enabled and the probe side finishes before the hash builder starts |
|
|
||
| Security Changes | ||
| ________________ | ||
| * Add file based password authenticator plugin. See :doc:`security/password-file`. |
There was a problem hiding this comment.
this URI also probably needs fixing. Please generate the HTML pages and check that everything looks correct
There was a problem hiding this comment.
Did you check if this works ? I don't think that this is correct
There was a problem hiding this comment.
Yeah, I'm sorry - I missed adding the change to the commit before pushing it.
There was a problem hiding this comment.
It works now.
vaishnavibatni
force-pushed
the
release-notes-0.252
branch
3 times, most recently
from
f2d98f1
to
6bf1854
Compare
vaishnavibatni
force-pushed
the
release-notes-0.252
branch
from
6bf1854
to
d90c7dc
Compare
mayankgarg1990
approved these changes
May 3, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Missing Release Notes
Andrii Rosa
Chi Tsai
Tal Galili
Extracted Release Notes
per-query-retry-limitto a non-zero integer to indicate the per query retry count.experimental.spiller.task-spilling-strategytoPER_QUERY_MEMORY_LIMIT.partial_results_enabledsession property. Additionallypartial_results_max_execution_time_multiplier,partial_results_completion_ratio_thresholdsession properties can be set to configure the max execution time multiplier and minimum completion ratio threshold for the queries.toString()forjava.sql.Arrayresults.log_formatted_query_enabledtotrue.All Commits