Release notes for 359

[martint]

Ashhar Hasan

• all checked
• 06-02 06:42:40 4bd272c Add product test launcher 'env describe' command
• 06-04 13:36:34 9ad26b4 Provide session timezone information in Query UI
• 06-07 07:59:50 67b8afc Re-enable testLargeIn tests on MemSQL
• 06-07 07:59:50 efec16f Lower MemSQL disk usage in tests
• 06-07 08:01:44 11bcc0f Extract regr_intercept, regr_slope pushdown tests to BaseJdbcConnectorTest
• 06-07 08:01:44 7299a61 Extract corr pushdown tests to BaseJdbcConnectorTest
• 06-07 08:01:44 996d8c1 Extract stddev_samp, stddev_pop pushdown tests to BaseJdbcConnectorTest
• 06-07 08:01:44 c0b2feb Extract var_samp, var_pop pushdown tests to BaseJdbcConnectorTest
• 06-07 08:01:44 e877ff0 Extract covar_samp, covar_pop pushdown tests to BaseJdbcConnectorTest
• 06-07 08:01:44 eb25392 Extract basic aggregation pushdown tests into BaseJdbcConnectorTest
• 06-07 22:23:44 f392a55 Add bing_tile_quadkey() to list.rst
• 06-09 03:41:00 16395a1 Convert oracle timestamp with time zone test to SqlDataTypeTest
• 06-09 03:41:00 4af5702 Convert oracle date test to SqlDataTypeTest
• 06-09 03:41:00 94cac3c Remove oracle legacy timestamp test
• 06-09 03:41:00 dc83efc Convert oracle timestamp test to SqlDataTypeTest
• 06-10 04:46:17 3ea7afa Remove obsolete Cli class
• 06-15 06:00:02 9bbb991 Document the oauth2 callback/redirect URL
• 06-17 22:17:55 07f7269 Add Redshift requirements
• 06-22 03:39:48 323105f Add new cli argument 'option' to test run and env up
• 06-22 03:39:48 3bd411f Add singlenode-compatibility PT environment
• 06-22 03:39:48 5f17fc3 Pass extra options to test runs from suite run
• 06-22 03:39:48 ad66e2a Create suite-compatibility and add Hive view compatibility tests
• 06-22 03:39:48 eb8e7f4 Clarify comments
• 06-22 12:36:36 e817259 Add requirements to Accumulo connector
• 06-22 12:58:22 bc4d864 Add requirements to MemSQL connector
• 06-23 07:27:04 2a685cc Rename arrayToPrestoType method to arrayToTrinoType
• 06-23 11:18:44 97af1be Fix handling of multiple LDAP user bind patterns
• 06-24 13:17:12 c7c47c8 Add requirements for Kudu connector
• 06-28 08:40:06 f2b6d09 Push topN to Phoenix unconditionally
• 06-28 08:41:57 48519ff Support TIMESTAMPS with precisions higher than 3 in MySQL

Dain Sundstrom

• all checked
• 06-14 21:15:15 7c1a277 Migrate ListenableFuture<?> to ListenableFuture
• 06-22 11:33:40 bcf6c58 Fix user mapping with password authenticator
• 06-22 11:33:40 bd01de0 Fix web UI support for user mapping in form login
• 06-23 09:59:46 daffd0e Add automatic internal communications HTTPS configuration
• 06-25 11:06:44 06c98df Improve DistinctLimitOperator

David Phillips

• all checked
• 06-01 18:21:51 022a266 Rename Hive connector "hive-hadoop2 to "hive"
• 06-02 10:29:09 0ef47d9 Update to Error Prone 2.7.1
• 06-02 10:29:09 386b5ea Validate result of Iterator.hasNext() in test
• 06-02 10:29:09 47243c7 Update to Jdbi 3.20.0
• 06-02 10:29:09 9d81c32 Fix usage of Optional.orElseThrow() for side effects
• 06-02 11:12:30 b9813d9 Remove dash as allowed character for environment
• 06-02 11:29:14 9fb818a Remove outdated compatible substitute for TrinoContainer
• 06-02 11:29:14 c637346 Simplify version code in JDBC compatibility test
• 06-02 13:44:05 ff4a1e3 Remove unused Hive allow-corrupt-writes config
• 06-04 10:42:43 a6c376d Update multiple event listeners to add config property
• 06-04 10:43:12 1a4672b Fix from_iso8601_timestamp_nanos examples
• 06-07 18:38:27 3112e04 Cleanup JsonCodec bindings in server module
• 06-07 22:58:24 d95eafe Clarify metastore filtering and remove unnecessary code
• 06-07 23:01:29 7e44c84 Deprecate embedded discovery service config property
• 06-07 23:43:48 9e7c047 Move Hadoop file system cache into Trino
• 06-18 13:21:23 9950ff3 Remove usage of /v1/info for JDBC driver
• 06-21 22:06:43 475a048 Remove Airlift JSON from clients
• 06-21 22:06:43 cf7e9b8 Remove Airlift logging from clients
• 06-21 22:06:43 d13e7f3 Remove Airlift security from clients
• 06-21 22:06:43 d7bc504 Remove Airlift concurrent from clients
• 06-21 22:06:43 dabd7fe Remove log levels option from CLI
• 06-21 22:16:57 26c9058 Allow specifying CLI output formats in lowercase
• 06-21 22:18:16 1e832c7 Add network debug logging option to CLI
• 06-23 07:07:56 78fcd46 Update to Parquet 1.12.0
• 06-25 10:52:17 1432d6b Add requirements for ClickHouse connector
• 06-25 10:52:39 f9f6844 Add requirements for Druid connector
• 06-25 10:59:51 5288cbb Clarify metastore cache property
• 06-25 11:19:49 52f5e7d Add page for JWT authentication
• 06-25 14:12:23 6bc2594 Reorder functions and operators list alphabetically

GitHub

• all checked
• 06-02 06:44:07 57b3155 Add example of murmur3 function usage
• 06-03 14:23:24 e326ab9 Avoid including hive views in iceberg SHOW TABLES
• 06-04 10:58:44 1c63f5b Add documentation for CURRENT_CATALOG and CURRENT_SCHEMA
• 06-04 11:04:20 00080c8 Add description for timezone for TIME types
• 06-07 15:35:20 ab8095d Fix formatting errors in role documentation (Fix formatting errors in role documentation #8205)
• 06-15 05:59:23 ea01a50 Fix order_by ClickHouse table property example
• 06-20 00:12:41 89bde4f Update esri-geometry-api to 2.2.4

Grzegorz Kokosiński

• all checked
• 06-02 06:31:07 ee0bdb2 Add javadocs to ColumnHandle and ConnectorTableHandle
• 06-21 06:01:38 dbf5d40 Configure SSL for Hydra IdP in product tests
• 06-22 03:55:33 2734d84 Fix flaky TestJdbcConnection
• 06-22 12:46:22 96502ac Add INSERT and DELETE to GRANT/REVOKE tests
• 06-22 12:46:22 9edca85 Add support for GRANT UPDATE statement
• 06-24 03:57:52 0b0e411 Fix BaseConnectorSmokeTest#testDelete
• 06-24 03:57:52 13c3a72 Move abstract onRemoteDatabase() to the top
• 06-24 03:57:52 8f8b3e5 Remove repeating defaults in BaseJdbcConnectorTest
• 06-24 03:57:52 b3ac41a Use BaseJdbcConnectorTest for BaseDruidConnectorTest
• 06-28 09:13:40 2ff6be7 Remove extra @test annotation on class
• 06-28 09:13:40 d4bfb26 Do not inject JwkService in guice manually

Karol Sobczak

• all checked
• 06-02 05:40:14 a499398 Introduce PageJoiner interface
• 06-02 05:40:14 f2f7ace Rename PageJoiner to DefaultPageJoiner
• 06-07 01:54:42 0c08dd6 Avoid referencing WindowOperator directly from its info supplier
• 06-07 01:54:42 285a23c Declare OperatorContext#infoSupplier to be a covariant Supplier
• 06-07 01:54:42 4ab192e Reduce retained references in TableFinishOperator info supplier
• 06-07 01:54:42 7870948 Reduce retained references in PartitionedOutputOperator info supplier
• 06-07 01:54:42 d1d0bbd Reduce retained references in TableWriterOperator info supplier
• 06-07 01:54:42 e28ac8c Clear live references to info suppliers in OperatorContext#destroy()
• 06-07 01:54:42 f522956 Use instance supplier for scan operator info
• 06-07 02:13:13 36919a4 Fix ValidateLimitWithPresortedInput for multiple sorted inputs
• 06-07 08:04:51 5681d44 Enhance join tests
• 06-07 08:05:36 7ff9a66 Format javadocs
• 06-07 08:05:36 ce5173a Fix typo
• 06-07 08:06:31 42a6456 Fix columns listing for materialized views
• 06-07 08:06:31 5576739 Implement listMaterializedViews in iceberg
• 06-07 08:06:31 6eb763c Inline fixed implementations in BaseConnectorTest
• 06-07 08:06:31 85f395a Add listMaterializedViews SPI
• 06-07 08:06:31 d1417dc Add getMaterializedViews SPI
• 06-07 08:06:31 e4cae79 Add MV listing APIs to HiveMaterializedViewMetadata
• 06-07 08:39:26 856aaf5 Fix warnings in benchmark class
• 06-07 08:39:26 ab961d9 Extract method
• 06-07 08:39:26 cf52219 Extract methods to BenchmarkFileFormatsUtils
• 06-07 12:44:20 79830cd Extract JoinTestUtils
• 06-08 01:07:02 557ff7b Move assignment above validation
• 06-08 01:07:02 869a5b2 Add HiveMaterializedViewMetadata#refreshMaterializedView
• 06-08 01:07:02 d8787a5 Enable connector to perform materialized view refresh itself
• 06-08 01:14:31 94d5904 Update table type validation in FileHiveMetastore
• 06-08 13:18:17 a374404 Fix typo in method name
• 06-08 13:42:47 5cec3fd Remove unused assignment
• 06-09 06:49:22 760fce8 Use HiveMetastoreClosure in HiveMaterializedViewMetadataFactory
• 06-10 04:20:01 c99dd0f Pass filter information to OperatorFactories
• 06-11 01:28:51 43fe897 Fix flaky test
• 06-11 07:21:55 8d6e113 Allow MATERIALIZED_VIEW in FileHiveMetastore
• 06-18 02:37:12 0528e8b Add assertEventually overload with retryFrequency
• 06-28 05:46:04 39b0af8 Remove unused parameters

Martin Traverso

• all checked
• 06-11 11:33:16 a06b507 Remove illegal overload version for hash_counts function
• 06-11 11:33:16 f4cc1fb Add test for setdigest functions
• 06-16 08:02:25 ca5426e Set default time zone for the current session
• 06-18 12:39:01 b41d388 Add support for generic parameters in make_set_digest function
• 06-18 12:59:12 6b453ea Ignore VSCode config folder
• 06-18 14:35:20 3fe0bc2 Fix incorrect pushdown if IS NULL predicate in Elasticsearch
• 06-18 16:26:00 3aef9d7 Document luhn_check function
• 06-18 16:26:00 9624dec Remove trailing spaces
• 06-21 09:40:20 f225b18 Fix failure when indexes share same alias

Piotr Findeisen

• all checked
• 06-07 04:52:02 c64d7ed Remove unused deprecated methods
• 06-07 07:05:31 02eb24b Print full thread dump when tests hang
• 06-08 02:32:47 37e560b Update Phoenix 5 client to 5.1.2
• 06-08 07:33:53 b6802bd Enable maven --strict-checksums on CI
• 06-08 13:13:52 5342d7a Fix exception message
• 06-08 13:18:09 2922630 Fix getPartitionNamesByFilter for Glue metastore
• 06-09 04:01:31 1ffe391 Rename isTopNLimitGuaranteed to isTopNGuaranteed
• 06-09 15:00:37 e24a3a6 Remove redunant limitation
• 06-11 01:56:22 25295d0 Keep Ldap product tests together
• 06-11 02:41:47 79b34c5 Build AcidInfo only for ORC-ACID tables
• 06-14 03:07:19 2530a43 Increase testShowSchemasLikeWithEscape robustness
• 06-14 03:30:20 0d5ae90 Guarantee limit for broker queries
• 06-14 03:30:20 2cd0add Remove enforced filter for Pinot segment queries
• 06-14 03:30:20 3c1ee4e Fix mixed case column handling
• 06-14 03:30:20 92ec228 Refactor PinotQueryBuilder.getFilterClause
• 06-14 03:30:20 adf0fe2 Extract pinot catalog name
• 06-14 03:30:20 f0d49a7 Remove TestMinimalFunctionality
• 06-14 03:43:47 8270d00 Test UPDATE with subquery predicate
• 06-14 03:43:47 cab7620 Support uncorrelated subquery in UPDATE assignments (SET)
• 06-14 03:43:47 fec1539 Fix typo
• 06-14 05:48:27 54935cb Validate no delete deltas for a non full ACID table
• 06-14 05:48:27 f214021 Avoid variable reassignment
• 06-14 10:39:48 0a239c9 Move method above helpers
• 06-14 10:39:48 726b865 Retain more cached information upon insert
• 06-14 10:39:48 8a3aa91 Provide better onDataChanged overload
• 06-14 10:40:11 bebc1a7 Update Tempto to 185
• 06-16 04:46:13 f91e144 Use shorter form of VARCHAR literal
• 06-16 06:27:35 8ed1f44 Expose Hive metastore debug port in Launcher
• 06-16 06:27:35 f2837d6 Remove unused method
• 06-17 00:45:48 50a6c69 Test MySQL JDBC URL verification
• 06-18 02:18:23 800e711 Exclude snakeyaml from the build
• 06-21 01:33:04 081860c Remove redundant else
• 06-21 01:33:04 dda757f Simplify assignment
• 06-21 01:33:36 18a3da3 Propagate runtime errors in ExpressionInterpreter
• 06-21 03:26:27 2602248 Encode unbounded varchar value without a CAST
• 06-21 03:26:27 d0037b3 Simplify code
• 06-21 05:10:36 01670f3 Bump mysql-connector-java to 8.0.22
• 06-22 00:51:53 3e32354 Reset glue partition fetcher use getGetPartitionThreads
• 06-22 03:31:29 472eae5 Fix system.metadata.table_comments for views and MVs
• 06-23 06:24:54 f39b4d8 Refactor HiveMetadataFactory
• 06-24 08:05:14 37813cd Make several static methods public for table redirection
• 06-24 08:05:14 ea5d988 Move isIcebergTable to HiveUtils
• 06-24 12:56:06 7458520 Add test for hive views with unions

Pratham

• all checked
• 06-10 16:25:12 41ff64c Validate ordinal based grouping expressions during analysis
• 06-17 09:00:51 e38bfbb Fix typo in Iceberg connector documentation

Praveen Krishna

• all checked
• 06-24 07:13:37 56def91 Capture column level dependency for Set Operators

Yuya Ebihara

• all checked
• 06-05 19:00:46 1fc5895 Fix wrong result due to column position mismatch in BigQuery
• 06-26 17:49:38 0a15dd8 Create MongoDB index for _schema collection only if absent

kasiafi

• all checked
• 06-06 01:18:31 89fd2ec Handle row ambiguous dereference as semantic error
• 06-21 09:47:59 181eaf1 Plan row pattern matching in window
• 06-21 09:47:59 285a8b5 Fix printing rowsPerMatch option in PlanPrinter
• 06-21 09:47:59 34d8485 Fix planning of pattern navigation offset
• 06-21 09:47:59 378ab0d Add builders and matchers for testing plans with PatternRecognitionNode
• 06-21 09:47:59 53deff6 Fix window frame check
• 06-21 09:47:59 731ecac Add rule to prune PatternRecognitionNode's source columns
• 06-21 09:47:59 768f1c1 Add rule for merging PatternRecognitionNodes
• 06-21 09:47:59 8d64c90 Do not use grouped execution for PatternRecognitionNode
• 06-21 09:47:59 96567d8 Analyze pattern recognition clauses in window and window measures
• 06-21 09:47:59 9c20aa0 Extract method for planning window specification
• 06-21 09:47:59 9d97193 Analyze components of window frame with pattern recognition
• 06-21 09:47:59 a4e75b7 Support window functions in PatternRecognitionNode
• 06-21 09:47:59 a58d031 Extract frameExtent from windowFrame in grammar
• 06-21 09:47:59 baa266e Add project-off rule for PatternRecognitionNode
• 06-21 09:47:59 c1b3a9e Skip window function's FrameInfo in pattern recognition context
• 06-21 09:47:59 c92ec68 Support pattern matching in area reduced to window frame
• 06-21 09:47:59 d10354b Test window with row pattern recognition in queries
• 06-21 09:47:59 dc84283 Support row pattern matching in window: grammmar and AST
• 06-21 09:47:59 e07bc55 Add constructor checks for PatternRecognitionNode
• 06-21 09:47:59 f1f558e Move CorrelationSupport to Visitor's context in ExpressionAnalyzer
• 06-21 09:47:59 f304a34 Add tests for pruning unused calls over window with pattern matching
• 06-21 09:47:59 f98fe48 Support row pattern measures over window: grammmar and AST

Łukasz Osipiuk

• all checked
• 06-08 02:39:40 5d2d7e7 Take BUCKET_ID column into account when applying delete_delta
• 06-08 02:39:40 af40c87 Change ORC ACID row_id columns order
• 06-10 05:53:05 0593a8e Add missing test groups
• 06-10 05:53:05 ba99e68 Bump version of coral to 1.0.60
• 06-14 05:27:47 3538624 Use Trino instead of Presto in TestHiveTransactionalTable
• 06-23 03:27:05 41cc087 Introduce hidden $approx_set aggregation
• 06-23 03:27:05 55cba82 Support $approx_set as a column statistics aggregation
• 06-24 11:41:27 2ee7c94 Restore non-cancellable DispatchQueryCreationFuture
• 06-24 23:15:36 045a130 Use actual pattern type when compiling LIKE pattern
• 06-24 23:15:36 04bf254 Inlike getVarcharType
• 06-24 23:15:36 522a48f Fix LIKE with char
• 06-24 23:15:36 53bc515 Fix typo
• 06-24 23:15:36 ddea70a Remove unused method
• 06-25 06:40:07 adfe91e Revert "Add test for hive views with unions"
• 06-25 10:08:22 aee5058 Basic result stability tests for $approx_set
• 06-28 02:25:04 55320ba Run ElasticSearch tests
• 06-28 02:25:04 86a5984 Fix flaky test testSelectInformationSchemaForMultiIndexAlias in elastic

[sopel39]

Iceberg
* Do not include Hive views in `SHOW TABLES` query results. ({issue}`8153`)

#8153

[hashhar]

Web UI
* Show session timezone in query details page on web UI. ({issue}`4196`)

#4196, #7929

[ebyhr]

BigQuery
* Fix incorrect results when accessing BigQuery records with wrong index. ({issue}`8183`)

#8183, #8201

[sopel39]

General
* Reduce query memory footprint. ({issue}`8086`)

#8086

[sopel39]

General
* Fix query failure for certain queries with `ORDER BY ... LIMIT` on sorted data. ({issue}`8184`)

#8184

[sopel39]

SPI
* Introduce `ConnectorMetadata#listMaterializedViews` for listing materialized view names. ({issue}`8113`)
* Introduce `ConnectorMetadata#getMaterializedViews` for getting materialized view definitions. ({issue}`8113`)

General
* List materialized view columns in `information_schema.columns` table ({issue}`8113`)

#8113

[sopel39]

SPI
* Enable connector to delegate materialized view refresh to itself. ({issue}`7960`)

#7960

[losipiuk]

Hive
* Add support for Hive views which use GROUP BY over a subquery that also uses GROUP BY on matching columns. ({issue}`7635`)

#8168
#7635

[findepi]

Hive
* Fix query failure when reading from a non-ORC insert-only transactional table. ({issue}`8259`)

#8259

[losipiuk]

Hive
* Correct how delete markers are interpreted for ORC ACID tables, 
  so Trino is not filtering out extraneous rows for certain tables. ({issue}`8208`)

#8208

[martint]

* Add support for {doc}`/sql/set-time-zone`. ({issue}`8112`)

#8135

[martint]

## Elasticsearch
* Fix potential incorrect results when queries contain an `IS NULL` predicate. ({issue}`3605`)

#3605

[martint]

## Elasticsearch
* Fix failure when multiple indexes share the same alias. ({issue}`8158`)

#8158

[kasiafi]

General
* Support row pattern recognition as part of window specification.

#8141
(there was no corresponding issue)

[findepi]

Hive
* Use multiple threads for getting partitions from Glue metastore. ({issue}`8320`)
* Respect `hive.metastore.glue.get-partition-threads` configuration property. ({issue}`8320`)

#8320

[findepi]

General
* Return view's and materialized view's comments in `system.metadata.table_comments`. Previously, the views and materialized
  views were reported as if having no comment. ({issue}`8327`)

#8327

[dain]

Security
* Fix user mapping for password authentication.  Formally, user mapping for password authentication would result in a spurious impersonation check. ({issue}`7027`) 

#7027

[kokosing]

General
* Add support for `GRANT UPDATE` statement. ({issue}`8279`)

HIve
* Add support for `GRANT UPDATE` statement, when `hive.security=sql-standard` is used. ({issue}`8279`) 

#8279

[dain]

Security
* Add automatic configuration of HTTPS for internal Trino communications.  Simply, set `internal-communication.https.required` and set an `internal-communication.shared-secret`, and Trino will automatically configure TLS between all Trino processes. ({issue}`7954`) 

#7954

[hashhar]

Security
* Fix handling of multiple LDAP user bind patterns. ({issue}`8134`)

#8134

[losipiuk]

General
* Fix incorrect query results for certain queries with `WHERE` using `LIKE` with pattern against `char` columns. ({issue}`8311`)

#8311, #8313

[ebyhr]

MongoDB
* Skip creating an index for `_schema` collection if it already exists. Previously, it caused an unauthorized error when an user doesn't have the enough privilege ({issue}`8264`)

#8264, #8321

[hashhar]

MySQL
* Support reading and writing ``TIMESTAMP`` values with precision higher than 3. ({issue}`6910`)
* Support predicate pushdown on ``TIMESTAMP`` columns. ({issue}`7413`)
* Handle ``TIMESTAMP`` values during forward offset changes ('gaps' in DST). ({issue}`5449`)

#6910, #7413, #5449 fixed via #8060

[martint]

* Add {func}`geometry_nearest_points`. ({issue}`8280`)

#8280

[martint]

* Fix planning failure when using {func}`hash_counts`. ({issue}`8248`)

#8248

[losipiuk]

SPI
* Allow computing HyperLogLog based approximate set summary as a column statistic during `ConnectorMetadata` driven statistics collection flow. ({issue}`8355`)

#8355

[ebyhr]

BigQuery
*  Add `bigquery.views-cache-ttl` config property to allow configuring the cache expiration for BigQuery views. ({issue}`8236`)

#8236, #8283

[phd3]

General:
* Fix error message when grouping expressions in ``GROUP BY`` queries contain aggregations, window functions or grouping operations.  ({issue}`8247`)

#8247

[Praveen2112]

General
 * Report input column information for queries involving set operations (UNION, INTERSECT and EXCEPT). 

#8371

[Praveen2112]

General
* Report datatype for output columns in EventListener. 

#8405

[wendigo]

General
  * Raise minimum required Java version for running Trino server to 11.0.11. ({issue}`8103`)

#8103

[losipiuk]

Hive
* Add support for inserting data into CSV and TEXT tables with skip_header_line_count table property set to 1.
  The same applies to creating tables with data using `CREATE TABLE ... AS SELECT` syntax. ({issue}`8390`)
* Add validation so creating CSV and TEXT tables with data is not allowed if skip_header_line_count is set to a value 
  greater than 1. ({issue}`8373`)

#8390, #8373

cc: @homar

[sopel39]

General:
* Prevent failure when querying ``system.metadata.table_comments`` and listed table is dropped concurrently. ({issue}`8443`)

#8443