Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release notes for 335 #3886

Closed
9 tasks done
martint opened this issue May 30, 2020 · 22 comments · Fixed by #4004
Closed
9 tasks done

Release notes for 335 #3886

martint opened this issue May 30, 2020 · 22 comments · Fixed by #4004
Milestone

Comments

@martint
Copy link
Member

martint commented May 30, 2020

Dain Sundstrom

  • all checked
  • 05-30 13:14:42 0abb2c8 Use adaptation in function invoker provider
  • 05-30 13:14:42 67291d1 Use InterpretedFunctionInvoker in ExpressionOptimizer
  • 05-30 13:14:42 7126b89 Add ScalarFunctionAdapter
  • 05-30 13:14:42 79318c6 Replace getScalarFunctiontImplementation with getScalarFunctionInvoker
  • 05-30 13:14:42 7b6768d Make FunctionInvokerProvider an internal detail of Metadata
  • 05-30 13:14:42 95cfa60 Require calling convention for getScalarFunctionInvoker
  • 05-30 13:14:42 b04a1ad Change code generator to use ScalarFunctionInvoker
  • 05-30 13:14:42 d57f5aa Fix calling convention of is distinct from
  • 05-30 13:14:42 f721c0d Set explicit calling convention for EQUAL and INDETERMINATE operators
  • 06-07 11:16:18 e3d798d Support reading uniontype as struct from Avro/ORC Hive tables

David Phillips

  • all checked
  • 05-31 19:27:11 389177b Add name to Environment
  • 06-01 22:14:38 cbdc58b Add missing period in release notes
  • 06-02 19:07:09 8704e5a Move Thrift metastore authentication classes
  • 06-02 20:40:51 67368f6 Run code formatter
  • 06-03 18:26:16 e8a994c Add additional constructor for ThriftHiveMetastore
  • 06-04 17:39:36 fb7b488 Fix the value showed in memory usage bar on worker web
  • 06-09 10:42:26 0027cbe Move Accumulo iterators to a separate module

Grzegorz Kokosiński

  • all checked
  • 06-01 00:59:53 1e3690a Add information_schema.role_authorization_descriptors
  • 06-01 06:20:32 35e8734 Add schema access rules to FileBasedSystemAccessControl
  • 06-02 11:46:07 d82d5f7 Allow creating a JDBC connector without CredentialProviderModule
  • 06-11 01:29:25 d034437 Fix typo

Karol Sobczak

  • all checked
  • 06-01 14:12:00 3fc2575 Move prometheus properties to presto-server-main
  • 06-02 03:34:49 9080569 Test for dynamic filter explicitly
  • 06-03 05:54:29 7f42b7b Don't use coordinator REST endpoints directly when caching is enabled
  • 06-03 06:14:58 446cd37 Make Hive caching and Hdfs impersonation mutually exclusive
  • 06-04 02:44:50 6ba38ee Update rubix to 0.3.10
  • 06-04 02:44:50 fd78ef6 Add hive.cache.ttl and hive.cache.disk-usage-percentage configs
  • 06-04 07:59:52 e931227 Generate dynamic filters only during last PPD run
  • 06-04 08:01:44 72474b9 Remove unused SemiJoinNode
  • 06-05 02:54:31 6d48728 Remove unused field
  • 06-05 12:25:15 9c92906 Assert number of dynamic filters
  • 06-05 14:31:25 aee21d2 Remove obsolete TODO
  • 06-08 02:04:17 33d4ef4 Fix check in ValuesNode constructor
  • 06-08 04:41:26 6347897 Fix flaky TestEventListener#testOutputStats
  • 06-08 12:19:44 4e42ed8 Reuse dynamic filters
  • 06-08 12:19:44 5709c8a Use ImmutableMap collector in Predicte Push Down
  • 06-08 12:33:16 0afa8be Update Rubix to 0.3.11
  • 06-08 12:33:16 0f9c1e4 Remove PrestoClusterManager
  • 06-08 12:33:16 33fa45e Make split scheduling Hive cache aware
  • 06-08 12:33:16 a6ec186 Allow some degreee of non-uniformity in equateDistribution
  • 06-09 03:47:34 5a282bb Verify dynamic filters are above table scan in DynamicFiltersChecker
  • 06-09 03:47:34 b36baf5 Add test to verify that dynamic filters not above table scan are removed
  • 06-09 05:29:11 6238d6d Increase tolerance in testEquateDistributionConsistentHashing test
  • 06-10 03:17:39 448363f Remove check that each node has cached data
  • 06-10 08:43:22 130620b Allow to override concurrency in benchmarks
  • 06-10 12:50:09 7f278db Rename LocalDynamicFilter to LocalDynamicFilterConsumer
  • 06-10 12:50:09 b451b8d Implement runtime partition pruning
  • 06-10 12:50:09 d656383 Remove dynamic filters with expression which are not a SymbolReference
  • 06-10 13:07:02 45f9261 Remove unused variable
  • 06-10 13:07:02 9ba18bb Test getFileBlockLocations with cache
  • 06-10 13:07:02 e0bed26 Use more accurate node id

Martin Traverso

  • all checked
  • 05-29 22:15:22 08a8d35 Remove unused method
  • 05-29 22:15:22 457b4cd Remove unnecessary JSON serialization
  • 05-30 14:16:12 18a2638 Add support for reduce_agg in window functions
  • 05-30 20:47:00 44d4eb6 Remove unused BETWEEN operator
  • 06-01 13:41:38 944d576 Resolve bound variables case-insensitively
  • 06-01 13:41:38 f1b8c60 Fix parsing of row(double precision)
  • 06-01 13:41:38 fca04a2 Remove hand-rolled type signature parser
  • 06-01 18:05:32 8000fab Add support for parsing datetime types with type variables
  • 06-05 12:06:17 08d6461 Fix dependencies check for StatisticsWriterNode
  • 06-05 12:09:52 9703022 Enhance QueryStatistics test
  • 06-06 06:20:18 982d2b0 Add children-pruning rule for SpatialJoinNode
  • 06-06 06:20:18 f635bd8 Add project-off rule for SpatialJoinNode
  • 06-06 08:26:56 20d960f Use assertj for query assertions
  • 06-06 08:26:56 21e3ddf Implement parametric timestamp type
  • 06-06 08:26:56 8d4b906 Add Int96Array block
  • 06-06 08:26:56 9905ef8 Provide backward-compatibility mode for clients
  • 06-06 08:26:56 d469a1c Render timestamps as ISO8601 without a timezone
  • 06-06 08:26:56 f4d38ea Make tests single-threaded
  • 06-07 16:55:54 84f61f0 Handle NaN values in unwrap casts
  • 06-08 23:30:42 6236648 Add source-pruning rule for TableWriterNode
  • 06-09 10:58:02 a00432f Fix incorrect cast from timestamp to time

Piotr Findeisen

  • all checked
  • 05-30 05:47:58 62fc8e0 Fix formatting error in release notes
  • 06-01 07:02:30 86886ef Handle mixed case partition names in sync_partition_metadata
  • 06-02 23:59:06 fa66094 Document new argument (case_sensitive) for sync_partition_metadata
  • 06-03 02:57:26 2ee5726 Run a test with dynamic filtering enabled too
  • 06-04 00:04:28 90598f0 Exit from product test launcher when all containers have been killed
  • 06-05 03:28:02 b848c0c Clarify default window frame range
  • 06-05 15:17:39 4181b0f Rename TypeHandlingJdbcPropertiesProvider to TypeHandlingJdbcSessionProperties
  • 06-05 15:17:39 71f3779 Rename DecimalSessionPropertiesProvider to DecimalSessionSessionProperties
  • 06-05 15:17:39 a6908dd Inline constant
  • 06-05 16:28:32 ff560aa Remove type special handling in JoinCompiler
  • 06-06 04:25:13 aea3a05 Do not silently ignore *Test test classes
  • 06-06 13:52:56 ca8922e Update statistics on insert to empty table in Hive connector
  • 06-08 01:58:06 0e18566 Fix flaky TestEventListener.testNormalQuery
  • 06-08 01:59:14 191a304 Bind JdbcMetadataConfig in Phoenix
  • 06-08 04:37:31 5fcfc93 Support arbitrary Java types in base-jdbc
  • 06-08 06:15:11 77273a2 Prevent silent overflow in packDateTimeWithZone
  • 06-08 06:15:11 bd74518 Increase range of allowed timestamp literals
  • 06-08 22:44:05 100a31a Fix imports
  • 06-08 23:01:19 db1661e Remove generics from ObjectReadFunction
  • 06-08 23:01:19 fd66bb7 Remove generics from ObjectWriteFunction
  • 06-09 02:02:57 7db9b48 Make partition_values optional in drop_stats
  • 06-09 03:50:34 4c51ac3 Code cleanup
  • 06-09 03:50:34 6ffffd1 Add connector smoke test exercising table stats API
  • 06-09 13:28:07 1792ae0 Fix version in the module
  • 06-11 05:17:55 a33835e Add main() to CassandraQueryRunner

Praveen Krishna

  • all checked
  • 06-09 00:00:35 e3ba4d8 Refactor presto-orc module
  • 06-09 22:36:23 cdb3c08 Remove redundant binding of RecordSetProvider
  • 06-09 22:36:23 d492734 Inject class loader safe classes with guice in Phoenix

Yuya Ebihara

  • all checked
  • 06-07 03:18:00 fbc313e Return varchar type for substr function with char argument
  • 06-07 07:57:12 02a0317 Move Teradata substring function to presto-main module
  • 06-07 07:57:12 a250a75 Promote substring function from alias instead of substr
  • 06-07 07:57:12 e7aa305 Add substring function alias with CHAR argument

Łukasz Osipiuk

  • all checked
  • 06-02 01:09:37 011fc37 Ignore ALREADY_EXISTS error from the connector in CREATE SCHEMA
  • 06-08 01:46:14 7ea4fc4 Eliminate redundant parameter extraction
  • 06-09 03:11:53 0780220 Add @fileexists validation to presto-base-jdbc
  • 06-09 03:11:53 0c9a2c1 Add @fileexists validation to presto-phoenix
  • 06-09 03:11:53 0e5cebd Add @fileexists validation to presto-password-authenticators
  • 06-09 03:11:53 267c6f4 Add @fileexists validation to presto-local-file
  • 06-09 03:11:53 4feb5f3 Add @fileexists validation to presto-cassandra
  • 06-09 03:11:53 6605ca6 Add @fileexists validation to presto-main
  • 06-09 03:11:53 a55dfd9 Add @fileexists validation to presto-hive
  • 06-09 03:11:53 a779a8a Add @fileexists validation to presto-proxy
  • 06-09 03:11:53 ab3772b Add @fileexists validation to presto-session-property-managers
  • 06-09 03:11:53 c9fbbb1 Add @fileexists validation to presto-bigquery
  • 06-09 03:11:53 d04546d Add @fileexists validation to presto-resource-group-managers
  • 06-09 03:11:53 d343cde Add @fileexists validation to presto-atop
  • 06-09 03:11:53 e27e037 Add @fileexists validation to presto-google-sheets
  • 06-09 03:11:53 ec22fde Add @fileexists validation to presto-plugin-toolkit
  • 06-09 03:11:53 f48dd09 Add @fileexists validation to presto-elasticsearch
  • 06-09 06:20:47 b6c06e9 Rename ThriftMetastoreClientFactory to DefaultThriftMetastoreClientFactory
  • 06-09 06:20:47 d48409b Make ThriftMetastoreClientFactory extendable
  • 06-09 06:20:47 de7ec45 Extract ThriftMetastoreClientFactory interface
  • 06-10 06:35:50 ae7bab6 Avoid NPE when enumerating ThreadInfo's
  • 06-10 12:30:09 acdf5e3 Fix name of test runner script
@martint martint added this to the 335 milestone May 30, 2020
@martint martint pinned this issue May 30, 2020
@martint
Copy link
Member Author

martint commented May 30, 2020

* Fix failure when :func:`reduce_agg` is used as a window function. (:issue:`3883 `)

#3885, #3883

@kokosing
Copy link
Member

kokosing commented Jun 1, 2020

Security
---
 *  Add  ``information_schema. role_authorization_descriptors`` table that returns information about what roles where granted to what principals. (:issue:`3535`)

Hive
---
 * Add support for``information_schema. role_authorization_descriptors`` table when ``hive.security=sql-standard``.  (:issue:`3535`)

#3535

@kokosing
Copy link
Member

kokosing commented Jun 1, 2020

Security
---
 * Adding schema access rules to file based system access control. (:issue:`3766`)

#3766

@findepi
Copy link
Member

findepi commented Jun 1, 2020

Hive
* Allow non-lowercase column names in ``system.sync_partition_metadata`` procedure. This can be enabled
  by passing ``case_sensitive=false`` when invoking the procedure. (:issue:`3431`)

#3431 #3830

@sopel39
Copy link
Member

sopel39 commented Jun 3, 2020

Hive
----

* Make caching work when coordinator is secured. (:issue:`3874`)
* Prevent caching from turning off in case of intermittent network failures. (:issue:`3874`)

#3874

@sopel39
Copy link
Member

sopel39 commented Jun 3, 2020

Hive
----

* Make caching and HDFS impersonation mutually exclusive. (:issue:`3913`)

#3913

@sopel39
Copy link
Member

sopel39 commented Jun 4, 2020

Hive
----

* Add ``hive.cache.ttl`` and ``hive.cache.disk-usage-percentage`` cache properties. (:issue:`3840`)

#3840

@findepi
Copy link
Member

findepi commented Jun 6, 2020

Hive
* Fix a bug that caused missing column statistics after ``INSERT`` to new table. (:issue:`2469`)

#2469 #3936

@martint
Copy link
Member Author

martint commented Jun 7, 2020

* Add support for variable-precision ``TIMESTAMP(p)`` type. (:issue:`3783`)

#3783

@ebyhr
Copy link
Member

ebyhr commented Jun 7, 2020

General
---
 * Return ``VARCHAR`` type when ``substr`` function's  argument is ``CHAR`` type. (:issue:`3599`)

#3599

@ebyhr
Copy link
Member

ebyhr commented Jun 7, 2020

General
---
 * Add a variant of ``substring`` function that takes a ``CHAR`` argument. (:issue:`3949`)

#3949

@findepi
Copy link
Member

findepi commented Jun 8, 2020

Phoenix
* Allow configuring whether ``DROP TABLE`` is allowed. This is controlled by the new ``allow-drop-table`
  catalog configuration property and defaults to ``true``, compatible with the previous behavior. (:issue:`3953`)

#3953

@sopel39
Copy link
Member

sopel39 commented Jun 8, 2020

General
-------

* Improve optimized local scheduling with regard to non-uniform data distribution. (:issue:`3922`)

Hive
----
* Schedule work on nodes with cached data. (:issue:`3922`)
* Upgrade Rubix to 0.3.11. (:issue:`3922`)

#3922

@dain
Copy link
Member

dain commented Jun 8, 2020

Hive
----
* Add support for ``UNIONTYPE``.  This is mapped to ``ROW`` containing a ``tag`` field and a for each field for each data type in the union. For example, ``UNIONTYPE<INT, DOUBLE>`` is mapped to ``ROW(tag INTEGAR, field0 INTEGER, field1 DOUBLE)``. (:issue:`3483`)

#3483

@findepi
Copy link
Member

findepi commented Jun 9, 2020

Hive
* Make ``partition_values`` argument to ``drop_stats`` procedure optional. (:issue:`3937`)

#3937 #3940

@martint
Copy link
Member Author

martint commented Jun 9, 2020

* Fix incorrect cast from ``TIMESTAMP WITHOUT TIME ZONE`` to ``TIME`` type. (:issue:`3848`)

#3848

@sopel39
Copy link
Member

sopel39 commented Jun 10, 2020

General
-------

* Implement dynamic partition pruning. (:issue:`1072`)

#1072

@findepi
Copy link
Member

findepi commented Jun 11, 2020

General
* Fix incorrect query results when converting very large ``TIMESTAMP`` values into
  ``TIMESTAMP WITHOUT TIME ZONE``, or when parsing very large
  ``TIMESTAMP WITHOUT TIME ZONE`` values. (:issue:`3956`)

(not sure it's worth mentioning)

#3956

@martint
Copy link
Member Author

martint commented Jun 11, 2020

SPI
* Add support for aggregation pushdown into connectors via the
  ``ConnectorMetadata.applyAggregation()`` method. (:issue:`3697`)

#3697

@electrum
Copy link
Member

Accumulo
---

* The server-side iterators are now in a JAR file named ``presto-accumulo-iterators``. (:issue:`3673`)

#3673

@electrum
Copy link
Member

Web UI Changes
---

* Fix the value displayed in the worker memory pools bar. (:issue:`3920`)

#3920

@findepi
Copy link
Member

findepi commented Jun 12, 2020

JDBC
* Fix the value returned from ``ResultSet.getDate`` for dates before October 4th, 1582. (:issue:`4005`)
* Fix the value returned from ``ResultSet.getTimestamp`` for dates before October 4th, 1582. (:issue:`4005`)

#4005

@martint martint unpinned this issue Jun 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging a pull request may close this issue.

7 participants