Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release notes for 316 #1000

Closed
5 of 6 tasks
electrum opened this issue Jun 15, 2019 · 19 comments · Fixed by #1087
Closed
5 of 6 tasks

Release notes for 316 #1000

electrum opened this issue Jun 15, 2019 · 19 comments · Fixed by #1087
Milestone

Comments

@electrum
Copy link
Member

electrum commented Jun 15, 2019

Dain Sundstrom

  • all checked
  • 06-15 19:29:53 4408334 Split TypeCoercion from TypeRegistry
  • 06-15 19:29:53 b16b3d6 Change specialize methods to take Metadata
  • 06-15 19:29:53 cad323e Change TypeRegistry to an internal detail of MetadataManager
  • 06-15 20:18:10 0ec41a9 Remove FunctionRegistry.getCoercion(Type, Type)
  • 06-15 20:18:10 4b63026 Remove unused TypeVariableConstraint.canBind
  • 06-15 20:18:10 848da88 Replace uses of MetadataManager with Metadata
  • 06-16 12:46:46 3b437c0 Cleanup AbstractTestAggregationFunction
  • 06-17 12:53:09 c0049cf Make FunctionRegistry an internal detail of Metadata
  • 06-17 18:21:37 4875c78 Extract literal function
  • 06-17 18:21:37 4f8d98a Remove unnecessary FunctionRegistry.mangleOperatorName(String)
  • 06-17 18:24:10 58b86da Move operator name mange to Signature
  • 06-18 09:32:05 527cc40 Inline Window call
  • 06-18 09:32:05 748f3fa Switch Aggregation filter to symbol
  • 06-18 09:32:05 a04d42b Inline Aggregation call
  • 06-22 22:39:18 9f78af6 Add FunctionCallBuilder
  • 06-24 14:48:13 09db394 Adjust getOffset output in Columnar classes to account for trimmed element blocks
  • 06-24 22:41:39 e802542 Move classes for Unnest Operator to a separate package
  • 06-24 22:41:39 f5b1534 Implement Unnest Operator with Dictionary Blocks
  • 06-26 12:37:00 07ac8db count workers by assuming the same configuration for all coordinators and add ClusterStats.activeCoordinators property
  • 06-27 10:29:43 d07f173 Fix up PageBuilderStatus::toString
  • 07-03 16:16:43 78f81de Update documentation in HiveQueryRunner main

David Phillips

  • all checked
  • 06-18 10:14:22 5a81eba Collect Hive column statistics on write by default
  • 06-18 10:18:26 77ec764 Acquire password in cli when its stdout is a pipe
  • 06-18 10:41:05 b669b57 Add support for UUID type in PostgreSQL connector
  • 06-20 00:02:38 0a0689e Remove unused RoleNotFoundException
  • 06-25 08:41:34 47894d2 Rename HiveMetastoreClientFactory to ThriftMetastoreClientFactory
  • 06-25 08:41:34 c5145cd Rename ThriftMetastoreStats classes
  • 06-27 12:58:27 3e7343c Update documentation for SELECT
  • 06-30 09:15:22 15a4885 Allow overriding Parquet schema in record writer
  • 06-30 09:15:22 52a2534 Move buildInitialPrivilegeSet to MetastoreUtil
  • 06-30 09:15:22 67db978 Fix logical ordering of dependencyManagement
  • 06-30 09:15:22 933b5b4 Eliminate idle threads for Hive caching metastore refresh
  • 06-30 09:15:22 d10adc6 Add setParameter to Table.Builder
  • 06-30 09:15:22 da62d58 Add variant of HiveWriteUtils.getTableDefaultLocation
  • 06-30 09:15:22 fb2e01b Use newer IOConstants for Hive writers
  • 07-02 22:00:51 48e6de3 Update error message and comment
  • 07-03 18:52:26 c6fb64e Fix refresh of CLI completion when catalog or schema changes

Grzegorz Kokosiński

  • all checked
  • 06-17 07:50:24 1e31c49 Remove duplicated TABLE_TABLES
  • 06-17 07:55:32 00ea23b Do not check status of processes on non existing container
  • 06-24 01:08:57 dcbd278 Remove extra constructor
  • 07-03 22:08:33 294200c Introduce Hive AccessControlMetadata
  • 07-04 04:54:57 2a632d3 Collect execution stats for JdbcClient for all connectors
  • 07-04 04:54:57 3b0fad2 Cleanup code
  • 07-04 04:54:57 625bdf6 Avoid extra JdbcClient::getColumns calls
  • 07-04 04:54:57 787b042 Mark SPI dependencies as provided for plugins
  • 07-04 04:54:57 7b3cf43 Introduce ForwardingJdbcClient
  • 07-04 04:54:57 8082baf Inject ConnectionFactory in Jdbc based connectors
  • 07-04 04:54:57 ca51cf0 Introduce StatisticsAwareJdbcClient
  • 07-04 04:54:57 caa6430 Collect stats for ConnectionFactory
  • 07-04 04:54:57 ecce6be Add jol-core SPI provided dependency to plugins
  • 07-04 07:30:20 1b1eb8a Remove redundant throws
  • 07-04 07:30:22 8d173de Do not allow to create or drop mixed case Hive reserved role
  • 07-04 15:19:56 004a776 Extract checkFormatForProperty
  • 07-04 15:19:56 992224d Pass table properties to Hive page sink
  • 07-04 15:19:56 aa8c1d6 Add testSnappyCompressedParquetTable to STORAGE_FORMATS group
  • 07-04 15:19:57 529c4a5 Limit visibility of constants
  • 07-04 15:19:57 72e2b8e Check if ORC properties are used with correct format
  • 07-04 22:16:04 2dbb8ff Support CSV Hive storage format
  • 07-04 22:16:04 41093c0 Place AVRO table property before TEXTFILE

Karol Sobczak

  • all checked
  • 06-17 13:00:18 9bbbcdf Make adapter WorkProcessorOperator explicitly expose push page sink
  • 06-17 13:00:18 b626457 Extract PageBuffer from WindowOperator
  • 06-25 03:28:00 63495f9 Remove invalid dynamic filters in JoinNode flipChildren
  • 06-28 00:20:29 b8e1c47 Get PrestoS3FileSystem, S3Select and Glue Metastore to work with AWS Default Credentials Provider
  • 07-02 01:44:09 9387342 Allow configuring the Glue catalog id

Martin Traverso

  • all checked
  • 06-15 10:00:49 0e172b1 Format comment
  • 06-15 10:00:49 2ce47a5 Simplify PlanBuilder#union
  • 06-15 10:00:49 f770a42 Migrate ImplementIntersectAndExceptAsUnion optimizer to rule
  • 06-19 13:12:25 1afbe98 Add support for projection pushdown
  • 06-19 13:12:25 f761c13 Fix default AstVisitor.visitRow implementation
  • 06-19 13:12:25 fdaf574 Reuse projection pushdown rules
  • 06-27 22:29:09 f7bbc2c Add benchmark for UnnestOperator
  • 07-04 12:10:04 c9c6f91 Remove TableLayout from Cassandra connector
  • 07-05 11:35:56 466a26edf6 Add 316 release notes

Piotr Findeisen

  • all checked
  • 06-16 14:11:43 1ab8b68 Fix LATERAL example query in documentation
  • 06-23 09:58:17 46cb6bf Remove not used field
  • 06-23 09:58:17 8496918 Fix messages of requireNonNull
  • 06-26 08:57:31 d939568 Fix typo in docs
  • 06-27 12:59:32 204ddf0 Ignore whitespace when expanding states in parser error handler
  • 06-27 12:59:32 2b33e57 Expand special rules in ErrorHandler
  • 06-27 12:59:32 304e8b3 Remove erroneous comment
  • 06-27 12:59:32 bb38400 Add more parser error handling tests
  • 06-28 14:24:13 f950bb0 Support multibyte characters in date_format function
  • 06-30 14:40:05 71496aa Convert Travis matrix expansion to explicit listing
  • 06-30 14:40:05 a88641d Define product test suites
  • 07-02 00:09:19 cb35c92 Disable G1 for multinode product tests configuration
  • 07-02 00:09:19 cc349bc Add separate JVM config for multinode's worker
  • 07-02 01:56:30 6be2956 Fix SHOW TABLES for hidden tpcds schemas
  • 07-02 01:56:30 d907aa0 Fix SHOW TABLES for hidden tpch schemas
  • 07-02 14:41:48 0e3fdf9 Add section on HDFS permissions to Hive connector docs
  • 07-04 13:32:47 18ec97a Update schemas in generate-tpcds.py
  • 07-04 13:33:11 85d462c Update schemas in generate-tpch.py
@electrum electrum added this to the 316 milestone Jun 15, 2019
@dain
Copy link
Member

dain commented Jun 25, 2019

* Improve performance of queries using ``UNNEST``.  (:issue: `901`)

#901

@findepi
Copy link
Member

findepi commented Jun 27, 2019

* Improve error messages when statement parsing fails. (:issue:`1042`)

#1042

@findepi
Copy link
Member

findepi commented Jun 28, 2019

* Fix ``date_format``  function failure when format string contains non-ASCII characters. (:issue:`1056`)

#1056

@anoopj
Copy link
Member

anoopj commented Jun 29, 2019

@findepi
Copy link
Member

findepi commented Jul 2, 2019

TPCH
---
* Fix ``SHOW TABLES`` for a hidden schema. (:issue:`1005`)

TPCDS
---
* Fix ``SHOW TABLES`` for a hidden schema. (:issue:`1005`)

#1007 #1005

@electrum
Copy link
Member Author

electrum commented Jul 4, 2019

CLI Changes
----------

* Fix refresh of completion cache when catalog or schema is changed. (:issue:`1016`)

#1016

@kokosing
Copy link
Member

kokosing commented Jul 4, 2019

Hive Connector Changes
-------------------------
 * Do not return invalid information from ``information_schema.table_privileges``, ``information_schema.roles``, ``information_schema.applicable_roles`` 
  and ``information_schema.enabled_roles`` when ``hive.security`` is set to other value than ``sql-standard``. 
  Instead an error is raised, saying that this is not yet supported. 
  This also affects queries like: ``SHOW ROLES``, ``SHOW ROLE GRANTS``, ``GRANT ROLE``, ``GRANT <privilege>``, ``REVOKE <privilege>``,  ``REVOKE ROLE``, `` and ``SET ROLE``. (:issue:`972`)

#972

@kokosing
Copy link
Member

kokosing commented Jul 4, 2019

JDBC based connectors changes
---------------------------------
 * Collect JMX statistics for JDBC connection creation and closure. (:issue:`906`).
 * Collect JMX statistics for ``JdbcClient`` methods usage. (:issue:`906`).

#906

@pgagnon
Copy link
Member

pgagnon commented Jul 4, 2019

PostgreSQL Connector Changes
----------------------------
* Add support for UUID type in PostgreSQL connector. (:issue:`1011`)

#1011

@kokosing
Copy link
Member

kokosing commented Jul 5, 2019

Hive Connector Changes
-------------------------
* Add support for ``CSV`` storage format. (:issue:`920`)

#920

@martint
Copy link
Member

martint commented Jul 5, 2019

Fix SHOW TABLES for a hidden schema. (:issue:1005)

@findepi, what was broken?

@martint
Copy link
Member

martint commented Jul 5, 2019

  • Collect JMX statistics for JDBC connection creation and closure. (:issue:906).

@kokosing, just to be clear, this affects the PostgreSQL, MySQL, Phoenix, Redshift and SQLServer connectors, right?

@findepi
Copy link
Member

findepi commented Jul 5, 2019

@martint SHOW TABLES FROM tpch.sf2 would fail (sf2 is a hidden schema).

@findepi
Copy link
Member

findepi commented Jul 6, 2019

Hive
* Support reading from and writing to Hadoop encryption zones (Hadoop KMS) (:issue:`997`)

#997

@martint please add this to #1087

@kokosing
Copy link
Member

kokosing commented Jul 7, 2019

@kokosing, just to be clear, this affects the PostgreSQL, MySQL, Phoenix, Redshift and SQLServer connectors, right?

Not for Phoenix. Phoenix is "semi-JDBC" connector, it does not use default JDBC guice modules and so didn't get statistics collection.

@electrum
Copy link
Member Author

electrum commented Jul 8, 2019

Hive Connector Changes
---

* Collect column statistics on write by default. This can be disabled using the
  ``hive.collect-column-statistics-on-write`` configuration property or the
  ``collect_column_statistics_on_write`` session property. (:issue:`981`)

#981

@electrum
Copy link
Member Author

electrum commented Jul 8, 2019

CLI Changes
---

* Allow reading password from console when stdout is a pipe. (:issue:`982`)

#982

@electrum
Copy link
Member Author

electrum commented Jul 8, 2019

PostgreSQL Connector Changes
---

* Add support for columns of type ``UUID``. (:issue:`1011`)

#1011

@electrum
Copy link
Member Author

electrum commented Jul 8, 2019

Hive Connector Changes
---

* Eliminate unused idle threads for the metastore cache. (:issue:`1061`)

#1061

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging a pull request may close this issue.

7 participants