cosmos spark 4.3.0 release (#23501)

Azure · Aug 11, 2021 · d36ff6e · d36ff6e
1 parent 38897a0
commit d36ff6e
Show file tree

Hide file tree

Showing 4 changed files with 19 additions and 13 deletions.
diff --git a/eng/versioning/version_client.txt b/eng/versioning/version_client.txt
@@ -76,7 +76,7 @@ com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.13;1.0.0-beta.14
 com.azure:azure-cosmos;4.17.0;4.18.0-beta.1
 com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
 com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.2.1-beta.1;4.2.1-beta.2
+com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.3.0;4.3.0
 com.azure:azure-cosmos-encryption;1.0.0-beta.6;1.0.0-beta.7
 com.azure:azure-data-appconfiguration;1.2.0;1.2.1
 com.azure:azure-data-appconfiguration-perf;1.0.0-beta.1;1.0.0-beta.1

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
@@ -1,6 +1,11 @@
 ## Release History
 
-### 4.2.1-beta.2 (Unreleased)
+### 4.3.0 (2021-08-11)
+#### Configuration Changes
+* Introduced a new config option `spark.cosmos.read.maxItemCount` to allow modifying the page size for query and change feed requests against the Cosmos DB backend. The previous default was 100 items per request - the new default is 1000 and can be modified via the new config option if necessary, see [PR](https://github.com/Azure/azure-sdk-for-java/pull/23466).
+
+#### Key Bug Fixes
+* Improved robustness for bulk ingestion jobs to avoid transient hangs - when the Spark job did not finish gracefully although the actual ingestion work has been finished. See [PR 22950](https://github.com/Azure/azure-sdk-for-java/pull/22950), [PR 23262](https://github.com/Azure/azure-sdk-for-java/pull/23262), [PR 23329](https://github.com/Azure/azure-sdk-for-java/pull/23329), [PR 23334](https://github.com/Azure/azure-sdk-for-java/pull/23334), [PR 23360](https://github.com/Azure/azure-sdk-for-java/pull/23360), [PR 23335](https://github.com/Azure/azure-sdk-for-java/pull/23335) and [PR 23461](https://github.com/Azure/azure-sdk-for-java/pull/23461)  
 
 ### 4.2.1-beta.1 (2021-07-15)
 * Fixed Catalog api synapse integration.

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
@@ -28,23 +28,24 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 
 ## Version Compatibility
 
-| Connector     | Spark         | Minimum Java Version | Supported Scala Versions |
-| ------------- | ------------- | -------------------- | -----------------------  |
-| 4.2.0         | 3.1.1         |        8             | 2.12                     |
-| 4.1.0         | 3.1.1         |        8             | 2.12                     |
-| 4.0.0         | 3.1.1         |        8             | 2.12                     |
-| 4.0.0-beta.3  | 3.1.1         |        8             | 2.12                     |
-| 4.0.0-beta.2  | 3.1.1         |        8             | 2.12                     |
-| 4.0.0-beta.1  | 3.1.1         |        8             | 2.12                     |
+| Connector     | Minimum Spark Version | Minimum Java Version | Supported Scala Versions |
+| ------------- | --------------------- | -------------------- | -----------------------  |
+| 4.3.0         | 3.1.1                 | 8                    | 2.12                     |
+| 4.2.0         | 3.1.1                 | 8                    | 2.12                     |
+| 4.1.0         | 3.1.1                 | 8                    | 2.12                     |
+| 4.0.0         | 3.1.1                 | 8                    | 2.12                     |
+| 4.0.0-beta.3  | 3.1.1                 | 8                    | 2.12                     |
+| 4.0.0-beta.2  | 3.1.1                 | 8                    | 2.12                     |
+| 4.0.0-beta.1  | 3.1.1                 | 8                    | 2.12                     |
 
 ## Download
 
 You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
-`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.2.0`
+`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.3.0`
 
 You can also integrate against Cosmos DB Spark Connector in your SBT project:
 ```scala
-libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.2.0"
+libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.3.0"
 ```
 
 Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
@@ -12,7 +12,7 @@
 
   <groupId>com.azure.cosmos.spark</groupId>
   <artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
-  <version>4.2.1-beta.2</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
+  <version>4.3.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
   <packaging>jar</packaging>
   <name>OLTP Spark Connector for Azure Cosmos DB SQL API</name>
   <description>OLTP Spark Connector for Azure Cosmos DB SQL API</description>