Skip to content

Commit fd766e5

Browse files
FabianMeiswinkelFabianMeiswinkel
authored
Release azure-cosmos-spark 4.23.0 (Azure#37095)
* Release azure-cosmos-spark 4.23.0 * Updating poms as well
1 parent 2507e34 commit fd766e5

File tree

16 files changed

+71
-70
lines changed

16 files changed

+71
-70
lines changed

‎eng/versioning/version_client.txt‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -100,10 +100,10 @@ com.azure:azure-cosmos;4.51.0;4.52.0-beta.1
100100
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
101101
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
102102
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
103-
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.22.0;4.23.0-beta.1
104-
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.22.0;4.23.0-beta.1
105-
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.22.0;4.23.0-beta.1
106-
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.22.0;4.23.0-beta.1
103+
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.22.0;4.23.0
104+
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.22.0;4.23.0
105+
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.22.0;4.23.0
106+
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.22.0;4.23.0
107107
com.azure:azure-cosmos-encryption;2.5.0;2.6.0-beta.1
108108
com.azure:azure-cosmos-test;1.0.0-beta.5;1.0.0-beta.6
109109
com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1

‎sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,13 @@
11
## Release History
22

3-
### 4.23.0-beta.1 (Unreleased)
3+
### 4.23.0 (2023-10-09)
44

55
#### Features Added
66
* Added configuration option to control the maximum batch size used - by default the batch size is determined automatically based on the throttling rate - and will auto-adjust to meet the throughput control limits when applied. This setting is mostly added to simplify Spark 2.4 migrations where it was possible to specify a fixed batch size. This setting should only be used when not enabling throughput control - and for new workloads not being migrated from Spark 2.4 using throughput control is preferred. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
77

8-
#### Breaking Changes
9-
108
#### Bugs Fixed
119
* Fixed an issue with backpressure when using WriteStrategy `ItemBulkUpdate` - with this write strategy a Reactor operator `bufferTimeout` was used, which has issues when backpressure happens and can result in an error `verflowException: Could not emit buffer due to lack of requests`. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
1210

13-
#### Other Changes
14-
1511
### 4.22.0 (2023-09-19)
1612

1713
#### Features Added

‎sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md‎

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2929
#### azure-cosmos-spark_3-1_2-12
3030
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3131
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
32+
| 4.23.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
3233
| 4.22.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
3334
| 4.21.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
3435
| 4.21.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.\*, 9.\* |
@@ -78,6 +79,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
7879
#### azure-cosmos-spark_3-2_2-12
7980
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
8081
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
82+
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8183
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8284
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8385
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
@@ -112,6 +114,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
112114
#### azure-cosmos-spark_3-3_2-12
113115
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
114116
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
117+
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
115118
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
116119
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
117120
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
@@ -128,18 +131,19 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
128131
#### azure-cosmos-spark_3-4_2-12
129132
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
130133
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
134+
| 4.23.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
131135
| 4.22.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
132136
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
133137
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
134138

135139
### Download
136140

137141
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
138-
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.22.0`
142+
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.23.0`
139143

140144
You can also integrate against Cosmos DB Spark Connector in your SBT project:
141145
```scala
142-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.22.0"
146+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.23.0"
143147
```
144148

145149
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
14-
<version>4.23.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
14+
<version>4.23.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12</url>
1717
<name>OLTP Spark 3.1 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-2_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,13 @@
11
## Release History
22

3-
### 4.23.0-beta.1 (Unreleased)
3+
### 4.23.0 (2023-10-09)
44

55
#### Features Added
66
* Added configuration option to control the maximum batch size used - by default the batch size is determined automatically based on the throttling rate - and will auto-adjust to meet the throughput control limits when applied. This setting is mostly added to simplify Spark 2.4 migrations where it was possible to specify a fixed batch size. This setting should only be used when not enabling throughput control - and for new workloads not being migrated from Spark 2.4 using throughput control is preferred. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
77

8-
#### Breaking Changes
9-
108
#### Bugs Fixed
119
* Fixed an issue with backpressure when using WriteStrategy `ItemBulkUpdate` - with this write strategy a Reactor operator `bufferTimeout` was used, which has issues when backpressure happens and can result in an error `verflowException: Could not emit buffer due to lack of requests`. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
1210

13-
#### Other Changes
14-
1511
### 4.22.0 (2023-09-19)
1612

1713
#### Features Added

‎sdk/cosmos/azure-cosmos-spark_3-2_2-12/README.md‎

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-2_2-12
2929
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
31+
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
3132
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
3233
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
3334
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
@@ -62,6 +63,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
6263
#### azure-cosmos-spark_3-3_2-12
6364
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
6465
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
66+
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
6567
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
6668
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
6769
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
@@ -78,6 +80,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
7880
#### azure-cosmos-spark_3-1_2-12
7981
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
8082
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
83+
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
8184
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
8285
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
8386
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 8.\*, 9.\* |
@@ -127,18 +130,19 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
127130
#### azure-cosmos-spark_3-4_2-12
128131
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
129132
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
133+
| 4.23.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
130134
| 4.22.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
131135
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
132136
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
133137

134138
### Download
135139

136140
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 10 from Maven:
137-
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.22.0`
141+
`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.23.0`
138142

139143
You can also integrate against Cosmos DB Spark Connector in your SBT project:
140144
```scala
141-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.22.0"
145+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.23.0"
142146
```
143147

144148
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-2_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-2_2-12</artifactId>
14-
<version>4.23.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
14+
<version>4.23.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-2_2-12</url>
1717
<name>OLTP Spark 3.2 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md‎

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,13 @@
11
## Release History
22

3-
### 4.23.0-beta.1 (Unreleased)
3+
### 4.23.0 (2023-10-09)
44

55
#### Features Added
66
* Added configuration option to control the maximum batch size used - by default the batch size is determined automatically based on the throttling rate - and will auto-adjust to meet the throughput control limits when applied. This setting is mostly added to simplify Spark 2.4 migrations where it was possible to specify a fixed batch size. This setting should only be used when not enabling throughput control - and for new workloads not being migrated from Spark 2.4 using throughput control is preferred. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
77

8-
#### Breaking Changes
9-
108
#### Bugs Fixed
119
* Fixed an issue with backpressure when using WriteStrategy `ItemBulkUpdate` - with this write strategy a Reactor operator `bufferTimeout` was used, which has issues when backpressure happens and can result in an error `verflowException: Could not emit buffer due to lack of requests`. See [PR 37072](https://github.com/Azure/azure-sdk-for-java/pull/37072)
1210

13-
#### Other Changes
14-
1511
### 4.22.0 (2023-09-19)
1612

1713
#### Features Added

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md‎

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-3_2-12
2929
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
31+
| 4.23.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
3132
| 4.22.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
3233
| 4.21.1 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
3334
| 4.21.0 | 3.3.0 | 8 | 2.12 | 11.\*, 12.\* |
@@ -44,6 +45,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
4445
#### azure-cosmos-spark_3-2_2-12
4546
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
4647
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
48+
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
4749
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
4850
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
4951
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
@@ -78,6 +80,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
7880
#### azure-cosmos-spark_3-1_2-12
7981
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
8082
|--------------|--------------------------|----------------------|--------------------------|-------------------------------|
83+
| 4.23.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8184
| 4.22.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8285
| 4.21.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
8386
| 4.21.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.\* |
@@ -127,18 +130,19 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
127130
#### azure-cosmos-spark_3-4_2-12
128131
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
129132
|-----------|--------------------------|----------------------|--------------------------|-------------------------------|
133+
| 4.23.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
130134
| 4.22.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
131135
| 4.21.1 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
132136
| 4.21.0 | 3.4.0 | 8 | 2.12 | 11.\*, 12.\* |
133137

134138
### Download
135139

136140
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
137-
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.22.0`
141+
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.23.0`
138142

139143
You can also integrate against Cosmos DB Spark Connector in your SBT project:
140144
```scala
141-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.22.0"
145+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.23.0"
142146
```
143147

144148
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
14-
<version>4.23.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
14+
<version>4.23.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
1717
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>

0 commit comments

Comments
 (0)