Skip to content

Commit 9a66816

Browse files
cosmos spark version bump (Azure#24099)
* cosmos spark 4.3.1 release * Clarifying DBX runtime support explicitly * Update README.md * cosmos spark version bump * Fixing documentation for Cosmos Spark connector * Update README.md
1 parent ea11f98 commit 9a66816

File tree

5 files changed

+14
-16
lines changed

5 files changed

+14
-16
lines changed

eng/versioning/version_client.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,7 @@ com.azure:azure-core-tracing-opentelemetry;1.0.0-beta.14;1.0.0-beta.15
7777
com.azure:azure-cosmos;4.19.0;4.20.0-beta.1
7878
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
7979
com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
80-
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.3.1;4.3.1
80+
com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.4.0-beta.1;4.4.0-beta.1
8181
com.azure:azure-cosmos-encryption;1.0.0-beta.8;1.0.0-beta.9
8282
com.azure:azure-data-appconfiguration;1.2.2;1.3.0-beta.1
8383
com.azure:azure-data-appconfiguration-perf;1.0.0-beta.1;1.0.0-beta.1

sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,7 @@
11
## Release History
22

3+
### 4.4.0-beta.1 (Unreleased)
4+
35
### 4.3.1 (2021-09-13)
46
#### Key Bug Fixes
57
* Fixed issue resulting in option `spark.cosmos.read.maxItemCount` not always being honored

sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md

Lines changed: 8 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,14 @@
1-
# Azure Cosmos DB OLTP Spark 3 connector
1+
## Azure Cosmos DB OLTP Spark 3 connector
22

3-
**Azure Cosmos DB OLTP Spark connector preview** provides Apache Spark support for Azure Cosmos DB using
3+
**Azure Cosmos DB OLTP Spark connector** provides Apache Spark support for Azure Cosmos DB using
44
the [SQL API][sql_api_query].
55
[Azure Cosmos DB][cosmos_introduction] is a globally-distributed database service which allows
66
developers to work with data using a variety of standard APIs, such as SQL, MongoDB, Cassandra, Graph, and Table.
77

8-
**NOTE this is a Preview build.
9-
This build has not been load or performance tested yet - and at this point is not recommended
10-
being used in production scenarios.**
11-
128
If you have any feedback or ideas on how to improve your experience please let us know here:
139
https://github.com/Azure/azure-sdk-for-java/issues/new
1410

15-
## Documentation
11+
### Documentation
1612

1713
- [Getting started](https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12/docs/quick-start.md)
1814
- [Catalog API](https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12/docs/catalog-api.md)
@@ -26,7 +22,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2622
[//]: # (//TODO: moderakh Azure Cosmos DB Partition)
2723
[//]: # (//TODO: moderakh Troubleshooting)
2824

29-
## Version Compatibility
25+
### Version Compatibility
3026

3127
| Connector | Minimum Spark Version | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3228
| ------------- | --------------------- | -------------------- | ----------------------- | ----------------------------- |
@@ -39,7 +35,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
3935
| 4.0.0-beta.2 | 3.1.1 | 8 | 2.12 | 8.\* |
4036
| 4.0.0-beta.1 | 3.1.1 | 8 | 2.12 | 8.\* |
4137

42-
## Download
38+
### Download
4339

4440
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
4541
`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.3.1`
@@ -51,17 +47,17 @@ libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12"
5147

5248
Cosmos DB Spark Connector is available on [Maven Central Repo](https://search.maven.org/search?q=g:com.azure.cosmos.spark).
5349

54-
### General
50+
#### General
5551

5652
If you encounter any bug, please file an issue [here](https://github.com/Azure/azure-sdk-for-java/issues/new).
5753

5854
To suggest a new feature or changes that could be made, file an issue the same way you would for a bug.
5955

60-
## License
56+
### License
6157
This project is under MIT license and uses and repackages other third party libraries as an uber jar.
6258
See [NOTICE.txt](https://github.com/Azure/azure-sdk-for-java/blob/main/NOTICE.txt).
6359

64-
## Contributing
60+
### Contributing
6561

6662
This project welcomes contributions and suggestions. Most contributions require you to agree to a
6763
[Contributor License Agreement (CLA)][cla] declaring that you have the right to, and actually do, grant us the rights

sdk/cosmos/azure-cosmos-spark_3-1_2-12/docs/quick-start.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
## Quick Start Guide for Cosmos DB Spark Connector Preview
1+
## Quick Start Guide for Cosmos DB Spark Connector
22

33
This tutorial is a quick start guide to show how to use Cosmos DB Spark Connector to read from or write to Cosmos DB. Cosmos DB Spark Connector is based on Spark 3.1.x.
44

@@ -19,7 +19,7 @@ You can use any other Spark 3.1.1 spark offering as well, also you should be abl
1919

2020
SLF4J is only needed if you plan to use logging, please also download an SLF4J binding which will link the SLF4J API with the logging implementation of your choice. See the [SLF4J user manual](https://www.slf4j.org/manual.html) for more information.
2121

22-
Install Cosmos DB Spark Connector, in your spark Cluster [azure-cosmos-spark_3-1_2-12-4.1.0.jar](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-1_2-12/4.1.0/jar)
22+
Install Cosmos DB Spark Connector, in your spark Cluster [azure-cosmos-spark_3-1_2-12-4.3.1.jar](https://search.maven.org/artifact/com.azure.cosmos.spark/azure-cosmos-spark_3-1_2-12/4.3.1/jar)
2323

2424
The getting started guide is based on PySpark however you can use the equivalent scala version as well, and you can run the following code snippet in an Azure Databricks PySpark notebook.
2525

sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212

1313
<groupId>com.azure.cosmos.spark</groupId>
1414
<artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
15-
<version>4.3.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
15+
<version>4.4.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
1616
<packaging>jar</packaging>
1717
<name>OLTP Spark Connector for Azure Cosmos DB SQL API</name>
1818
<description>OLTP Spark Connector for Azure Cosmos DB SQL API</description>

0 commit comments

Comments
 (0)