Hi. We're unable to use this in our builds since this seems to baked in to the EMR cluster. The docs say that EMR provides it's own repository https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-artifact-repository.html however we cannot find this.
Please could you share the repository URL and the GAV definition about where this can be found? for example:
<dependency>
<groupId>com.amazonaws.glue</groupId>
<artifactId>sagemaker-spark</artifactId>
<version>spark_3.0.1-amzn-0-1.4.1</version>
</dependency>
I can see this on my Spark classpath on EMR 6.1.0 as /usr/share/aws/sagemaker-spark-sdk/lib/sagemaker-spark-sdk.jar with the version spark_3.0.1-amzn-0-1.4.1. Where can we find this?