Skip to content

Commit 5d12405

Browse files
authored
Bump up awssdk.version to 1.11.903 to fix java.lang.NoSuchFieldError: SERVICE_ID
With OOTB POM that has <awssdk.version>1.11.903</awssdk.version> I was running into following exception when starting the docker container: Caused by: java.lang.NoSuchFieldError: SERVICE_ID at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4772) at com.amazonaws.services.s3.AmazonS3Client.createRequest(AmazonS3Client.java:4758) at com.amazonaws.services.s3.AmazonS3Client.headBucket(AmazonS3Client.java:1434) at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:1374) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$verifyBucketExists$1(S3AFileSystem.java:381) at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109) at org.apache.hadoop.fs.s3a.Invoker.lambda$retry$3(Invoker.java:265) With <awssdk.version>1.11.903</awssdk.version> the issue is resolved and I am able start the docker container and details of the completed spark jobs
1 parent 18ba723 commit 5d12405

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

utilities/Spark_UI/glue-3_0/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@
1313
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
1414
<jdk.version>1.8</jdk.version>
1515
<hadoop.version>3.2.1</hadoop.version>
16-
<awssdk.version>1.11.901</awssdk.version>
16+
<awssdk.version>1.11.903</awssdk.version>
1717
<httpclient.version>4.5.13</httpclient.version>
1818
<jackson.version>2.10.5</jackson.version>
1919
<jackson.databind.version>2.10.5.1</jackson.databind.version>

0 commit comments

Comments
 (0)