fix: compatibility notice for sagemaker notebook al2-v3

[ericfzhu]

A potential solution to address #3242 for users with AL2-V3 SageMaker notebook instances.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 20b2d01
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
• Commit ID: 20b2d01
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[kukushking]

Hey @ericfzhu thanks for opening this. It is true that from pyarrow v21+ it stopped building on AL2 due to an older CMake, but you should still be able to use an older version pyarrow (technically >=8,<23) on AL2 if you can't upgrade AL2023.

The notice makes me think we require pyarrow 21+ which isn't exactly true, perhaps it needs to be slightly updated.

[ericfzhu]

Would pinning or installing a lower version of PyArrow be a better recommendation here? Basically something like:

awswrangler>=3.14.0 defaults to PyArrow 21.0.0+, which requires CMake 3.25+ to build. On AL2-V3 notebook instances (CMake 2.8), you have two options:

• Upgrade to AL2023-v1
• Pin PyArrow to an older version:
  !pip install awswrangler "pyarrow<21"

[kukushking]

@ericfzhu Something along the lines of:

1. AL2 - Pin to lower pyarrow
2. AL2 - Upgrade CMake
3. Upgrade to AL2023

[ericfzhu]

This should better address what the actual problem is, and potential solutions to address the issue

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 55ec2eb
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
• Commit ID: 55ec2eb
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[kukushking]

Thanks @ericfzhu !

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 597a30d
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[jaidisido]

AWS CodeBuild CI Report

• CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
• Commit ID: 597a30d
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository