Added Glue Job Version Deprecation Checker

Author: moomindani

README.md

@@ -54,10 +54,14 @@ repository at: [awslabs/aws-glue-libs](https://github.com/awslabs/aws-glue-libs)
    You can use this Dockerfile to run Spark history server in your container.
    See details: [Launching the Spark History Server and Viewing the Spark UI Using Docker ](https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html#monitor-spark-ui-history-local)
 
- - [use only IAM access controls](utilities/use_only_IAM_access_controls/README.md)
- 
-   AWS Lake Formation applies its own permission model when you access data in Amazon S3 and metadata in AWS Glue Data Catalog through use of Amazon EMR, Amazon Athena and so on. 
-   If you currently use Lake Formation and instead would like to use only IAM Access controls, this tool enables you to achieve it.
+- [use only IAM access controls](utilities/use_only_IAM_access_controls/README.md)
+
+  AWS Lake Formation applies its own permission model when you access data in Amazon S3 and metadata in AWS Glue Data Catalog through use of Amazon EMR, Amazon Athena and so on.
+  If you currently use Lake Formation and instead would like to use only IAM Access controls, this tool enables you to achieve it.
+
+- [Glue Job Version Deprecation Checker](utilities/glue_version_deprecation_checker/README.md)
+
+  This command line utility helps you to identify the target Glue jobs which will be deprecated per [AWS Glue version support policy](https://docs.aws.amazon.com/glue/latest/dg/glue-version-support-policy.html).
 
 ### GlueCustomConnectors
 AWS Glue provides [built-in support](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-connect.html) for the most commonly used data stores such as Amazon Redshift, MySQL, MongoDB. Powered by Glue ETL Custom Connector, you can subscribe a third-party connector from AWS Marketplace or build your own connector to connect to data stores that are not natively supported.

utilities/glue_version_deprecation_checker/README.md

@@ -0,0 +1,47 @@
+## Glue Job Version Deprecation Checker
+
+Per [AWS Glue version support policy](https://docs.aws.amazon.com/glue/latest/dg/glue-version-support-policy.html), Glue jobs using specific versions are going to be deprecated.
+This command line utility helps you to identify the target Glue jobs which will be deprecated.
+
+## How to use it
+
+You can run this shell script in any location where you have Bash and the following environment.
+
+### Pre-requisite
+* Configure default region. See details: [Configuring the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html)
+* Install [AWS CLI](https://aws.amazon.com/cli/)
+
+### Syntax
+```
+$ ./check_jobs.sh [ -r COMMA_SEPARATED_REGION_NAMES ] [ -p PROFILE_NAME ]
+```
+
+* Glue jobs in all regions are listed if the option `-r` is not specified.
+
+### Example 1. Check Glue jobs in all regions
+```
+$ ./check_jobs.sh
+```
+
+### Example 2. Check Glue jobs only in us-east-1 and us-west-2
+```
+$ ./check_jobs.sh -r us-east-1,us-west-2
+```
+
+### Example 3. Check Glue jobs only in us-east-1 and us-west-2 using AWS named profile
+```
+$ ./check_jobs.sh -r us-west-2 -p test_profile
+```
+
+### Example of command output
+```
+Region: us-west-2
+-------------------------------------------------------------------------------------------
+|                                         GetJobs                                         |
++-------------+------------------------------------------+--------------+-----------------+
+| GlueVersion |                 JobName                  |   JobType    |  PythonVersion  |
++-------------+------------------------------------------+--------------+-----------------+
+|  0.9        |  sample_spark_job                        |  glueetl     |  2              |
+|  1.0        |  sample_pythonshell                      |  pythonshell |  2              |
++-------------+------------------------------------------+--------------+-----------------+
+```

utilities/glue_version_deprecation_checker/check_jobs.sh

@@ -0,0 +1,43 @@
+# Copyright 2022 Amazon.com, Inc. or its affiliates. All Rights Reserved.
+# SPDX-License-Identifier: MIT-0
+#! /bin/bash
+
+regions=
+profile=
+
+usage() {
+  echo "Usage: $0 [ -r COMMA_SEPARATED_REGION_NAMES ] [ -p PROFILE_NAME ]"
+  echo " - Glue jobs in all regions are listed if the option '-r' is not specified."
+}
+
+exit_abnormal() {
+  usage
+  exit 1
+}
+
+while getopts r:p:h OPT; do
+  case $OPT in
+     p) profile=${OPTARG};;
+     r) IFS=',' read -r -a regions <<< ${OPTARG};;
+     *) exit_abnormal;;
+  esac
+done
+
+profile_option=""
+if [ ! -z "${profile}" ]
+then
+  echo "Profile: $profile"
+  profile_option="--profile $profile"
+fi
+
+if [ -z "${regions}" ]
+then
+  regions=$(aws ec2 describe-regions --query 'Regions[].{Name:RegionName}' $profile_option --output text|sort -r)
+fi
+
+echo "Following Glue jobs are going to be deprecated as per AWS Glue's version support policy. "
+for region in $regions
+do
+    echo "Region: $region"
+    aws glue get-jobs --query 'Jobs[? (GlueVersion==`"0.9"` || GlueVersion==null) && (Command.Name==`"glueetl"` || Command.Name==`"gluestreaming"`) || Command.PythonVersion==`"2"`].{JobName:Name,JobType:Command.Name,GlueVersion:GlueVersion,PythonVersion:Command.PythonVersion}' $profile_option --region $region --output table
+done