Control: AWS Glue Spark jobs should run on supported versions of AWS Glue

Description

This control checks whether an AWS Glue for Spark job is configured to run on a supported version of AWS Glue. The control fails if the Spark job is configured to run on a version of AWS Glue that's earlier than the minimum supported version.

Usage

Run the control in your terminal:

powerpipe control run aws_compliance.control.glue_spark_job_runs_on_version_3_or_higher

Snapshot and share results via Turbot Pipes:

powerpipe login
powerpipe control run aws_compliance.control.glue_spark_job_runs_on_version_3_or_higher --share

SQL

This control uses a named query:

select
  arn as resource,
  case
    when not default_arguments @> '{"--enable-spark-ui": "true"}'::jsonb then 'skip'
    when cast(glue_version AS DECIMAL) >= $1 then 'ok'
    else 'alarm'
  end as status,
  case
    when not default_arguments @> '{"--enable-spark-ui": "true"}'::jsonb then title  || ' is not a spark job.'
    else title  || ' uses ' || glue_version || ' glue version.'
  end as reason
  , region, account_id
from
  aws_glue_job;

Params

Args	Name	Default	Description	Variable
$1	glue_spark_job_supported_version	`3`	Minimum supported Glue version.	glue_spark_job_supported_version

Control: AWS Glue Spark jobs should run on supported versions of AWS Glue

Description

Usage

SQL

Params

Tags