blob: 0b2d3a18068fc9b939b912e7d6e08299e7f420ae [file] [log] [blame]
:py:mod:`airflow.providers.amazon.aws.example_dags.example_glue`
================================================================
.. py:module:: airflow.providers.amazon.aws.example_dags.example_glue
Module Contents
---------------
Functions
~~~~~~~~~
.. autoapisummary::
airflow.providers.amazon.aws.example_dags.example_glue.upload_artifacts_to_s3
Attributes
~~~~~~~~~~
.. autoapisummary::
airflow.providers.amazon.aws.example_dags.example_glue.GLUE_DATABASE_NAME
airflow.providers.amazon.aws.example_dags.example_glue.GLUE_EXAMPLE_S3_BUCKET
airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_ROLE
airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_NAME
airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_CONFIG
airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_CSV
airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_SCRIPT
airflow.providers.amazon.aws.example_dags.example_glue.setup_upload_artifacts_to_s3
.. py:data:: GLUE_DATABASE_NAME
.. py:data:: GLUE_EXAMPLE_S3_BUCKET
.. py:data:: GLUE_CRAWLER_ROLE
.. py:data:: GLUE_CRAWLER_NAME
:annotation: = example_crawler
.. py:data:: GLUE_CRAWLER_CONFIG
.. py:data:: EXAMPLE_CSV
:annotation: = Multiline-String
.. raw:: html
<details><summary>Show Value</summary>
.. code-block:: text
:linenos:
apple,0.5
milk,2.5
bread,4.0
.. raw:: html
</details>
.. py:data:: EXAMPLE_SCRIPT
.. py:function:: upload_artifacts_to_s3()
Upload example CSV input data and an example Spark script to be used by the Glue Job
.. py:data:: setup_upload_artifacts_to_s3