| :py:mod:`airflow.providers.amazon.aws.example_dags.example_glue` |
| ================================================================ |
| |
| .. py:module:: airflow.providers.amazon.aws.example_dags.example_glue |
| |
| |
| Module Contents |
| --------------- |
| |
| |
| Functions |
| ~~~~~~~~~ |
| |
| .. autoapisummary:: |
| |
| airflow.providers.amazon.aws.example_dags.example_glue.upload_artifacts_to_s3 |
| |
| |
| |
| Attributes |
| ~~~~~~~~~~ |
| |
| .. autoapisummary:: |
| |
| airflow.providers.amazon.aws.example_dags.example_glue.GLUE_DATABASE_NAME |
| airflow.providers.amazon.aws.example_dags.example_glue.GLUE_EXAMPLE_S3_BUCKET |
| airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_ROLE |
| airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_NAME |
| airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_CONFIG |
| airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_CSV |
| airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_SCRIPT |
| airflow.providers.amazon.aws.example_dags.example_glue.setup_upload_artifacts_to_s3 |
| |
| |
| .. py:data:: GLUE_DATABASE_NAME |
| |
| |
| |
| |
| .. py:data:: GLUE_EXAMPLE_S3_BUCKET |
| |
| |
| |
| |
| .. py:data:: GLUE_CRAWLER_ROLE |
| |
| |
| |
| |
| .. py:data:: GLUE_CRAWLER_NAME |
| :annotation: = example_crawler |
| |
| |
| |
| .. py:data:: GLUE_CRAWLER_CONFIG |
| |
| |
| |
| |
| .. py:data:: EXAMPLE_CSV |
| :annotation: = Multiline-String |
| |
| .. raw:: html |
| |
| <details><summary>Show Value</summary> |
| |
| .. code-block:: text |
| :linenos: |
| |
| |
| apple,0.5 |
| milk,2.5 |
| bread,4.0 |
| |
| |
| .. raw:: html |
| |
| </details> |
| |
| |
| |
| .. py:data:: EXAMPLE_SCRIPT |
| |
| |
| |
| |
| .. py:function:: upload_artifacts_to_s3() |
| |
| Upload example CSV input data and an example Spark script to be used by the Glue Job |
| |
| |
| .. py:data:: setup_upload_artifacts_to_s3 |
| |
| |
| |
| |