| :py:mod:`airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp` |
| ================================================================================================ |
| |
| .. py:module:: airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp |
| |
| .. autoapi-nested-parse:: |
| |
| Example Airflow DAG that demonstrates interactions with Google Cloud Transfer. |
| |
| |
| This DAG relies on the following OS environment variables |
| |
| * GCP_PROJECT_ID - Google Cloud Project to use for the Google Cloud Transfer Service. |
| * GCP_TRANSFER_FIRST_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied from AWS. |
| It is also a source bucket in next step |
| * GCP_TRANSFER_SECOND_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied |
| |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:data:: GCP_PROJECT_ID |
| |
| |
| |
| |
| .. py:data:: GCP_TRANSFER_FIRST_TARGET_BUCKET |
| |
| |
| |
| |
| .. py:data:: GCP_TRANSFER_SECOND_TARGET_BUCKET |
| |
| |
| |
| |
| .. py:data:: gcs_to_gcs_transfer_body |
| |
| |
| |
| |
| .. py:data:: update_body |
| |
| |
| |
| |
| .. py:data:: create_transfer |
| |
| |
| |
| |
