| :py:mod:`tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp` |
| ========================================================================================================= |
| |
| .. py:module:: tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp |
| |
| .. autoapi-nested-parse:: |
| |
| Example Airflow DAG that demonstrates interactions with Google Cloud Transfer. |
| |
| |
| This DAG relies on the following OS environment variables |
| |
| * GCP_PROJECT_ID - Google Cloud Project to use for the Google Cloud Transfer Service. |
| * GCP_TRANSFER_FIRST_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied from AWS. |
| It is also a source bucket in next step |
| * GCP_TRANSFER_SECOND_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied |
| |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:data:: ENV_ID |
| |
| |
| |
| |
| .. py:data:: PROJECT_ID_TRANSFER |
| |
| |
| |
| |
| .. py:data:: DAG_ID |
| :annotation: = example_gcp_transfer |
| |
| |
| |
| .. py:data:: BUCKET_NAME_SRC |
| |
| |
| |
| |
| .. py:data:: BUCKET_NAME_DST |
| |
| |
| |
| |
| .. py:data:: FILE_NAME |
| :annotation: = file |
| |
| |
| |
| .. py:data:: FILE_URI |
| |
| |
| |
| |
| .. py:data:: CURRENT_FOLDER |
| |
| |
| |
| |
| .. py:data:: FILE_LOCAL_PATH |
| |
| |
| |
| |
| .. py:data:: gcs_to_gcs_transfer_body |
| |
| |
| |
| |
| .. py:data:: update_body |
| |
| |
| |
| |
| .. py:data:: create_bucket_src |
| |
| |
| |
| |
| .. py:data:: test_run |
| |
| |
| |
| |
