| .. Licensed to the Apache Software Foundation (ASF) under one |
| or more contributor license agreements. See the NOTICE file |
| distributed with this work for additional information |
| regarding copyright ownership. The ASF licenses this file |
| to you under the Apache License, Version 2.0 (the |
| "License"); you may not use this file except in compliance |
| with the License. You may obtain a copy of the License at |
| |
| .. http://www.apache.org/licenses/LICENSE-2.0 |
| |
| .. Unless required by applicable law or agreed to in writing, |
| software distributed under the License is distributed on an |
| "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY |
| KIND, either express or implied. See the License for the |
| specific language governing permissions and limitations |
| under the License. |
| |
| |
| Changelog |
| --------- |
| |
| 2.1.0 |
| ..... |
| |
| Features |
| ~~~~~~~~ |
| * ``Allow attaching to previously launched task in ECSOperator (#16685)`` |
| * ``Update AWS Base hook to use refreshable credentials (#16770) (#16771)`` |
| * ``Added select_query to the templated fields in RedshiftToS3Operator (#16767)`` |
| * ``AWS Hook - allow IDP HTTP retry (#12639) (#16612)`` |
| * ``Update Boto3 API calls in ECSOperator (#16050)`` |
| * ``Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)`` |
| * ``Adding SalesforceToS3Operator to Amazon Provider (#17094)`` |
| |
| Bug Fixes |
| ~~~~~~~~~ |
| |
| * ``AWS DataSync default polling adjusted from 5s to 30s (#11011)`` |
| * ``Fix wrong template_fields_renderers for AWS operators (#16820)`` |
| * ``AWS DataSync cancel task on exception (#11011) (#16589)`` |
| * ``Fixed template_fields_renderers for Amazon provider (#17087)`` |
| * ``removing try-catch block (#17081)`` |
| * ``ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)`` |
| * ``Made S3ToRedshiftOperator transaction safe (#17117)`` |
| |
| .. Below changes are excluded from the changelog. Move them to |
| appropriate section above if needed. Do not delete the lines(!): |
| * ``Removes pylint from our toolchain (#16682)`` |
| * ``Bump sphinxcontrib-spelling and minor improvements (#16675)`` |
| * ``Prepare documentation for July release of providers. (#17015)`` |
| * ``Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)`` |
| * ``Fixed wrongly escaped characters in amazon's changelog (#17020)`` |
| * ``Updating Amazon-AWS example DAGs to use XComArgs (#16868)`` |
| |
| 2.0.0 |
| ..... |
| |
| Breaking changes |
| ~~~~~~~~~~~~~~~~ |
| |
| * ``Auto-apply apply_default decorator (#15667)`` |
| |
| .. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+. |
| If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade |
| Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded |
| automatically and you will have to manually run ``airflow upgrade db`` to complete the migration. |
| |
| Features |
| ~~~~~~~~ |
| |
| * ``CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)`` |
| * ``remove retry for now (#16150)`` |
| * ``Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)`` |
| * ``Add support of capacity provider strategy for ECSOperator (#15848)`` |
| * ``Update copy command for s3 to redshift (#16241)`` |
| * ``Make job name check optional in SageMakerTrainingOperator (#16327)`` |
| * ``Add AWS DMS replication task operators (#15850)`` |
| |
| Bug Fixes |
| ~~~~~~~~~ |
| |
| * ``Fix S3 Select payload join (#16189)`` |
| * ``Fix spacing in 'AwsBatchWaitersHook' docstring (#15839)`` |
| * ``MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)`` |
| * ``fix: AwsGlueJobOperator change order of args for load_file (#16216)`` |
| * ``Fix S3ToFTPOperator (#13796)`` |
| |
| .. Below changes are excluded from the changelog. Move them to |
| appropriate section above if needed. Do not delete the lines(!): |
| * ``Check synctatic correctness for code-snippets (#16005)`` |
| * ``Bump pyupgrade v2.13.0 to v2.18.1 (#15991)`` |
| * ``Rename example bucket names to use INVALID BUCKET NAME by default (#15651)`` |
| * ``Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)`` |
| * ``Updated documentation for June 2021 provider release (#16294)`` |
| * ``Add Connection Documentation for the Hive Provider (#15704)`` |
| * ``Update Docstrings of Modules with Missing Params (#15391)`` |
| * ``Fix spelling (#15699)`` |
| * ``Add Connection Documentation for Providers (#15499)`` |
| * ``More documentation update for June providers release (#16405)`` |
| * ``Synchronizes updated changelog after buggfix release (#16464)`` |
| |
| 1.4.0 |
| ..... |
| |
| Features |
| ~~~~~~~~ |
| |
| * ``S3Hook.load_file should accept Path object in addition to str (#15232)`` |
| |
| Bug fixes |
| ~~~~~~~~~ |
| |
| * ``Fix 'logging.exception' redundancy (#14823)`` |
| * ``Fix AthenaSensor calling AthenaHook incorrectly (#15427)`` |
| * ``Add links to new modules for deprecated modules (#15316)`` |
| * ``Fixes doc for SQSSensor (#15323)`` |
| |
| 1.3.0 |
| ..... |
| |
| Features |
| ~~~~~~~~ |
| |
| * ``A bunch of template_fields_renderers additions (#15130)`` |
| * ``Send region_name into parent class of AwsGlueJobHook (#14251)`` |
| * ``Added retry to ECS Operator (#14263)`` |
| * ``Make script_args templated in AwsGlueJobOperator (#14925)`` |
| * ``Add FTPToS3Operator (#13707)`` |
| * ``Implemented S3 Bucket Tagging (#14402)`` |
| * ``S3DataSource is not required (#14220)`` |
| |
| Bug fixes |
| ~~~~~~~~~ |
| |
| * ``AWS: Do not log info when SSM & SecretsManager secret not found (#15120)`` |
| * ``Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)`` |
| |
| 1.2.0 |
| ..... |
| |
| Features |
| ~~~~~~~~ |
| |
| * ``Avoid using threads in S3 remote logging upload (#14414)`` |
| * ``Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)`` |
| * ``includes the STS token if STS credentials are used (#11227)`` |
| |
| 1.1.0 |
| ..... |
| |
| Features |
| ~~~~~~~~ |
| |
| * ``Adding support to put extra arguments for Glue Job. (#14027)`` |
| * ``Add aws ses email backend for use with EmailOperator. (#13986)`` |
| * ``Add bucket_name to template fileds in S3 operators (#13973)`` |
| * ``Add ExasolToS3Operator (#13847)`` |
| * ``AWS Glue Crawler Integration (#13072)`` |
| * ``Add acl_policy to S3CopyObjectOperator (#13773)`` |
| * ``AllowDiskUse parameter and docs in MongotoS3Operator (#12033)`` |
| * ``Add S3ToFTPOperator (#11747)`` |
| * ``add xcom push for ECSOperator (#12096)`` |
| * ``[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)`` |
| * ``Add S3KeySizeSensor (#13049)`` |
| * ``Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)`` |
| * ``Allow Tags on AWS Batch Job Submission (#13396)`` |
| |
| Bug fixes |
| ~~~~~~~~~ |
| |
| * ``Fix bug in GCSToS3Operator (#13718)`` |
| * ``Fix S3KeysUnchangedSensor so that template_fields work (#13490)`` |
| |
| |
| 1.0.0 |
| ..... |
| |
| |
| Initial version of the provider. |
