blob: 4365e3914bc5f85954e5133f7767097ccc72bb68 [file] [log] [blame]
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
.. http://www.apache.org/licenses/LICENSE-2.0
.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
.. NOTE TO CONTRIBUTORS:
Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes
and you want to add an explanation to the users on how they are supposed to deal with them.
The changelog is updated and maintained semi-automatically by release manager.
Changelog
---------
6.1.0
.....
.. note::
This release of provider is only available for Airflow 2.4+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Misc
~~~~
* ``Bump minimum Airflow version in providers (#30917)``
* ``Update return types of 'get_key' methods on 'S3Hook' (#30923)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add full automation for min Airflow version for providers (#30994)``
* ``Add mechanism to suspend providers (#30422)``
* ``Use 'AirflowProviderDeprecationWarning' in providers (#30975)``
* ``Decouple "job runner" from BaseJob ORM model (#30255)``
6.0.0
.....
Breaking changes
~~~~~~~~~~~~~~~~
The auth option is moved from the extra field to the auth parameter in the Hook. If you have extra
parameters defined in your connections as auth, you should move them to the DAG where your HiveOperator
or other Hive related operators are used.
* ``Move auth parameter from extra to Hook parameter (#30212)``
5.1.3
.....
Bug Fixes
~~~~~~~~~
* ``Validate Hive Beeline parameters (#29502)``
5.1.2
.....
Misc
~~~~
* ``Fixed MyPy errors introduced by new mysql-connector-python (#28995)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Revert "Remove conn.close() ignores (#29005)" (#29010)``
* ``Remove conn.close() ignores (#29005)``
5.1.1
.....
Bug Fixes
~~~~~~~~~
* ``Move local_infile option from extra to hook parameter (#28811)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
5.1.0
.....
Features
~~~~~~~~
The ``apache.hive`` provider provides now hive macros that used to be provided by Airflow. As of 5.1.0 version
of ``apache.hive`` the hive macros are provided by the Provider.
* ``Move Hive macros to the provider (#28538)``
* ``Make pandas dependency optional for Amazon Provider (#28505)``
.. Review and move the new changes to one of the sections above:
5.0.0
.....
Breaking changes
~~~~~~~~~~~~~~~~
The ``hive_cli_params`` from connection were moved to the Hook. If you have extra parameters defined in your
connections as ``hive_cli_params`` extra, you should move them to the DAG where your HiveOperator is used.
* ``Move hive_cli_params to hook parameters (#28101)``
Features
~~~~~~~~
* ``Improve filtering for invalid schemas in Hive hook (#27808)``
4.1.1
.....
Bug Fixes
~~~~~~~~~
* ``Bump common.sql provider to 1.3.1 (#27888)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Prepare for follow-up release for November providers (#27774)``
4.1.0
.....
.. note::
This release of provider is only available for Airflow 2.3+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Misc
~~~~
* ``Move min airflow version to 2.3.0 for all providers (#27196)``
Bug Fixes
~~~~~~~~~
* ``Filter out invalid schemas in Hive hook (#27647)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update old style typing (#26872)``
* ``Enable string normalization in python formatting - providers (#27205)``
4.0.1
.....
Misc
~~~~
* ``Add common-sql lower bound for common-sql (#25789)``
.. Review and move the new changes to one of the sections above:
* ``Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)``
4.0.0
.....
Breaking Changes
~~~~~~~~~~~~~~~~
* The ``hql`` parameter in ``get_records`` of ``HiveServer2Hook`` has been renamed to sql to match the
``get_records`` DbApiHook signature. If you used it as a positional parameter, this is no change for you,
but if you used it as keyword one, you need to rename it.
* ``hive_conf`` parameter has been renamed to ``parameters`` and it is now second parameter, to match ``get_records``
signature from the DbApiHook. You need to rename it if you used it.
* ``schema`` parameter in ``get_records`` is an optional kwargs extra parameter that you can add, to match
the schema of ``get_records`` from DbApiHook.
* ``Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)``
* ``Remove Smart Sensors (#25507)``
3.1.0
.....
Features
~~~~~~~~
* ``Move all SQL classes to common-sql provider (#24836)``
Bug Fixes
~~~~~~~~~
* ``fix connection extra parameter 'auth_mechanism' in 'HiveMetastoreHook' and 'HiveServer2Hook' (#24713)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Move provider dependencies to inside provider folders (#24672)``
* ``Remove 'hook-class-names' from provider.yaml (#24702)``
3.0.0
.....
Breaking changes
~~~~~~~~~~~~~~~~
.. note::
This release of provider is only available for Airflow 2.2+ as explained in the
`Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>`_.
Misc
~~~~
* ``chore: Refactoring and Cleaning Apache Providers (#24219)``
* ``AIP-47 - Migrate hive DAGs to new design #22439 (#24204)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Add typing for airflow/configuration.py (#23716)``
* ``Add explanatory note for contributors about updating Changelog (#24229)``
* ``Prepare docs for May 2022 provider's release (#24231)``
* ``Update package description to remove double min-airflow specification (#24292)``
2.3.3
.....
Bug Fixes
~~~~~~~~~
* ``Fix HiveToMySqlOperator's wrong docstring (#23316)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Bump pre-commit hook versions (#22887)``
2.3.2
.....
Bug Fixes
~~~~~~~~~
* ``Fix mistakenly added install_requires for all providers (#22382)``
2.3.1
.....
Misc
~~~~~
* ``Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)``
2.3.0
.....
Features
~~~~~~~~
* ``Set larger limit get_partitions_by_filter in HiveMetastoreHook (#21504)``
Bug Fixes
~~~~~~~~~
* ``Fix Python 3.9 support in Hive (#21893)``
* ``Fix key typo in 'template_fields_renderers' for 'HiveOperator' (#21525)``
Misc
~~~~
* ``Support for Python 3.10``
* ``Add how-to guide for hive operator (#21590)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix mypy issues in 'example_twitter_dag' (#21571)``
* ``Remove unnecessary/stale comments (#21572)``
2.2.0
.....
Features
~~~~~~~~
* ``Add more SQL template fields renderers (#21237)``
* ``Add conditional 'template_fields_renderers' check for new SQL lexers (#21403)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix K8S changelog to be PyPI-compatible (#20614)``
* ``Fix template_fields type to have MyPy friendly Sequence type (#20571)``
* ``Fix MyPy errors in Apache Providers (#20422)``
* ``Fix MyPy Errors for providers: Tableau, CNCF, Apache (#20654)``
* ``Remove ':type' lines now sphinx-autoapi supports typehints (#20951)``
* ``Update documentation for provider December 2021 release (#20523)``
* ``Even more typing in operators (template_fields/ext) (#20608)``
* ``Use typed Context EVERYWHERE (#20565)``
* ``Add some type hints for Hive providers (#20210)``
* ``Add documentation for January 2021 providers release (#21257)``
2.1.0
.....
Features
~~~~~~~~
* ``hive provider: restore HA support for metastore (#19777)``
Bug Fixes
~~~~~~~~~
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix typos in Hive transfer operator docstrings (#19474)``
* ``Improve various docstrings in Apache Hive providers (#19866)``
* ``Cleanup of start_date and default arg use for Apache example DAGs (#18657)``
2.0.3
.....
Bug Fixes
~~~~~~~~~
* ``fix get_connections deprecation warn in hivemetastore hook (#18854)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``More f-strings (#18855)``
* ``Remove unnecessary string concatenations in AirflowException in s3_to_hive.py (#19026)``
* ``Update documentation for September providers release (#18613)``
* ``Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)``
2.0.2
.....
Bug fixes
~~~~~~~~~
* ``HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)``
Misc
~~~~
* ``Optimise connection importing for Airflow 2.2.0``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update description about the new ''connection-types'' provider meta-data (#17767)``
* ``Import Hooks lazily individually in providers manager (#17682)``
2.0.1
.....
Features
~~~~~~~~
* ``Add Python 3.9 support (#15515)``
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Removes pylint from our toolchain (#16682)``
* ``Prepare documentation for July release of providers. (#17015)``
* ``Fixed wrongly escaped characters in amazon's changelog (#17020)``
* ``Updating Apache example DAGs to use XComArgs (#16869)``
2.0.0
.....
Breaking changes
~~~~~~~~~~~~~~~~
* ``Auto-apply apply_default decorator (#15667)``
.. warning:: Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run ``airflow upgrade db`` to complete the migration.
.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Bump pyupgrade v2.13.0 to v2.18.1 (#15991)``
* ``Remove duplicate key from Python dictionary (#15735)``
* ``Prepares provider release after PIP 21 compatibility (#15576)``
* ``Make Airflow code Pylint 2.8 compatible (#15534)``
* ``Use Pip 21.* to install airflow officially (#15513)``
* ``Updated documentation for June 2021 provider release (#16294)``
* ``Add Connection Documentation for the Hive Provider (#15704)``
* ``More documentation update for June providers release (#16405)``
* ``Synchronizes updated changelog after buggfix release (#16464)``
1.0.3
.....
Bug fixes
~~~~~~~~~
* ``Fix mistake and typos in doc/docstrings (#15180)``
* ``Fix grammar and remove duplicate words (#14647)``
* ``Resolve issue related to HiveCliHook kill (#14542)``
1.0.2
.....
Bug fixes
~~~~~~~~~
* ``Corrections in docs and tools after releasing provider RCs (#14082)``
1.0.1
.....
Updated documentation and readme files.
Bug fixes
~~~~~~~~~
* ``Remove password if in LDAP or CUSTOM mode HiveServer2Hook (#11767)``
1.0.0
.....
Initial version of the provider.