blob: 3b1fd3b6e83c2b1a6cfe379bb47e8b492a1086f8 [file] [log] [blame]
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
.. http://www.apache.org/licenses/LICENSE-2.0
.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
=============
Amazon Athena
=============
`Amazon Athena <https://aws.amazon.com/athena/>`__ is an interactive query service
that makes it easy to analyze data in Amazon Simple Storage Service (S3) using
standard SQL. Athena is serverless, so there is no infrastructure to setup or
manage, and you pay only for the queries you run. To get started, simply point
to your data in S3, define the schema, and start querying using standard SQL.
Prerequisite Tasks
------------------
.. include:: _partials/prerequisite_tasks.rst
Operators
---------
.. _howto/operator:AthenaOperator:
Run a query in Amazon Athena
============================
Use the :class:`~airflow.providers.amazon.aws.operators.athena.AthenaOperator`
to run a query in Amazon Athena.
In the following example, we query an existing Athena table and send the results to
an existing Amazon S3 bucket. For more examples of how to use this operator, please
see the `Sample DAG <https://github.com/apache/airflow/blob/main/airflow/providers/amazon/aws/example_dags/example_athena.py>`__.
.. exampleinclude:: /../../tests/system/providers/amazon/aws/example_athena.py
:language: python
:start-after: [START howto_operator_athena]
:dedent: 4
:end-before: [END howto_operator_athena]
Sensors
-------
.. _howto/sensor:AthenaSensor:
Wait on Amazon Athena query results
===================================
Use the :class:`~airflow.providers.amazon.aws.sensors.athena.AthenaSensor`
to wait for the results of a query in Amazon Athena.
.. exampleinclude:: /../../tests/system/providers/amazon/aws/example_athena.py
:language: python
:start-after: [START howto_sensor_athena]
:dedent: 4
:end-before: [END howto_sensor_athena]
Reference
---------
* `AWS boto3 library documentation for Athena <https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/athena.html>`__