| :py:mod:`airflow.providers.apache.hdfs.hooks.hdfs` |
| ================================================== |
| |
| .. py:module:: airflow.providers.apache.hdfs.hooks.hdfs |
| |
| .. autoapi-nested-parse:: |
| |
| Hook for HDFS operations |
| |
| |
| |
| Module Contents |
| --------------- |
| |
| Classes |
| ~~~~~~~ |
| |
| .. autoapisummary:: |
| |
| airflow.providers.apache.hdfs.hooks.hdfs.HDFSHook |
| |
| |
| |
| |
| Attributes |
| ~~~~~~~~~~ |
| |
| .. autoapisummary:: |
| |
| airflow.providers.apache.hdfs.hooks.hdfs.snakebite_loaded |
| |
| |
| .. py:data:: snakebite_loaded |
| :annotation: = True |
| |
| |
| |
| .. py:exception:: HDFSHookException |
| |
| Bases: :py:obj:`airflow.exceptions.AirflowException` |
| |
| Exception specific for HDFS |
| |
| |
| .. py:class:: HDFSHook(hdfs_conn_id = 'hdfs_default', proxy_user = None, autoconfig = False) |
| |
| Bases: :py:obj:`airflow.hooks.base.BaseHook` |
| |
| Interact with HDFS. This class is a wrapper around the snakebite library. |
| |
| :param hdfs_conn_id: Connection id to fetch connection info |
| :param proxy_user: effective user for HDFS operations |
| :param autoconfig: use snakebite's automatically configured client |
| |
| .. py:attribute:: conn_name_attr |
| :annotation: = hdfs_conn_id |
| |
| |
| |
| .. py:attribute:: default_conn_name |
| :annotation: = hdfs_default |
| |
| |
| |
| .. py:attribute:: conn_type |
| :annotation: = hdfs |
| |
| |
| |
| .. py:attribute:: hook_name |
| :annotation: = HDFS |
| |
| |
| |
| .. py:method:: get_conn() |
| |
| Returns a snakebite HDFSClient object. |
| |
| |
| |
