| :mod:`airflow.sensors.named_hive_partition_sensor` |
| ================================================== |
| |
| .. py:module:: airflow.sensors.named_hive_partition_sensor |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:class:: NamedHivePartitionSensor(partition_names, metastore_conn_id='metastore_default', poke_interval=60 * 3, hook=None, *args, **kwargs) |
| |
| Bases: :class:`airflow.sensors.base_sensor_operator.BaseSensorOperator` |
| |
| Waits for a set of partitions to show up in Hive. |
| |
| :param partition_names: List of fully qualified names of the |
| partitions to wait for. A fully qualified name is of the |
| form ``schema.table/pk1=pv1/pk2=pv2``, for example, |
| default.users/ds=2016-01-01. This is passed as is to the metastore |
| Thrift client ``get_partitions_by_name`` method. Note that |
| you cannot use logical or comparison operators as in |
| HivePartitionSensor. |
| :type partition_names: list[str] |
| :param metastore_conn_id: reference to the metastore thrift service |
| connection id |
| :type metastore_conn_id: str |
| |
| .. attribute:: template_fields |
| :annotation: = ['partition_names'] |
| |
| |
| |
| .. attribute:: ui_color |
| :annotation: = #8d99ae |
| |
| |
| |
| |
| .. staticmethod:: parse_partition_name(partition) |
| |
| |
| |
| |
| .. method:: poke_partition(self, partition) |
| |
| |
| |
| |
| .. method:: poke(self, context) |
| |
| |
| |
| |
