| :mod:`airflow.contrib.sensors.emr_step_sensor` |
| ============================================== |
| |
| .. py:module:: airflow.contrib.sensors.emr_step_sensor |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:class:: EmrStepSensor(job_flow_id, step_id, *args, **kwargs) |
| |
| Bases: :class:`airflow.contrib.sensors.emr_base_sensor.EmrBaseSensor` |
| |
| Asks for the state of the step until it reaches a terminal state. |
| If it fails the sensor errors, failing the task. |
| |
| :param job_flow_id: job_flow_id which contains the step check the state of |
| :type job_flow_id: str |
| :param step_id: step to check the state of |
| :type step_id: str |
| |
| .. attribute:: NON_TERMINAL_STATES |
| :annotation: = ['PENDING', 'RUNNING', 'CONTINUE', 'CANCEL_PENDING'] |
| |
| |
| |
| .. attribute:: FAILED_STATE |
| :annotation: = ['CANCELLED', 'FAILED', 'INTERRUPTED'] |
| |
| |
| |
| .. attribute:: template_fields |
| :annotation: = ['job_flow_id', 'step_id'] |
| |
| |
| |
| .. attribute:: template_ext |
| :annotation: = [] |
| |
| |
| |
| |
| .. method:: get_emr_response(self) |
| |
| |
| |
| |
| .. staticmethod:: state_from_response(response) |
| |
| |
| |
| |
| .. staticmethod:: failure_message_from_response(response) |
| |
| |
| |
| |