| :mod:`airflow.contrib.hooks.emr_hook` |
| ===================================== |
| |
| .. py:module:: airflow.contrib.hooks.emr_hook |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:class:: EmrHook(emr_conn_id=None, region_name=None, *args, **kwargs) |
| |
| Bases: :class:`airflow.contrib.hooks.aws_hook.AwsHook` |
| |
| Interact with AWS EMR. emr_conn_id is only necessary for using the |
| create_job_flow method. |
| |
| |
| .. method:: get_conn(self) |
| |
| |
| |
| |
| .. method:: get_cluster_id_by_name(self, emr_cluster_name, cluster_states) |
| |
| |
| |
| |
| .. method:: create_job_flow(self, job_flow_overrides) |
| |
| Creates a job flow using the config from the EMR connection. |
| Keys of the json extra hash may have the arguments of the boto3 |
| run_job_flow method. |
| Overrides for this config may be passed as the job_flow_overrides. |
| |
| |
| |
| |
