| :mod:`airflow.contrib.operators.sqoop_operator` |
| =============================================== |
| |
| .. py:module:: airflow.contrib.operators.sqoop_operator |
| |
| .. autoapi-nested-parse:: |
| |
| This module contains a sqoop 1 operator |
| |
| |
| |
| Module Contents |
| --------------- |
| |
| .. py:class:: SqoopOperator(conn_id='sqoop_default', cmd_type='import', table=None, query=None, target_dir=None, append=None, file_type='text', columns=None, num_mappers=None, split_by=None, where=None, export_dir=None, input_null_string=None, input_null_non_string=None, staging_table=None, clear_staging_table=False, enclosed_by=None, escaped_by=None, input_fields_terminated_by=None, input_lines_terminated_by=None, input_optionally_enclosed_by=None, batch=False, direct=False, driver=None, verbose=False, relaxed_isolation=False, properties=None, hcatalog_database=None, hcatalog_table=None, create_hcatalog_table=False, extra_import_options=None, extra_export_options=None, *args, **kwargs) |
| |
| Bases: :class:`airflow.models.BaseOperator` |
| |
| Execute a Sqoop job. |
| Documentation for Apache Sqoop can be found here: |
| https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html |
| |
| .. attribute:: template_fields |
| :annotation: = ['conn_id', 'cmd_type', 'table', 'query', 'target_dir', 'file_type', 'columns', 'split_by', 'where', 'export_dir', 'input_null_string', 'input_null_non_string', 'staging_table', 'enclosed_by', 'escaped_by', 'input_fields_terminated_by', 'input_lines_terminated_by', 'input_optionally_enclosed_by', 'properties', 'extra_import_options', 'driver', 'extra_export_options', 'hcatalog_database', 'hcatalog_table'] |
| |
| |
| |
| .. attribute:: ui_color |
| :annotation: = #7D8CA4 |
| |
| |
| |
| |
| .. method:: execute(self, context) |
| |
| Execute sqoop job |
| |
| |
| |
| |
| .. method:: on_kill(self) |
| |
| |
| |
| |
