blob: 93b80740429deba511a8356495169e8adca99786 [file] [log] [blame]
:mod:`airflow.providers.google.cloud.operators.dataprep`
========================================================
.. py:module:: airflow.providers.google.cloud.operators.dataprep
.. autoapi-nested-parse::
This module contains a Google Dataprep operator.
Module Contents
---------------
.. py:class:: DataprepGetJobsForJobGroupOperator(*, dataprep_conn_id: str = 'dataprep_default', job_id: int, **kwargs)
Bases: :class:`airflow.models.BaseOperator`
Get information about the batch jobs within a Cloud Dataprep job.
API documentation https://clouddataprep.com/documentation/api#section/Overview
.. seealso::
For more information on how to use this operator, take a look at the guide:
:ref:`howto/operator:DataprepGetJobsForJobGroupOperator`
:param job_id The ID of the job that will be requests
:type job_id: int
.. attribute:: template_fields
:annotation: = ['job_id']
.. method:: execute(self, context: dict)
.. py:class:: DataprepGetJobGroupOperator(*, dataprep_conn_id: str = 'dataprep_default', job_group_id: int, embed: str, include_deleted: bool, **kwargs)
Bases: :class:`airflow.models.BaseOperator`
Get the specified job group.
A job group is a job that is executed from a specific node in a flow.
API documentation https://clouddataprep.com/documentation/api#section/Overview
.. seealso::
For more information on how to use this operator, take a look at the guide:
:ref:`howto/operator:DataprepGetJobGroupOperator`
:param job_group_id: The ID of the job that will be requests
:type job_group_id: int
:param embed: Comma-separated list of objects to pull in as part of the response
:type embed: string
:param include_deleted: if set to "true", will include deleted objects
:type include_deleted: bool
.. attribute:: template_fields
:annotation: = ['job_group_id', 'embed']
.. method:: execute(self, context: dict)
.. py:class:: DataprepRunJobGroupOperator(*, dataprep_conn_id: str = 'dataprep_default', body_request: dict, **kwargs)
Bases: :class:`airflow.models.BaseOperator`
Create a ``jobGroup``, which launches the specified job as the authenticated user.
This performs the same action as clicking on the Run Job button in the application.
To get recipe_id please follow the Dataprep API documentation
https://clouddataprep.com/documentation/api#operation/runJobGroup
:param recipe_id: The identifier for the recipe you would like to run.
:type recipe_id: int
.. attribute:: template_fields
:annotation: = ['body_request']
.. method:: execute(self, context: None)