airflow_client.client.DatasetApi

All URIs are relative to /api/v1

Method	HTTP request	Description
create_dataset_event	POST /datasets/events	Create dataset event
delete_dag_dataset_queued_event	DELETE /dags/{dag_id}/datasets/queuedEvent/{uri}	Delete a queued Dataset event for a DAG.
delete_dag_dataset_queued_events	DELETE /dags/{dag_id}/datasets/queuedEvent	Delete queued Dataset events for a DAG.
delete_dataset_queued_events	DELETE /datasets/queuedEvent/{uri}	Delete queued Dataset events for a Dataset.
get_dag_dataset_queued_event	GET /dags/{dag_id}/datasets/queuedEvent/{uri}	Get a queued Dataset event for a DAG
get_dag_dataset_queued_events	GET /dags/{dag_id}/datasets/queuedEvent	Get queued Dataset events for a DAG.
get_dataset	GET /datasets/{uri}	Get a dataset
get_dataset_events	GET /datasets/events	Get dataset events
get_dataset_queued_events	GET /datasets/queuedEvent/{uri}	Get queued Dataset events for a Dataset.
get_datasets	GET /datasets	List datasets
get_upstream_dataset_events	GET /dags/{dag_id}/dagRuns/{dag_run_id}/upstreamDatasetEvents	Get dataset events for a DAG run

create_dataset_event

DatasetEvent create_dataset_event(create_dataset_event)

Create dataset event

Create dataset event

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.create_dataset_event import CreateDatasetEvent
from airflow_client.client.model.error import Error
from airflow_client.client.model.dataset_event import DatasetEvent
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    create_dataset_event = CreateDatasetEvent(
        dataset_uri="dataset_uri_example",
        extra={},
    ) # CreateDatasetEvent | 

    # example passing only required values which don't have defaults set
    try:
        # Create dataset event
        api_response = api_instance.create_dataset_event(create_dataset_event)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->create_dataset_event: %s\n" % e)

Parameters

Name	Type	Description	Notes
create_dataset_event	CreateDatasetEvent

Return type

DatasetEvent

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: application/json
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
400	Client specified an invalid argument.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

delete_dag_dataset_queued_event

delete_dag_dataset_queued_event(dag_id, uri)

Delete a queued Dataset event for a DAG.

Delete a queued Dataset event for a DAG. New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    dag_id = "dag_id_example" # str | The DAG ID.
    uri = "uri_example" # str | The encoded Dataset URI
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Delete a queued Dataset event for a DAG.
        api_instance.delete_dag_dataset_queued_event(dag_id, uri)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dag_dataset_queued_event: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Delete a queued Dataset event for a DAG.
        api_instance.delete_dag_dataset_queued_event(dag_id, uri, before=before)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dag_dataset_queued_event: %s\n" % e)

Parameters

Name	Type	Description	Notes
dag_id	str	The DAG ID.
uri	str	The encoded Dataset URI
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

void (empty response body)

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
204	Success.	-
400	Client specified an invalid argument.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

delete_dag_dataset_queued_events

delete_dag_dataset_queued_events(dag_id)

Delete queued Dataset events for a DAG.

Delete queued Dataset events for a DAG. New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    dag_id = "dag_id_example" # str | The DAG ID.
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Delete queued Dataset events for a DAG.
        api_instance.delete_dag_dataset_queued_events(dag_id)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dag_dataset_queued_events: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Delete queued Dataset events for a DAG.
        api_instance.delete_dag_dataset_queued_events(dag_id, before=before)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dag_dataset_queued_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
dag_id	str	The DAG ID.
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

void (empty response body)

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
204	Success.	-
400	Client specified an invalid argument.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

delete_dataset_queued_events

delete_dataset_queued_events(uri)

Delete queued Dataset events for a Dataset.

Delete queued Dataset events for a Dataset. New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    uri = "uri_example" # str | The encoded Dataset URI
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Delete queued Dataset events for a Dataset.
        api_instance.delete_dataset_queued_events(uri)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dataset_queued_events: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Delete queued Dataset events for a Dataset.
        api_instance.delete_dataset_queued_events(uri, before=before)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->delete_dataset_queued_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
uri	str	The encoded Dataset URI
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

void (empty response body)

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
204	Success.	-
400	Client specified an invalid argument.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_dag_dataset_queued_event

QueuedEvent get_dag_dataset_queued_event(dag_id, uri)

Get a queued Dataset event for a DAG

Get a queued Dataset event for a DAG. New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from airflow_client.client.model.queued_event import QueuedEvent
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    dag_id = "dag_id_example" # str | The DAG ID.
    uri = "uri_example" # str | The encoded Dataset URI
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Get a queued Dataset event for a DAG
        api_response = api_instance.get_dag_dataset_queued_event(dag_id, uri)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dag_dataset_queued_event: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Get a queued Dataset event for a DAG
        api_response = api_instance.get_dag_dataset_queued_event(dag_id, uri, before=before)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dag_dataset_queued_event: %s\n" % e)

Parameters

Name	Type	Description	Notes
dag_id	str	The DAG ID.
uri	str	The encoded Dataset URI
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

QueuedEvent

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_dag_dataset_queued_events

QueuedEventCollection get_dag_dataset_queued_events(dag_id)

Get queued Dataset events for a DAG.

Get queued Dataset events for a DAG. New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.queued_event_collection import QueuedEventCollection
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    dag_id = "dag_id_example" # str | The DAG ID.
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Get queued Dataset events for a DAG.
        api_response = api_instance.get_dag_dataset_queued_events(dag_id)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dag_dataset_queued_events: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Get queued Dataset events for a DAG.
        api_response = api_instance.get_dag_dataset_queued_events(dag_id, before=before)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dag_dataset_queued_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
dag_id	str	The DAG ID.
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

QueuedEventCollection

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_dataset

Dataset get_dataset(uri)

Get a dataset

Get a dataset by uri.

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from airflow_client.client.model.dataset import Dataset
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    uri = "uri_example" # str | The encoded Dataset URI

    # example passing only required values which don't have defaults set
    try:
        # Get a dataset
        api_response = api_instance.get_dataset(uri)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dataset: %s\n" % e)

Parameters

Name	Type	Description	Notes
uri	str	The encoded Dataset URI

Return type

Dataset

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_dataset_events

DatasetEventCollection get_dataset_events()

Get dataset events

Get dataset events

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.dataset_event_collection import DatasetEventCollection
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    limit = 100 # int | The numbers of items to return. (optional) if omitted the server will use the default value of 100
    offset = 0 # int | The number of items to skip before starting to collect the result set. (optional)
    order_by = "order_by_example" # str | The name of the field to order the results by. Prefix a field name with `-` to reverse the sort order.  *New in version 2.1.0*  (optional)
    dataset_id = 1 # int | The Dataset ID that updated the dataset. (optional)
    source_dag_id = "source_dag_id_example" # str | The DAG ID that updated the dataset. (optional)
    source_task_id = "source_task_id_example" # str | The task ID that updated the dataset. (optional)
    source_run_id = "source_run_id_example" # str | The DAG run ID that updated the dataset. (optional)
    source_map_index = 1 # int | The map index that updated the dataset. (optional)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Get dataset events
        api_response = api_instance.get_dataset_events(limit=limit, offset=offset, order_by=order_by, dataset_id=dataset_id, source_dag_id=source_dag_id, source_task_id=source_task_id, source_run_id=source_run_id, source_map_index=source_map_index)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dataset_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
limit	int	The numbers of items to return.	[optional] if omitted the server will use the default value of 100
offset	int	The number of items to skip before starting to collect the result set.	[optional]
order_by	str	The name of the field to order the results by. Prefix a field name with `-` to reverse the sort order. New in version 2.1.0	[optional]
dataset_id	int	The Dataset ID that updated the dataset.	[optional]
source_dag_id	str	The DAG ID that updated the dataset.	[optional]
source_task_id	str	The task ID that updated the dataset.	[optional]
source_run_id	str	The DAG run ID that updated the dataset.	[optional]
source_map_index	int	The map index that updated the dataset.	[optional]

Return type

DatasetEventCollection

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_dataset_queued_events

QueuedEventCollection get_dataset_queued_events(uri)

Get queued Dataset events for a Dataset.

Get queued Dataset events for a Dataset New in version 2.9.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.queued_event_collection import QueuedEventCollection
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    uri = "uri_example" # str | The encoded Dataset URI
    before = dateutil_parser('1970-01-01T00:00:00.00Z') # datetime | Timestamp to select event logs occurring before. (optional)

    # example passing only required values which don't have defaults set
    try:
        # Get queued Dataset events for a Dataset.
        api_response = api_instance.get_dataset_queued_events(uri)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dataset_queued_events: %s\n" % e)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # Get queued Dataset events for a Dataset.
        api_response = api_instance.get_dataset_queued_events(uri, before=before)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_dataset_queued_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
uri	str	The encoded Dataset URI
before	datetime	Timestamp to select event logs occurring before.	[optional]

Return type

QueuedEventCollection

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_datasets

DatasetCollection get_datasets()

List datasets

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.error import Error
from airflow_client.client.model.dataset_collection import DatasetCollection
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    limit = 100 # int | The numbers of items to return. (optional) if omitted the server will use the default value of 100
    offset = 0 # int | The number of items to skip before starting to collect the result set. (optional)
    order_by = "order_by_example" # str | The name of the field to order the results by. Prefix a field name with `-` to reverse the sort order.  *New in version 2.1.0*  (optional)
    uri_pattern = "uri_pattern_example" # str | If set, only return datasets with uris matching this pattern.  (optional)
    dag_ids = "dag_ids_example" # str | One or more DAG IDs separated by commas to filter datasets by associated DAGs either consuming or producing.  *New in version 2.9.0*  (optional)

    # example passing only required values which don't have defaults set
    # and optional values
    try:
        # List datasets
        api_response = api_instance.get_datasets(limit=limit, offset=offset, order_by=order_by, uri_pattern=uri_pattern, dag_ids=dag_ids)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_datasets: %s\n" % e)

Parameters

Name	Type	Description	Notes
limit	int	The numbers of items to return.	[optional] if omitted the server will use the default value of 100
offset	int	The number of items to skip before starting to collect the result set.	[optional]
order_by	str	The name of the field to order the results by. Prefix a field name with `-` to reverse the sort order. New in version 2.1.0	[optional]
uri_pattern	str	If set, only return datasets with uris matching this pattern.	[optional]
dag_ids	str	One or more DAG IDs separated by commas to filter datasets by associated DAGs either consuming or producing. New in version 2.9.0	[optional]

Return type

DatasetCollection

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]

get_upstream_dataset_events

DatasetEventCollection get_upstream_dataset_events(dag_id, dag_run_id)

Get dataset events for a DAG run

Get datasets for a dag run. New in version 2.4.0

Example

• Basic Authentication (Basic):

import time
import airflow_client.client
from airflow_client.client.api import dataset_api
from airflow_client.client.model.dataset_event_collection import DatasetEventCollection
from airflow_client.client.model.error import Error
from pprint import pprint
# Defining the host is optional and defaults to /api/v1
# See configuration.py for a list of all supported configuration parameters.
configuration = airflow_client.client.Configuration(
    host = "/api/v1"
)

# The client must configure the authentication and authorization parameters
# in accordance with the API server security policy.
# Examples for each auth method are provided below, use the example that
# satisfies your auth use case.

# Configure HTTP basic authorization: Basic
configuration = airflow_client.client.Configuration(
    username = 'YOUR_USERNAME',
    password = 'YOUR_PASSWORD'
)

# Enter a context with an instance of the API client
with airflow_client.client.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = dataset_api.DatasetApi(api_client)
    dag_id = "dag_id_example" # str | The DAG ID.
    dag_run_id = "dag_run_id_example" # str | The DAG run ID.

    # example passing only required values which don't have defaults set
    try:
        # Get dataset events for a DAG run
        api_response = api_instance.get_upstream_dataset_events(dag_id, dag_run_id)
        pprint(api_response)
    except airflow_client.client.ApiException as e:
        print("Exception when calling DatasetApi->get_upstream_dataset_events: %s\n" % e)

Parameters

Name	Type	Description	Notes
dag_id	str	The DAG ID.
dag_run_id	str	The DAG run ID.

Return type

DatasetEventCollection

Authorization

Basic, Kerberos

HTTP request headers

• Content-Type: Not defined
• Accept: application/json

HTTP response details

Status code	Description	Response headers
200	Success.	-
401	Request not authenticated due to missing, invalid, authentication info.	-
403	Client does not have sufficient permission.	-
404	A specified resource is not found.	-

[Back to top] [Back to API list] [Back to Model list] [Back to README]