title: “Pipeline option patterns”

Pipeline option patterns

The samples on this page show you common pipeline configurations. For more information about pipeline configuration options, see Creating a pipeline and Configuring pipeline options.

{{< language-switcher java py >}}

Retroactively logging runtime parameters

Use the ValueProvider interface to access runtime parameters after completing a pipeline job.

You can use the ValueProvider interface to pass runtime parameters to your pipeline, but you can only log the parameters from within the Beam DAG. A solution is to add a pipeline branch with a DoFn that processes a placeholder value and then logs the runtime parameters:

{{< highlight java >}} {{< code_sample “examples/java/src/main/java/org/apache/beam/examples/snippets/Snippets.java” AccessingValueProviderInfoAfterRunSnip1 >}} {{< /highlight >}}

{{< highlight py >}} {{< code_sample “sdks/python/apache_beam/examples/snippets/snippets.py” AccessingValueProviderInfoAfterRunSnip1 >}} {{< /highlight >}}