permalinkUse a Python function in Pipeline Builder

permalinkPrerequisites

This guide assumes you have already authored and published a Python function. Review our getting started with Python functions documentation for a tutorial.

permalinkArchitecture

Python functions run in a Pipeline Builder pipeline as a sidecar container. This means that the function does not need to be deployed and scales dynamically with the size of your pipeline. Embedded functions can be previewed similarly to other transforms in Pipeline Builder.

permalinkUse your function in a Pipeline Builder pipeline

Follow the steps below to prepare and configure a Python function in your pipeline:

1. Open the Pipeline Builder pipeline in which you want to use your Python function.

2. Select Reusables from the upper part of the pipeline graph, then choose User-defined functions.

3. Select Import UDF and search through the available functions to find the one you want to use.
4. Choose Add next to the function name. The function should then show as Imported.

5. Close the import dialogue and select Transform on your Pipeline Builder graph where you would like to use the function.
6. From the list of transforms, find the UDFs tab to the left to view your imported functions.
7. Fill out the transform definition specifying the input columns and parameters, then select Apply.

You should now see your Python function on your Pipeline Builder graph and can preview the output of the function.