5C. [Repositories] Multiple Outputs with Data Transforms12. Key Takeaways

12 - Key Takeaways

This content is also available at learn.palantir.com ↗ and is presented here for accessibility purposes.

The Foundry Transforms API provides you with two frameworks for outputting multiple datasets from a single transform file. Using the transform_df() decorator, you can write a for loop to programmatically run inputs through logic and output them according to a provided array in a generated transform. A multi-output transform, by contrast, leverages the transform() decorator to output multiple datasets while running the code logic only once.

In this tutorial you:

  1. Built a Transform Project stage of your pipeline.
  2. Created a generated and multi-output transform that resulted in several output datasets.
  3. Configured a schedule and added documentation elements for your transform project.

Below is a list of product documentation used in the course of this training:

Having your builds operating automatically on a schedule reliably provides your downstream use cases with fresh data. But what if something unexpected happens during the build process? The next two tutorials convey best practices and steps for monitoring the health of your pipeline.