5C. [Repositories] Multiple Outputs with Data Transforms8. Add A Data Lineage Graph For Documentation

8 - Add a Data Lineage Graph for Documentation

This content is also available at learn.palantir.com ↗ and is presented here for accessibility purposes.

📖 Task Introduction

Using the same pattern from previous tutorials, add a Data Lineage graph in the pipeline stage folder.

🔨 Task Instructions

  1. Be sure you’re on the Master branch of your flight_alert_metrics_logic repository.
  2. Click the Explore lineage button in the top right of your screen.
  3. Click the < on the flight_alerts_joined_passengers node to bring its input or "parent" datasets to the graph.
  4. Rearrange the nodes aesthetically as desired.
  5. Change the Node color options to Folder to better illustrate the pipeline stage.
  6. Click the Flow button near the top of the screen to animate the data flow between nodes. This doesn’t offer any added functionality but does help emphasize the movement of data on the graph.
  7. Save your graph in your Transform Project: Alert Metrics folder as Alert Metrics Pipeline.