1. Data Pipeline Foundations11. Maintaining

11 - Maintaining

This content is also available at learn.palantir.com ↗ and is presented here for accessibility purposes.

Once you’ve built your datasets in Pipeline Builder (or in a repository if specialized code is needed), you can schedule and monitor your logic using a number of complementary pipeline maintenance applications, each of which you’ll encounter on this learning path.

  • Data Lineage, which you discovered during the Intro to Foundry course, offers pipeline visualization and exploration tools for understanding data freshness, health, resource usage, and downstream dependencies.
  • The Scheduler application, which is accessible in Data Lineage, enables you to define datasets that should build together when your defined time and/or event-based are triggered. It also tracks pipeline metrics and provides additional schedule-level health checks.
  • You’ll use the Data Health application to monitor your pipeline and alert you when your defined conditions are met.