Introduction to Data Analysis in Foundry5. Tabular Data Lifecycle

5 - Tabular Data Lifecycle

This content is also available at learn.palantir.com ↗ and is presented here for accessibility purposes.

How can I ensure as an analyst that the datasets I'm working with reflect the latest available data? How is tabular data updated in Foundry?

Foundry’s data integration suite enables you and your team to connect to and regularly synchronize external datasources into Foundry. Once those connections are made, your data engineer colleagues can construct data transformation pipelines in Foundry that execute on a schedule. Those schedules can be monitored for freshness and quality using granular checks. As an analyst, you, too, can review these health measures to validate the data you’re working with.

As an analyst, you may not need to know the details of a pipeline — its code, logic, service level agreements — but awareness of the general scope of Foundry data pipelines is beneficial. Review Data pipeline to check basic concepts of a data pipeline. Then review Manage schedules documentation for an overview of how your data engineer colleagues configure pipeline schedules to keep data up-to-date.