1 - About this Course

Authoring data pipelines is traditionally a slow, messy and expensive undertaking that often results in a patchwork of unmanageable pipelines that are:

1. Expensive to maintain
2. Inaccessible to non-technical users
3. Maintained via tribal knowledge.

This course is about using Foundry to break that mold by democratizing and streamlining pipeline construction and maintenance.

📚 Recommended Reading (~8 minutes)

Review this primer ↗ on ways the Foundry data transformation and pipelining capabilities address data quality challenges.

⚠️ Course Prerequisites

If you have not completed Foundry Foundations ↗ and Intro to Foundry on the Data Engineering learning path, do so now.

Outcomes

This course will introduce you to Foundry vocabulary and applications you’ll be using as you transform data.

⚠️ Note that this course will be split into two tracks:

1. Pipeline Builder (course prefix "Builder")
2. Code Repositories (course prefix "Repositories")

You are of course free to follow both tracks, but we advise you to prioritize the "Builder" track, first.

Courses without prefix are shared among both tracks.

🥅 Learning Objectives

• Understand the definition and essential anatomy of a Foundry data pipeline.
• Learn the sequence of data integration applications you’ll be using through the learning path.

💪 Foundry Skills

• Explore a pipeline with the Data Lineage application.
• Create a project structure for the first stage of your data pipeline.