6 - Schedule the passengers pipeline

📖 Task Introduction

Let’s create a schedule for this segment of your overall pipeline using the principles you learned in the previous tutorial on Scheduling Pipelines.

🔨 Task Instructions

1. Open the Data Lineage graph you saved in the previous task.

2. Click the Manage schedules button on the right side of your screen.

3. Create a new schedule and name it *yourName Passengers Schedule (e.g., Jmeier Passengers Schedule). Add a description: Build schedule for Datasource Project: Passengers.

4. Switch to a connecting build and then define “what” will build “when”:

   • Set your two clean datasets as the targets of your schedule.
   • Set your two raw datasets as input triggers (i.e., set them as inputs then also as triggers*).

5. Change the Build scope to Project Scoped.

6. Open the Advanced options and set the schedule to abort on failure but retry three times with a minute in between retries.

7. Save your schedule.