7 - Exercise Summary

✅ What you built

1. A new Datasource project for passenger data.
2. New Pipeline Builder artifacts in the project’s .../datasets/raw and .../datasets/clean folders.
3. A JSON parsing transform.
4. A series of transforms to clean raw passenger data.
5. Notepad and Data Lineage documentation for the passengers datasource pipeline.
6. A build schedule for the passengers datasource pipeline.

✅ What you learned

Pipeline Builder can parse JSON (and XML) into formats usable by Spark (e.g., Parquet).