12 - Key Takeaways

You now have a new datasource project structure, repository, and preprocessed datasets for passengers, having parsed raw files into Spark DataFrames and written them to Parquet. At this point, you should be getting used to the basic development flow: branch → code → preview → commit → build → merge. As we proceed, we’ll continue to add nuance and complexity.

In this tutorial you:

1. Created a Datasource Project: Passengers project and associated passengers_logic code repository.
2. Used Foundry APIs and packages to parse raw JSON and CSV files into output datasets.

Below is a list of product documentation used in the course of this training:

• Python Raw File Access
• Deep dive on Foundry build concepts