5B. [Repositories] Publishing and Using Shared Libraries in Code Repositories18. Key Takeaways
18 - Key Takeaways
This content is also available at learn.palantir.com ↗ and is presented here for accessibility purposes.
Foundry enables you to publish Python libraries to your organization’s Conda library where they can be referenced broadly. This workflow is an important part of a Foundry data engineer’s toolkit.
In this tutorial you:
Learned how Python packages are made available in the Code Repositories application.
Built your own code library repository and published cleaning and type utilities.
Used your published cleaning and type utilities in your flight alerts and passengers logic repositories.
Configured a schedule and added documentation elements for your passengers datasource project.
Below is a list of product documentation used in the course of this training:
You now have a set of clean dataset outputs from your passengers and flight alerts datasource projects. It’s now time to move to the next phase of your pipeline — the transform project. There’s you’ll continue to explore increasingly sophisticated techniques for transforming data in your pipeline.