Overview

Pipeline outputs are the end result of a pipeline in Pipeline Builder; outputs can be datasets or Ontology components such as object types, object links, or time series.

Creating Ontology outputs is currently an experimental feature in Pipeline Builder. Your version of Pipeline Builder may not include this functionality. For more information, contact your Palantir representative.

Outputs help you describe your pipeline, from adding your data to creating transform logic. Outputs are created once you deploy your first pipeline build and allow you to expand your workflow and Project capabilities in other Foundry applications.

To add an output, select Add pipeline output in the outputs panel to the right of your graph.

New pipeline creation page

This will take you to the output type selection screen.

Output types

Review the sections below for details on each output type.

Datasets

A dataset is a fundamental element in Foundry. Workflows in Pipeline Builder start with adding datasets, continue with transforms on datasets, and can end with datasets as an output. Add a dataset as an output to when you want to build a pipeline that produces clean, transformed data. You can use your final dataset as a foundation for Ontology building in the Ontology Manager.

Learn more about adding dataset outputs.

Geotemporal series syncs

Geotemporal series can be used to track the geographic position of entities over time, and consist of different observations. Each observation contains an identifier, timestamp, position, and other user-specified properties. You can add a geotemporal series sync output to your Pipeline Builder pipeline to make batch or streaming geotemporal data in Foundry available in downstream applications such as the Map application. Geotemporal observations from Foundry are written in Pipeline Builder.

Learn more about adding geotemporal series syncs in Pipeline Builder.

In order to use the geotemporal series sync output in Pipeline Builder, you must have geotemporal series enabled for your enrollment. Please contact your Palantir representative for any further questions about enabling this feature.

Ontology outputs

Add Ontology elements as outputs to your pipeline to guide your workflow from raw datasets to cleaned and structured data that defines a new object type element in your global Ontology. With Pipeline Builder, you can add and edit object types, link types, and time series within one workflow interface rather than navigating back to Ontology Manager.

Learn more about adding Ontology outputs.

Object types

An object type is the schema definition of a real-world entity or event. Add an object type output to your workflow to help guide data transforms into defined elements that you can use to build applications in Foundry, including Workshop modules or Slate applications.

A link type is the schema definition of a relationship between two object types. A link refers to a single instance of that relationship between two objects. If you add two object type outputs to your pipeline, you can create a link to define their relationship and add to your global Ontology. Use object links to build robust applications in Workshop and Slate.

Time series syncs

Time series data are any data that consists of one or more sets of timestamp and value pairs; these pairs measure a quantity over time. This can include measuring sales volumes per year, total flights per day, production outputs per hour, or high frequency temperature readings at sub-second resolution. Add a time series sync output to your Pipeline to index data backing time series properties.

Learn more about time series setup and usage.

Learn more about the Foundry Ontology.