Data connectivity & integrationPipeline Builder TransformsProject

Project

Supported in: Batch, Streaming

Transforms input dataset either by selecting columns or applying functions to columns.

Transform categories: Other

Declared arguments

  • Columns - List of column transformations to apply to the dataset.
    List<Expression<AnyType>>
  • Dataset - Dataset to apply operations to.
    Table
  • Keep remaining columns - Keeps all columns not projected in the dataset.
    Literal<Boolean>

Examples

Example 1: Base case

Argument values:

  • Columns: [
    alias(
     alias: airline,
     expression: airlin,
    )]
  • Dataset: ri.foundry.main.dataset.a
  • Keep remaining columns: false

Input:

airlinmiles
foundry airways2500
new air3000

Output:

airline
foundry airways
new air