Drop duplicates

Supported in: Batch

Drops duplicate rows from the input.

Transform categories: Other

Declared arguments

• Dataset - Dataset to deduplicate rows.
  Table
• optional Column subset - If any columns are specified only those will be used when determining uniqueness.
  Set<Column<AnyType>>

Examples

Example 1: Base case

Argument values:

• Dataset: ri.foundry.main.dataset.aggregate
• Column subset: {tail_number}

Input:

Output:

---

Example 2: Base case

Description: No subset looks for exact duplicates. Argument values:

• Dataset: ri.foundry.main.dataset.aggregate
• Column subset: {}

Input:

Output:

---