Semi join

Supported in: Batch

Semi joins left and right dataset inputs together. This removes all rows that don't match the join condition.

Transform categories: Join

Declared arguments

• Condition for columns to select on the left: All columns in the left input schema will be tested to see if they match this condition. If they match, the column will be selected in the output.
  ColumnPredicate
• Join condition: Condition on which to join.
  Expression<Boolean>
• Left dataset: Left dataset to use in join.
  Table
• Right dataset: Right dataset to use in join.
  Table

Examples

Example 1: Base case

Argument values:

• Condition for columns to select on the left:
  columnNameIsIn(
   columnNames: [tail_number, airline],
  )
• Join condition:
  equals(
   left: tail_number,
   right: tail_number,
  )
• Left dataset: ri.foundry.main.dataset.left
• Right dataset: ri.foundry.main.dataset.right

Inputs:

ri.foundry.main.dataset.left

ri.foundry.main.dataset.right

Output:

---

Example 2: Base case

Description: Simple complex join condition.

Argument values:

• Condition for columns to select on the left:
  columnNameIsIn(
   columnNames: [tail_number, airline, factor],
  )
• Join condition:
  and(
   conditions: [
  lessThan(
   left: factor,
   right: factor,
  ),
  equals(
   left: tail_number,
   right: tail_number,
  )],
  )
• Left dataset: ri.foundry.main.dataset.left
• Right dataset: ri.foundry.main.dataset.right

Inputs:

ri.foundry.main.dataset.left

ri.foundry.main.dataset.right

Output:

---

Example 3: Base case

Argument values:

• Condition for columns to select on the left:
  columnNameIsIn(
   columnNames: [tail_number, airline, factor],
  )
• Join condition:
  and(
   conditions: [
  equals(
   left: tail_number,
   right: tail_number,
  ),
  equals(
   left: factor,
   right: factor,
  )],
  )
• Left dataset: ri.foundry.main.dataset.left
• Right dataset: ri.foundry.main.dataset.right

Inputs:

ri.foundry.main.dataset.left

ri.foundry.main.dataset.right

Output:

---

Example 4: Base case

Argument values:

• Condition for columns to select on the left:
  allColumns(
  
  )
• Join condition:
  equals(
   left: tail_number,
   right: tail_number,
  )
• Left dataset: ri.foundry.main.dataset.left
• Right dataset: ri.foundry.main.dataset.right

Inputs:

ri.foundry.main.dataset.left

ri.foundry.main.dataset.right

Output:

---