Normalize column names

Supported in: Batch, Streaming

Normalizes column names to use lower_snake_case.

Transform categories: Data preparation

Declared arguments

  • Dataset - Dataset to normalize column names.
    Table
  • optional Remove special characters - Removes all instances of @~`!#$%^&=*+':"/?>< from column names.
    Literal<Boolean>

Examples

Example 1: Base case

Argument values:

  • Dataset: ri.foundry.main.dataset.a
  • Remove special characters: null

Input:

recentlyServicedtailNumber_airlineCode
trueKK-150KK
falseXB-120XB
trueMT-190MT

Output:

recently_servicedtail_numberairline_code
trueKK-150KK
falseXB-120XB
trueMT-190MT

Example 2: Base case

Argument values:

  • Dataset: ri.foundry.main.dataset.a
  • Remove special characters: true

Input:

recently^Servicedtail@Number$!airline*Code
trueKK-150KK
falseXB-120XB
trueMT-190MT

Output:

recently_servicedtail_numberairline_code
trueKK-150KK
falseXB-120XB
trueMT-190MT

Example 3: Edge case

Argument values:

  • Dataset: ri.foundry.main.dataset.a
  • Remove special characters: null

Input:

columnA.columnB()column!Ccolumn,;{} Dcolumn()e
foobarfooBarfoobar

Output:

column_acolumn_bcolumn!_ccolumn_dcolumn_e
foobarfooBarfoobar