Supported in: Batch, Streaming
Transforms input dataset either by selecting columns or applying functions to columns.
Transform categories: Popular
Description: Rename matched columns based on regex. Argument values:
column
,column
,Input:
id | distance_str | factor_str |
---|---|---|
1 | 2000 | 1265 |
Output:
distance_int | factor_int | id |
---|---|---|
2000 | 1265 | 1 |
Description: You can choose to keep both matched and remaining columns. Argument values:
column
,column
, _as_integer
],Input:
id | distance |
---|---|
1 | 2000 |
Output:
distance_as_integer | id | distance |
---|---|---|
2000 | 1 | 2000 |
Description: You can choose to keep the columns that the condition matches, in addition to the new columns that are created. Argument values:
column
,column
, _as_integer
],Input:
id | distance |
---|---|
1 | 2000 |
Output:
distance_as_integer | distance |
---|---|
2000 | 2000 |
Description: When keeping matching columns but the projected column overrides the existing column, then the matched column isn't kept. In order to keep the original column, you must rename the projected column to a new name. Argument values:
column
,Input:
id | distance |
---|---|
1 | 2000 |
Output:
distance |
---|
2000 |
Description: You can choose to keep only the columns that are projected. Argument values:
column
,column
, _as_integer
],Input:
id | distance |
---|---|
1 | 2000 |
Output:
distance_as_integer |
---|
2000 |
Description: You can choose to keep only remaining columns that did not match the condition. Argument values:
column
,Input:
id | distance |
---|---|
1 | 2000 |
Output:
distance | id |
---|---|
2000 | 1 |