Transformations

Transformations in DataBridge are responsible for processing, combining, and transforming data between the source and destination stages of the pipeline.

Overview

Transformations allow you to:

• Combine Datasets: Merge multiple source datasets into unified views
• Data Filtering: Filter and subset data based on business rules
• Field Mapping: Rename, restructure, and transform data fields
• Data Aggregation: Perform calculations and aggregations
• Data Quality: Clean and standardize data formats
• Business Logic: Apply complex business rules and transformations

Available Transformation Types

• SQL

Common Configuration Pattern

All transformations follow a consistent configuration pattern:

{
  "name": "transformation_name",
  "input_data_frames": ["source1", "source2"],
  "output_data_frame": "output_dataset",
  "type": "transformation_type",
  "configuration": {
    // Type-specific configuration
  }
}

Configuration

See documentation for the transformations configuration element.