Configuration section: destination_adapters

Description

Destination Adapters deliver data that has been ingested and transformed by the DataBridge Engine Pipeline to destination systems (e.g. beqom APIs). As destination systems have different APIs with diverse configuration formats, each destination adapter has a dedicated configuration format. The configuration for each Destination Adapter can be split into:

• A "wrapper" which indicates the connector to be launched
• An "inner section" which contains connector-specific configuration

The "wrapper" is covered in this documentation section while each Destination Adapter has their dedicated documentation page under the Destination Adapters section.

Specification

adapter (string, required)

Module name, e.g., accelerate_integration, payanalytics_dataset.

See Destination Adapters section.

datasets (string[], required)

A list of Data Frame names that are available to the Destination Adapter.

secrets (string[], required)

A list of names for the secrets are available to the Destination Adapter.

configuration (object, required)

Adapter specific, see Destination Adapters

Example:

{
  "version": 1,
  "destination_adapters": [
    {
      "adapter": "payanalytics_dataset",
      "configuration": {
        "instance_url": "customer.payanalytics.com",
        "identifier_prefix": null,
        "data_source": "employees",
        "api_token_secret_name": "my-payanalytics-secret",
        "field_mapping": {
          "employee_id_field": "empid",
          "main_employee_characterization_field": "jobrole",
          "gender_field": "gender",
          "first_demographic_variable": "gender",
          "salary_field": "salary",
          "extra_fields": []
        },
        "gender_mapping": {
          "male": "male",
          "female": "female",
          "nonBinary": null,
          "notReported": null
        }
      }
    }
  ]
}