Deployment Overview

Once you've Setup Your Project and Built Your Pipeline , the last thing you need to do is deploy your pipeline.

Deployment

Deploy your data pipelines to your data warehouse.

General Deployment Steps

This assumes you've created your data pipeline. If you don't have one, check out the Quick Start Guide.

• Configure your Environment
• Configure your Git Integration
• Set your Parameters.
• Deploy your pipeline. You can use the following:
  • Deploy Using the CLI
  • Deploy Using the Coalesce UI

Refresh

Deploy and refresh jobs are triggered for individual environments. Once an environment has been deployed, it can be refreshed using the API or CLI.

General Refresh Steps

• Create your Jobs
• Configure your Environment
• Configure your Git Integration
• Set your Parameters.
  • You can set them on the environment level or during the deploy processes.
• Refresh your pipeline. You can use the following:
  • CLI
  • UI

Deployment vs. Refresh

Learn about what happens when you run deploy and refresh.

Deploy and Create

Deploy and Create is responsible for structural changes to your data warehouse. Deployment starts with a calculation of differences in metadata between what is currently deployed to the environment and what the newly desired configuration state is - typically performing column/table creation or editing. This usually involves executing DDL (Data Definition Language) SQL statements such as ALTER, CREATE, and DELETE.

Refresh and Run

Refresh is responsible for running the data transformations defined in your data warehouse metadata. This typically involves DML (Data Manipulation Language) SQL statements such as MERGE, INSERT, UPDATE, and TRUNCATE which will perform transformations on the actual data.