Skip to main content

Deployment Overview

Coalesce Scheduler

The Coalesce Scheduler is now available. Schedule deployments directly in the app. Read more in Scheduling Jobs in Coalesce.

Once you've Setup Your Project and Built Your Pipeline , the last thing you need to do is deploy your pipeline.

Deployment​

Deploy your data pipelines to your data warehouse.

General Deployment Steps​

This assumes you've created your data pipeline. If you don't have one, check out the Quick Start Guide.

Refresh​

Deploy and refresh jobs are triggered for individual environments. Once an environment has been deployed, it can be refreshed using the API or CLI.

General Refresh Steps​

  • Create your Jobs
  • Configure your Environment
  • Configure your Git Integration
  • Set your Parameters (optional)
    • You can set them on the environment level or during the deploy processes.
  • Refresh your pipeline. You can use the following:
    • CLI
    • UI
    • API

Deployment vs. Refresh​

Learn about what happens when you run deploy and refresh.

Deploy and Create​

Deploy and Create is responsible for structural changes to your data warehouse. Deployment starts with a calculation of differences in metadata between what is currently deployed to the environment and what the newly desired configuration state is - typically performing column/table creation or editing. This usually involves executing DDL (Data Definition Language) SQL statements such as ALTER, CREATE, and DELETE.

Refresh and Run​

Refresh is responsible for running the data transformations defined in your data warehouse metadata. This typically involves DML (Data Manipulation Language) SQL statements such as MERGE, INSERT, UPDATE, and TRUNCATE which will perform transformations on the actual data.

Deploy and Refresh Methods​

LocationDeployRefresh and Jobs
Coalesce App✔️✔️
CLI✔️✔️
REST API✔️
DevOps Platform✔️✔️