Scheduling
The Coalesce Scheduler is now available. Schedule deployments directly in the app. Read more in Scheduling Jobs in Coalesce.
Coalesce orchestrates the execution of a transformation pipeline and allows users the freedom and flexibility to choose a scheduling mechanism for deployments and job refreshes that fit their organization’s current workflows.
There are many tools available to automate execution according to time (ex. every hour) or via specific triggers (ex. upon code deployment). We have a few articles with example setups and ideas on how to automate jobs and deployments, which you can see below. Environment deployments and database refreshes can also be triggered ad-hoc in different ways, which one can read more about here.
📄️ Coalesce Scheduler
The Coalesce Scheduler gives you the ability to schedule data pipeline refreshes directly in the Coalesce app. You no longer need to use a third-party solution simplifying your IT dependency and allowing you to generate data insights faster.
📄️ Scheduling Coalesce Pipelines in Snowflake
One easy way to schedule Coalesce pipelines/jobs without the need to use any third party schedulers is to take advantage of Snowflake stored procedures, Tasks, and functions to make the necessary API calls to the Coalesce endpoints at a custom-defined cadence.
📄️ Schedule Jobs With GitHub Actions and the CLI
Schedule Jobs With GitHub Actions and the CLI in Coalesce
📄️ Schedule Your Pipelines with Azure DevOps
Deploy or refresh your pipeline using Azure DevOps
📄️ Schedule Jobs With GitHub Actions and the API
In this how-to, we will walk you through best practices for scheduling Coalesce refreshes through the GitHub actions.
📄️ Coalesce Refresh Scheduling with Azure Data Factory
In this article we will explore setting up a basic Coalesce pipeline Refresh Trigger using the Azure Data Factory web UI.
📄️ Coalesce Deployments and Refresh with GitLab
In this tutorial, we go through how to securely set up Coalesce Deployments and Refresh using GitLab.
📄️ Schedule Coalesce Jobs with Apache Airflow
This article details the steps for configuring nodes in an Airflow DAG to utilize the Coalesce API to trigger Coalesce Jobs on a schedule.