Home
Documentation
Help Center

Scheduling Jobs in Coalesce

Suggest Edits

The Coalesce Scheduler gives you the ability to schedule data pipeline refreshes directly in the Coalesce app. You no longer need to use a third-party solution simplifying your IT dependency and allowing you to generate data insights faster.

Before You Begin

  • You must have an Environment Admin role.
  • The Environment must have Snowflake credentials added. The Scheduler uses the Snowflake credentials of the user that created or last modified the Scheduled Job.
  • A Job must be deployed before it can be scheduled. Learn more about deploying your pipeline.

How to Schedule a Job

  1. In your Coalesce App, go to the Deploy page.
  2. Next to any Job, click the dropdown and select Create Job Schedule. You can also click the Deploy button next to the environment.

  1. Configuration: Fill out the Job Schedule form. If you click on the Job to create a Job schedule, the Project, Environment, and Job Name will be prefilled.
    1. Project - You’ll be able to create Jobs for any Project you have Environment Admin access to.
    2. Environment - Select the Environment in the Project.
    3. Job Name - Select an existing Job in the Environment.
    4. Job Schedule Name - Choose a unique name to make it easy to identify later.
    5. Cron Expression - Enter a Cron expression in UTC time for the Job frequency.
    6. Retry on Failure - Toggle to retry the entire Job if it fails. This will retry the entire Job.

🚧

Jobs Run One Time When Saved

Jobs run one time as soon as they are saved. Then run on the normal schedule after. Be sure you want this Job to run.


  1. Notifications: Coalesce will send an email notification for successful, retries, and failed Jobs.
    1. Email on: Choose if you want emails to be sent for Success only, Errors only (includes retries), or both.
    2. Email Addresses: Each email address should be entered on a new line.

5.. Save the Job. You’ll be able to see the Job on the Job Schedules page.

📘

Refresh the Page

Refresh the page to see the status of a Scheduled Job.


View Scheduled Jobs

You can view Scheduled Jobs in two ways.

  1. Select View Schedules next to the Job you want to view the schedules for.
  1. Select View Schedules Jobs next to Deploy to see all Scheduled Jobs for the Environment.

You’ll be able to view a list of Scheduled Jobs on the Jobs Schedule page.

Edit Scheduled Jobs

  1. On the Jobs Schedule page, in the Actions column, select Edit.
  2. You can edit the Job Schedule Name and Frequency. If you need to edit the Project or other information create a new Job Schedule.

🚧

Editing Jobs Created By Another User

Editing Scheduled Jobs created by another user, will use your Coalesce and Snowflake credentials to run the job.


Scheduled Jobs Notifications and Alerts

Notifications can be sent using email. You can configure emails to be sent for Success, Error, or Both.

You can also edit the notifications at any time by editing the Job Schedule.

Notifications are sent for:

  • Each successful Job Schedule.
  • Each failed Job Schedule.

Delete Job Schedules

To delete a Job Schedule, go to the Jobs Schedule page, in the Actions column, select Delete.

  • You can delete a Scheduled Job at any time.

🚧

Deleting a Job

If you delete a Job attached to a schedule, then commit the deleted Job change to the deploy branch, then try to deploy, you’ll get a warning message in the Review Plan step. The Jobs Schedules for the deleted Job will be removed at the next scheduled run and won’t be part of the deploy.


Scheduled Job Status and Results

On the Job Schedule page, you can see:

  • Last Execution - Last time the Scheduled Job was run displayed in system time.
  • Next Execution - Next Scheduled Job run time.
  • Run Status - Most recent status of the Scheduled Job.
    • Successful
    • Running
    • Failed
      To view the results click on the Run Status of any scheduled job.

Scheduler Permissions

Important Scheduling Information

  • You can create multiple schedules for each Job.
  • Refreshed All Nodes and Ad-Hoc jobs aren’t part of the Job Scheduler and can only be run using the CLI or API .
  • Schedules use Cron to run and they are in UTC time.
  • Scheduled Jobs are run one time as soon as they are created.
  • Selecting Run Job from the Jobs menu will run the Job one-time. It will not change the Scheduled Job.
  • Scheduled Jobs can’t be paused. You’ll need to delete the Job Schedule or change the frequency.
  • Scheduled Jobs run in parallel. If more than one Job is scheduled for the same time, they will run at the same time. If there is an ad-hoc refresh during a Scheduled Job, they will run at the same time.
  • Scheduled Jobs aren’t committed to your Git provider.

Resources

Updated 1 day ago