Skip to main content

Data Vault By Scalefree For Databricks

  • data vault
  • databricks

Overview

Data Vault for Coalesce powered by Scalefree.

Installation

  • Copy the Package ID  @coalesce/databricks/data-vault-by-scalefree-for-databricks
  • In Coalesce, open the Workspace where you wish to install the package.
  • Go to the Build Setting of the Workspace, tab Packages, and click the Install button on the top right of the page.
  • Paste the Package ID, and proceed with the installation process.

Description

Welcome to datavault4coalesce!

This is the Databricks version of Datavault4Coalesce. If you are looking for the Snowflake version, visit here!

dataVault4coalesce_logo

The following documentation sheds some light on the node types that have been developed by Scalefree to make your Coalesce-Experience more comfortable! The documentation can be found by clicking the links in the sidebar on the right side. In the documentation, the macros and their parameters are explained and further exemplified.

NOTE: Coalesce has released a Hands-On Guide for using Datavault4Coalesce. Check it our here!

Included node types

  • Staging Area
  • Hubs, Links & Satellites
  • PIT Tables
  • Snapshot Control

With datavault4coalesce you will get a lot of awesome features, including:

Features

  • Ghost Records
  • Multi Batch Processing
  • Automatic PIT cleanup based on logarithmic snapshot logic
  • Pattern based on years of experience in Data Vault Loading
  • Virtual Load Enddate

Requirements

To use the node types efficiently, there are a few prerequisites you need to provide:

  • Coalesce Environment connected to a Databricks Instance
  • Basic Data Vault Knowledge (If this is new to you, check the following Article)

Installation

To have access to the Datavault4Coalesce node definitions, you have to write an email to support@coalesce.io and request that the package is added to your environment!

Resources:

Versions

Available versions of the package.

Version #Release DateNotes
1.1.0August 01, 2025
 GA Release