Dynamic Tables
Overview
Dynamic tables simplify data engineering in Snowflake by providing a reliable, cost-effective, and automated way to transform data.
Installation
- Copy the Package ID:
@coalesce/snowflake/dynamic-tables - In Coalesce, open the Workspace where you wish to install the package.
- Go to the Build Setting of the Workspace, tab Packages, and click the Install button on the top right of the page.
- Paste the Package ID, and proceed with the installation process.
Description
Snowflake - Dynamic Tables - Brief Summary
-
Dynamic Table Work Serve as intermediate processing layers within a data pipeline. These nodes handle complex transformations, data cleaning, and filtering before data reaches final consumption. They optimize performance by breaking down logic into manageable, automated steps.
-
Dynamic Table Dimension Provide essential business context, such as attributes for customers, products, or locations. These nodes use declarative logic to ensure descriptive data is automatically synchronized with source changes, allowing for seamless slicing and dicing of metrics in reports.
-
Dynamic Table Latest Record version Ensure data integrity by automatically surfacing the most recent state of a record. By handling deduplication and versioning natively, these nodes provide a "single source of truth" for the current status of business entities, eliminating the need for complex manual cleanup queries.
Summary: Together, these node types leverage Snowflake’s declarative orchestration to provide a low-maintenance, automated framework for real-time data modeling. They ensure that business insights are built on fresh, accurate, and high-performance data structures.
Nodetypes Config Matrix
| Category | Feature | DT Work | DT Dimension | DT Latest Record |
|---|---|---|---|---|
| Create | Create As Dynamic Table | ✅ | ✅ | ✅ |
| Create | Create As Dynamic Transient Table | ✅ | ✅ | ✅ |
| Create | Warehouse | ✅ | ✅ | ✅ |
| Create | Advanced Warehouse Selection | ✅ | ✅ | ✅ |
| Create | Initialization Warehouse Size | ✅ | ✅ | ✅ |
| Create | Initialize | ✅ | ✅ | ✅ |
| Create | Cluster Key | ✅ | ✅ | ✅ |
| Refresh | Refresh Warehouse size | ✅ |