Skip to main content

Dagster & Snowflake

This library provides an integration with the Snowflake data warehouse. Connect to Snowflake as a resource, then use the integration-provided functions to construct an op to establish connections and execute Snowflake queries. Read and write natively to Snowflake from Dagster assets.

Installation​

pip install dagster-snowflake

Example​

from dagster_snowflake import SnowflakeResource

import dagster as dg


@dg.asset
def my_table(snowflake: SnowflakeResource):
    with snowflake.get_connection() as conn:
        return conn.cursor().execute_query("SELECT * FROM foo")


defs = dg.Definitions(
    assets=[my_table],
    resources={
        "snowflake": SnowflakeResource(
            account="snowflake account",
            user="snowflake user",
            password=dg.EnvVar("SNOWFLAKE_PASSWORD"),
            database="snowflake database",
            schema="snowflake schema",
            warehouse="snowflake warehouse",
        )
    },
)

About Snowflake​

A cloud-based data storage and analytics service, generally termed "data-as-a-service". Snowflake's data warehouse is one of the most widely adopted cloud warehouses for analytics.