From the course: Learning SnowflakeDB

Unlock the full course today

Join today to access over 23,200 courses taught by industry experts.

Load SnowflakeDB using Snowpipe streams

Load SnowflakeDB using Snowpipe streams - Snowflake Tutorial

From the course: Learning SnowflakeDB

Load SnowflakeDB using Snowpipe streams

- [Instructor] So again, in the documentation, another type of loading is Snowpipe. As it says here, it's the continuous data ingestion service. It loads data within minutes after files are added to a stage and submitted for ingestion. It's serverless, it manages load capacity and ensures optimal compute resources to meet demand. It provides a pipeline for loading fresh data in micro-batches. That's really important to understand. So it's micro-batching as soon as it's available. And if we drill in a little bit, the data will be available within minutes, rather than manually executing copy statements on a schedule to load larger batches. So it's kind of in the middle of continuous and not continuous. It's not a series of events, it's micro-batches, it's faster than a manual copy. And then again, just kind of drills down. I really like this, how is Snowpipe different from bulk data loading? So it goes into the technical…

Contents