Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make minor improvements to Snowflake integration #4881

Merged
merged 1 commit into from
Dec 26, 2024
Merged

Make minor improvements to Snowflake integration #4881

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 9 additions & 9 deletions web/docs/integrations/snowflake/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 1,7 @@
# Snowflake

[Snowflake](https://snowflake.com) is a multi-cloud data warehouse. Tenzir can
send events from a pipeline into [Snowflake
send events from a pipeline to [Snowflake
databases](https://docs.snowflake.com/en/sql-reference/ddl-database).

![Snowflake](snowflake.svg)
Expand All @@ -10,14 10,14 @@ Use the [`to_snowflake`](../../tql2/operators/to_snowflake.md) output operator
at the end of a pipeline to send events to a specific table.

:::info ADBC
Tenzir Apache Arrow under the hood to represent batches of events. Therefore, we
can use [Arrow Database Connectivity
(ADBC)](https://arrow.apache.org/docs/format/ADBC.html) as interface to
Snowflake, enabling efficient transfer of large datasets. Think of ADBC as the
columnar equivalent of JDBC/ODBC. Thanks to the existing [Snowflake
driver](https://arrow.apache.org/adbc/current/driver/snowflake.html), you can
directly stream events from a Tenzir pipeline to Snowflake using ADBC's *Bulk
Ingestion* API. For further details on ADBC, read the [introductory blog
Tenzir uses [Apache Arrow](https://arrow.apache.org) under the hood to encode
batches of events into a columnar representation. The [Arrow Database
raxyte marked this conversation as resolved.
Show resolved Hide resolved
Connectivity (ADBC)](https://arrow.apache.org/docs/format/ADBC.html) API makes
makes it possible to efficiently transfer large datasets between Tenzir and a
database. Think of ADBC as the columnar equivalent of JDBC/ODBC. ADBC has a
[Snowflake driver](https://arrow.apache.org/adbc/current/driver/snowflake.html)
that Tenzir uses to send events to Snowflake with the bulk ingestion API. For
further details on ADBC, read the [introductory blog
post](https://arrow.apache.org/blog/2023/01/05/introducing-arrow-adbc/) from the
Arrow project.
:::
Expand Down
Loading