Setting Up Streams with Snowflake

In the following section, we'll show you how to set up a Stream and configure your destination settings to use Snowflake.

Streams Settings

On your QuickNode dashboard, navigate to the Streams page by clicking the Streams tab on the left side-panel. After, click the Create Stream button in the top-right corner. You'll be prompted to first configure your Stream settings:

• Chain and Network: Begin by selecting a target Chain and Network from the list of supported chains and networks. You can check the supported chains and network here
• Dataset: Once you've chosen the network and chain, proceed to select a Dataset that defines the type of data you intend to stream. See the full list of supported data schemas here.
• Stream name: A stream name will be populated by default but you can modify this if needed.
• Region: By default, the region most closest to you will be populated, however, you can modify this if needed.
• Batch size: Configure the batch size for your Stream. By default this will be set to 1 (for minimal latency), however you can update this if needed.
• Stream start: By default, your stream will start at the tip of the chain (e.g., latest block number), however if you are backfilling (retrieving historical data), you can update this value to start from a specific block number.
• Stream end: If you want your Stream to end a specific block number, update this value. Otherise, by default the Stream won't end.

Reorg Handling

Streams can be configured to handle reorgs. You can enable the Latest block delay and Restream on reorg settings to properly manage reorgs to your preferences. Check out the Reorg handling page to learn more about Reorgs and how to properly manage them.

Destination Settings

To initiate the stream creation process through Snowflake, follow these steps:

• Destination: Select the destination type as Snowflake. It will open a new sections for adding destination settings.
• Protocol: Specify the protocol (e.g., HTTP, HTTPS) you want to use to connect to Snowflake.
• Host: Input the Snowflake host URL (e.g., your_account.region.snowflakecomputing.com). You can find this in your Snowflake account details.
• Port: Input the port number for the host URL. The default value is port 443.
• Username: The username for your Snowflake account login. If you're not sure, check with your Snowflake administrator or find it in the 'Profile' menu of your Snowflake console.
• Password: The password for your Snowflake account login.
• Database: Enter the name of the Snowflake database you wish to connect to.
• Schema: Enter the Schema name you have on the Snowflake database.
• Table: Enter the Table name on Snowflake you want to stream data too.
• Retry wait period - Determine the time for which it should wait to retry to stream the data again.
• Pause stream after - Determine the number of tries after which the stream should should pause. When we exhaust retries, we would terminate your stream that you’d be able to resume anytime the delivery setbacks are resolved.

After configuring all the settings according to your preferences, click on the Test destination button located in the bottom. This action will test the destination and confirm it can be delivered to. Then, click Create a Stream in the bottom-right corner.