Counting unique snowflakes is fun. Thanks to Google open sourcing ZetaSketch and Snowflake’s ability to run native Java UDFs, we can achieve sketch compatibility for approximate counts with other ecosystem players. — In 2019 Google open-sourced ZetaSketch, a “collection of libraries for single-pass, distributed, approximate aggregation and sketching algorithms”. This has allowed other projects to enable compatibility for approximate counts and partial results:

This pattern will allow you to create high-traffic apps available to the world, hosted by Streamlit Cloud. Play and prepare your data with Snowflake and Streamlit, and then serve the results in production out of static Parquet files. Snowflake acquired Streamlit for a good reason: Streamlit adds magic to the…

Summary This was my first data conference since 2019, and a lot has changed since (including my t-shirt stamps). Gone are my “Mr BigQuery” days, now I am a Snowflake “Data Cloud Advocate”. As such, these were my main observations from the ground: Snowflake is behind everything, everywhere, at all the…

Snowflake Scripting is a SQL extension to facilitate migrations and your development of stored procedures. Find here my notes and basic scripts to get you started. — My goal in this post is to review some basic scripts to get you started. Note that this is the initial public preview release — test these scripts, check the docs, and share your feedback with us. And don’t forget to check the Snowflake Scripting docs.

Let’s take a real-time streaming source — all the RSVPs from Meetup.com — into Snowflake, with the help of Google Cloud Pub/Sub — Use case We want to move a stream of data with ~4k messages per hour to Snowflake, using Google Pub/Sub as temporary storage. This is a real use case, consisting of all worldwide RSVPs on meetup.com being published in real time. …

This is a quick demo to show how to export the Hacker News archive from BigQuery into Snowflake. It will be quick, easy, and a great way to show off semi-structured data support in Snowflake, and its SQL recursive capabilities. — From BigQuery to Snowflake in less than 1 minute Hacker News in BigQuery If you are a BigQuery user, you can find the Hacker News archive table on console.cloud.google.com/bigquery?p=bigquery-public-data&d=hacker_news&t=full&page=table.

How to export GA4 from BigQuery into Snowflake, and translate the cookbook sample queries. — Google Analytics 4 exports event data from individual user level for free into BigQuery. You might then be wondering “How do I move this data into Snowflake, to get all the benefits of the Data Cloud?” and “Is there a quick way to translate the sample BigQuery queries into Snowflake…

Building a decay function in SQL is not trivial, but fun. The best answer so far uses window functions, but can we do better with a JS UDTF in Snowflake? Find the results here — Brittany Bennett and Claire Carroll snipped data-twitter with a fun SQL puzzle. Hours later Benn Eifert had a great solution with SQL window functions. Then TJ Murphy tested it in Snowflake and explained why window functions are better than joins. And now, it’s my turn to play…

The most popular language on Reddit (other than English) will surprise you. To build this chart I analyzed almost a million Reddit comments with Snowflake and a Java UDTF (in less than 2 minutes). — The most popular languages on Reddit, after analyzing 1M comments: English, German(!), Spanish, Portuguese, French, Italian, Romanian(!), Dutch(!)… Surprising results, compared to the # of native speakers: