Great post on the power of HLL++ and it’s open sourcing!

…urrent pricing model for querying data is 5 USD per 1TB of billable bytes, and that adds up quickly. Imagine a dashboard that shows multiple charts — distribution of users by country, distribution of visitors by domain, total number of unique visitors, unique pageviews, etc. In the most naïve case, every chart is a query in its own right, meaning we’ve spent ~$25 just by opening a single page for Publisher A!

Taking BigQuery HLL to the extreme

143

Paulius Imbrasas

Felipe Hoffa

1 min readAug 7, 2019

Great post on the power of HLL++ and it’s open sourcing!

On the costs side, please consider BI Engine, the natural companion for BigQuery. Right now it works with Data Studio, but an API and native connections to other tools are coming in the future. BI Engine is an in-memory engine that sits transparently between BigQuery and your dashboards — fixing this costs issue.

Bigquery