Open in app
Felipe Hoffa
15.6K Followers
About

Sign in

Open in app
Felipe Hoffa

May 26, 2016·1 min read

Recently I thought of using the 8 cores and 52 GB RAM of my free google VM for Apache Spark cluster. There are several guides available on internet for setting up Spark on physical machines but none …

Apache Spark Cluster on Google Compute Engine Instance
36
3

Aditya Choudhary

Did you try Google Cloud Dataproc?

It’s the easiest way to run Spark on GCP, and it will launch in 90 seconds.

See more details here: https://cloud.google.com/blog/big-data/2016/05/bigquery-and-dataproc-shine-in-independent-big-data-platform-comparison

Felipe Hoffa

Data Cloud Advocate at Snowflake ❄️. Originally from Chile, now in San Francisco and around the world. Previously at Google. Let’s talk data.

More from Felipe Hoffa

Data Cloud Advocate at Snowflake ❄️. Originally from Chile, now in San Francisco and around the world. Previously at Google. Let’s talk data.