Myth #3 of Apache Spark Optimization: Instance Rightsizing
In this blog series we are examining the Five Myths of Apache Spark Optimization. So far we’ve looked at Myth 1: Observability and Monitoring and Myth 2: Cluster Autoscaling. Stay tuned for the entire series! The third myth addresses another common assumption of many Spark users: Choosing the right instances will eliminate waste in a cluster.