Why is Spark So Slow? 5 Ways to Optimize Spark Today
When Apache Spark works well, it works really well. Sometimes, though, users find themselves asking this frustrating question. Spark is such a popular large-scale data processing framework because it is capable of performing more computations and carrying out more stream processing than many other data processing solutions. Compared to popular conventional systems like MapReduce, Spark is 10-100x faster.