Shuffle Data Store Now Available for Ocean for Apache Spark
NetApp is excited to announce the addition of Shuffle Data Store for Ocean for Apache Spark. Customers running on AWS can now benefit from improved resilience and efficiency for multi-step data preparation pipelines that require Apache Spark to shuffle data. The external shuffle solution is backed by either Amazon FSx for NetApp ONTAP storage or Amazon S3 storage, which have been optimally configured for Spark workloads.