Amazon’s Elastic Map Reduce or EMR, makes it easy to set up, operate and scale big data environments. This enables data scientists and developers to rapidly analyze massive amounts of structured and unstructured data. Combined with Spot by NetApp’s Elastigroup, data scientists can reliably run EMR core and task nodes on highly affordable EC2 spot instances.
In modern cloud architecture applications are broken down into independent building blocks usually as microservices. These microservices allow teams to be more agile and deploy faster. Microservices form distributed systems in which communication between them is critical in order to create the unified system. A good practice for such communication is to implement an event-driven architecture.
Spot by NetApp’s Ocean continuously optimizes Kubernetes clusters with a wide feature set tackling different aspects of running and managing Kubernetes containers in a cloud environment. To help users improve the efficiency and performance of their cloud environments, Ocean’s rightsizing capabilities provide recommendations that target over-provisioning and underutilization.
Spark is one of the most widely-used compute tools for big data analytics. It excels at real-time batch and stream processing, and powers machine learning, AI, NLP and data analysis applications. Thanks to its in-memory processing capabilities, Spark has risen in popularity. As Spark usage increases, the older Hadoop stack is on the decline with its various limitations that make it harder for data teams to realize business outcomes.
Whether you are new to AWS or have been to every re:Invent since 2012 you may have questions about cloud security and how it impacts your valuable technology and data. In particular, you might be wondering where AWS’s security responsibilities end and where yours begin? Which parts of the cloud can you rely on Amazon’s security team and technology to keep safe and which parts must you take care of?
Cloud MSPs or managed service providers are great at helping companies properly leverage the public cloud, typically handling cloud strategy, implementation and day-to-day operations for their customers. However, when it comes to things like customizable billing, analyzing cloud spend per customer, optimizing cost and increasing profit margins, MSPs are over-burdened with complex, manual processes.
When buying AWS Savings Plans and RIs, Spot Eco makes it easy to create a highly utilized and well-balanced blend of Savings Plans and RIs. Leveraging 3rd party Standard RIs (with shorter terms) alongside Convertible RIs, and Savings Plans, Eco helps ensure maximum savings with minimum commitment.
AWS is one of the primary providers for services that help users deploy and manage their containerized applications on the cloud. Since launching ECS in 2014 and EKS in 2017, AWS has learned a lot about running containers at scale and in production. AWS developed Bottlerocket OS, a new operating system for hosting containers. This OS was specifically designed to address gaps left by the ECS and EKS-optimized AMIs, which are based on operating systems that run traditional software applications.
We often encounter companies who are end-customers of a Cloud MSP (Managed Service Provider) and/or reseller of AWS products and services. In these cases, the end-customer may not have access to the AWS Management Account because the MSP owns it and restricts access for security reasons.
As we develop and deploy cloud compute automation and optimization solutions here at Spot by NetApp, we use various tools to improve our day-to-day operations. In this post I’ll share how we’ve found Terraform Cloud from Hashicorp to be quite helpful with deployment management.
