This simple FastAPI service will help you find data in a data lake Data lakes provide a myriad of benefits. They are data agnostic and don’t require you to define a schema upfront. However, without a proper structure, it may be challenging to find the data that you need. In this article, we’ll address this problem by creating a FastAPI abstraction allowing us to query the AWS Glue metadata catalog.

In my previous blog post, we discussed why research shows that over 90% of enterprises are embracing a multi-cloud strategy. Simply put, a multi-cloud approach offers significant advantages to organizations seeking to optimize the Three Cs of Cloud: Cost, Capabilities and Compliance. Still, with all the advantages to be gained with a multi-cloud approach, executives should be aware of the downsides. Here is my take on the top 5 challenges of multi-cloud adoption.

In 2020, cloud migration sped up by a factor of 24, according to McKinsey. Would you be surprised to learn there were a lot of factors driving that shift? Due to COVID-19, companies needed to go remote fast and securely. They wanted to lift the maintenance burden off overworked IT teams. And, in the face of the year’s worldwide economic uncertainty, motivation to take advantage of cloud’s cost savings was running high.

When it comes to connecting to AWS, using a direct connect through a Software Defined Interconnection® platform like Console Connect can really help your business improve speed, security and control when accessing one of the world’s most popular cloud platforms.

Stackery can be used to create a new CloudFormation template or to quickly visualize an existing one. Code is automatically generated as you simply drag-and-drop resources on a graphical grid. The experience is much more intuitive than previous generation tools like AWS CloudFormation Designer. Stackery visualizes resources the way a human would perceive them, grouping related resources together.

Choosing the right service plan is crucial when you are using Amazon Web Services (AWS). With 170 distinct services, ranging from compute to storage to networking and content delivery — each offered at different price points — the process requires careful consideration to make the right choice for your business. By default, AWS services are available on-demand and you pay a monthly bill for services used.

As your infrastructure grows, getting a handle on all your AWS resources can be overwhelming. While that’s probably an understatement, help could be right around the corner. We’ll cover a few CloudFormation visualizer tools that can help, but let’s level set first. AWS CloudFormation is an established Infrastructure-as-Code solution that allows you to define, provision, organize, manage and update your AWS resources from a text-file template.

If you’re worried that switching to serverless infrastructure is too expensive for your business, you’re not alone. Total spending on cloud services will top $284 billion by 2024. The good news is there are many ways to track and lower your serverless operation costs without slowing down your business. Lambda and how can it help your business? Find out more by reading these Lambda frequently asked questions.

For the first time, a software load balancer exceeds 2-million RPS on a single Arm instance. A few weeks ago, while I was working on an HAProxy issue related to thread locking contention, I found myself running some tests on a server with an 8-core, 16-thread Intel Xeon W2145 processor that we have in our lab. Although my intention wasn’t to benchmark the proxy, I observed HAProxy reach 1.03 million HTTP requests per second.

It’s essential to choose the right tool for the job. I have an old, sturdy screwdriver that I use for lots of odd DIY jobs around my house, like cleaning gutters, opening paint cans, and general maintenance on my lawnmower. However, when I’m performing an upgrade on my computer, a large, rusty screwdriver isn’t the best tool to remove the screws anchoring my motherboard.