Operations | Monitoring | ITSM | DevOps | Cloud

We’re thrilled to announce several new observability features for the Pub/Sub to Splunk Dataflow template to help operators keep a tab on their streaming pipeline performance. Splunk Enterprise and Splunk Cloud customers use the Splunk Dataflow template to reliably export Google Cloud logs for in-depth analytics for security, IT or business use cases.

Embracing the cloud is not just a case of improving infrastructure, experts believe, but also a way to drive transformation. Many of the world’s largest financial exchanges are transforming the way they run global capital markets through the adoption of cloud computing technologies. In November, financial derivatives exchange CME Group entered a 10-year partnership with Google that will move CME’s IT infrastructure and markets to the cloud.

The simple query service (SQS) was one of the first services AWS offered. It’s a managed queuing service that lets you take pressure from your downstream services. You put your items on the queue, and other services can pull them whenever they have the capacity to work on them. It’s a managed service, so you don’t have to install or maintain the software yourself; you just configure a queue and start pushing to and pulling from it. So SQS is very simple to get started with.

Although both data lakes and data warehouses are commonly used to store large amounts of data, the phrases are not interchangeable. A data lake is not a straight substitute for a data warehouse; rather, they are complementary technologies that serve a variety of use cases, some of which overlap. Most companies that have a data lake also have a data warehouse. The two methods of data storage are sometimes mistaken, yet they are vastly different.

Climate change: it’s one of the most pressing challenges of our time. Yet, while the focus is often on power plant pollution, single-use plastics, deforestation, and fossil fuels, web technologies remain among the biggest, least-visible carbon culprits. Inversely, though, it means that web technologies can be part of the solution.

Before we take a deep dive into the ways to achieve observability, it is important to understand what observability is and how it is achieved. Frequently, observability is confused with monitoring. Observability provides end-to-end visibility into a system’s internal health by using the data it generates: logs, traces, and metrics. In a multi-cloud environment, observability enables you to detect and resolve anomalies.