Operations | Monitoring | ITSM | DevOps | Cloud

In July’s This Month in Datadog, Jeremy is joined by Datadog product leaders for in-depth conversations about how Bits enables you to confidently evaluate and release features containing AI-generated code, and use natural language to ask, understand, and act across Datadog.

AssemblyAI is a leading Voice AI platform that provides speech-to-text models and AI infrastructure developers use to build real-time voice applications. AssemblyAI uses Datadog to unify observability across its AI inference pipelines and multi-cloud GPU infrastructure, enabling the team to optimize performance and costs, accelerate model releases, and confidently deliver fast, reliable AI experiences at scale.

At hyperscale, a regional cloud outage is not merely a technical disruption—for Samsung Account, which serves 2.1 billion users across three global regions, it is an immediate global service crisis. Fragmented, region-siloed monitoring creates blind spots that make early detection nearly impossible, leaving SRE teams perpetually reactive rather than predictive. The path to proactive reliability requires both a philosophical shift and a foundational change in how observability data is collected, unified, and reasoned over.

Modernizing a legacy system serving 20 million devices without users noticing is like replacing a jet engine mid-flight. In this session, YoungJin Jung and Donggen Hong from LG U+ share their 18-month journey transforming a Telco-scale API Gateway from a rigid, proprietary solution into a high-performance, open-source architecture on AWS, and the operational challenges they solved along the way.

Replace "AI shipped on hope" with an operating model that holds up once real users depend on it. AI quality is multi-dimensional, covering accuracy, tone, safety, and faithfulness to user data, and can't be debugged from outputs alone. Without visibility into what their AI actually did in production, teams miss regressions, reverse-engineer chains by hand, and watch a single bad answer erode trust built over hundreds of right ones.

Every team is doing something with AI right now. What that something is, is an entirely different question. And whether that something is successful? Most teams are still figuring it out as they go.

AI coding tools are accelerating development velocity, creating a release challenge most teams aren’t equipped for. Without controlled rollout, higher change velocity makes it harder to know which specific release drove the results you’re seeing in production. And when teams use AI, to build AI – LLM apps and AI agents– complexity multiplies. Traditional observability can’t ensure AI agent quality, performance, and cost-efficiency at production scale.

AI’s ability to write code made huge strides over the past year. Today, coding agents aren’t just assisting developers; they are winning the "coding race" by orders of magnitude and fundamentally changing the way engineers work.

The breakthroughs in AI today aren’t just coming from bigger datasets and more compute; Reinforcement Learning (RL) has quietly become one of the most powerful forces in modern AI development. RL is teaching models to reason and self-correct, enabling capabilities that make AGI feel less like science fiction and more like an inevitable future.

AI coding assistants are rapidly evolving from passive copilots into active, agentic collaborators capable of planning, executing, and iterating on complex software tasks. This shift has huge ramifications onthe software development lifecycle (SDLC), developer productivity, and even the structure of engineering teams.