For the past two years, AI enthusiasts have been treated to a nonstop procession of lightspeed innovations. ChatGPT rang the era in with a bang; millions of blogs, emails, trivia questions, and sonnets later, Microsoft etched the writing on the wall with its $10 billion investment in OpenAI, ChatGPT’s progenitor. Since then, companies from Alphabet to Zoom have scrambled to somehow, some way, integrate AI into their core offerings.

The demand for LLM is rapidly increasing—it’s estimated that there will be 750 million apps using LLMs by 2025. As a result, the need for LLM observability and monitoring tools is also rising. In this blog, we’ll dive into what LLM monitoring and observability are, why they’re both crucial and how we can track various metrics to ensure our model isn’t just working but thriving.

Cribl employees are renowned for their insatiable curiosity, especially when it comes to their passions. Having been a technical writer for most of my adult life, this goat is deeply passionate about two things: writing engaging content and understanding the mindset of our users. As one of our founders always says, “Software is a people business.” To make my users successful, I need to know how they think. But what if the “user” is a machine? This goat is intrigued.

GenAI apps, also known as Intelligent Apps, are the latest formulation of AI-capable applications. Unlike “Traditional” AI apps that utilize pre-defined processes in a chain to deliver predictive answers, GenAI apps create new and unique interactions with end users. Due to their creative and autonomous nature, integrating generative AI models into apps is like embedding a living brain into a piece of software.

From cloud to edge, hardware-agnostic AI/ML In January Canonical will reconfirm its presence at CES 2025; here we will be showing a cutting-edge AI/ML demo that showcases how AI models can be trained, deployed, and updated seamlessly across various hardware platforms.

Sumo Logic Mo Copilot is a natural language assistant that helps first responders derive insights from logs and resolve issues faster using contextual suggestions and plain English queries. It has been in preview since May 2024 with dozens of customers. Choosing a foundation model was a critical step in its development. Let’s explore our high-level requirements for Copilot, the role of foundation models and the rationale for standardizing on Amazon Bedrock.

TL;DR: The Sentry extension for GitHub Copilot now goes beyond chat to help you generate tests, surface issues, and suggests fixes all within your regular PR workflow. Did you forget to write unit tests? Automatically generate them and merge them to your feature branch within GitHub. Have you already merged a PR? Catch new issues, get solutions to those bugs, and deploy those fixes quickly. Add the Sentry extension from the GitHub Marketplace to get started. Continue reading for more details and demos.

Logz.io introduces its AI Agent in Beta, using GenAI to revolutionize observability. The AI Agent simplifies monitoring with automated data analysis and root cause detection, accelerating issue resolution by 3-5x for beta users—marking a critical step toward fully autonomous observability.