Operations | Monitoring | ITSM | DevOps | Cloud

Testing GenAI: How to approach nondeterministic software development

Oct 20, 2023 By CircleCI In CircleCI
Michael Webster, principal engineer at CircleCI, talks to Rob about testing AI-enabled applications. In this episode, learn how to face the unique challenges posed by the probabilistic and non-deterministic nature of AI output, as well as the importance of subjective evaluation criteria. Webster covers how model graded evals can be used to test AI applications, and the importance of caution in using this approach.
View Video
servicenow

AI will empower app developers-not replace them

Oct 18, 2023 By Sally Benford In ServiceNow

Despite the rise of AI, the need for app developers isn’t going away. In fact, a 2023 ServiceNow-sponsored study by Pearson suggests approximately 95,000 new application developer roles will be added globally over the next five years. According to ServiceNow’s special report on the impact of AI on tech skills, based on the research, only about 20% of app developer tasks will be either automated or augmented by 2027.

Read Post

Latest breakthroughs in vector search for Elasticsearch and Lucene: ElasticON AI

Oct 18, 2023 By Elastic In Elastic
Elastic experts Jim Ferenzi and Ben Trent discuss key Elasticsearch and Lucene improvements — including intuitive vector search support, multi-threading, RRF, and hybrid search with filtering and doc-level security. Plus, hear what they are working on next! Additional resources.
View Video

AI-Generated Runbooks

Oct 17, 2023 By PagerDuty In PagerDuty
AI-generated Runbooks lower the barrier to entry to new automation developers and speeds up the time to create new automation for experienced automation authors. This feature works seamlessly with the user’s preferred scripting language, offering a low-code solution for what used to be a high-code task. Watch how Runbook Automation users can write the task they wish to automate in plain-English and let AI build a template of automation for that particular task.
View Video
Sponsored Post
Infraon

AI for Customer Support and Why You Need It

Oct 13, 2023 By Harshvardhan Thakur In Infraon

Providing exceptional customer support has become a key differentiator for businesses. Customers expect quick and personalized solutions to their queries and issues. To meet these expectations, organizations are turning to Artificial Intelligence (AI) for customer support solutions. AI technologies, such as Generative AI, have revolutionized the way companies interact with their customers, streamlining support processes, and delivering superior customer experiences. In this comprehensive guide, we will explore the significance of AI for customer support, its various use cases, how to implement it, the role of Generative AI, and the barriers to overcome for its successful adoption.

Read Post

GenAI in production: how we built AI into CircleCI

Oct 13, 2023 By CircleCI In CircleCI
In this episode, you’ll learn how to empower your team to do the most challenging thing when it comes to AI - getting started! Rob is joined by Kira Muehlbauer and Ryan Hamilton, two engineers who worked on building a groundbreaking feature at CircleCI called the AI error summarizer. Discover their insights into the process of building AI products, the challenges they faced, and the valuable lessons they learned along the way.
View Video

Copyright © 2026 OpsMatters™. All rights reserved.