Operations | Monitoring | ITSM | DevOps | Cloud

Michael Webster, principal engineer at CircleCI, talks to Rob about testing AI-enabled applications. In this episode, learn how to face the unique challenges posed by the probabilistic and non-deterministic nature of AI output, as well as the importance of subjective evaluation criteria. Webster covers how model graded evals can be used to test AI applications, and the importance of caution in using this approach.

In this episode, you’ll learn how to empower your team to do the most challenging thing when it comes to AI - getting started! Rob is joined by Kira Muehlbauer and Ryan Hamilton, two engineers who worked on building a groundbreaking feature at CircleCI called the AI error summarizer. Discover their insights into the process of building AI products, the challenges they faced, and the valuable lessons they learned along the way.

Continuous Labs by CircleCI is launching Config.tips, your go-to resource for mastering configuration files and simplifying your development workflow. In this video, we’ll take you on a tour of Config.tips, showcasing how it can empower developers like you to tackle even the most complex config challenges with ease. Whether you’re configuring databases, setting up CI/CD pipelines, or working with any tech stack, we want to build the biggest collaborative platform to get you covered.

To learn more about parallelism and resource classes, book some time with us here.

To learn more about the benefits of running continuous integration jobs on self-hosted infrastructure.

To learn more about ML model development, visit: circleci.com/blog/top-7-challenges-of-ml-model-development/

Welcome to our new #SupportShorts video series featuring our Support Engineering Team answering some of your most frequently asked CircleCI questions, tackling common customer issues, as well as sharing their favorite tips and tricks. In today's video, Ervin shows how to validate your config using the CircleCI CLI.

And we thought we were excited about shipping our newest feature. Customers are raving about rerun failed tests, and for good reason.

Learn more about using containers and VMs in CI/CD pipelines.

With CircleCI, your team can increase developer productivity and velocity.