In this Grafana Office Hours, Ishan Jain talks about AI Observability with Grafana: what it entails, factors to consider when monitoring and observing LLMs, and how to do it all with Grafana. He is joined by Senior Developer Advocate Nicole van der Hoeven.

LINKS:

(blog) A Guide to LLM Observability with OpenTelemetry: https://techstrong.ai/building-with-ai/a-guide-to-llm-observability-with-opentelemetry/
(blog) An Introduction to Observability for LLM-based applications using OpenTelemetry: https://opentelemetry.io/blog/2024/llm-observability/
(blog) A complete guide to LLM observability with OpenTelemetry and Grafana Cloud: https://grafana.com/blog/2024/07/18/a-complete-guide-to-llm-observability-with-opentelemetry-and-grafana-cloud/
(docs) AI Observability: https://grafana.com/docs/grafana-cloud/monitor-applications/ai-observability/
(repo) OpenLit repository
(docs) OpenLit docs

Contact Ishan:
X: https://twitter.com/ishan_jainn
LinkedIn: https://www.linkedin.com/in/ishan-jain-80791226a/

Contact Nicole:
Mastodon: https://pkm.social/@nicole
LinkedIn: https://www.linkedin.com/in/nvanderhoeven/
Site: https://nicolevanderhoeven.com

Learn more about Grafana Labs:
Website: https://grafana.com
Repo: https://github.com/grafana/grafana