What You Actually Need to Monitor AI Systems in Production
You did it. You added the latest AI agent into your product. Shipped it. Went to sleep. Woke up to find it returning a blank string, taking five seconds longer than yesterday, or confidently outputting lies in perfect JSON. Naturally, you check your logs. You see a prompt. You see a response. And you see nothing helpful. Surprise. Prompt in and response out is not observability. It is vibes.