Operations | Monitoring | ITSM | DevOps | Cloud

In 2025, 85% of organizations increased AI investment, and 91% plan to do the same this year, according to Deloitte. Despite continued spending, however, ROI lags behind, with just 6% seeing payback within one year. While AI use cases tend to have a longer payback period, often in the 2-4 year range, companies can’t afford to keep spending money without some measure of its practical impact both immediately and over time.

AI tokens are the small chunks of text, roughly four characters or three quarters of a word each, that language models read and generate. Every prompt and every response is measured in tokens, and AI providers bill per million of them. That makes the token the base unit of AI spend: 1,000 tokens is about 750 words, and every AI feature you ship is a token meter running.

CloudZero had a full team on the ground at Ai4 in Las Vegas during the first week of August 2026. The team included CTO Erik Peterson, who spoke on a panel about AI cost economics. The same problem surfaced everywhere we went: teams can see what they’re spending, but not whether it’s working. DIY cost tooling that fails time and time again, agent sprawl, and a widening gap between finance and engineering kept coming up throughout the week.

Serving large language models at scale is fundamentally a distributed systems problem. A single GPU, or even a single node, is rarely enough once you need multiple models, multiple replicas, tensor-parallel sharding across GPUs, or high-availability rollouts. Kubernetes solves general container orchestration well, but it has no native concept of a GPU-aware, actor-based compute cluster.

Our iPhones now have the capability to take amazing, high-quality photos and videos, but they can quickly eat up your storage if you don’t know how to reduce photo size on iPhone, or how to compress a photo on iPhone. If your cloud storage runs out, you can use the methods in this article to free up the space on your phone or back up your photos on another private alternative to iCloud Photos, like Internxt Drive and Photos.

There’s an S3 charge that stays invisible in a normal storage cost review. AWS bills S3 object tags per tag, per hour, so the cost scales with how many objects you have, not how much data you store. It gets its own line item, which is easy to miss when you’re scanning storage spend. It can sneak up on you. Tags get added in a dev environment to drive lifecycle rules, where object counts are small and the cost is nothing.

Generative AI ROI measures the financial return on generative AI investments relative to their total cost. Benchmarks diverge sharply: Google Cloud's 2025 study found 74% of enterprises see ROI within the first year, while MIT's NANDA initiative found 95% of pilots deliver no measurable P&L impact. The difference is not the AI. It is whether the organization can actually measure cost and outcome at the use case level.

When CFOs talk about AI budgets, they tend to describe it the same way: it’s a black box, offering little or no transparency. The bill arrives at the end of the month, it’s bigger than last month, and nobody can really explain why. Meanwhile, engineering keeps asking to raise the token budget. I think that framing undersells what’s actually happening out there. If the black box is the bill, the Pandora’s box is what you opened when you brought AI into the company.

The default Kubernetes scheduler was built for stateless services: web servers, APIs, databases. It schedules a pod, checks that a node has enough of whatever resources were requested, and binds it. For CPU and memory, that model works fine. For GPUs, it falls apart in three specific ways. First, GPUs are treated as an opaque integer resource.

Organizations are increasingly integrating GenAI capabilities into their applications to deliver richer, more contextual user experiences—from AI-powered customer support and enterprise search to content generation, virtual assistants, and automated workflows. To build and scale these GenAI-powered experiences, they are turning to platforms such as Amazon Bedrock, which provides access to foundation models that developers can integrate into their applications.