VxCloud
Back to Blog
AI & MLvxcloud field note

Our AI cost optimization agent just identified $127K in annual savings for a customer by right-sizing their EC2 instances and switching to Graviton.

The savings number got attention. The harder part was building a recommendation system that operations teams would actually trust enough to apply.

Joel Wembo

Joel Wembo

@joelwembo

Founder and CEO at vxcloud. Focused on cloud infrastructure, DevOps systems, and practical AI for operators.

Feb 28, 2026/ 7 min read
AI and machine learning visualization with neural network patterns and data analytics.

AI and machine learning visualization with neural network patterns and data analytics.

Photo: Possessed Photography / Unsplash
876 92

Cost optimization only works when recommendations feel safe

Plenty of platforms can point out expensive infrastructure. Far fewer can make useful recommendations that a real operations team is willing to approve quickly.

That is because cloud cost is not just a finance problem. It is tightly coupled to performance, resilience, architecture, and the social reality of shared ownership. Suggesting a smaller instance size is easy. Proving that the change will not wreck latency during the end-of-month spike is harder.

The system that found $127K in annual savings only worked because it was built around evidence, not generic advice.

We evaluate utilization over time, not snapshots

One of the easiest mistakes in cost tooling is overreacting to short windows. A quiet afternoon can make a service look wildly oversized when it is actually tuned for periodic demand or background processing.

Our agent evaluates:

  • CPU, memory, and network behavior over rolling windows
  • Peak-to-baseline variance across business cycles
  • Sustained underutilization versus legitimate burst posture
  • Rightsizing candidates grouped by service role, not just instance type

This reduces the number of naive recommendations and makes it easier to explain why a specific change is safe.

Recommendations are ranked by confidence and reversibility

Not every savings opportunity deserves the same urgency. A move from x86 to Graviton might save more money than shrinking a worker pool, but it can also involve compatibility work or performance testing.

We score opportunities using two practical questions:

  1. How confident are we that the change preserves service behavior?
  2. How easy is it to reverse if the result is worse than expected?

That leads to better sequencing. Low-risk, high-confidence wins get surfaced first. More complex recommendations still appear, but with the caveats teams need to plan them responsibly.

The best savings came from patterns, not outliers

The $127K result did not come from one spectacular mistake. It came from repeated patterns across the estate:

  • Baseline services running on instance classes chosen long before current traffic levels
  • Workloads with flat demand still paying on-demand pricing
  • Services compatible with Graviton but never migrated because nobody owned the follow-through
  • Autoscaling groups with minimums set for a past incident and never revisited

This is why autonomous analysis helps. Humans are good at handling acute events. They are much worse at patiently re-evaluating dozens of "good enough" decisions that have quietly become wasteful.

FinOps recommendations need operational context

A strong cost agent cannot live on billing data alone. It needs deployment history, service ownership, runtime metrics, and at least some awareness of risk posture.

For example, we intentionally suppress or downgrade certain suggestions when:

  • The service recently had a performance incident
  • A team is in the middle of a launch or migration
  • Capacity is intentionally elevated for seasonal traffic
  • The recommendation would collide with a compliance or architecture standard

This is the difference between useful optimization and spam.

Adoption improved when we explained the "why" clearly

Teams accepted far more recommendations once every suggestion included a short rationale:

  • What signal triggered the recommendation
  • What alternative size or architecture we propose
  • The estimated annual savings
  • The confidence level and major assumptions
  • The fastest rollback path

That made the system legible. Engineers do not need the agent to be perfect. They do need it to be inspectable.

The real product is ongoing discipline

The headline number is nice, but the more important outcome is that cost review stops being a quarterly cleanup exercise. Instead, teams get a steady stream of ranked opportunities while conditions are still fresh and decisions are still reversible.

  That is the real promise of AI in operations: not replacing judgment, but making disciplined review continuous enough that obvious savings do not sit untouched for a year.
AICost OptimizationAWS

Keep Reading

Related articles

View all posts