Our AI cost optimization agent just identified $127K in annual savings for a customer by right-sizing their EC2 instances and switching to Graviton.
The savings number got attention. The harder part was building a recommendation system that operations teams would actually trust enough to apply.

Joel Wembo
@joelwembo
Founder and CEO at vxcloud. Focused on cloud infrastructure, DevOps systems, and practical AI for operators.
AI and machine learning visualization with neural network patterns and data analytics.
Photo: Possessed Photography / UnsplashCost optimization only works when recommendations feel safe
Plenty of platforms can point out expensive infrastructure. Far fewer can make useful recommendations that a real operations team is willing to approve quickly.
That is because cloud cost is not just a finance problem. It is tightly coupled to performance, resilience, architecture, and the social reality of shared ownership. Suggesting a smaller instance size is easy. Proving that the change will not wreck latency during the end-of-month spike is harder.
The system that found $127K in annual savings only worked because it was built around evidence, not generic advice.
We evaluate utilization over time, not snapshots
One of the easiest mistakes in cost tooling is overreacting to short windows. A quiet afternoon can make a service look wildly oversized when it is actually tuned for periodic demand or background processing.
Our agent evaluates:
- CPU, memory, and network behavior over rolling windows
- Peak-to-baseline variance across business cycles
- Sustained underutilization versus legitimate burst posture
- Rightsizing candidates grouped by service role, not just instance type
This reduces the number of naive recommendations and makes it easier to explain why a specific change is safe.
Recommendations are ranked by confidence and reversibility
Not every savings opportunity deserves the same urgency. A move from x86 to Graviton might save more money than shrinking a worker pool, but it can also involve compatibility work or performance testing.
We score opportunities using two practical questions:
- How confident are we that the change preserves service behavior?
- How easy is it to reverse if the result is worse than expected?
That leads to better sequencing. Low-risk, high-confidence wins get surfaced first. More complex recommendations still appear, but with the caveats teams need to plan them responsibly.
The best savings came from patterns, not outliers
The $127K result did not come from one spectacular mistake. It came from repeated patterns across the estate:
- Baseline services running on instance classes chosen long before current traffic levels
- Workloads with flat demand still paying on-demand pricing
- Services compatible with Graviton but never migrated because nobody owned the follow-through
- Autoscaling groups with minimums set for a past incident and never revisited
This is why autonomous analysis helps. Humans are good at handling acute events. They are much worse at patiently re-evaluating dozens of "good enough" decisions that have quietly become wasteful.
FinOps recommendations need operational context
A strong cost agent cannot live on billing data alone. It needs deployment history, service ownership, runtime metrics, and at least some awareness of risk posture.
For example, we intentionally suppress or downgrade certain suggestions when:
- The service recently had a performance incident
- A team is in the middle of a launch or migration
- Capacity is intentionally elevated for seasonal traffic
- The recommendation would collide with a compliance or architecture standard
This is the difference between useful optimization and spam.
Adoption improved when we explained the "why" clearly
Teams accepted far more recommendations once every suggestion included a short rationale:
- What signal triggered the recommendation
- What alternative size or architecture we propose
- The estimated annual savings
- The confidence level and major assumptions
- The fastest rollback path
That made the system legible. Engineers do not need the agent to be perfect. They do need it to be inspectable.
The real product is ongoing discipline
The headline number is nice, but the more important outcome is that cost review stops being a quarterly cleanup exercise. Instead, teams get a steady stream of ranked opportunities while conditions are still fresh and decisions are still reversible.
That is the real promise of AI in operations: not replacing judgment, but making disciplined review continuous enough that obvious savings do not sit untouched for a year.