Back to all use cases
Cross-IndustryConsultingCloud (AWS)

Paying for compute that is doing work

GL
Global Logistics Provider

Overview

A logistics provider's Snowflake spend was growing faster than its data volume or user count, and finance wanted an explanation before approving the next commitment. AceMQ analyzed consumption against the work each warehouse was actually performing.

Challenge

Most of the growth came from structural choices rather than genuine demand. Warehouses had been sized up to fix individual slow queries and never sized back down. Auto-suspend was set high enough that warehouses idled for long stretches while still billing. Several teams shared warehouses, so contention drove further size increases that benefited nobody in particular.

Environment

Snowflake on AWS serving business intelligence, dbt transformations, and ad-hoc analysis across multiple teams.

Approach

AceMQ built consumption attribution down to warehouse, workload, and query pattern so decisions could be made from evidence instead of averages. Sizing was then set per workload against its measured profile, with auto-suspend tuned to the trade-off between idle billing and cache warmth rather than to a default.

Solution

  • Built credit consumption attribution by warehouse, workload, team, and query pattern
  • Right-sized each warehouse against measured query profiles rather than the worst query ever run on it
  • Tuned auto-suspend per warehouse against the real trade-off between idle billing and result cache warmth
  • Separated contending workloads onto dedicated warehouses so sizing decisions stopped being compromises
  • Applied multi-cluster scaling only where concurrency, not query size, was the actual constraint
  • Set resource monitors and per-team guardrails with alerting before thresholds are reached

Outcome

Credit consumption dropped meaningfully without degrading query performance for any workload, and the growth curve flattened against data volume. Finance now has attribution by team, so cost conversations reference specific workloads rather than a single aggregate number.

Technologies

SnowflakedbtTerraformAirflow

Ready to Get Started?

Whether you need architecture advisory, 24/7 support, or full managed services, AceMQ has the expertise to help.

Contact Us