Back to all use cases
Government / DefenseAssessmentOn-Premises

Establishing what is actually recoverable and what is not

PS
Public Sector Agency

Overview

A public sector agency ran Redis for several workloads with different durability needs but a single inherited configuration. Nobody could state which data survived a host failure and which did not. AceMQ assessed the deployment against each workload's real requirements.

Challenge

Redis persistence options trade durability against latency in ways that are easy to misconfigure and hard to notice until a failure. The agency's instances used snapshot intervals that would lose minutes of writes, while some workloads had been assumed durable. Replication and failover had never been tested, so promotion behavior and data loss on failover were unknown.

Environment

On-premises Redis instances with Sentinel-managed failover, supporting caching, queuing, and session workloads.

Approach

AceMQ classified each workload by what loss it could actually tolerate, then compared that against what the current configuration guaranteed. Failover was exercised deliberately, with data loss measured rather than estimated, so the gap between assumption and behavior was documented with evidence.

Solution

  • Classified each workload by tolerable data loss and compared it against what the configuration actually guarantees
  • Reviewed snapshot intervals and append-only file fsync policy per instance against those requirements
  • Exercised Sentinel failover deliberately and measured actual data loss and promotion time
  • Assessed replication topology, quorum configuration, and split-brain exposure
  • Verified restore procedures from existing persistence artifacts with timed recovery tests
  • Delivered a per-workload durability matrix with the configuration changes required to close each gap

Outcome

The agency received a documented, evidence-backed statement of what each workload survives, replacing an assumption that had never been tested. Two workloads believed to be durable turned out not to be, and were reconfigured before a failure demonstrated it.

Technologies

RedisRedis SentinelLinuxPrometheus

Ready to Get Started?

Whether you need architecture advisory, 24/7 support, or full managed services, AceMQ has the expertise to help.

Contact Us