Emergency RabbitMQ Support

RabbitMQ Help: Emergency Support for Split Brain and Full Disks

Last reviewed by Scott Sternloff

If RabbitMQ is down, split-brained or out of disk, call +1 305-204-2607. Under a support contract a senior AceMQ engineer is on your incident within 15 minutes, 24/7; without one, a new emergency engagement starts the same day. The same engineers then find the root cause and hand you the change that stops it recurring, so the incident is not repeated.

The only partner with direct RabbitMQ core team access

senior RabbitMQ SMEs
11+
min emergency SLA
15
enterprise customers
160+
countries served
26+

Trusted for Mission-Critical RabbitMQ by Teams in Finance, Healthcare, Defense, Telecom, and More

Customers

  • Microsoft logo
  • Henry Schein logo
  • Enbridge logo
  • Gojek logo

Partners

  • Broadcom logo
  • Redis logo
  • VMware Tanzu logo
  • OSSeva logo
AceMQ is the Featured Authorized Partner for RabbitMQ

Named by the RabbitMQ Core Team

The Featured Authorized Partner for RabbitMQ — named by the engineers who build it

AceMQ is the Featured Authorized Partner for RabbitMQ, named by the RabbitMQ Core Engineering Team — the people who write and maintain the broker. That recognition covers RabbitMQ support, licensing and professional services, and it makes AceMQ the only RabbitMQ partner with a direct line to the core team. When an escalation needs an answer that is not in the documentation, it does not stop at a support tier.

You do not have to take our word for it — RabbitMQ lists AceMQ on its own site.

See AceMQ listed on rabbitmq.com (opens in a new tab)
Only
RabbitMQ partner with a direct line to the Core Engineering Team
Support · Licensing · Services
the full scope the partner status covers
Below 72 cores
the only provider globally licensing commercial RabbitMQ under Broadcom's minimum

Is This You?

You probably need this if…

  1. 01

    Your cluster hits a memory or disk alarm and you restart nodes to clear it, without knowing why it filled

  2. 02

    Queues are backing up with tens of thousands of unacked messages and consumers look healthy

  3. 03

    Quorum queues are running fewer members than you configured, and you don't know when they dropped

  4. 04

    Federation or shovel links restart every time you add or remove a node

  5. 05

    rabbitmqctl and rabbitmq-diagnostics stopped working after a security agent rollout

  6. 06

    A partition healed itself but you can't tell whether you lost messages

  7. 07

    Throughput fell off a cliff and nothing in your application changed

  8. 08

    You've opened tickets with a vendor who keeps asking for logs and never reaches a conclusion

Outcomes

Where you are now, and where you end up

Concrete state changes, not deliverable counts. This is what actually differs about your RabbitMQ estate when the engagement closes.

  1. Before

    Recurring memory alarms cleared by restarting nodes on a runbook nobody wrote down.

    After

    The specific queue and consumer pattern driving memory growth is identified, with a corrected prefetch and flow-control configuration that holds under peak load.

  2. Before

    A backlog of unacknowledged messages that grows during business hours and never fully drains.

    After

    Consumer acknowledgement behavior and prefetch sizing corrected, backlog drained, and an alert that fires on unacked growth before it becomes visible to users.

  3. Before

    Quorum queues silently running with fewer members than configured after past node replacements.

    After

    Full member sets restored, the replacement procedure that lost them corrected, and a check that surfaces under-replicated queues automatically.

  4. Before

    Nobody on the team can say with confidence whether the last partition event lost messages.

    After

    A documented partition-handling strategy, verified publisher confirms, and a reconciliation method that answers the question definitively.

  5. Before

    Incidents diagnosed by whoever is available, with knowledge leaving when they do.

    After

    A written diagnostic runbook specific to your topology, so the next incident is handled the same way regardless of who is on call.

Recognise your estate here? Get a quote for RabbitMQ emergency support from a senior engineer.

Contact Us

Scope

What's covered

  • 01

    Memory & Disk Alarms

    Memory high-watermark tuning, paging behavior, disk free-space limits, and the queue or consumer pattern actually driving growth. We find what fills the broker, not just how to clear the alarm.

  • 02

    Backlogs & Consumer Lag

    Unacked message growth, prefetch misconfiguration, slow or stalled consumers, and acknowledgement patterns that quietly hold messages in memory without ever completing.

  • 03

    Clustering & Partitions

    Network partition handling strategy, split-brain recovery, node discovery failures, and Erlang distribution issues — including the case where a security agent silently blocks the Erlang binaries the CLI depends on.

  • 04

    Quorum & Classic Queues

    Under-replicated quorum queues, member loss after node replacement, quorum queue creation failures at high message counts, and classic mirrored queue behavior on versions where it still applies.

  • 05

    Federation & Shovel

    Links that restart on cluster topology change, unidirectional message flow, upstream connection churn, and federation behavior across unreliable WAN links.

  • 06

    Performance & Throughput

    Publisher confirm latency, channel churn, connection storms, message size effects, and the interaction between prefetch, concurrency, and consumer processing time that governs real throughput.

Want a senior RabbitMQ engineer to scope this with you? Get a quote or send us a message.

Contact Us

The Engagement

How it actually runs

Every phase has a defined duration and a concrete artifact handed over at the end of it. You always know what stage you're in and what you've received.

  1. Phase 1First 24 hours

    Rapid Triage

    A senior engineer gets read access to your cluster, metrics, and logs. We establish what changed, what the actual failure signature is, and whether you are currently at risk of another incident — before proposing anything.

    You receive

    • Current-state risk assessment with anything urgent flagged immediately
    • Confirmed failure signature, separated from downstream symptoms
    • Interim mitigation if you are still exposed
  2. Phase 22–5 days

    Deep Diagnosis

    We reproduce or trace the failure through broker internals — queue and channel state, Erlang process and memory breakdown, flow control, disk and network behavior, and the client-side acknowledgement pattern. Most RabbitMQ problems are not broker bugs; they are configuration and client behavior interacting badly under load.

    You receive

    • Root cause established with supporting evidence, not a hypothesis
    • Contributing factors ranked by impact
    • Reproduction steps where the failure can be reproduced safely
  3. Phase 31–2 weeks

    Remediation

    We implement the fix with you — configuration changes, topology corrections, client library changes, or an upgrade where the cause is a known defect. Changes are staged and validated rather than applied directly to production.

    You receive

    • Applied and validated fix, with rollback plan
    • Before/after metrics demonstrating the change worked
    • Client-side recommendations where the fix belongs in application code
  4. Phase 41 week

    Prevention & Handover

    We close by making sure this class of failure surfaces early next time. That means the monitoring and alerting gaps that let it reach production get closed, and your team gets a written runbook for the specific topology you run.

    You receive

    • Written root-cause analysis document
    • Monitoring and alert rules covering the failure mode
    • Diagnostic runbook specific to your cluster topology
    • Live handover session with your on-call team

Emergency RabbitMQ support: split brain, full disks and other outages

Emergency RabbitMQ support means a senior engineer on your incident within 15 minutes under a support contract, 24/7, working from the broker's own state rather than from guesses. The first hour decides whether the rest of the incident is spent fixing the cluster or recovering from a restart that destroyed the evidence. These are the situations we are called for most, and the first move in each.

Common RabbitMQ emergencies: the first check and the move to avoid
First checkDo notWhat AceMQ does
Split brain (network partition)rabbitmqctl cluster_status on every node, comparing running nodes and the partitions listRestart nodes at random before logs and status are savedDecides which side holds the state worth keeping, brings the other side back in, and sets the partition-handling strategy that prevents a repeat
Full disk or disk alarmrabbitmq-diagnostics alarms, then what is using the volume: queue data, logs or dumpsDelete files from the data directory by handFrees or extends space safely, finds the queue or consumer fault that filled it, and clears the alarm so publishers resume
Memory alarmrabbitmq-diagnostics memory_breakdownRestart the node to clear itFinds the queue and consumer pattern driving memory, then corrects prefetch and flow control
Quorum queue without a majorityrabbitmq-queues quorum_status for the queue, and which members are upDelete and redeclare the queueRestores the missing members and checks what was lost

Split brain: recover first, then stop it recurring

A split brain happens when nodes lose contact with each other and each side carries on. With the default partition handling the cluster stays partitioned until a person acts, and writes may continue on both sides. Recovery means choosing the partition whose state is trustworthy, stopping the nodes on the other side and starting them again so they rejoin. That choice is the hard part, because it decides which messages survive. Prevention on RabbitMQ 4.2 and earlier is a partition-handling strategy such as pause-minority on an odd number of nodes; on 4.3 and later that setting no longer exists, and the Raft-based metadata store and quorum queues need a majority to accept writes.

Full disks: the alarm is the symptom

When free disk space falls below the configured limit, RabbitMQ blocks publishers to protect itself, so applications see connections stall while the broker looks healthy. Lowering the limit clears the alarm and leaves the node free to fill the disk completely. The useful questions are what filled it, whether it is a backlog because consumers stopped, and how much headroom the volume has at peak. We answer those during the incident and leave you alerts that fire well before the limit.

Emergency first, then the contract

You do not need a contract to call. Without one, a new emergency engagement starts the same day. A support contract means the next emergency is answered in 15 minutes, and managed RabbitMQ services are the step up for teams that would rather not hold the pager at all.

For the monitoring and alert thresholds that catch these early, see RabbitMQ troubleshooting: 12 production issues and how to fix them

Ready to talk RabbitMQ? Get a quote or send us a message.

Contact Us

Customer Success

Real RabbitMQ Results

See how enterprises trust AceMQ for their most critical RabbitMQ workloads.

1 / 8 case studies

All use cases

FAQ

Questions about RabbitMQ emergency support

My RabbitMQ cluster has split brain. What should I do first?

Save the evidence before you restart anything: run rabbitmqctl cluster_status on every node, copy the logs, and note which side your applications are connected to. Then decide which partition holds the state you want to keep, because that decides which messages survive. If you cannot make that call confidently, phone us on +1 305-204-2607 and we will work it with your engineers. Under a support contract we are on the incident within 15 minutes.

RabbitMQ has stopped accepting messages and the disk is full. What now?

Run rabbitmq-diagnostics alarms to confirm a disk alarm is active. RabbitMQ blocks publishers while it is set, which is why producers hang with no error from the broker. Find out what is using the volume before you act. A growing backlog means consumers have stopped, which needs fixing or the disk fills again. Do not delete files from the data directory by hand. Extend the volume or free space safely, and let the alarm clear.

How is RabbitMQ troubleshooting different from your 24/7 support?

Support is an ongoing contract with an SLA for incidents as they happen. Troubleshooting is a scoped engagement aimed at one persistent or recurring problem you have not been able to resolve — typically something that has been open for weeks and survived several attempted fixes. Many customers start with a troubleshooting engagement to clear a specific issue, then move onto a support contract to keep it from recurring.

How quickly can you start on a production issue?

For an active production incident, we can have a senior engineer engaged within 15 minutes under a support contract, or same-day for a new emergency engagement. For a persistent non-urgent problem, engagements typically start within a few business days. Tell us the severity when you contact us and we will be direct about what we can commit to.

What access do you need to troubleshoot our cluster?

At minimum, read access to the management API or metrics, broker logs, and configuration. Interactive access to a live session with your engineers is significantly faster than an asynchronous log exchange. We work regularly in restricted and air-gapped environments where direct access is impossible, and can guide your team through the diagnostic steps instead — it takes longer, but it works.

What if the problem turns out not to be RabbitMQ?

That happens often, and we will tell you. RabbitMQ symptoms frequently originate in storage latency, network policy, JVM or client library behavior, Kubernetes scheduling, or a security agent interfering with the Erlang runtime. We diagnose across the full stack because that is where the cause usually lives, and we would rather hand you an accurate answer about your storage layer than a plausible one about your broker.

Do you fix the problem or just tell us what's wrong?

Both, and the fix is included. We implement remediation with your team rather than delivering a report and leaving. Where the correct fix belongs in your application code, we specify exactly what needs to change and why, and review it with your developers — we just will not merge to your application repositories on your behalf.

Can you help if we're on an end-of-life RabbitMQ version?

Yes. Many regulated environments cannot upgrade on the community's timeline, and that is a normal enterprise constraint rather than a disqualifier. We troubleshoot RabbitMQ from 3.8.x to 4.x, apply workarounds where upstream fixes are not available for your version, and will tell you honestly when a specific problem genuinely cannot be resolved without upgrading.

What do we actually receive at the end?

A written root-cause analysis, the applied and validated fix with before-and-after metrics, monitoring and alert rules that would have caught the issue earlier, and a diagnostic runbook written for your specific topology. The runbook matters most: it means the next incident of this class gets handled consistently, whoever is on call.

Let's talk

Stop Restarting Nodes and Hoping

Bring us the RabbitMQ problem that keeps coming back. A senior engineer will tell you what is actually causing it — and what specifically to change so it stops.

Email Us

Get in Touch

Talk to a RabbitMQ Expert

Send us a message and we'll follow up within 1 hour — or book a free 30-min consultation directly.

305-204-2607
info@acemq.com
66 W. Flagler St. 9th Floor
Miami, FL 33130

Prefer to talk now? Call us directly or use the consultation tab to find a time that works.

We respond within 1 hour.

Pick a time that works — no pressure, no pitch. Just 30 minutes with an expert.

We respond within 1 hour.