Give Deprecated Features Their Own Help Center Section


TL;DR
Inbox zero feels like a win until you realize your AI closed half those tickets without a real answer. Deflection rate without resolution rate is a vanity metric. Audit what your AI actually said, watch for reopens and repeat contacts, and build a closure policy before you trust the number.
Your queue hit zero yesterday. No backlog, no SLA breaches, green dashboards everywhere. Then a customer emails back: "I already asked this three times and keep getting a link to an article that doesn't apply to me."
That's when inbox zero stops being a signal and starts being a mask.
An AI support agent that closes tickets automatically is doing exactly what you configured it to do. The problem isn't the automation — it's that most teams configure closure without configuring resolution criteria. The AI fires a reply, the ticket closes, and the queue looks clean. Whether the customer got an answer is a separate question, and most teams aren't asking it.
Deflection means a ticket didn't reach a human. Resolution means the customer's problem was actually solved. These two things can overlap heavily, or they can diverge completely, and a clean inbox tells you nothing about which is happening.
Say a team resolves 800 tickets a month and the AI handles 500 of them. If 150 of those 500 customers come back within 72 hours with the same issue, the real human-handled volume is closer to 650 — plus the frustration tax on those 150 customers. The queue looked clean. The workload didn't shrink.
The metric that matters is contact rate per issue: how often does the same customer, or customers with the same problem, contact you again within a defined window? That number exposes silent misresolutions that deflection rate buries.
In practice, silent misresolution shows up in a few predictable patterns.
A customer submits a billing question. The AI matches it to a help article about invoice formatting and closes the ticket with a link. The customer's actual question was about a charge they don't recognize. They either email back, open a new ticket, or — worse — quietly churn without another contact.
Or a customer asks about an integration that broke after your last deploy. The AI has no context about the deploy, finds the closest docs match, and closes with a "try reconnecting" suggestion. The customer tries it, it doesn't work, and they open a new ticket. Your queue ate two tickets and produced zero resolution.
The common thread: the AI responded to the surface-level words, not the underlying intent, and closed before it confirmed anything.
Most teams treat ticket closure as a mechanical trigger: reply sent → close. A closure policy adds conditions to that trigger that are actually connected to resolution.
At minimum, your policy should require:
None of these are complicated. They're just decisions you have to make before you trust your queue number.
The fastest way to know whether your AI is resolving or burying is to read what it said. Pull 20 AI-closed tickets from last week — not the ones that got reopened, the ones that stayed closed — and read the full exchange.
You're looking for: did the AI's reply match what the customer actually asked? Did the customer acknowledge the answer, or did the thread just go quiet? Going quiet is not resolution — it's often resignation.
With Chattering, every AI-handled conversation is logged in full with the citations the agent used, so this review takes minutes rather than a manual dig through email threads. The point isn't the tooling — it's building the habit of reading the work, not just the count.
A well-designed AI support agent knows when it doesn't know something. That's not a failure state — it's the feature. When the agent detects low confidence, ambiguous intent, or a frustrated tone, it should hand off to a human with the full conversation context already loaded, not restart the customer from scratch.
That handoff loop is what separates deflection infrastructure from resolution infrastructure. If your AI never escalates, that's not a sign it's handling everything well — it's a sign the escalation threshold is misconfigured or missing entirely.
Replace inbox zero as your primary signal with a short set of resolution-quality indicators: reopen rate within 72 hours, repeat contact rate per issue category, and CSAT on AI-closed tickets versus human-closed tickets. If those three numbers look good, your queue number is meaningful. If they don't, your queue number is covering for a problem your customers already know about.
Pull a sample of AI-closed tickets and check the reopen rate within 72 hours, plus the repeat contact rate for the same issue category. If customers are coming back on the same topic, the AI closed without resolving.
Not necessarily — but you should add conditions to it. Require a confidence threshold before auto-closing, and hold any ticket closed with an article link in a pending state for 48 hours before marking it fully resolved.
Low confidence in the match, detected frustration in the customer's tone, or a follow-up message that restates the original question are all strong escalation triggers. Any one of them should route to a human with full conversation context.