Keep Your Public Feedback Board Alive and Useful


TL;DR
Before we turn on an AI support agent, we need a knowledge base that answers real customer questions, states policies clearly, exposes product limits, and explains when to escalate. The goal is not more documentation. It is trustworthy source material the agent can cite, follow, and hand off from.
An AI support agent is only as useful as the material it can rely on. If our knowledge base is vague, outdated, or written for marketing instead of support, the agent will either avoid answering, give incomplete answers, or escalate questions a human could have handled.
Before we put an agent in front of customers, we need to make the knowledge base operational. That means it should reflect how support actually works: the questions customers ask, the policies agents enforce, the edge cases that create tickets, and the moments where a human needs to step in.
This is not about creating a perfect documentation site. It is about giving the AI enough grounded source material to answer common questions, cite where the answer came from, and hand off with useful context when it cannot safely resolve the issue.
The best knowledge base plan is hiding in the inbox.
We should not begin by asking, “What articles should we write?” We should begin by reviewing recent conversations. Look for repeated questions, not theoretical topics. If five customers asked how billing proration works, that article matters more than a polished overview of the product vision.
Support teams usually know these patterns already. The work is turning that tribal knowledge into source material. Pull questions from email, chat, contact forms, sales handoffs, cancellation feedback, and onboarding calls. Then group them by the action the customer is trying to complete.
For example, “How do I invite a teammate?”, “Why can’t my teammate see the workspace?”, and “Can I restrict admin access?” may belong in separate sections of one article about team management. The AI agent can then answer a specific question while citing a source that covers the surrounding context.
If we use Chattering, this matters because the agent answers from the company’s own website and docs and cites its sources. Thin or scattered docs reduce the agent’s ability to give a confident, verifiable answer.
A knowledge base article for AI support should be easy to retrieve and easy to quote.
That usually means short sections, direct headings, and concrete statements. Avoid burying the actual answer under background. If a customer asks, “Can I export my data?”, the article should say exactly what can be exported, where to do it, which formats are supported, who has permission, and what is not included.
We want the article to mirror the way a strong support rep replies: answer first, then add caveats.
A useful structure is:
That is the one checklist we need. It keeps documentation grounded in support reality.
Avoid clever titles. “Taking your data with you” may sound friendly, but “Export your data” is easier for customers, humans, and AI systems to match to an intent. The same applies to headings inside the article. Use the customer’s language.
Many AI support failures come from missing policy docs, not missing product docs.
Customers ask operational questions: Can I get a refund? What happens if I cancel mid-cycle? Do you offer invoices? Can we remove our data? Is support included on this plan? Can I switch from monthly to annual?
If those answers are not written down, a human agent may still know what to do. An AI agent should not guess.
Before launch, we should create plain policy pages for billing, refunds, cancellations, plan changes, data retention, security requests, support availability, and account ownership. These pages do not need legal language unless the subject requires it. They need the exact rule the support team follows.
For example, “Refunds are reviewed case by case” is not enough. What information should the customer provide? Who reviews the request? Are there situations where refunds are not offered? Should the AI agent answer directly, or should it collect details and hand off?
The more judgment a policy requires, the more important it is to define the escalation path.
Support docs often explain what the product does. AI support also needs docs that explain what the product does not do.
That includes unsupported integrations, feature limitations, permission restrictions, usage limits, regional availability, API constraints, and known tradeoffs. These are not embarrassing; they are guardrails.
If a feature is not available, the agent needs a safe answer: “That is not supported right now,” plus the closest workaround if one exists. Without that source, the agent may overpromise or escalate every limitation question to the team.
This is especially important for small SaaS teams where roadmap details live in founders’ heads. If support has a standard answer for “Do you support SSO?”, “Can I self-host?”, or “Is there an API?”, that answer belongs in the knowledge base.
If the answer changes often, add an owner and review cadence. A stale limitation article is worse than no article because it can create false confidence.
Setup articles explain the happy path. Support tickets usually happen when the happy path breaks.
For each major workflow, add a troubleshooting section. Start with the symptoms customers actually report: “I did not receive the invite email,” “My import is stuck,” “The widget is not appearing,” “The webhook test failed.”
Then explain the checks in the order a support rep would perform them. Do not just say, “Check your configuration.” Say which setting to check, where it appears, what the expected value looks like, and what to send support if the issue continues.
This helps the AI agent resolve simple problems and gather useful context for harder ones. When Chattering hands off to a human, it can pass the conversation context along. That handoff is much more useful if the agent already asked for the workspace ID, error message, browser, integration name, or steps tried.
An AI support agent should not answer every question. Some issues need a human: billing disputes, account access conflicts, security concerns, bugs affecting production data, angry cancellation messages, custom enterprise requests, and anything involving sensitive judgment.
We should write down those rules before launch.
This can live as an internal-facing article or a support operations page. The important part is that the agent has clear instructions about when to stop answering and create a handoff.
For each escalation category, define what context should be collected. A bug report may need steps to reproduce, screenshots, environment, account ID, and expected behavior. A billing issue may need invoice number, workspace email, plan, and the customer’s requested outcome.
This is where AI support becomes part of the team instead of a layer in front of the team. The agent handles what is safe, then routes the rest with enough detail that the human does not have to restart the conversation.
Before turning on an AI support agent, search the help center for old versions of key topics.
Duplicate articles are common after product launches, pricing changes, and migrations. A human rep can often recognize the newer article. An AI agent may retrieve both unless the source set is clean.
Look for contradictions in pricing language, plan names, screenshots, feature availability, and permission names. If an article refers to an old navigation path, update it. If a page exists only for SEO and does not help support answer a question, decide whether it should be included as a source.
A smaller, accurate knowledge base is better than a large, conflicting one.
Because Chattering cites its sources, each important answer needs a stable page that can stand behind it. That page should have a clear title, a focused topic, and enough detail that a customer can verify the answer without opening a ticket.
If information is split across many tiny fragments, consolidate it. If one long article covers ten unrelated topics, break it up. The goal is not to optimize for a search engine crawler. The goal is to make the right source retrievable at the moment of need.
Screenshots can help customers, but do not make them the only place where information exists. If a setting is important, name it in text. AI agents rely on written source material far more reliably than visual-only instructions.
The first version of the knowledge base will miss things. That is normal.
What matters is whether we have a process to improve it from real conversations. After launch, review questions the AI could not answer, answers that required human correction, and escalations that lacked enough context. Each one is either a documentation gap, a policy gap, or an instruction gap.
For a small SaaS team, this review can be simple: once a week, pick the top unanswered or escalated themes and update the relevant articles. If the same question appears again, the agent should have better source material next time.
Turning on AI support is not a one-time documentation project. It is a way to expose what the support team already knows but has not written down yet. The better we capture that knowledge, the more confidently the agent can answer customers and the less often humans have to repeat the same work.
No, but we need reliable coverage for common questions, policies, troubleshooting, and escalation rules. A small accurate source set is safer than a large outdated one.
Use public docs for customer-facing answers and internal docs for routing, escalation, and context collection. Keep any sensitive internal material clearly separated from customer-visible responses.
Review unanswered questions and poor escalations every week at first. Each repeated gap should become an article update, a clearer policy, or a better handoff instruction.