Short answer: With a retrieval-based chat widget, keeping answers current means keeping sources current — recrawl your site after meaningful changes, replace outdated knowledge files, and use corrections to override anything that still comes out wrong. There is no retraining step, so an update takes minutes rather than a support ticket.
The failure mode is not dramatic. It is a widget quoting last season's opening hours to somebody standing outside your locked door.
Why staleness is a sourcing problem, not a model problem
Because a modern widget uses retrieval-augmented generation, every answer is composed from passages pulled out of an index built from your content. The model contributes phrasing and synthesis. The facts come from the index.
So an out-of-date answer means one of four things: the source page still says the old thing, the page changed but the index has not been refreshed, an old knowledge file is still uploaded, or a correction you wrote months ago is now itself outdated.
That is the entire diagnostic tree. Work it in order and you will find the cause every time.
The consequence cuts both ways. Grounding answers in your own content sharply reduces the chance of invention, because the model is summarising passages you wrote rather than reaching into general knowledge. It also means the widget inherits every gap, ambiguity and contradiction in your material. It cannot be more current, or clearer, than its sources. Maintenance is not housekeeping around the edges of the product. It is the product.
The four sources that go stale
Your website pages. The most common culprit, and the most reassuring, because fixing the page fixes the widget and every human reader at once. Watch for the page you forgot existed — the old landing page from a campaign two years ago that still advertises a discontinued service.
The index. Your crawl is a snapshot. Edit a page and the index keeps serving the old passage until a recrawl happens. This is the gap that surprises people most, because the website looks right while the chat is wrong.
Knowledge files. Uploads are the easiest thing to forget. Clerkzo accepts ten file types at up to ten megabytes each, which makes it tempting to dump a folder in and never look again. A price list from last year sitting in the knowledge base is a booby trap.
Corrections. A correction is an authoritative override, which is exactly why it needs review. You told it in March that you were fully booked until June. It is now July, and it still says so.
How to diagnose a wrong answer in two minutes
When somebody reports a bad answer, resist the urge to start editing things. Work the tree in order.
First, ask the same question in the playground and confirm you can reproduce it. A surprising number of reported problems are misremembered, or were a different question entirely.
Second, open the page that should hold the answer and read what it actually says, not what you believe it says. Often enough the page is the problem and the widget was faithfully repeating it.
Third, if the page is right, the index is behind. Recrawl and retest.
Fourth, if the page is right and the index is fresh, look at your uploaded files for a contradicting document, then at your corrections list for an override that has expired.
Only after all four is it worth concluding that retrieval simply did not surface the right passage — which usually means the fact is buried in a long page and wants pulling out into its own clearly headed section.
A maintenance rhythm that actually gets done
Anything more elaborate than this gets abandoned by week three.
When something changes, update it immediately. Prices, hours, services, staff, policies. Edit the page, trigger a recrawl, and spot-check the answer in the playground. Five minutes.
Once a month, read conversations. Sort for thumbs-down ratings and skim the rest. You are looking for answers that were technically drawn from your content but no longer true, and for questions that keep arriving without good answers. Fifteen minutes.
Once a quarter, audit sources. List every uploaded file and every correction and ask whether each is still true. Delete rather than accumulate. Thirty minutes.
Before anything seasonal, test deliberately. Holiday hours, seasonal services, campaign offers. Ask the widget the questions your customers will ask that week, in the playground, before they ask them for real.
One practical note: recrawls are metered per plan rather than unlimited, which nudges you towards batching. Make the five edits you have been meaning to make, then recrawl once.
The quarterly content audit, as a checklist
Print this, or copy it into whatever you use for recurring tasks. It is the thirty minutes that prevents most stale-answer complaints.
- Prices. Does every published price still match what you charge? Check the page, any uploaded price sheet, and any correction that mentions a number.
- Hours. Standard hours, seasonal hours, holiday closures. Is anything on the site describing a season that has passed?
- Services. Is anything listed that you no longer offer? Is anything you now offer missing entirely?
- Coverage. Areas served, travel charges, postcode boundaries. These drift quietly as businesses grow.
- People. Named staff who have left, qualifications that have changed, team pages nobody has touched in two years.
- Policies. Cancellation terms, deposits, guarantees, returns. High-stakes and rarely reviewed.
- Lead times. "Usually within a week" was true when you wrote it. Is it true now?
- Uploaded files. List every file. For each one, answer: is this still accurate, and is it duplicated by a live page? Delete or replace, do not archive.
- Corrections. List every correction. For each one, answer: is this still true, and does the underlying content now say it properly? Retire the ones the website has caught up with.
- Orphan pages and contradictions. Delete old campaign pages and discontinued services, then check that the facts most likely to appear twice, usually price and hours, agree wherever they appear.
- Recrawl and spot-check. Ask ten real customer questions in the playground and confirm the answers match reality.
If a full pass feels like too much, do items one, two, eight and nine. Those four catch most of it.
Use the rating signal properly
Every conversation is saved with a thumbs up or down. Down-votes are the cheapest quality signal you will ever get, because a stranger volunteered it.
Read the whole exchange, not the rated message. Often the down-vote lands on a perfectly accurate answer that arrived after two useless ones. Look for clusters: three down-votes on availability questions in a week almost always means a stale source rather than three unlucky visitors.
The absence of a rating is a signal too, just a weaker one. Most visitors never rate anything. So do not read a quiet month as proof of quality — read the transcripts instead, particularly the ones that end in a handoff or end abruptly. An abandoned conversation is a down-vote nobody bothered to click.
Corrections: the fast lane
Recrawling is right when the underlying content changed. Corrections are right when the content is fine and the answer is not — the wording is ambiguous, two pages conflict, or the question is one nobody thought to publish an answer to.
Flag the answer, type what it should have said, done. The override applies to similar questions going forward. It is the closest thing in this workflow to what people mean by chatbot training: you review real output and you tell the system what right looks like.
Keep corrections tight. One clear fact per correction beats a paragraph covering four scenarios, because a narrow override is easier to audit and easier to retire when it expires.
Treat corrections as a temporary layer. Correcting the same theme three times is not a correction problem, it is a missing page: write the page, recrawl, retire the overrides.
Conflicting sources are worse than missing ones
If your pricing page says one thing and an uploaded PDF says another, retrieval may surface either. Answers become inconsistent — right on Tuesday, wrong on Thursday — which is far more corrosive to trust than a clean "I am not sure."
The fix is source hygiene, not more corrections. Pick one canonical location for each fact. Delete the duplicate. If both need to exist, make sure they agree word for word.
The usual offenders are predictable: a price mentioned in an old blog post, a PDF brochure with last year's hours in the footer, two location pages where only one got updated. Go looking for those specifically and you will usually find one.
Common mistakes
Editing the page and assuming the widget knows. It does not, until the crawl runs. This is the single most common cause of "it is still wrong".
Correcting instead of fixing. An override papers over a wrong page while every human reader still sees the wrong page. Fix the page; correct only what the page cannot say.
Uploading rather than replacing. Adding version two of a document without deleting version one gives retrieval two answers and no way to choose.
Reviewing on a calendar instead of on events. A quarterly review is the safety net. The trigger that matters is the change itself, on the day it happens.
Treating a seasonal correction as permanent. Anything with a date in it needs an end date in your diary the moment you write it.
Who owns this
Somebody has to. The habit dies wherever the answer to "who reads the conversations" is "everyone."
It does not need to be a technical person. Whoever answers the phone usually knows within thirty seconds whether an answer is right, and they already know which questions customers actually ask. Give them the login and fifteen minutes a month. Route the edge cases they cannot resolve to a person via human handoff rather than guessing at a correction. If you want to see where the crawl, files and corrections sit, it is laid out on how it works.
Attach it to a routine that already exists — the Monday admin hour, the end-of-month invoicing session. Standalone tasks lose.
Frequently asked questions
How often should I recrawl my site?
After any meaningful content change, plus a periodic refresh for safety. Event-driven beats calendar-driven — the change is the trigger.
Do I need to recrawl if I only fixed a typo?
No. Recrawl when facts change, not when wording is polished.
What if two of my pages contradict each other?
Fix the pages. Retrieval cannot adjudicate a conflict it did not create, and a correction papering over it will drift out of sync later.
Can I schedule content to expire?
Treat corrections and seasonal files as having an end date and put the review in your calendar. Anything time-bound should be checked on a fixed rhythm rather than remembered.
Will a recrawl wipe my corrections?
No. Corrections sit alongside the crawled content as verified overrides, so refreshing the index does not undo the answers you have approved. That is exactly why they need their own review cycle.
How do I know maintenance is working?
Keep a small set of real customer questions and re-ask them after every significant change. How accurate are AI chatbots covers building that test set properly.