An accurate chatbot can still shut customers out. The missing test is whether people can finish the task, not whether the model knows the answer.
Measure whether customers finish, not whether the bot answers
A customer asks your AI assistant how to change an appointment. The answer is accurate, the response arrives quickly and your dashboard records a successful conversation. But the customer cannot reach the suggested appointment buttons using a keyboard. They leave without changing anything. Your reporting calls this automation. The customer experiences a closed door.
That distinction should shape the business case for customer-facing AI. Accuracy is necessary, but service access depends on the whole journey: finding help, opening the conversation, understanding its status, acting on an answer and reaching a person when required. Buying a capable model does not buy an accessible service. The surrounding interface, authentication, generated content and handover all matter.
The issue is not hypothetical. AccessibilityChecker's 2026 study of 30 AI tools reported that only six passed its assessment. Crucially, this was one blind tester using one screen reader across ten tasks, not a representative survey or a certification of the products. Its useful lesson is the method: test whether somebody can complete actual work, rather than infer usability from the brand or the model underneath.
For a small UK business, start with three customer outcomes. Can someone get an answer about an order, change a booking and raise a complaint? Define the evidence of success before selecting a widget. A readable answer is not proof of an updated booking. A displayed confirmation is not proof that assistive technology announces it. Put those distinctions into your purchasing brief and your operational reporting. Otherwise, an apparent reduction in support demand may simply be customers giving up.
An accurate answer is not a completed customer journey.
Keep the UK legal position separate from vendor marketing
Accessibility advice often arrives wrapped in American legal terminology. A supplier may advertise ADA compliance or describe a global standard as though it creates the same duties everywhere. UK buyers need a more precise conversation. Ask which legislation applies to your organisation, which technical standard the supplier tested against and what evidence supports its claims. Those are three different questions.
GOV.UK guidance for public sector bodies identifies WCAG 2.2 AA and an accessibility statement as the route to meeting the public sector website and app requirements, subject to relevant exemptions. The same guidance says UK service providers have reasonable-adjustment obligations under the Equality Act 2010, or the Disability Discrimination Act 1995 in Northern Ireland. Do not turn that into a blanket claim that every private business falls under the public sector regulations.
There is current UK attention to the AI-specific problem too. The Government Digital and Data community event on 29 September 2026 explicitly covered AI accessibility testing, risks and practical considerations. That event is evidence of an active delivery concern, not a new law or government endorsement of a particular product.
What this means in practice is straightforward. Write accessibility into acceptance criteria and supplier discussions before rollout. Request an account of tested journeys, supported browser and assistive-technology combinations, known barriers and the process for fixing them. A statement that the underlying model is accessible is not enough: your embedded widget and booking integration may behave differently. Keep an accountable business owner for the service. Outsourcing the software does not remove the need to understand whether customers can actually use what you have bought.
Ask separately about legal scope, technical standards and evidence from the deployed service.
Test the conversation after the first message
A static scan can find missing labels, contrast problems and many other useful defects. It cannot, by itself, tell you whether an unpredictable, multi-turn conversation remains understandable. The difficult moment may occur after the fourth reply, when a suggested action appears, a timeout warning interrupts or a customer needs to correct earlier information. Test those states deliberately.
Monobot's 28 October 2026 guide describes practical issues including keyboard operation, new-message announcements, conversation history and an easy route to a person. It is vendor guidance, so it is useful as an implementation checklist rather than independent proof of the vendor's accessibility. The underlying point stands: a labelled text box is only the beginning of the service.
Run a keyboard-only check from the page before the chat opens. Can you find the launcher, see where focus is, submit a question, select a suggested action and close the window? Does focus return somewhere sensible? Then repeat with a screen reader. Check whether the service announces that it is working, whether the final answer can be found without rereading the entire transcript, and whether streaming text produces silence or repeated interruptions. Do not assume announcing every new token is helpful.
Include failure and recovery. Submit a missing order number, trigger an unavailable booking slot, disconnect during a reply and return to the conversation. Ask testers whether they know what happened and what to do next. Save the result for each task, including any assistance required. Use ordinary language in the record: could not reach the cancellation button is much more useful to a business owner than a reassuring accessibility score with no explanation. Automated checks should support this work, not substitute for observing task completion.
Test the fourth reply, the failed action and the recovery, not just the empty chat window.
Choose test coverage from users, not your own laptop
A developer trying one screen reader for an afternoon can uncover obvious problems. That is valuable, but it is not the same as a customer who uses assistive technology every day completing the service independently. Plan both technical checks and user involvement. Include people with relevant access needs, and recognise that visual, hearing, motor and cognitive barriers are not interchangeable.
The WebAIM Screen Reader User Survey number 11 collected 1,780 valid responses in July and August 2026. Among respondents, 91.8% reported using a screen reader on a mobile device. Within its European responses, primary desktop use of JAWS and NVDA was almost equal: 42.8% and 42.3% respectively. These are self-selected survey findings, not UK population estimates. They nevertheless provide a strong warning against treating a single desktop demonstration as sufficient coverage.
Start with the devices and browsers your service supports, then agree a manageable test matrix with accessibility expertise. NVDA is a useful free option for initial Windows checks, and VoiceOver is available on Apple devices. Neither removes the need to consider other combinations or to involve experienced users. Record exactly what was tested so a narrow pass does not become a claim of universal compatibility.
What this means in practice is a small but explicit release checklist. Test the three priority customer outcomes on desktop and mobile, including zoom, keyboard operation and relevant screen readers. Record device, browser, software version, task result and blocker. Retest the affected journeys after a widget update, not just after a model change. If your customers cannot complete a booking on the phone they actually use, a flawless demonstration on the supplier's laptop is commercially irrelevant.
WebAIM found mobile screen reader use among 91.8% of its survey respondents, not just desktop use.
Make the answer and the alternative usable too
Even a technically operable chat interface can deliver an unusable answer. Dense paragraphs, unexplained acronyms and a list of vaguely labelled links create unnecessary effort. A customer trying to rearrange a delivery should not have to extract one instruction from an essay about your commitment to customer service. Put the answer first, give the next step and keep optional detail separate.
Structure matters for navigation as well as readability. In the same WebAIM survey, 67.8% of respondents said they would first navigate through headings when looking for information on a lengthy page. Do not assume that particular percentage describes chat behaviour. It does show why meaningful structure is more than decoration. In longer generated responses, use genuine lists, descriptive link text and clear separation between the customer's question and the assistant's reply. Test the rendered result, not just the text returned by the model.
Provide alternatives that work without completing the AI conversation. A visible contact form, email route or staffed phone option should be reachable outside the widget. Voice is useful for some customers and unsuitable for others. Text is not automatically accessible either. The aim is a usable choice, rather than replacing one compulsory interaction mode with another.
Be explicit about what happens on handover. Does an adviser receive the relevant information, with appropriate privacy controls, or must the customer repeat everything? Can someone request help without disclosing a diagnosis? Can a person who cannot use the chat still reach the same service? Test those details. This is an access question, distinct from whether the manual team has enough capacity during an outage. The customer should be able to choose a workable route while the AI is functioning exactly as designed.
A human-help link inside an inaccessible widget is not a usable alternative.
Keep the benefit, but stop counting exclusion as efficiency
The strongest counterargument is that AI can improve accessibility. That is true. Plain-language explanations can make a complicated process easier to understand. A conversational route may help somebody who struggles with a dense menu. Text support can suit someone who cannot use a phone. Round-the-clock access can be useful when a customer needs time to formulate a question. Accessibility is not an argument against AI.
It is an argument against making the least-tested channel compulsory. The right comparison is not an idealised human service against an imperfect bot. Compare real customer outcomes before and after the change, including the alternative routes. If the AI helps one group but prevents another from completing essential tasks, the rollout needs adjustment even when the average handling time improves.
Set a business release rule that is stricter than a pleasing dashboard. Known blockers to priority tasks need an owner and a resolution before you depend on the affected AI route. Maintain an accessible alternative while investigating. Track completed bookings, resolved enquiries, failed actions and requests for another channel alongside conversation volume. Do not collect sensitive disability information simply to populate an analytics chart. Combine proportionate operational records with voluntary feedback and properly organised testing.
A practical first week needs no grand transformation programme. Select three common tasks, document what completion means, run automated and manual checks, observe relevant users and fix the most serious barriers. Ask the supplier for evidence rather than a badge. Repeat the checks after material changes to the interface, authentication or integrations. Assign a named person to review unresolved defects. The business gain is not merely a lower contact count. It is a service more customers can finish independently, with a clear way to get help when the conversation is not the right route for them.
Fewer support contacts can mean better self-service, or customers who could not get through.
Key Takeaways
- Define three priority customer tasks and record what successful completion actually means.
- Test keyboard operation, screen reader feedback and mobile journeys after multiple replies and failed actions.
- Ask suppliers for tested combinations and known barriers, not an unsupported accessibility badge.
- Keep a usable contact route outside the AI widget, without requiring customers to disclose a diagnosis.
- Retest after interface and integration changes, and report failed actions alongside apparent automation gains.
