Metrickle

Accessibility analytics: measuring whether your product works for everyone

An audit tells you whether your code meets WCAG. It can’t tell you whether people using a keyboard or large text actually finish checkout. Accessibility analytics measures that from real usage, by comparing people who use accessibility settings with people who don’t. This guide covers what you can measure, what you can’t and shouldn’t, and how to read the numbers.

Task: Checkoutquillmere.example · since v4.12
Attempts5,436
Success rate68%
Widest gap33 pts
Checkout success rate by accessibility setting, with the gap to people using no accessibility settings
SettingAttemptsSuccessGap
No accessibility settings4,41071%—
Reduced motion23670%−1
Large text44858%−13
Keyboard navigation34238%−33

People using keyboard navigation finish checkout at about half the rate of people using no accessibility settings: 38%, down from 69% before v4.12, when Tab started skipping the “Pay now” button.

Three ways to know whether your product is accessible

Each answers a different question. None of them replaces the others.

Automated scans

Tools like axe check the code against rules: missing labels, low contrast, elements you can’t reach by keyboard. Fast and repeatable, but they only catch what a rule can express, and they can’t say who is affected.

Audits and research

An expert audit maps the product against WCAG. Testing with disabled people shows why something is hard. Both are essential, and both are snapshots of a product that keeps changing.

Accessibility analytics

Real usage, every day, split by accessibility setting. It answers how many people fall behind, where, how much it costs and whether the last release made it better or worse.

What you can measure: settings, not people

Browsers and operating systems expose the settings people choose: larger text, reduced motion, high contrast. Some behaviour, like navigating by keyboard, can be observed directly. Those are the raw material.

What you can’t measure is disability, and you shouldn’t try. Plenty of people use large text because their phone is small, and plenty of disabled people use no setting at all. Settings tell you how someone is using your product, which is what a fix needs to know.

Accessibility settings that can be measured, where, and how
SettingWhereHow it’s detected
Keyboard navigationWeb, iOS, AndroidWeb: five Tab presses, once Tab outnumbers pointer presses. iOS: a hardware keyboard or Switch Control. Android: a hardware keyboard or Switch Access
Zoomed inWebPage pinch-zoomed past 105%
Large textWeb, mobileBrowser default font above 16px; system text size above the default
High contrastWeb, mobileprefers-contrast, or the system setting
Forced coloursWebforced-colors: active, such as Windows contrast themes
Reduced motionWeb, mobileprefers-reduced-motion, or the system setting
Inverted coloursWeb, mobileA media query, or the system setting
Reduced transparencyWeb, iOSA media query, or the system setting
Bold textMobileThe system setting
GreyscaleiOSThe system setting
Screen readeriOS and Android apps onlyVoiceOver and TalkBack state. Browsers don’t expose it

Browsers deliberately hide whether a screen reader is running, because exposing it would single out disabled visitors. Don’t try to infer it. Sustained keyboard navigation on the web covers many people using a screen reader and many who don’t use one.

The method: compare with people using no accessibility settings

An accessibility gap is a difference between groups, so the comparison matters more than any single number.

  1. Pick a task

    Choose something with a clear start and finish that matters to the business: sign up, check out, book, finish onboarding. Give it a time window, like 30 minutes.

  2. Split by setting

    Measure success rate and time on task for each setting, and for people using no accessibility settings. Compare each group with them, not with the overall average, which already includes the groups you’re testing.

  3. Wait for enough attempts

    A handful of attempts is noise. By default Metrickle won’t give a verdict on a group until 15 different people have tried, judges small groups with an exact test so only an unmistakable gap turns red, and shows the count so nobody reads too much into a small one.

  4. Find the step

    Filter the funnel to the group that falls behind. The step where their drop-off departs from that of people using none is where the barrier is. Friction hotspots on that step usually name the element.

  5. Hear it from them

    Read barrier reports from that page, and show a one-question survey only to people with that setting. Ask about the task, never about disability.

Reading the numbers honestly

Accessibility numbers get quoted in planning meetings and sometimes in legal correspondence, so they need to survive scrutiny.

  • Settings overlap. One person can have zoom and keyboard navigation on. Groups aren’t mutually exclusive, so they don’t add up to a total.
  • Settings travel with other things. People using large text may skew towards older devices. If a gap looks large, check it holds within one device type before calling it a layout bug.
  • Say “people using keyboard navigation”, not “disabled people”. Report what was measured. It’s accurate, and it points at the fix.
  • A small gap isn’t a pass. A group that’s 8 points behind on few attempts is a group to watch, not a group to declare fine.
  • Look after the conversion too. A barrier in onboarding or account settings costs retained customers, not just first orders.
Checkout, since v4.12quillmere.example
Result for each accessibility setting, with attempts counted
SettingAttemptsResult
Reduced motion236No gap
Large text448Early signal
Forced colours12Too few attempts
Keyboard navigation342Gap found

Forced colours has 12 attempts. It isn’t green. By default it stays unjudged until 15 different people have tried.

Turn a gap into a priority

Backlogs are ordered by impact, and accessibility work often loses that argument because nobody has the number. The gap gives you one.

Say 1,000 people using keyboard navigation start checkout each month, and 40% finish against 70% of people using no accessibility settings. Closing the gap is worth about 300 orders a month. At a £42 average order, that’s roughly £12,600 a month: a number a product manager can weigh against anything else on the list.

Regulation adds to it. The European Accessibility Act has applied to many consumer products and services since June 2025, and the ADA and Section 508 apply in the US. Evidence of how disabled people actually get through your product, release after release, is stronger than a single audit PDF. Ask your legal advisers what you need for your situation.

Connect the scan to the impact

Scanners produce long lists, and teams struggle to know which violation matters. Analytics produces gaps, and teams struggle to know which line of code causes them. Put them together and both problems shrink.

Metrickle accepts axe-core results uploaded from CI and attaches each violation to the page and element it was found on. When a friction hotspot and a violation land on the same element, the violation comes with a count of the people it’s stopping.

  • Fix in order of impact, not in the order a scanner lists them.
  • Catch what scans miss: a gap with no violation behind it points to a problem only real use reveals, like a confusing flow.
Hotspot: /invoices/newquillmere.example · last 30 days
The hotspot, who it affects, and the scan finding on the same element
EvidenceDetail
Frictiondiv.due-day dead clicks in 1,140 sessions
WhoPeople using keyboard navigation abandon here 3.4× as often as people using no accessibility settings
ScanSerious: element is clickable but not focusable (WCAG 2.1.1)
Feedback2 reports: “Can’t pick a due date without a mouse”

The scan found the bug. The analytics priced it. Same element, four kinds of evidence, one issue.

Do it without singling anyone out

Never ask about disability

Record the settings a device reports. Don’t add questions, sign-up fields or surveys that ask people to disclose.

Report groups, not people

Use settings for breakdowns and filters, the way you’d use device type. Don’t build audiences or target marketing at them.

Let policy switch it off

If your privacy policy needs it, Metrickle’s web SDK takes a11y: false. Cookieless mode records settings with nothing stored on the device.

Common questions

What is accessibility analytics?

Measuring how well people using accessibility settings, such as keyboard navigation, zoom, large text or a screen reader (in your iOS and Android apps), get through your product compared with people using none. It uses ordinary analytics events with the device’s settings attached.

Can I detect screen reader users on my website?

No, and you shouldn’t try. Browsers deliberately don’t expose it. Sustained keyboard navigation is a useful, honest proxy. Mobile apps can read the VoiceOver and TalkBack setting from the operating system.

How many people do I need before the numbers mean anything?

It depends on the size of the gap, but a few dozen attempts per group is a sensible floor. By default Metrickle won’t give a verdict until 15 different people have tried, and keeps the group visibly unjudged until then. Below a few dozen, only a large gap can be told apart from chance. On low-traffic flows, look at a longer period.

Is accessibility setting data sensitive personal data?

Settings aren’t a record of health or disability, and Metrickle never infers why a setting is on. They can still feel personal, so treat them carefully: report in groups, don’t target individuals, and check your obligations with whoever advises you on privacy law.

Does accessibility analytics replace an audit?

No. An audit tells you what fails a standard. Testing with disabled people tells you why something is hard. Analytics tells you how many people fall behind, where, and whether a fix worked. Use all three.

Which settings should I look at first?

Keyboard navigation and large text. They’re common, and they break the most layouts: unfocusable custom controls, and text that overflows or clips at bigger sizes.

Find out who your product fails, and what it costs

Every event carries the device’s accessibility settings, with nothing to tag. Free to start.

Start free