Evidano is an AI-powered qualitative data analysis platform that speeds transcription, thematic coding, cross-segment comparison, and reporting. Teams that test only general-pop users miss high-value usability signals: a Smashing Magazine summary (June 10, 2026) reports a 30-interview study where cognitive participants identified 1.8× more issues and made 1.8× more suggestions. Read the original study at Smashing Magazine. In this post we translate those findings into a reproducible workflow for qualitative analysis of cognitive accessibility and show how Evidano (www.evidano.com) speeds transcription, thematic coding, cross-segment comparison, and reporting so teams can act on extra insights within days, not weeks.
Key Takeaways
The June 2026 study showed that cognitive participants surfaced 197 issues and 93 suggestions across 30 moderated sessions, about 1.8× the issues and suggestions found by gen-pop participants, indicating high incremental value from even a small number of cognitive sessions.
- Cognitive participants in the study uncovered 197 issues versus 113 from gen-pop participants, and 93 suggestions versus 54, a roughly 1.8× enrichment across both counts.
- The study used 30 moderated online interviews (10 per AI-generated prototype site) with a 5/5 split of cognitive versus gen-pop participants per site, run summer 2024 and summarized June 10, 2026.
- Researchers measured issue counts, suggestion counts, and Accessible Usability Scale (AUS) scores, and emphasized richer qualitative explanations from cognitive participants.
- A 7-step checklist reproduces the study workflow from recruitment to AI-driven follow-ups so teams can move from raw sessions to prioritized fixes faster.
- Evidano supports secure auto-transcription with PII redaction, AI-assisted coding, cross-segment frequency analysis, and automated follow-up interviews to validate fixes.
Fast take: what the study found
The study found cognitive participants surfaced 197 issues and 93 suggestions compared with 113 issues and 54 suggestions from gen-pop participants, about 1.8× more signals across both counts.
- Study run: summer 2024; writeup published June 10, 2026 (Smashing Magazine).
- Design: three AI-generated websites with varied complexity and tasks.
- Measures: issue counts (observed and reported), suggestions, and Accessible Usability Scale (AUS) scores.
Findings snapshot
| Metric | Cognitive | Gen pop | Note |
|---|---|---|---|
| Total participants | 30 (10 per site; 5 cog / 5 gen per site) | Moderated online interviews; AUS survey post-session | |
| Total issues identified | 197 | 113 | Counted once per participant when they raised a concern or missed task element |
| Total suggestions | 93 | 54 | Feature or content improvement suggestions |
| Issue ratio (cognitive / gen) | 1.8× | , | Cognitive participants found 1.8x more issues and made 1.8x more suggestions |
What happened: methods in plain English
Researchers ran 30 moderated sessions on three prototype sites and logged each reported confusion, missed element, and suggestion once per participant to produce the study counts.
- Researchers created three prototype websites (recipes, bookstore, salon) using an AI prototyping tool, recruited via a screener that captured self-reported memory, focus, and learning challenges, then ran 30 moderated sessions.
- Outcome metrics included issue counts, suggestion counts, and AUS (Accessible Usability Scale) scores.
- Qualitative detail was emphasized: cognitive participants gave longer, richer explanations of why elements were confusing.
- Limitations include a small sample, platform differences between cognitive and gen-pop sessions, and different facilitators, with the author consolidating coding for consistency.
Implications for researchers: qualitative analysis of cognitive accessibility
For UX researchers
UX researchers should include even a small number of cognitive participants early, because 2–4 cognitive sessions can surface many high-impact issues that gen-pop tests miss.
Track more than task completion: log cognitive load signals (how drained or focused users felt) and capture verbatim quotes to explain impact to stakeholders.
For product managers
Product managers should prioritize cognitive findings because cognitive issues often map to churn risks like unclear affordances, unpredictable interactions, and ambiguous labels.
Use cognitive findings to prioritize fixes that reduce decision friction and improve predictable behavior across flows.
For accessibility leads
Accessibility leads should treat cognitive inclusion as an on-ramp to broader accessibility testing, because fixes that reduce cognitive load also benefit screen-reader users and aging populations.
Report both quantitative counts and qualitative impact (energy, frustration) to make a stronger business case.
Do more, faster with Evidano (how the platform maps to this use case)
Overview
Evidano automates transcription, AI-assisted coding, cross-segment analysis, and secure handling to accelerate qualitative research workflows.
Use Evidano to move from raw sessions to prioritized fixes more quickly while maintaining human-in-the-loop rigor.
Problem: messy, multilingual transcripts and noisy audio
Evidano provides automated transcription with a custom dictionary and PII redaction so teams can ingest sessions securely and accurately.
Apply a custom dictionary before transcribing to improve accuracy for site-specific terms.
Problem: manual coding is slow and inconsistent
Evidano supports importing a codebook and running AI-assisted coding to apply hierarchical themes and subcodes, then lets researchers review suggested code assignments.
Maintain human-in-the-loop rigor while cutting analysis time.
Problem: comparing segments (cognitive vs gen-pop) is tedious
Evidano cross-segment and frequency analysis instantly surfaces which themes, issues, and suggestions are enriched in the cognitive cohort and exports shareable visualizations.
Available exports include word clouds, co-occurrence networks, and hierarchical code trees to help stakeholders see differences quickly.
Problem: getting follow-up data at scale
Evidano offers AI avatar interviewers that let teams run autonomous, repeatable qualitative probes to validate fixes or collect longitudinal feedback.
Use autonomous probes to scale follow-up research after initial moderated rounds.
Security & compliance
Evidano encrypts data and does not use participant data to train third-party models, addressing sensitive participant concerns common in accessibility research.
Apply consent, PII redaction, and encrypted storage to meet research ethics expectations.
Checklist: 7-step workflow to reproduce this study in Evidano
Follow this 7-step checklist to go from raw sessions to prioritized fixes using the study's approach.
- 1) Recruit with a screener capturing self-identified memory, focus, and learning challenges, and tag cohort metadata.
- 2) Record moderated sessions and upload audio/video to Evidano, applying a custom dictionary before transcribing.
- 3) Auto-transcribe with PII redaction, then export raw transcripts for review.
- 4) Import or create a codebook, run AI-assisted coding across transcripts, and mark issues versus suggestions.
- 5) Run cross-segment frequency and co-occurrence analyses to surface themes enriched in cognitive participants.
- 6) Generate visuals and an executive brief with top issues, exemplar quotes, and AUS distributions to share with PMs and designers.
- 7) Deploy AI avatar follow-ups to validate proposed fixes asynchronously and collect more suggestions.
FAQ: Qualitative analysis of cognitive accessibility
Is this a quantitative claim?
No, the study is exploratory and small-sample, so the 1.8× figure is an observed effect in 30 interviews, useful for prioritization but not a population estimate.
Treat the 1.8× enrichment as an observed signal to guide research prioritization rather than a definitive population statistic.
How many cognitive participants do I need?
Start small: 2–4 cognitive sessions often surface high-impact issues and are a practical initial investment for most teams.
Use Evidano to scale and compare cohorts as you iterate beyond the initial sessions.
How do I protect sensitive participant data?
Protect participant data by ensuring informed consent, redacting PII in transcripts, and using a secure platform that encrypts data.
Evidano provides transcription with PII redaction and encrypted storage to support secure handling during analysis.
Wrapping up: next steps and CTA
Add a couple of cognitive sessions to your next round and run a focused qualitative analysis comparing cohorts to find blind spots cognitive participants reveal.
- If you want to move from raw interview files to prioritized fixes in days, not weeks, Try Evidano for free: upload recordings, auto-transcribe, run thematic and cross-segment analysis, and export shareable visuals and a stakeholder brief.
- Ethics note: this guidance is research-focused and not clinical. Obtain informed consent and treat participant data with confidentiality.