Evidano home
Peer-reviewed article · Public Personnel Management · 2026Sage Publishing logo
Peer-reviewed article

ENAP and UBC used AI-assisted qualitative coding on 39,788 federal survey comments

A 2026 article in Public Personnel Management (Sage) by researchers at the École nationale d’administration publique and the University of British Columbia used Evidano to code 39,788 open-ended survey comments, with human review and validation throughout.

The study used Evidano, then published as AILYZE.

39,788
open-ended comments coded
16,526
unique respondents
3
national survey waves, April 2024 to March 2025
15%
random sample manually verified by the team

What the study analyzed

Federal workforce responses to the 2025 return-to-office mandate, drawn from three Federal News Network pulse surveys of 16,526 unique respondents. As the authors note, manual coding alone of a corpus this large would have been impractical, so computational support was required to analyze the data systematically while maintaining interpretive rigor.

The open-access article traces how frustration and anger rose from 11% of comments in the first wave to a third of comments after the mandate, alongside growing concerns about performance and autonomy. The authors are Geneviève Morin, Carey Doberstein, and Étienne Charbonneau, Canada Research Chair in Comparative Public Management.

How Evidano fit the workflow

A documented, human-in-the-loop workflow

  1. 1
    Import

    All 39,788 comments were imported into Evidano for AI-assisted coding.

  2. 2
    Code against your codebook

    The tool coded comments against the researchers’ predefined thematic grid of three domains, subdomains, and subthemes, clustering passages by meaning. It produced a coding matrix with exemplar excerpts and text-level justifications for each decision.

  3. 3
    Human validation

    The team reviewed classifications and manually verified a random 15% sample. No major misclassifications remained after refinement, and no themes outside the framework emerged.

  4. 4
    Interpret

    Researchers interpreted the validated themes within their conceptual framework. The tool organized material; the analysis stayed with the team.

“Rather than relying on keyword matching, AILYZE identifies conceptual patterns based on contextual meaning, clustering related passages even when they do not share identical vocabulary.”
— From the published study, Public Personnel Management (2026). AILYZE is now Evidano.
“This design ensured that AI augmented rather than replaced expert qualitative judgment, limiting automation bias while preserving analytical rigor.”
— From the published study, Public Personnel Management (2026)
“The AI tool did not generate interpretations or theoretical claims; its function was restricted to organizing thematic material, which was subsequently interpreted through the conceptual framework and validated by the research team.”
— From the published study, Data and Analysis
“For scholars, the study demonstrates the value of AI-assisted qualitative analysis for examining large-scale administrative phenomena while retaining interpretive depth.”
— From the published study, Conclusion

From bottleneck to scalable analysis

Manual only

Coding tens of thousands of comments by hand is impractical. Coder drift and fatigue build up at scale. Reproducing the exact process is difficult.

With Evidano

Codes the full corpus against your codebook. Deterministic outputs reduce drift and fatigue. Researchers review, validate, and stay in control.

Augments, not replaces

Researchers reviewed and refined every classification.

Transparent and auditable

Text-level justifications enabled auditing and contestation.

Reproducible

Deterministic, version-locked inference yields identical outputs.

Open access

Published under a CC BY licence, so the full protocol and validation log are there for anyone to check.

About Evidano (previously AILYZE)

Evidano is AI-assisted qualitative data analysis software for interviews, focus groups, open-ended survey responses, and documents. It supports AI-assisted thematic analysis with your own or an AI-suggested codebook, transcription and translation in 100+ languages, clickable quotes and citations, and exportable visual reports. End-to-end encryption, no third-party data sharing, and your data is not used to train AI. From USD 50/month for unlimited analysis.

Run the first pass in days, not weeks

Keep the judgment with you. Let Evidano do the heavy lifting on your interviews, focus groups, open-ended responses, and documents.