The opinions expressed here are the authors’ own and do not necessarily reflect the positions, strategies, or opinions of the organizations they work for.
Evaluators are starting to use large language models not just to analyse interviews but to conduct them. Early pilots, from adaptive survey agents to interview bots used in after-action reviews, show that an AI can hold a fluent conversation. But fluency is not the standard an evaluation interview is judged by. Sound evaluative judgement depends on interview data that are accurate, neutral, aligned with the questions the evaluation set out to ask, and probed far enough to be credible. Until now, evaluators have had no systematic way to check whether an AI interviewer meets that standard.
About Ali Safarnejad

Ali Safarnejad, PhD, is currently a Senior Evaluation Specialist (Data Science) with the Asian Development Bank, based in Manila. At the time of the research on the AI interviewers, he was an Evaluation Specialist at UNICEF. Dr. Safarnejad leads evaluations across humanitarian and development contexts, using technology and advanced analytics in development programme evaluations and emergency response after-action reviews, with a strong interest in improving the efficiency and quality of evaluative evidence through thoughtful use of AI and machine learning.
About Hippolyte Lefebvre

Dr. Hippolyte Lefebvre is an Assistant Professor in Management Information Systems at University College Dublin. His research, which focuses on improving Data and AI management in organizations, is featured in outlets such as the European Journal of Information Systems, Electronic Markets and Harvard Business Review. Hippolyte lectures about Data and AI Management at UCD Michael Smurfit Graduate Business School. Before joining academia, Hippolyte worked as a Monitoring and Data Analyst for the United Nations, supporting 11 countries across Asia and Africa.
About the authors
- Ali Safarnejad (Senior Evaluation Specialist (Data Science), ADB; formerly Multi-Country Evaluation Specialist, UNICEF)
- Hippolyte Lefebvre (School of Business, University College Dublin, Ireland)
Read the article
Read the full research article, “Assessing AI-Mediated Interviewing Quality: A Theory-Grounded Comparison of Models for Evaluation Data Collection,” published in the American Journal of Evaluation in 2026.
Full citation
Safarnejad, A., & Lefebvre, H. (2026). Assessing AI-mediated interviewing quality: A theory-grounded comparison of models for evaluation data collection. American Journal of Evaluation. doi.org/10.1177/10982140261476953
We are grateful to Dr. Safarnejad for sharing this perspective on the study and for this contribution to the responsible, transparent use of AI in evaluation.
Run this analysis on your own data
Evidano codes documents, interviews, survey responses and spreadsheets with AI, with your judgment in control at every step.
Research, accuracy and responsible AI
How Evidano's output has been evaluated, how its models were built, how your data is handled, and how to disclose or cite AI use in your own work.
- Resource
Human vs AI: validated accuracy benchmarks
Four head-to-head comparisons against expert human analysis — 371 interview transcripts with Arizona State and Penn State, 298 evaluation reports, 224 open-ended survey responses with UT Austin and Wichita State, and a 160-response manual-coding review.
- Resource
How Evidano’s models were trained
Model provenance for research-ethics review: a provenance-tiered curated corpus, and customer uploads, prompts and outputs excluded from training entirely.
- Resource
Data security for qualitative research
Encryption in transit and at rest, customer-controlled deletion, regional storage, and SOC 2 Type 2, GDPR, HIPAA-ready and CCPA/CPRA compliance.
- Resource
How to cite and disclose Evidano
Citation formats in APA, MLA, Chicago, Harvard and Vancouver, methods-section wording per workflow, and an AI-policy review of 41 journals across 8 disciplines.
- Resource
Environmental impact of an analysis workflow
Measured energy and water footprint of a typical project, with regional comparisons and mitigation.
