Evidano home
Peer-reviewed article · Monash University · 2024Studies in Educational Evaluation journal logo
Peer-reviewed article

Monash University study trialled AI thematic analysis to cross-check its themes

Researchers at Monash University trialled Evidano in a 2024 study published open access in Studies in Educational Evaluation (Elsevier). Human researchers led the interpretation throughout.

The study used Evidano, then published as AILYZE.

23
doctoral writers’ responses analysed, from 29 recruited
5
themes constructed
2
data sources: student survey plus editors’ reflections
2024
open-access, Elsevier journal

What the study examined

A study of doctoral writing groups and collaborative peer feedback, set within a constructivist design. The qualitative data came from open-ended survey responses from PhD students at a research-intensive Australian university, interwoven with the two editors’ reflections. The analysis used Braun and Clarke’s reflexive thematic analysis, and the study was approved by the Monash University Human Research Ethics Committee.

Where Evidano fit in

The authors trialled Evidano to view the key ideas in the editors’ reflections from a different perspective. Researchers constructed the themes themselves; the AI analysis served as a complementary check that supported the study’s trustworthiness, alongside reflexivity, co-researcher agreement, triangulation, and thick description.

How Evidano fit the workflow

  1. 1
    Editors’ written reflections

    Qualitative text gathered through reflective prompts.

  2. 2
    AI thematic analysis with Evidano

    Surfaced key ideas from a different perspective.

  3. 3
    Compared with researcher-constructed themes

    Human coding and interpretation stayed central.

  4. 4
    Strengthened trustworthiness

    The AI highlighted ideas similar to the constructed themes.

“We also trialled the use of the new AI thematic analysis software Ailyze (https://www.ailyze.com/) to see a different perspective on the key ideas mentioned in the editors' reflections.”
— From the publication, Data analysis section (Ailyze is now Evidano)
“Our AI analysis further helped to demonstrate the trustworthiness of our coding strategy, as it highlighted key ideas similar to those of the themes we had constructed.”
— From the publication, data analysis section
Transparent disclosure

AI use was named and disclosed in the data analysis section, with a link to the tool.

Human comparability

The AI highlighted key ideas similar to the themes the researchers had constructed.

Researcher oversight

Humans led coding and interpretation. Evidano supported the work, it did not replace judgment.

Part of trustworthiness

Evidano sat alongside reflexivity, triangulation, and co-researcher agreement.

About Evidano (previously AILYZE)

Evidano is AI-assisted qualitative data analysis software for interviews, focus groups, open-ended survey responses, and documents. It supports AI-assisted thematic analysis with your own or an AI-suggested codebook, transcription and translation in 100+ languages, clickable quotes and citations, and exportable visual reports. End-to-end encryption, no third-party data sharing, and your data is not used to train AI. From USD 50/month for unlimited analysis.

Run the first pass in days, not weeks

Keep the judgment with you. Let Evidano do the heavy lifting on your interviews, focus groups, open-ended responses, and documents.