Evidano home
Commentary on News

What AI Qualitative Analysis Reveals About STEM Design Thinking

Evidano8 min read

Teacher educators and STEM researchers often have to compare lesson plans, open-ended questionnaires, and coding frameworks before they can explain how design thinking works in practice. AI qualitative analysis for STEM research can accelerate that synthesis, but useful results still depend on transparent methods, careful interpretation, and traceable evidence. A November 2, 2026, qualitative case study in PLOS One examined how 55 senior pre-service mathematics teachers in Türkiye integrated design thinking into mathematics-focused STEM lesson plans. The study analyzed 24 collaborative lesson plans and individual questionnaire responses collected after a 15-week course. The findings show why qualitative researchers should distinguish between mentioning a design-thinking phase and implementing it meaningfully. The study also demonstrates how frequency analysis, thematic analysis, cross-source comparison, and quotation retrieval can clarify where an educational framework is strong, incomplete, or constrained by practice.

Key Takeaways

According to the PLOS One study, "Pre-service mathematics teachers’ integration of design thinking in STEM lesson plans", pre-service mathematics teachers commonly included the Define, Ideate, and Prototype phases of design thinking, but they used the Empathy and Test phases much less consistently.

The study suggests that AI qualitative analysis can help STEM researchers compare lesson-plan artifacts with participant reflections, identify uneven phase coverage, and connect numerical patterns with the reasons participants give for those patterns.

  • According to the November 2, 2026, PLOS One study, 55 senior pre-service mathematics teachers participated in a qualitative case study at a state university in Türkiye.
  • According to the study, the researchers analyzed 24 collaborative STEM lesson plans and questionnaire responses from all 55 participants after a 15-week course during the 2021 to 2022 academic year.
  • According to the study, Define appeared in 95.8% of lesson plans, Prototype in 91.7%, and Ideate in 83.3%, while Empathy appeared in only 20.8% and Test in 54.2%.
  • According to the study, 43 participants believed mathematics teachers should be able to develop design-thinking lesson plans, while 30 participants identified time consumption as a disadvantage.
  • According to the study, independent coders reached 93.1% agreement when evaluating lesson-plan STEM features and 90% initial agreement when coding a 25% sample of questionnaire responses.

What the Qualitative STEM Education Study Found

The November 2, 2026, PLOS One study found that pre-service mathematics teachers integrated design thinking into STEM lesson plans unevenly rather than applying all five phases as a sustained, iterative cycle.

The study examined five design-thinking phases: Empathy, Define, Ideate, Prototype, and Test. The authors treated design thinking as non-linear, meaning that testing can send learners back to problem definition or prototyping for further refinement.

The study found that lesson plans often emphasized product completion. Define, Ideate, and Prototype formed the dominant procedural core, while Empathy was frequently omitted and Test was often treated as a final check rather than as a source of evidence for revision.

The study’s qualitative analysis combined two data sources: 24 group-produced lesson plans and individually completed open-ended questionnaires. The researchers used an inductive four-stage thematic process consisting of familiarization, initial coding, category development, and theme construction.

Participants described both value and constraint. PMT 25 said, "The most challenging part was aligning the design with other disciplines and finding suitable learning outcomes." PMT 16 added, "I think design is necessary, but it should not take too much time because there is a program that needs to be covered."

The study reported that participants selected topics primarily around real-life problems and student learning. The most frequent topic-selection codes were problems from participants’ own experience, with 34 mentions, and student learning, with 19 mentions.

Findings Snapshot: Design Thinking in Mathematics STEM Lessons

Date or study elementMetricValueImplication for qualitative researchers
November 2, 2026Study participants55 senior pre-service mathematics teachersThe sample supports an in-depth case analysis, but the findings should not be generalized to all mathematics teachers.
2021 to 2022 academic yearCourse duration15 weeks, with weekly 2-hour sessionsThe instructional context provides a defined boundary for interpreting participant experiences.
November 2, 2026Lesson-plan artifacts24 collaborative lesson plansArtifact analysis reveals enacted planning choices, not only participants’ stated beliefs.
November 2, 2026Define phase95.8% of lesson plansProblem framing was nearly universal in the analyzed plans.
November 2, 2026Prototype phase91.7% of lesson plansParticipants frequently translated ideas into products or models.
November 2, 2026Empathy phase20.8% of lesson plansUser-centered inquiry was the least represented design-thinking phase.
November 2, 2026Test phase54.2% of lesson plansMore than half of the plans included testing, but testing was less common than initial construction phases.
November 2, 2026Questionnaire coding reliability90% initial agreement across 14 of 55 participantsIndependent coding and reconciliation strengthened the credibility of the thematic findings.

Implications for STEM Researchers and Teacher Educators

The November 2, 2026, PLOS One study indicates that STEM researchers should analyze both the presence and the quality of design-thinking phases.

A frequency count alone could show that a lesson plan contains a Test phase, but the study’s coding protocol required substantive implementation, such as measurement, quantitative analysis, or evidence-based prototype refinement. AI qualitative analysis should therefore distinguish nominal mentions from operationalized practices.

The study also shows why researchers should triangulate documents and participant accounts. Lesson plans revealed where phases appeared, while questionnaire responses helped explain barriers involving topic selection, discipline alignment, materials, timing, and assessment.

For teacher educators, the study suggests that scaffolding should focus especially on Empathy and Test. Participants understood the value of authentic, student-centered learning, but many plans did not translate that belief into user inquiry or iterative optimization.

  • Use code definitions that separate a phase being named from a phase being enacted.
  • Compare document frequencies with themes from interviews or questionnaires before drawing conclusions.
  • Track negative cases, such as lesson plans that included mathematics but did not use mathematical reasoning to test or improve a design.
  • Preserve quotations alongside codes so that claims about barriers remain connected to participant language.
  • Treat AI-generated themes as an analytical aid that requires researcher review, not as a replacement for methodological judgment.

How Evidano Supports AI Qualitative Analysis for STEM Research

Problem: Researchers need to compare lesson plans and questionnaire responses

Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze interviews, open-ended surveys, academic papers, reports, and other documents.

Researchers can upload lesson plans and questionnaire responses to organize a mixed qualitative dataset, then use thematic, content, frequency, and cross-segment analyses to compare enacted practices with reported experiences. The Evidano features page provides an overview of the platform’s research capabilities.

Problem: Phase frequencies do not explain why implementation is uneven

Evidano can support frequency analysis for recurring codes such as Empathy, Test, curriculum alignment, time, materials, and assessment, while thematic analysis can connect those codes to broader interpretations.

For a study like the November 2, 2026, PLOS One case, researchers could compare lesson-plan phase coverage with questionnaire themes to investigate whether an omitted phase reflects conceptual misunderstanding, resource constraints, or curriculum pressure.

Problem: Researchers need traceable answers during interpretation

Evidano’s AI chat over uploaded documents and analyses can help researchers retrieve relevant excerpts, compare coded groups, and ask focused questions about patterns across the dataset.

Researchers remain responsible for checking quotations, code boundaries, sample context, and competing interpretations before publishing findings. Evidano encrypts data and states that uploaded data is never used to train third-party models, which is relevant when working with participant responses or restricted research materials.

FAQ: AI Qualitative Analysis for STEM Research

What did the 2026 PLOS One study find about design thinking in mathematics STEM lessons?

The November 2, 2026, PLOS One study found that pre-service mathematics teachers integrated Define, Ideate, and Prototype more often than Empathy and Test in their STEM lesson plans.

The study analyzed 55 participants, 24 lesson plans, and open-ended questionnaire responses, finding that Empathy appeared in 20.8% of plans while Test appeared in 54.2%.

Why is qualitative analysis useful for studying design thinking in education?

Qualitative analysis is useful because design thinking involves meanings, planning decisions, participant experiences, and iterative practices that cannot be understood through phase counts alone.

The PLOS One study combined content analysis of lesson plans with inductive thematic analysis of questionnaire responses to connect observable planning patterns with participants’ explanations.

How can AI help analyze STEM lesson plans and open-ended responses?

AI can help researchers organize documents, identify recurring concepts, compare segments, retrieve supporting quotations, and summarize patterns across lesson plans and open-ended responses.

Researchers should validate AI-supported findings against the source material, codebook, sampling design, and study context, especially when interpreting nuanced educational practices.

What was the main challenge reported by participants in the study?

The November 2, 2026, PLOS One study reported that time consumption was the most frequently mentioned disadvantage, with 30 participants identifying it as a concern.

Participants also described difficulties with choosing topics, aligning mathematics with other STEM disciplines, selecting materials, designing assessments, and maintaining curriculum coverage.

Can AI qualitative analysis replace human coding in education research?

AI qualitative analysis should support, not replace, human coding and interpretation in education research.

The PLOS One study used independent researchers, inter-rater checks, expert validation, reconciliation, and an audit trail, practices that remain important when AI tools are added to a qualitative workflow.

Conclusion and Next Steps

The November 2, 2026, PLOS One study shows that design-thinking research in mathematics education benefits from combining frequency analysis, thematic interpretation, document analysis, and participant quotations. The study’s most important analytical distinction is between naming a design-thinking phase and implementing that phase through meaningful mathematical reasoning, user inquiry, testing, and refinement. AI qualitative analysis can make these comparisons faster and more traceable when researchers keep the codebook, source excerpts, and methodological boundaries visible. Researchers analyzing STEM lesson plans, teacher reflections, or open-ended education surveys can try Evidano for free.

Topics

  • AI qualitative analysis for STEM research
  • qualitative analysis of design thinking in STEM education
  • AI thematic analysis of education research
  • design thinking in mathematics education
  • qualitative STEM education research

Keep reading

Browse all articles