Evidano home
Commentary on News

What AI Reveals in STEM Lesson Plan Analysis

Evidano9 min read

Qualitative analysis of STEM lesson plans can show whether design thinking is genuinely integrated or simply listed as a sequence of activities. That distinction matters to mathematics education researchers, teacher educators, and curriculum teams assessing interdisciplinary learning. A November 2, 2026 PLoS One study examined 24 lesson plans created by 55 senior pre-service mathematics teachers in Türkiye and found that Define, Ideate, and Prototype appeared far more often than Empathy and Test. The findings demonstrate both the value and the difficulty of analyzing mixed qualitative evidence, including lesson plans, open-ended questionnaires, quotations, and coded frequencies. This article refracts the study through AI-enabled qualitative research: how researchers can organize documents, compare themes across data sources, identify underrepresented design thinking phases, and preserve an auditable path from participant language to conclusions. The goal is not to replace methodological judgment, but to make large or mixed qualitative datasets easier to inspect and explain.

Key Takeaways

According to the Pre-service mathematics teachers’ integration of design thinking in STEM lesson plans study published in PLoS One on November 2, 2026, pre-service mathematics teachers included some design thinking phases strongly but integrated the full process unevenly. AI qualitative analysis can help education researchers compare lesson-plan content with questionnaire themes, surface missing phases, and connect frequency patterns to participants’ explanations.

  • The PLoS One study analyzed 24 collaboratively developed lesson plans and questionnaire responses from 55 senior pre-service mathematics teachers during a 15-week course in the 2021 to 2022 academic year.
  • The study reported that Define appeared in 95.8% of lesson plans, Prototype in 91.7%, and Ideate in 83.3%, while Empathy appeared in only 20.8% and Test in 54.2%.
  • The PLoS One researchers found that only 3 of 24 lesson plans included all five design thinking phases, while 1 lesson plan included no design thinking phase.
  • The study reported 90% initial inter-rater agreement for a randomly selected 25% sample of questionnaire coding and 93.1% initial agreement for independent lesson-plan evaluation.
  • The study’s participants described alignment with other disciplines, learning objectives, materials, assessment, time, and curriculum coverage as major planning challenges.

What the STEM Lesson Plan Study Found

The PLoS One study found that pre-service mathematics teachers treated design thinking as valuable but often implemented it as a partial, product-oriented process. The study used a qualitative case study design involving 55 senior participants at a state university in Türkiye, 24 group lesson plans, and individually completed open-ended questionnaires.

The PLoS One researchers analyzed lesson plans with a STEM integration rubric and coded the presence and quality of five design thinking phases: Empathy, Define, Ideate, Prototype, and Test. The researchers also used an inductive four-stage thematic process for questionnaire data: familiarization, initial coding, category development, and theme construction.

The results suggest that the most common lesson-plan structure moved from defining a problem to generating an idea and building a prototype. The PLoS One study interpreted the low representation of Empathy as evidence that user-centered inquiry was frequently bypassed, while the lower representation of Test suggested that prototypes were often treated as final products rather than solutions to evaluate and improve.

The participants’ own words explain the implementation gap. PMT 25 said, "The most challenging part was aligning the design with other disciplines and finding suitable learning outcomes." PMT 16 added, "I think design is necessary, but it should not take too much time because there is a program that needs to be covered." The PLoS One study attributed these comments to challenges involving interdisciplinary alignment and curriculum time.

The study also recorded positive expectations. PMT 22 said, "We expect students to think creatively, be curious, use imagination, and enhance communication and cooperation skills." The PLoS One researchers connected these responses to participants’ belief that design thinking could support engagement, creativity, mathematical modeling, and real-world learning.

Findings Snapshot for AI Qualitative Analysis

Date or study measureMetricValueImplication for qualitative researchers
November 2, 2026Study publicationPLoS One, volume 21, issue 11, article e0361875The source provides a peer-reviewed case for examining design thinking through mixed qualitative data.
2021 to 2022 academic yearCourse context15 weeks, with weekly 2-hour sessionsLongitudinal course materials can be compared with participant reflections.
Study sampleSenior pre-service mathematics teachers55 participants, 33 female and 22 maleIndividual questionnaire responses provide variation within a shared instructional context.
Lesson-plan datasetCollaborative lesson plans24 plansDocument analysis can measure whether named design thinking phases are substantively implemented.
Lesson-plan codingDefine phase95.8% of plansProblem definition was nearly universal in the analyzed plans.
Lesson-plan codingPrototype phase91.7% of plansBuilding solutions was common, but presence alone does not demonstrate iteration.
Lesson-plan codingEmpathy phase20.8% of plansUser-centered inquiry was the least represented phase.
Lesson-plan codingTest phase54.2% of plansEvaluation and refinement appeared in more than half, but less often than construction phases.
Reliability assessmentQuestionnaire inter-rater agreement90% before discussionIndependent coding and reconciliation can strengthen confidence in emergent themes.
Reliability assessmentLesson-plan inter-rater agreement93.1% before discussionA second evaluator can help identify coding disagreements in document analysis.

Implications for Education Researchers and Teacher Educators

Education researchers should analyze design thinking integration as both a structural and substantive phenomenon. The PLoS One study distinguished between a phase being mentioned and a phase being meaningfully implemented through mathematical reasoning, quantitative analysis, or evidence-based justification.

Teacher educators should examine relationships between document evidence and participant explanations. The PLoS One study found that participants selected topics based on real-life problems and student learning, with the codes "problems from own experience" appearing 34 times and "student learning" appearing 19 times. Those motivations did not always translate into explicit user research or iterative testing in the lesson plans.

Qualitative researchers should preserve both frequency and context. A frequency such as 20.8% for Empathy identifies an uneven pattern, but participant quotations about materials, curriculum time, and assessment help explain why the pattern occurred.

AI-enabled qualitative research is useful when the dataset contains multiple formats and analytical levels. A researcher can use AI to locate references to Empathy, Test, assessment, materials, or mathematical modeling across lesson plans and questionnaires, then manually inspect the excerpts that support each theme.

AI analysis should remain subordinate to the study design and codebook. The PLoS One researchers used two researchers, explicit coding procedures, inter-rater checks, reconciliation, and triangulation, so an AI workflow should add traceability rather than remove human review.

How Evidano Helps With Qualitative Analysis of STEM Lesson Plans

Problem: Researchers must compare lesson plans with open-ended questionnaire responses

Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze lesson plans, open-ended questionnaires, research papers, and other documents.

Researchers can upload lesson-plan documents and questionnaire data, then use thematic, content, frequency, and cross-segment analyses to compare enacted design thinking practices with participants’ reported experiences. Explore Evidano’s research features.

Problem: Important design thinking phases may be unevenly represented

Evidano can help researchers organize codes such as Empathy, Define, Ideate, Prototype, and Test, then inspect how those codes co-occur with mathematics, assessment, curriculum, materials, or student engagement.

A researcher can use frequency analysis to identify underrepresented themes and hierarchical codes to separate broad phases from subcodes such as user needs, feedback, measurement, and iterative refinement.

Problem: Frequencies do not explain participant reasoning

Evidano’s AI chat over uploaded documents and analyses can help researchers ask targeted questions such as which participants discussed curriculum time, which lesson plans included measurable testing, and how claims about engagement were supported.

Researchers should verify AI-generated summaries against the original excerpts and retain quotations, code definitions, and analytic decisions in the project record.

Problem: Mixed qualitative datasets are difficult to synthesize transparently

Evidano supports document and spreadsheet ingestion, which allows researchers to analyze lesson plans alongside structured participant metadata or survey-style open-ended responses.

Evidano states that research data is encrypted and never used to train third-party models. Researchers handling education data should still apply informed-consent requirements, remove unnecessary identifiers, and follow their institution’s ethics protocol.

FAQ: AI Qualitative Analysis of STEM Lesson Plans

What did the 2026 study find about design thinking in mathematics-focused STEM lesson plans?

The 2026 PLoS One study found that design thinking was integrated unevenly across 24 lesson plans created by 55 pre-service mathematics teachers.

Define, Ideate, and Prototype appeared in more than 80% of plans, while Empathy appeared in 20.8% and Test in 54.2%.

Why is qualitative analysis useful for evaluating design thinking in education?

Qualitative analysis is useful because design thinking quality depends on how phases are enacted, not merely whether phase labels appear in a lesson plan.

The PLoS One study combined document coding with open-ended questionnaire analysis to connect observable planning practices with participants’ explanations of alignment, timing, materials, and assessment.

Can AI identify missing or weak design thinking phases?

AI can help identify references to design thinking phases and flag documents where phases are absent, brief, or disconnected from related evidence.

Human researchers must decide whether a phase is substantively implemented, because the PLoS One study distinguished meaningful mathematical integration from superficial or nominal mention.

How can researchers maintain rigor when using AI for qualitative analysis?

Researchers can maintain rigor by using a documented codebook, reviewing source excerpts, checking AI outputs against the data, and recording human decisions.

The PLoS One study reported 90% initial agreement for questionnaire coding and 93.1% initial agreement for lesson-plan evaluation before discussion, providing a useful model for independent review and reconciliation.

What were the main challenges reported by the pre-service mathematics teachers?

The main challenges were selecting suitable topics, aligning mathematics with other STEM disciplines, managing materials and time, defining learning outcomes, and assessing student designs.

The PLoS One study reported that time consumption was mentioned 30 times as a disadvantage, while materials and suitable environments were mentioned 10 times.

What should researchers avoid when using AI to analyze education data?

Researchers should avoid treating AI-generated themes as final findings without checking the original data, code definitions, contradictory cases, and study context.

AI can accelerate retrieval and comparison, but methodological interpretation, ethical judgment, and final claims remain responsibilities of the research team.

Conclusion and Next Steps for Qualitative STEM Research

The November 2, 2026 PLoS One study shows why qualitative analysis of STEM lesson plans must examine both design thinking phase frequency and the depth of mathematical integration. The study’s 24 lesson plans and 55 participant responses reveal a clear pattern: defining, ideating, and prototyping were common, while empathy, testing, and sustained iteration were less consistently represented.

AI-enabled qualitative research can make this type of mixed-data analysis more efficient by connecting documents, codes, frequencies, quotations, and cross-segment comparisons. Researchers should use AI as a traceable research assistant, retain source evidence, and apply human review to interpretation and reporting.

Evidano helps research teams analyze qualitative documents and open-ended responses in one workspace. Try Evidano for free to organize your next education research project.

Topics

  • qualitative analysis of STEM lesson plans
  • AI qualitative analysis education research
  • AI thematic analysis education
  • design thinking in mathematics education
  • qualitative research software for educators

Keep reading

Browse all articles