A 719-student psychometrics study used Evidano to analyze open-ended feedback

The researchers developed a five-point instrument to measure “science delay of gratification”: students’ willingness to postpone immediate rewards and distractions in order to pursue longer-term science-learning goals.

The final sample included 719 ninth- and tenth-grade students from six Indian states, selected through a stratified sampling design. The quantitative study began with 35 candidate items and produced a 21-item scale after genetic-algorithm and Nash-equilibrium optimization. Network psychometrics was used to examine structure, fit, stability, and measurement invariance across gender and grade.

At the end of the questionnaire, students could provide open-ended feedback. The authors analyzed that text to understand how students experienced the exercise and what it revealed about their study behavior. The article appears in the International Journal of Basic and Applied Sciences.

The qualitative feedback contained 3,828 words and 721 unique words after inconsequential responses were removed. The researchers first used Voyant Tools to produce a word cloud and keyword frequencies. They then used Evidano for thematic analysis of the same feedback.

Evidano identified three major themes: first, the exercise’s effect on self-awareness and motivation; second, feedback on survey design and content; and third, the role of distraction and time management in study practices.

The article presents the themes with subthemes, giving the qualitative strand a clear structure alongside the much larger psychometric analysis.

Students described the exercise as a prompt for reflection. The first theme included recognition of personal study habits, awareness of distractions, greater determination to focus, and renewed attention to the importance of science and academic work.

The second theme captured feedback on the instrument itself. Students found some questions repetitive, wanted the approach extended beyond science, connected the items to daily life, and noted pressure or stress associated with study workload.

The third theme focused on modern distractions and time management. Students mentioned social media, mobile phones, gaming, the need to prioritize study tasks, and the importance of balancing focused work with breaks and self-care.

Together, these themes added practical meaning to the scale-development exercise. They showed not only whether the instrument performed statistically, but also what it made students think about while completing it.

This is a strong mixed-evidence example. Evidano was not used to validate the psychometric scale or generate the quantitative conclusions. It was used for the task it was suited to: structuring the open-ended feedback that accompanied a large survey.

For education and behavioral-science researchers, the case shows how a short qualitative field can make scale validation more informative. Respondents can reveal confusing wording, repetitive items, missing content, and unexpected reflective effects that conventional reliability and model-fit measures do not capture.

The paper notes that the auto-generated psychological items were not vetted by subject-matter experts, leaving content-validity assessment for future research. The scale was developed specifically for secondary-school science, and cross-cultural validation remains necessary.

The qualitative feedback was an optional component of a structured survey. It should not be interpreted as equivalent to in-depth interviews or as a representative account of every student’s experience.