Primary keyword: qualitative analysis sports officiating. Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze interviews, open-ended surveys, and documents. This post reframes the PLOS ONE evaluation of the Northern Territory Institute of Sport High Performance Officiating Program (HPOP, cohort 2021) through the lens of AI-enabled qualitative research, showing which mixed-method signals matter, what the PLOS ONE team measured, and how AI tools accelerate thematic synthesis and replication for sport psychologists and program designers.
Key Takeaways
Three of five officials in the NTIS High Performance Officiating Program (HPOP) showed reliable improvements in self-efficacy and resilience, according to the PLOS ONE study published 5 August 2026 (PLOS ONE).
- Sample and timing: the 2021 HPOP intake produced analyzable data on five officials, with measurements at four timepoints in February, May, August, and November 2021, as reported in PLOS ONE on 5 August 2026.
- Quantitative outcomes: the PLOS ONE authors reported that three of the five officials demonstrated reliable improvements in both resilience and self-efficacy using Reliable Change Indices (RCI), and one official showed a 37.5% improvement in resilience (RCI = 3.99) from baseline to program completion.
- Qualitative confirmation: PLOS ONE thematic analysis found two higher-order themes, ‘officiating self-efficacy’ and ‘officiating opportunities’, supported by participant quotes such as Alex’s statement, “I feel more confident in my abilities. I have been given opportunities to ref high level games with high level referees. Benchmarking against other referees has been good for me.”
- Program design note: the HPOP combined workshops, mentorship, and individual sessions across a 12-month schedule (Feb–Nov 2021) and intentionally targeted resilience, self-regulation, and self-efficacy, according to the PLOS ONE report.
What happened and how the study measured it
What happened: the PLOS ONE study by Grylls et al. (published 5 August 2026) evaluated psychosocial change in five officials who completed the NTIS High Performance Officiating Program (HPOP) during 2021.
How it was measured: Grylls et al. used a longitudinal repeated-measures design with four timepoints (February, May, August, November 2021) and combined validated psychometrics (CD-RISC10 for resilience, REFS for referee self-efficacy, CAS for challenge/threat appraisal, Rotter’s locus of control, and the Functional Assertiveness Scale) with open-ended qualitative questions and mentor ratings.
Constraints and approach: Grylls et al. adopted an idiographic analysis to report each participant’s trajectory (n = 5 after one dropout), and they applied Reliable Change Indices (RCI) to determine which changes exceeded measurement error, a method suited to small applied cohorts.
Findings snapshot
| Date / Period | Metric | Value reported | Implication |
|---|---|---|---|
| 5 August 2026 (publication) | Cohort analysed | 5 officials (data from 6 applicants, 1 dropout) | Small idiographic sample, use RCIs for individual-level inference |
| Feb–Nov 2021 (program) | Measurement points | 4 timepoints: Feb, May, Aug, Nov 2021 | Enables within-participant longitudinal change detection |
| Baseline → Time 4 | Officials with reliable self-efficacy + resilience gains | 3 of 5 officials | Majority show psychosocial benefit, but effects are individualized |
| Baseline → Time 4 (example) | Jamie resilience change | 37.5% increase, RCI = 3.99 | Substantial individual improvement beyond measurement error |
| Baseline → Time 4 (example) | Alex mentor-rated self-efficacy | 67.57% increase, RCI = 7.20 | Large mentor-perceived gains in competence and opportunity |
Implications for sport researchers and program designers
How should researchers interpret the PLOS ONE results: the PLOS ONE authors recommend treating each official as an individual case and combining quantitative RCIs with qualitative social validation to understand mechanisms of change.
Design implications for programs: Grylls et al. (PLOS ONE, 5 August 2026) show that multimodal programs that pair mentoring, workshops, and mastery opportunities are associated with increases in game knowledge, communication, and pragmatic politeness, but changes in threat appraisal and objective effectiveness may require targeted interventions.
Evaluation implications: the PLOS ONE study demonstrates that small-cohort interventions benefit from idiographic reporting, multiple timepoints, mentor corroboration, and triangulation with open-text data to capture adaptive responses and social support.
How Evidano helps in AI-enabled qualitative research
Problem: small-sample, mixed-methods programs are hard to synthesize
Answer: small cohorts produce rich individual trajectories but create synthesis burdens for teams, because manual coding, RCI computation, and cross-case theme mapping are time consuming.
Solution: Evidano automates thematic extraction and aligns qualitative themes with quantitative time-series. Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze interviews, open-ended surveys, and documents.
Feature mapping: use Evidano features to ingest transcripts and mentor notes, compute code frequencies, and produce hierarchical themes that mirror the PLOS ONE six-stage thematic workflow.
Problem: inconsistent coder perspective and mentor–participant rating mismatches
Answer: inconsistent rater views complicate claims about change, as Grylls et al. found divergent mentor vs participant ratings early in the HPOP year.
Solution: Evidano supports cross-segment analyses to compare mentor text, participant text, and numeric ratings side by side, revealing systematic biases and temporal convergence patterns.
Feature mapping: combine Evidano’s cross-segment analysis with time-series filters to replicate RCIs and link qualitative quotes to quantitative inflection points.
Problem: reproducible audit trail and secure data handling
Answer: program evaluations require traceable methods and secure storage for participant data.
Solution: Evidano offers encrypted storage and an auditable analysis pipeline for mixed-methods projects, and integrates transcript cleanup and PII redaction so teams can comply with ethics requirements.
Contextual links: learn about Evidano’s data practices on our data security page.
FAQ: qualitative analysis sports officiating
How did the PLOS ONE team measure change in a five-person cohort?
+
Direct answer: Grylls et al. used repeated measures across four timepoints and Reliable Change Indices to detect individual-level change.
Support: the PLOS ONE study (published 5 August 2026) collected data at baseline, two midpoints, and program completion (Feb, May, Aug, Nov 2021) and reported RCIs where values outside ±1.96 indicated significant change.
What qualitative method did the PLOS ONE authors use to validate quantitative trends?
+
Direct answer: the PLOS ONE authors conducted an inductive thematic analysis using a six-stage Nowell et al. procedure.
Support: Grylls et al. described independent coding, theme generation, team review, and visual theme mapping to corroborate quantitative RCIs and provide social validation, with exemplar quotes such as Jade’s: “My resilience has grown beyond where I started. And I thought I would ever get to. I can deal with confrontation better and bounce back from any setbacks much quicker.”
Can AI tools reproduce the idiographic approach used in HPOP evaluation?
+
Direct answer: yes, AI-enabled qualitative platforms can reproduce idiographic analyses by linking individual transcripts to time-stamped quantitative scores.
Support: tools like Evidano can import timepoint-coded survey data and transcripts, compute per-participant code frequencies, and export per-case RCIs and theme timelines to match the PLOS ONE idiographic reporting style.
What are the main limitations to generalizing the PLOS ONE findings?
+
Direct answer: the primary limitations are small sample size and program multimodality, which limit causal attribution and external generalizability.
Support: Grylls et al. (PLOS ONE, 5 August 2026) explicitly note n = 5, gender imbalance concerns, and difficulty attributing outcomes to specific HPOP components because the program combined mentorship, workshops, and individual sessions.
Conclusion & Next Steps
The PLOS ONE evaluation (published 5 August 2026) of the NTIS HPOP demonstrates that structured, multimodal development programs can produce reliable improvements in self-efficacy and resilience for a majority of participants in small cohorts, while also requiring idiographic methods and qualitative triangulation to explain individual differences.
For researchers and program designers, the practical takeaway from PLOS ONE is to combine RCIs, repeated measures, mentor corroboration, and thematic analysis to produce defensible, actionable findings.
If you run small-cohort program evaluations and want to speed coding, link quotes to time-series scores, and produce an auditable mixed-methods report, try Evidano’s platform and workflows.
Start a free trial and reproduce the PLOS ONE mixed-methods workflow in your own program evaluation: Try Evidano for free.
Topics
- qualitative analysis sports officiating
- AI qualitative research
- HPOP evaluation
- thematic analysis sports officials
- Evidano
Keep reading
- Commentary on NewsAI Tools Improve Qualitative Analysis of Sports OfficiatingAI tools for qualitative analysis speed synthesis of program evaluations like the NTIS HPOP (PLOS One, Aug 5, 2026). Read results, quotes, and Evidano use cases.
- Commentary on NewsChildhood Cancer Qualitative Study: Key Caregiving ThemesLearn what a 2026 childhood cancer qualitative study found about caregiving in Palestine, and see how AI qualitative analysis turns interviews into evidence.
- Commentary on NewsAI Qualitative Research: Lessons From BEP CareSee how AI qualitative research can turn BEP implementation interviews into actionable insights for maternal health programs. Explore the evidence.