Site Logo
All articles
Commentary on News

Qualitative analysis of training interventions

Evidano6 min read

Fast payoff for implementers and qualitative teams: a June 29, 2026 PLOS Medicine study from the University of Gondar reports that a multilevel onsite training plus a 6-month mentorship (Jan–Sep 2024) raised provider knowledge (median to ~90.9) and reduced diagnostic delay by 54.2% in Northwest Ethiopia. Read the original study at PLOS Medicine. If you want to turn mixed-methods reports, transcripts, and chart extracts like these into reproducible themes and segment comparisons in hours rather than weeks, Evidano automates transcription, bilingual ingestion, thematic and cross-segment analysis, and visualizations while keeping data encrypted and off third-party model training. Ethics note: this article and our guidance are research-focused, non-diagnostic, and meant for program evaluation and implementation learning.

Key Takeaways

Evidano is an AI-powered qualitative data analysis platform that automates transcription, bilingual ingestion, AI-assisted coding, and cross-segment synthesis for implementation research.

A Jan–Sep 2024 multilevel onsite training plus a 6-month mentorship in Northwest Ethiopia raised provider knowledge to a median of about 90.9 and reduced the diagnostic interval by 54.2% (56.5 → 25.8 days).

  • The intervention reached 1, 020 HEWs, 29 primary-level and 18 level-1 clinicians through onsite and cascade trainings (Jan–Sep 2024).
  • Provider knowledge scores rose to a median ~90.9 after training, measured by KAP surveys with 100% response.
  • The diagnostic interval fell 54.2% (from 56.5 to 25.8 days) based on a chart review of n=100 patients.
  • A 2-week Evidano pilot can ingest transcripts, import a CFIR codebook, run AI-assisted coding, and produce stakeholder-ready memos with visuals.

Findings snapshot

Date / ItemMetricValue / ChangeSource / Note
PublishedDateJune 29, 2026PLOS Medicine
Intervention reach (Jan–Sep 2024)Participants trained1, 020 HEWs; 29 primary-level; 18 level‑1 cliniciansOnsite + cascade trainings
Provider knowledge (median)Primary & SecondaryRose to 90.9 (post)KAP surveys, 100% response
Diagnostic intervalFirst contact → confirmed diagnosisDecreased by 54.2% (56.5 → 25.8 days)Chart review of n=100 patients
Patient delaySymptom onset → first contactDecreased by 9.3% (27.0 → 24.5 days)Wilcoxon tests
BudgetTotal intervention costUSD 52, 762Project accounting (reported)

What happened (brief methods)

The evaluation used a quasi-experimental pre–post mixed-methods design from January–September 2024 across primary, secondary and tertiary tiers. The intervention combined immersive onsite workshops (10 days for level-1 clinicians, 7 days for primary providers, 5 days pictorial modules for HEWs) with a 6-month mentorship program (monthly onsite and remote supervision).

  • Quantitative methods: KAP surveys normalized 0–100, chart review of 100 pediatric oncology records, pre/post comparison.
  • Qualitative methods: 18 in-depth interviews (IDIs) with Level I, 29 Level II interviews, multiple HEW focus group discussions; analysis framed by CFIR.
  • Limitations: no contemporaneous control group; conflict and seasonal factors required adaptive delivery such as cascade mini-trainings.

Qualitative analysis of training interventions: what the interviews reveal

Key qualitative themes

Interviews identified supportive leadership and existing digital tools (DHIS-2, EMR) as enablers that smoothed adoption and feedback loops.

Supportive leadership and digital tools smoothed adoption and feedback loops.

Diagnostic supply shortages and frequent staff rotations undermined consistent application of new skills.

Cultural beliefs and reliance on traditional healers continued to produce initial patient delays despite improved HEW referrals.

Why the qualitative component matters

The qualitative component explains how and why observed quantitative gains occurred by revealing mechanisms such as mentorship, case conferences, and cascade trainings.

Quantitative gains (knowledge scores, interval shortenings) show effect size, while qualitative data explain mechanisms and where friction remained.

CFIR-guided interviews pinpoint actionable barriers (reagents, transport, motivation) that should appear in any implementation report.

So what for qualitative researchers and implementers

For implementation researchers

Implementation researchers should triangulate KAP and patient-journey metrics with CFIR themes to separate what changed from why it changed.

The study's 54% diagnostic interval reduction is best interpreted alongside mentorship fidelity and supply constraints.

Documenting adaptations (for example, cascade mini-trainings during unrest) belongs in the intervention file as core qualitative replication data.

For program managers / funders

Program managers and funders should use quantified improvements (scores, referrals) together with qualitative notes on workload trade-offs to guide staffing and budgeting.

In this project, referrals from HEWs tripled and 1.96% of HEWs reported time conflicts, findings that guide staffing decisions.

Managers should track proximal outcomes (knowledge, referrals) and distal outcomes (treatment initiation, infrastructure gaps) when scaling.

For qualitative teams

Qualitative teams should use hierarchical codebooks (CFIR domains to subthemes) and link codes to timestamps and facilities for rapid cross-site comparative memos.

Capturing implementation determinants (leadership, supply chain, community beliefs) allows teams to recommend targeted solutions rather than generic training.

Do more, faster with Evidano

Problem: scattered transcripts, forms, and charts

Evidano speeds synthesis by ingesting interview audio, scanned referral forms, and chart extracts, then transcribing and translating with a custom dictionary for local terms.

Problem: slow, inconsistent coding

Evidano lets teams import a CFIR codebook, run AI-assisted coding, review suggested codes, and lock a final codebook for reproducible applied coding across facilities.

Problem: comparing segments (HEW vs facility vs region)

Evidano produces cross-segment thematic frequency tables and co-occurrence networks so teams can show which barriers cluster with diagnostic delay in conflict-affected zones.

Problem: sharing findings with stakeholders

Evidano exports clickable quotes, visual dashboards (word clouds, hierarchies), and slide-ready summaries linked back to source transcripts, avoiding the need to re-contact participants.

Security & compliance

Evidano encrypts data end-to-end and does not use client data to train third-party models, making it suitable for ethically sensitive implementation research.

Checklist: reproduce a CFIR-driven synthesis in Evidano (2 weeks pilot)

A 2-week pilot can ingest source documents, run AI-assisted coding, and deliver stakeholder-ready evidence tables and visuals.

  • Step 1: Gather inputs: workshop slide decks, KAP spreadsheets, audio of IDIs/FGDs, n=100 chart extracts, and referral registers.
  • Step 2: Ingest uploads to Evidano; enable a custom dictionary for local terms (for example, local words for lymphadenopathy).
  • Step 3: Auto-transcribe and translate; review low-confidence segments flagged by Evidano; redact PII automatically.
  • Step 4: Import a CFIR codebook or create one in Evidano; run AI-assisted coding and validate on a 10% sample.
  • Step 5: Generate thematic frequency, co-occurrence network, and cross-segment comparisons (HEW vs facility vs region).
  • Step 6: Produce a stakeholder memo with evidence tables, top quotes, and visual exports for program managers.
  • Step 7: Iterate and use Evidano chat over your corpus to answer ad-hoc questions, for example, “Which facilities reported reagent shortages in July 2024? ”

FAQ: qualitative analysis of training interventions

How do I compare pre/post themes reliably?

Use the same codebook across timepoints and lock code definitions, and report both frequency changes and exemplar quotes to show depth and direction of change.

Can AI help with local language terms and translation?

Yes, Evidano supports custom dictionaries so local terms, including local names for symptoms, remain consistent during transcription and translation.

Is the platform secure for sensitive health data?

Yes, Evidano encrypts uploads end-to-end and explicitly does not use client data to train external models, making it suitable for ethically sensitive implementation research.

Wrapping up: next moves

If you are preparing to synthesize a mixed-methods implementation study like the Gondar training project, link CFIR themes to measurable process changes such as KAP, referrals, and diagnostic intervals.

  • Use AI to remove transcription bottlenecks, standardize coding, and produce cross-segment evidence tables that decision-makers trust.
  • Try a 2-week Evidano pilot to ingest transcripts, import your codebook, and produce a stakeholder memo with visuals, Try Evidano for free.
Company
About
Newsletter

Product updates, research, and tips — straight to your inbox.

© Evidano, All Rights Reserved.