Learning Health System Readiness: Qualitative Playbook

Healthcare teams need repeatable, rigorous ways to judge organisational readiness for a learning health system (LHS). This post refracts the BMJ Open Delphi protocol (published 1 August 2025) into a practical guide for qualitative analysis of learning health system readiness and shows how teams can run the same validation + synthesis workflow faster using Evidano (see www.evidano.com). Read on to learn the key metrics, a 7-step reproducible workflow, and exactly which Evidano features to use to turn Delphi responses, open comments and bilingual inputs into actionable reports.

Fast take + source

What happened: A multi-author team published a Delphi protocol to validate a questionnaire that measures organisations' readiness to implement a learning health system. The protocol uses a three-round Delphi (consensus threshold ~70%) with planned recruitment of ~40 panelists drawn from ~100 identified experts. Full protocol: www.bmjopen.bmj.com/content/15/8/e088720 (published 1 August 2025).

Why it matters: readiness tools let hospitals and clinics prioritise investments (data pipelines, people, governance) and measure progress toward continuous learning.
What you get from this post: exact data points to collect, an analysis checklist, and a repeatable Evidano workflow to speed content validation, thematic coding, cross-segment comparison and bilingual synthesis.

Findings snapshot

Item	Value	Source / Note
Protocol published	1 August 2025	www.bmjopen.bmj.com/content/15/8/e088720
Delphi rounds	3 (each open 14 days)	Rounds 1–3 description in protocol
Planned panel size	≈40 participants (aim)	Identified ≈100 potential experts; purposive + snowball sampling
Consensus threshold	~70% agreement	Aligned with common Delphi practice
Questionnaire domains	4 (P2D, D2K, K2P, LHS core values)	Blueprint in protocol supplement
Quant & qual tools	Excel (descriptives) + MAXQDA (V.24.1.0)	Protocol specifies conventional content analysis
Languages	English & French	Survey materials and communications bilingual
Ethics	McGill REB AO3-E23-24B	Data stored on secured McGill servers

How the Delphi and readiness questionnaire work (plain English)

The team built a pre-Delphi LHS readiness questionnaire from a scoping review and multi-stakeholder feedback. The instrument maps to the learning cycle: performance→data (P2D), data→knowledge (D2K), knowledge→performance (K2P), plus core LHS values.

Round 1: all items rated for importance, relevance, and clarity (3-point scale). Open-text for missing concepts.
Round 2: participants review aggregated Round 1 stats (mean, median, SD, IQR) and re-rate items lacking consensus.
Round 3: final attempt to achieve ≥70% agreement; steering committee adjudicates wording and removals between rounds.
Analysis: closed-ended items → descriptive stats in Excel; open-ended responses → inductive conventional content analysis in MAXQDA.

What this means for researchers and policy teams: implications

For qualitative researchers

Use the protocol as a template for validating organisational measurement tools when empirical evidence is sparse. Key design choices to copy: purposive + snowball recruitment, 14-day response windows, round-by-round reporting of aggregate stats, and documenting steering committee decisions.

Collect identifiers linked to demographics (kept separate) so you can analyse importance/relevance by role (decision-maker, clinician, researcher).

For UX & implementation teams

A validated readiness questionnaire gives you a baseline to prioritise interventions (training, data engineering, governance). Expect common barriers: limited human/financial resources and research/data collection capacity; facilitators: learning culture and partnership processes.

Plan follow-ups (cognitive interviews, focus groups) as the protocol recommends, these supply the qualitative depth needed to write change plans.

For policy and health-system leaders

Readiness is organisational and inter-organisational. Start with single-organisation assessments but plan network-level pilots once local maturity is established.

Use standardised scores and open-text themes from Delphi rounds to argue for targeted investments (D2K pipelines, analytics capacity, and community engagement).

Do more, faster with Evidano

Problem: multi-round Delphi + bilingual open text = manual drag

Solution: Import survey exports (CSV) and bilingual open responses into Evidano to run thematic coding, frequency counts, and cross-segment comparisons in minutes instead of weeks.

Problem: inconsistent coding across rounds and reviewers

Solution: Use Evidano's hierarchical codes→subcodes and codebook import to standardise definitions across analysts, then apply AI-assisted coding to harmonise legacy and new items.

Problem: French + English responses and translation nuance

Solution: Evidano's translation with a custom dictionary preserves technical terms and local phrases, avoiding meaning drift during content analysis.

Problem: stakeholder-ready outputs

Solution: Generate exportable visualisations (word clouds, co-occurrence networks, hierarchical code maps) and clickable quote lists for your knowledge mobilisation workshops.

Security & compliance

Evidano encrypts data, supports PII redaction in transcripts, and never uses customer data to train third-party models, aligned with the protocol's emphasis on secure storage and controlled access.

7-step workflow: reproduce the protocol analysis in Evidano (two-week pilot)

Use this run-book to take Round 1 exports → stakeholder-ready brief in two weeks.

Step 1: Export Round 1 CSVs and open-text answers from your survey platform (e.g., Lime Surveys).
Step 2: Import CSVs into Evidano; map demographics to segments (decision-maker, clinician, researcher).
Step 3: Run automated thematic analysis on open-text (inductive code generation); review suggested codes and lock codebook.
Step 4: Apply hierarchical coding to all responses; run frequency counts and co-occurrence networks to surface linked concerns (e.g., data infrastructure + workforce).
Step 5: Produce cross-segment comparisons (importance/relevance by role) and export visual dashboards for Round 2 materials.
Step 6: Translate French responses with a custom dictionary; reconcile any translation ambiguities via bilingual quote review.
Step 7: Generate a 1-page decision brief and appendix with codebook, exemplar quotes, and methodology notes for your steering committee and the Round 2 packet.

FAQ: qualitative analysis of LHS readiness

Q: What counts as evidence of 'readiness' in these surveys?

A: The protocol operationalises readiness across four domains (P2D, D2K, K2P, core values). Quantitative item agreement (~70%) plus consistent open-text themes (triangulated across roles) provide content validity.

Q: How do I compare segments reliably?

A: Predefine segments in your import; use per-item descriptive stats (mean, median, SD, IQR) and run subcode frequency comparisons. In Evidano you can filter, visualise, and export segment dashboards for stakeholders.

Q: Is this approach appropriate for multilingual contexts?

A: Yes. The BMJ protocol ran bilingual surveys (English/French). For robust qualitative analysis, translate with a domain-aware dictionary and validate translations with bilingual reviewers; Evidano supports both steps.

Wrapping up: next moves

If you plan to run or analyse an LHS readiness Delphi, use the protocol's design choices (3 rounds, 14-day windows, ~70% consensus) and adopt an AI-enabled workflow to cut synthesis time.

Immediate next move: download the protocol at www.bmjopen.bmj.com/content/15/8/e088720 and sketch your participant list (aim for 30–40 to allow for attrition).
Try Evidano: import your Round 1 export, run thematic coding + segment comparisons, and produce the Round 2 briefing pack in a single session, see www.evidano.com to start a pilot.

Keep reading

Browse all articles