Evidano home
Commentary on News

What Lemmy Reveals About AI Qualitative Analysis

Evidano8 min read

AI qualitative analysis helps researchers move from large volumes of online conversation to defensible themes, motivations, and user experiences. The audience for this workflow includes social researchers, UX teams, community managers, and policy analysts studying platform migration. The 2023 Reddit to Lemmy case shows why qualitative context matters: platform growth statistics and sentiment scores identified a major migration, while interviews and open-ended responses explained why users left Reddit, how they adapted to federation, and what could determine long-term retention. According to the J Multimed Inf Syst study on Reddit migration and Lemmy, researchers combined growth data, VADER sentiment analysis, a survey of 354 users, and qualitative responses from 16 users. This post translates that mixed-methods design into a practical AI qualitative analysis workflow, while preserving the source's limitations and the need for human interpretation.

Key Takeaways

The J Multimed Inf Syst study on Reddit migration and Lemmy found that Reddit's June and July 2023 policy changes triggered rapid Lemmy growth, while qualitative analysis showed that dissatisfaction with Reddit, interest in open-source communities, adaptation challenges, and expectations about future activity shaped the migration experience.

  • The 2023 J Multimed Inf Syst study analyzed 48, 272 Lemmy comments, surveyed 354 users between September 22 and September 26, 2023, and collected qualitative responses from 16 users.
  • The study found that 96.6% of survey respondents cited dissatisfaction with Reddit's policies or API changes as a migration motivation in September 2023.
  • The study reported that 90.7% of respondents intended to continue using Lemmy long term, although users still cited limited content diversity and technical problems.
  • The study found that Lemmy posts increased from approximately 250, 000 in May 2023 to more than 2, 500, 000 in August 2023, while comments rose from around 500, 000 to more than 11, 000, 000 over the same period.
  • The study's 16-user qualitative analysis identified recurring themes involving Reddit dissatisfaction, platform adaptation, community welcome, decentralization, missing features, and long-term engagement.

What the 2023 Reddit to Lemmy Study Measured

The 2023 J Multimed Inf Syst study measured Lemmy's migration through four complementary evidence streams: platform growth, sentiment analysis, a user survey, and qualitative responses. The research examined Lemmy activity before and after Reddit's June 2023 API changes and the shutdown of third-party applications on June 30, 2023.

The J Multimed Inf Syst study analyzed 48, 272 comments from Lemmy communities using VADER, a lexicon-based social media sentiment tool. The researchers classified comments as positive, neutral, or negative and found that post-migration sentiment was predominantly positive toward Lemmy, while many negative comments criticized Reddit, technical issues, or low activity in smaller communities.

The J Multimed Inf Syst study surveyed 354 respondents from three Lemmy communities. The survey reported that 95.5% of respondents had recently migrated from Reddit, 62.1% viewed Reddit negatively after migration, and 58.3% described the Lemmy community response as very welcoming.

The J Multimed Inf Syst study also used open-ended questionnaires with 16 purposively selected users, including Reddit migrants and original Lemmy users. Thematic analysis found that users valued decentralization, open-source software, third-party applications, and the absence of advertising, while missing Reddit's larger content base and stronger moderation tools.

The study's qualitative evidence adds meaning that a sentiment score cannot provide. One participant described the motivation for leaving Reddit as: "My primary reason for migration was the disappearance of third-party apps." Another participant summarized the pre-migration Lemmy experience as: "It felt a bit like a sleepy village."

Snapshot: AI Qualitative Analysis Inputs and Findings

Evidence streamDate or sampleFinding reported by the JMIS studyResearch implication
Comment corpusMay 12, 2020 to September 24, 2023The JMIS study analyzed 48, 272 comments with VADER sentiment analysis.AI-assisted coding can organize large conversational datasets before human review of context and sarcasm.
Platform activityMay to August 2023The JMIS study reported that posts grew from approximately 250, 000 to more than 2, 500, 000, while comments grew from around 500, 000 to more than 11, 000, 000.Volume change signals when researchers should investigate user motivations and adaptation experiences.
Migration surveySeptember 22 to September 26, 2023The JMIS study collected 354 responses, with 96.6% citing dissatisfaction with Reddit policies or API changes.Frequency analysis identifies dominant motivations that qualitative coding can explain in depth.
Open-ended questionnaire2023, 16 usersThe JMIS study identified themes involving platform dissatisfaction, adaptation, community response, feature preferences, and retention.Thematic analysis connects user language to decisions about onboarding, moderation, and product design.
Long-term intentionSeptember 2023The JMIS study reported that 90.7% of respondents intended to continue using Lemmy.Retention claims require segment-level interpretation because users also reported technical and content limitations.

Implications for Researchers Studying Online Communities

Researchers studying online communities should combine scale, sentiment, and qualitative explanation instead of treating any single metric as a complete account of migration. The JMIS study demonstrates this principle because growth data showed when Lemmy expanded, survey data quantified motivations and intentions, and interviews explained how users interpreted federation, moderation, and community culture.

AI qualitative analysis is most useful when researchers define a code framework before interpreting results. For the Lemmy case, a practical framework would include migration trigger, trust in platform leadership, third-party application dependence, federation comprehension, community welcome, technical friction, content diversity, moderation, and retention intent.

Cross-segment comparison is especially important for platform migration research. The JMIS study distinguished Reddit migrants from original Lemmy users and found that existing users were excited about growth but concerned about server capacity, moderation, and community culture. A single overall sentiment score could conceal those differences.

Researchers should treat automated sentiment as an organizing signal, not a final interpretation. The JMIS study acknowledged that VADER may miss sarcasm and context-specific emotion, and the study's survey and qualitative methods helped explain why comments were positive or negative.

The JMIS study also reported methodological limitations that researchers should preserve in any AI-assisted workflow: growth estimates did not cover every Lemmy server, the survey covered three communities, and the 16-person qualitative sample was not representative of all Lemmy users.

How Evidano Supports AI Qualitative Analysis

Problem: Large comment and interview datasets are difficult to synthesize

Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze interviews, open-ended surveys, and documents. Researchers can upload comment exports, interview transcripts, papers, and survey responses to create a searchable evidence base.

Evidano's thematic, content, and frequency analyses can help organize migration motives, adaptation barriers, community reactions, and retention signals before researchers validate the interpretation. Researchers can review the source material through Evidano's qualitative research features.

Problem: Overall sentiment hides differences between user groups

Evidano supports cross-segment analysis, which allows researchers to compare Reddit migrants with original Lemmy users, active contributors with lurkers, or users from different instances.

A cross-segment workflow can show whether a theme such as technical friction appears across groups or is concentrated among newcomers. Researchers should use these comparisons as analytical evidence, not as a substitute for methodological judgment.

Problem: Researchers need to ask follow-up questions across evidence

Evidano's AI chat enables researchers to ask questions across uploaded documents and analyses, such as which comments explain dissatisfaction with third-party applications or which responses connect federation confusion with onboarding difficulty.

Researchers can use visualizations such as word clouds, co-occurrence networks, and hierarchical codes to inspect relationships among themes. Evidano encrypts data and does not use customer data to train third-party models, according to Evidano's data security information.

FAQ: AI Qualitative Analysis of Online Communities

What did the Reddit to Lemmy study find?

The JMIS study found that Reddit policy and API changes in June 2023 were associated with rapid Lemmy growth and that users generally viewed Lemmy positively after migration.

The study also found that users valued decentralization, open-source software, and third-party applications, while concerns included technical problems, limited content diversity, and weaker moderation tools.

How many users and comments did the Lemmy study analyze?

The JMIS study analyzed 48, 272 comments, surveyed 354 users, and collected qualitative responses from 16 users.

The comment data covered periods from May 12, 2020 through September 24, 2023, while the survey ran for 5 days from September 22 through September 26, 2023.

Why is qualitative analysis important for platform migration research?

Qualitative analysis explains the motivations, meanings, and experiences behind migration metrics that growth counts and sentiment labels cannot fully capture.

The JMIS study's thematic analysis showed how users interpreted third-party application loss, federation, community welcome, technical friction, and future engagement.

Can AI replace human interpretation in qualitative research?

AI can accelerate organization, coding, comparison, and retrieval, but human researchers remain responsible for context, sampling decisions, validation, and ethical interpretation.

The JMIS study noted that automated sentiment analysis can miss sarcasm and context-specific emotion, which supports using AI as an assistant within a mixed-methods workflow.

How can researchers analyze online community data with Evidano?

Researchers can upload transcripts, documents, reports, and survey responses to Evidano, then use thematic, frequency, content, cross-segment, and AI chat analyses to investigate user motivations and experiences.

Researchers can validate AI-generated findings against original excerpts and present relationships among codes through Evidano's qualitative research visualizations.

Conclusion and Next Steps

The 2023 Reddit to Lemmy study shows that strong qualitative research connects what happened with why users experienced it that way. The study's 48, 272-comment corpus and 354-person survey established the scale of migration, while responses from 16 users revealed the trust, usability, community, and retention themes behind the numbers.

AI qualitative analysis can make this mixed-methods workflow more manageable by organizing evidence, comparing segments, surfacing recurring themes, and helping researchers return to supporting excerpts. Human review remains essential for context, ethics, sampling, and claims about user experience.

Researchers studying platform migration, digital communities, or product adoption can use Evidano to move from raw conversations to structured findings more efficiently. Try Evidano for free and turn qualitative data into evidence your team can act on.

Topics

  • AI qualitative analysis
  • qualitative analysis of online communities
  • AI thematic analysis
  • social media qualitative research
  • Reddit migration research

Keep reading

Browse all articles