Evidano home
Commentary on News

What Lemmy Reveals About AI Qualitative Research

Evidano9 min read

Researchers studying platform migrations need more than registration counts or sentiment scores. They need to understand why users leave, how newcomers adapt, which community dynamics encourage retention, and where technical problems undermine trust. The 2023 Reddit migration to Lemmy provides a useful case because the study combined growth data, sentiment analysis, a 354-person survey, and qualitative responses from 16 users. This article explains what that mixed-methods design reveals about AI qualitative research and how research teams can apply the same logic to interviews, open-ended surveys, and social media data. Evidano is an AI-powered qualitative data analysis platform that helps researchers analyze interviews, open-ended surveys, and documents. Its thematic, content, frequency, and cross-segment analyses can help teams move from large text collections to defensible patterns while keeping qualitative interpretation central.

Key Takeaways

The J Multimed Inf Syst study on Reddit migration and Lemmy found that Reddit's June 2023 API changes triggered rapid Lemmy growth, predominantly positive migration sentiment, and strong stated intentions to continue using Lemmy.

AI qualitative research is most useful when it connects recurring themes and user language with quantitative evidence, rather than treating sentiment scores or user counts as complete explanations.

  • The study analyzed 48, 272 comments collected between May 12, 2020, and September 24, 2023, and found predominantly positive sentiment toward Lemmy alongside criticism of Reddit.
  • The study's September 22 to September 26, 2023 survey received 354 responses, with 96.6% identifying dissatisfaction with Reddit's policies or API changes as a migration motivation.
  • The study's qualitative questionnaire involved 16 users and identified recurring themes involving platform dissatisfaction, federation learning, community welcome, technical limitations, and long-term retention.
  • The study reported that 90.7% of survey respondents intended to continue using Lemmy, although respondents also reported missing Reddit's larger content base and more mature moderation tools.

How AI Qualitative Research Explains the Reddit to Lemmy Migration

The Reddit to Lemmy migration was driven by a combination of policy dissatisfaction, product preferences, and community expectations, according to the 2023 J Multimed Inf Syst study. Reddit's decision to charge for API access in June 2023 contributed to the shutdown of third-party applications such as Apollo, Sync, and BaconReader, while subreddit blackouts created additional momentum for alternatives.

The study measured the migration through several complementary methods. User and server growth data showed that Lemmy instances increased from fewer than 200 to more than 1, 200 during the growth period, while posts rose from approximately 250, 000 in May 2023 to more than 2, 500, 000 in August 2023. Comments increased from around 500, 000 in May 2023 to more than 11, 000, 000 in August 2023.

The study's VADER analysis covered 48, 272 comments from pre-migration and post-migration periods. The researchers reported that post-migration discussions were predominantly positive, while negative comments often focused on Reddit's policies, Lemmy's smaller communities, glitches, and technical issues.

The study's qualitative evidence explains why the numerical growth mattered. User 15 said, "My primary reason for migration was the disappearance of third-party apps." User 5 described pre-migration Lemmy as "a sleepy village." These quotations show how thematic analysis can connect a platform event to user expectations, frustration, and perceived community value.

The study also identified a tension between decentralization and concentration. Lemmy.world and Lemmy.ml together represented approximately 18% of Lemmy's users in the study's reported data, suggesting that decentralized services can still develop centralization patterns.

Lemmy Migration Findings Snapshot

Date or periodEvidence sourceValueResearch implication
June to July 2023User growth analysis in the J Multimed Inf Syst studyLemmy registrations and activity rose sharply after Reddit's third-party app shutdownPolicy events can create sudden migration waves that require time-based qualitative analysis
May to August 2023Platform activity data in the J Multimed Inf Syst studyPosts increased from approximately 250, 000 to more than 2, 500, 000Content volume can expand faster than researchers can manually review it
May to August 2023Platform activity data in the J Multimed Inf Syst studyComments increased from around 500, 000 to more than 11, 000, 000Automated coding and sampling can help identify themes in high-volume discussion data
May 12, 2020 to September 24, 2023VADER sentiment dataset in the J Multimed Inf Syst study48, 272 commentsSentiment analysis provides scale, but qualitative coding is needed to explain the sentiment
September 22 to September 26, 2023Online survey in the J Multimed Inf Syst study354 responsesSurvey results can validate themes found in comments and interviews
2023 qualitative questionnaireSemi-structured questionnaire in the J Multimed Inf Syst study16 usersSmall purposive samples can reveal motivations and experiences hidden by aggregate metrics

Implications for Social Media and UX Researchers

Social media and UX researchers should analyze migration as a journey involving triggers, adaptation, community response, and retention, according to the study's mixed-methods findings. A registration spike shows that people arrived, but it does not show whether they understood federation, found relevant communities, or planned to stay.

  • Researchers should separate dissatisfaction with the origin platform from satisfaction with the destination platform because the Lemmy study found negative comments that criticized Reddit rather than the migration itself.
  • Researchers should compare newcomers with established users because the study found different perspectives on growth, moderation capacity, community culture, and platform scale.
  • Researchers should code learning barriers because the September 2023 survey found that 39.8% of respondents needed time to understand instances and federation, while 36.9% understood those concepts immediately.
  • Researchers should connect product feedback with retention signals because the study found that 92.6% of respondents used Lemmy daily and 90.7% intended to continue using it, while 42.2% still reported minor technical issues.
  • Researchers should treat automated sentiment as directional evidence because the study explicitly noted that VADER may miss sarcasm and context-specific meaning.

The study's qualitative results also show why direct language matters. User 14 warned that concerns about "server capacity, " "moderator tools, " and "spam" were practical risks rather than abstract objections. A research workflow that preserves these phrases alongside codes can help product and community teams prioritize actions.

How Evidano Supports AI Qualitative Research

Problem: Large comment and survey datasets are difficult to synthesize

Evidano can ingest documents and spreadsheets, then organize qualitative evidence into thematic, content, frequency, and cross-segment analyses. Researchers can use this workflow to compare migration discussions, survey responses, and interview transcripts without relying on a single sentiment score.

Teams studying high-volume feedback can learn more about Evidano's qualitative research features and use AI-assisted analysis to identify recurring motivations, barriers, and expectations.

Problem: Aggregate sentiment does not explain user motivations

Evidano can help researchers move from sentiment labels to underlying themes by examining the language associated with positive, negative, and neutral responses. In a migration study, relevant themes might include policy distrust, third-party app dependence, federation confusion, community welcome, technical friction, and retention intent.

Researchers should validate AI-generated themes against source excerpts and the study design. The Lemmy study provides a useful model because it paired automated VADER analysis with manual content analysis and qualitative questionnaires.

Problem: Different user groups experience the same change differently

Evidano's cross-segment analysis can help compare Reddit migrants with original Lemmy users, active contributors with lurkers, or users from different instances and communities. Segment comparisons can reveal whether a theme is widespread or concentrated in one audience.

Researchers can also use AI chat over their documents and analyses to ask focused follow-up questions, such as which themes distinguish long-term users from uncertain users or which technical issues appear alongside negative experience descriptions.

Problem: Interview evidence is slow to prepare and review

Evidano supports transcription with custom dictionaries and PII redaction, which can help research teams prepare semi-structured interviews for analysis. Translation support can help teams compare multilingual responses while preserving research terminology through custom dictionaries.

Evidano states that customer data is encrypted and never used to train third-party models. Research teams should still confirm that their workflow meets their institution's consent, privacy, and data-governance requirements.

FAQ: AI Qualitative Research for Platform Migration Studies

What is AI qualitative research?

AI qualitative research uses artificial intelligence to organize, code, compare, and interrogate text while researchers remain responsible for interpretation and research decisions.

The 2023 Lemmy study illustrates the value of combining automated analysis with manual content analysis, survey evidence, and 16 qualitative responses rather than treating automation as a substitute for research judgment.

What did the Reddit to Lemmy study find?

The study found that Reddit's 2023 policy and API changes contributed to rapid Lemmy growth, predominantly positive migration sentiment, and strong stated intentions to continue using Lemmy.

The study analyzed 48, 272 comments, surveyed 354 people between September 22 and September 26, 2023, and collected qualitative responses from 16 users.

Why combine sentiment analysis with thematic analysis?

Sentiment analysis estimates emotional direction at scale, while thematic analysis explains the reasons, experiences, and meanings behind that direction.

The Lemmy study found predominantly positive migration sentiment, but qualitative evidence showed that users still faced federation learning barriers, technical issues, smaller communities, and concerns about moderation capacity.

How can researchers analyze social media comments with AI?

Researchers can collect eligible comments, remove duplicates, define comparison periods and segments, use AI to identify candidate themes, and validate those themes against representative excerpts and human review.

The Lemmy study collected comments through the platform API, structured them with fields such as content, sentiment, ID, and timestamp, and acknowledged that automated sentiment could miss sarcasm or context.

Can AI replace qualitative researchers?

AI can accelerate organization and comparison, but AI should not replace qualitative researchers' responsibility for sampling, interpretation, ethics, contextual judgment, and validation.

The Lemmy study's limitations, including a purposive 16-person qualitative sample and incomplete coverage of all instances, demonstrate why researchers must qualify findings and avoid overgeneralization.

Conclusion and Next Steps for AI Qualitative Research

The Reddit to Lemmy case shows that AI qualitative research is strongest when it connects scale with meaning. Growth metrics identified when migration accelerated, sentiment analysis showed the overall direction of discussion, the survey measured motivations and intentions, and qualitative responses explained how users experienced the transition.

For researchers studying platform migration, product adoption, or online communities, the practical lesson is to combine thematic analysis, cross-segment comparison, and source-level evidence. Evidano can help teams bring those materials into one analysis workflow while preserving the excerpts and context needed for defensible conclusions.

Start organizing interviews, open-ended survey responses, reports, and social media research in a workflow built for qualitative analysis. Try Evidano for free.

Topics

  • AI qualitative research
  • AI thematic analysis
  • qualitative analysis of social media
  • Reddit Lemmy migration research
  • mixed methods research

Keep reading

Browse all articles