Reddit AI Search Favors Popular, Formal Comments Over Personal Experience, Audit Finds

A new preprint from the University of Illinois Urbana-Champaign found that Reddit's AI search consistently favored highly upvoted and formally written comments over those containing personal experience markers — raising questions about whose voice actually reaches users.

The findings matter because Reddit has long been valued as a source of authentic, first-person human experience. If the platform's AI search systematically filters out that experiential language before surfacing answers, the very quality that makes Reddit useful for audience research and consumer insight may be getting lost in translation. For marketers and researchers, this represents a meaningful shift in how AI is reshaping social media content discovery and what that means for the reliability of platform-sourced insights.

How Language and Engagement Shaped What Gets Surfaced

Researchers processed 10,000 questions through Reddit's AI search feature three times and analyzed 30,000 answers traced back through 14.68 million comments. The questions originated from 20 advice and support subreddits — including large communities like r/personalfinance and r/AskDocs and smaller ones like r/UKJobs and r/AusLegal.

Formal Language and Upvotes Drove Selection Odds

The study identified formality as the strongest language-based predictor of comment selection. A comment that was one standard deviation more formal had 49% higher odds of being selected by the system (odds ratio 1.488). Comments using directive words like "should" and "must" also saw elevated selection odds at 1.070.

By contrast, comments with markers of personal experience — such as first-person pronouns and past tense verbs — had lower odds of selection at 0.789. Supportive language also underperformed at 0.924.

After controlling for a comment's score, position, and age, the associations narrowed but held. Formality dropped to an odds ratio of 1.213 and experiential voice fell to 0.860. The authors were careful to note that the research is observational. "Our study is observational and should not be interpreted causally," they wrote — meaning writing formally does not guarantee selection.

Structural Visibility Held a Significant Advantage

Beyond language patterns, the audit revealed that structural visibility played an even larger role in determining which comments reached the AI answer.

A one-standard-deviation increase in a comment's vote ranking within its thread multiplied selection odds by 2.88 — the largest single association in the model. The median selected comment ranked at the 91st percentile for score in its thread, compared to the 45th percentile for comments that were not chosen.

Timing also proved critical. Selected comments appeared a median of 1.2 hours after the original post, while non-selected comments appeared after a median of 5.9 hours. Being early and visible compounded a comment's chances significantly.

Additional structural factors included:

• 92% of selected comments were direct replies to the original post
• Comments containing an external link had an odds ratio of 2.25
• A one-standard-deviation increase in comment length carried an odds ratio of 1.79
• Comments with a score of zero or below made up just 0.53% of selected comments but 5.1% of all comments collected

A typical AI answer drew from about seven different subreddits. The subreddit where the original question was posted contributed 17.7% of retrieved posts in large communities and 15.7% in smaller ones.

This pattern of algorithmic filtering — where structural signals outweigh content quality — is one of the broader risks and challenges businesses face when adopting AI at scale, particularly when those systems mediate access to human knowledge and experience.

What the AI Did With the Comments It Selected

First-Person Voice Nearly Disappeared in Written Answers

Perhaps the most striking finding involved how Reddit's AI transformed the comments it did select. Researchers compared 1,000 queries and their source comments with the final written answers the system generated.

Usage of first-person words like "I" and "my" fell from 3.3% in the quoted comments to just 0.06% in the AI-generated answers — a near-total removal of personal voice from the content.

The same queries were run through GPT-4o-mini and GPT-5 via OpenAI's API with web search enabled. Both models also used less first-person language than the original Reddit comments, but Reddit's own responses showed the largest reduction of the three. Out of 4,932 citations across both models and search configurations, only 18 referenced Reddit directly.

Reddit CEO Steve Huffman told investors in February that Reddit excels at questions where "the answer actually is multiple perspectives from lots of people." This audit measured precisely which of those perspectives made it through — and found the personal ones were largely left behind.

Reddit's AI search feature — originally launched as Reddit Answers in December 2024 — was merged into Reddit's unified search experience on May 26, 2026. It is now accessible through an Ask button in the search bar.

The authors acknowledge that these selection patterns may not apply to other types of communities or to other AI search platforms. The paper has not yet undergone peer review and findings could shift if a revised version is published.

For a broader view of how AI-generated summaries are affecting content discovery across the web, the evolving landscape of SEO and AI search offers important context for businesses rethinking their content and research strategies.

What This Means in Practice

Marketers and researchers relying on Reddit for consumer insights should read the source comment threads beneath AI answers directly rather than accepting the summary alone — the most experiential and human responses may not have surfaced. Reddit's AI search is best treated as a filtered entry point, not a comprehensive reflection of community sentiment.

Content creators and community contributors should note that early posting, longer replies, and external links were all associated with higher selection odds when optimizing for AI search visibility on Reddit. Timing, in particular, appears to carry outsized influence — a comment posted within the first hour of a thread has a structurally different chance of surfacing than one posted five hours later, regardless of its quality or depth.

Business and SEO professionals should treat Reddit AI summaries as a filtered starting point and cross-reference original threads to capture the full range of user perspectives that algorithmic selection may have excluded. The University of Illinois preprint is available for review at SSRN for those who wish to examine the methodology in detail.