Problem
Research questions and friction points this paper is trying to address.
AI search
online content ecosystem
generative AI
search engine
user engagement
The Impact of AI Search on the Online Content Ecosystem: Evidence from Google and Reddit
🤖 AI Summary
This study investigates whether generative AI search features—such as Google’s AI Overviews, which provide direct summaries on search results pages—undermine users’ incentives to visit original content platforms and thereby reshape the online content ecosystem. Leveraging a policy discontinuity between SFW (AI-citable) and NSFW (non-citable) communities on Reddit, the authors employ a difference-in-differences design with large-scale user behavior data to empirically identify heterogeneous effects of AI search on engagement with experiential versus factual content. The findings reveal that AI Overviews increase daily comment volume and commenting users in SFW communities by 12.0% and 12.3%, respectively, with effects concentrated in experiential discussions. However, the subsequent introduction of an AI-powered conversational interface nearly fully offsets these gains, highlighting the critical role of interface design in shaping user incentives.
📝 Abstract
Search engines traditionally complement online content platforms by directing users seeking information to external websites. The emergence of generative AI search tools that summarize answers directly on the results page may disrupt this relationship by making visits to source platforms optional. We study this question using Google AI Overviews and Reddit, one of the largest online discussion platforms. Our identification exploits Google's content moderation policy: Safe-for-Work (SFW) Reddit communities are indexed by Google organic search and surfaced in Google AI Overviews, while Not-Safe-for-Work (NSFW) communities, though indexed by organic search, are prohibited from being referenced in AI Overview summaries. Using a difference-in-differences design, we find that AI Overviews increase engagement in SFW communities: daily comments rise by 12.0 percent and the number of commenting users by 12.3 percent relative to NSFW communities. The effects are concentrated in experience-based discussions (opinions, advice, and personal experiences) rather than fact-based information. However, the subsequent introduction of Google AI Mode, which allows users to interact conversationally with the AI summary, largely eliminates these gains in experience-based content. These results suggest that the effects of AI search depend critically on interface design and types of content.
Innovation
Methods, ideas, or system contributions that make the work stand out.
generative AI search
difference-in-differences
content ecosystem
user engagement
interface design
🔎 Similar Papers
No similar papers found.
