Engagement vs. Commitment: The Economic Trade-Offs of Polarizing News Content

2026-05-18

AI Summary

This study investigates the economic trade-off between attention-grabbing effects—such as increased dwell time—and user commitment—measured by subscriptions and retention—in the context of polarized news content. Leveraging a deep learning classifier fine-tuned for multi-party systems and large language models to quantify polarization, the authors identify causal effects using a Bartik-style instrumental variable from editorial supply-side variation and an election-driven demand-side instrument capturing shifts in political salience. The findings reveal that while polarized content prolongs user dwell time, it fails to translate into higher subscription rates; during high-salience electoral periods, it even significantly reduces subscriptions and accelerates user churn, with affective polarization exhibiting the strongest negative impact. These results challenge explanations based on confirmation bias and instead support a novel “balanced consumption” mechanism.

Abstract

Content that drives engagement need not be the same content that drives willingness to pay. We study how polarizing content affects engagement (time on site) and commitment (subscriptions and retention) on a major news platform. We measure article-level polarization with deep-learning classifiers and large language models tailored to a multiparty system, and identify causal effects with two complementary instrumental variables: a Bartik instrument exploiting supply-side editorial variation, and an election instrument exploiting demand-side political salience. We find that supply-driven increases in polarizing content raise engagement but not subscriptions. During the high-salience election window, the same content reduces subscriptions and accelerates churn, with affective polarization driving the sharpest divergence. On the mechanism, we find evidence inconsistent with confirmation bias: three pre-determined ideology proxies do not moderate the engagement or subscription effects. By contrast, on ideological dimensions where the publisher covers both sides, exogenous shifts in the publisher's supply of content opposite readers' baseline ideology raise their consumption of that content, consistent with balanced consumption. These results document an asymmetric engagement-commitment trade-off for digital publishers: polarizing content reliably captures attention but does not convert to subscriptions, and actively damages commitment when political salience is elevated

Problem

• polarizing content
• engagement
• commitment
• subscriptions
• political salience

Innovation

• polarizing content
• causal inference
• instrumental variables
• large language models
• engagement-commitment trade-off