🤖 AI Summary
This study addresses how the “engagement interchangeability” mechanism within X’s recommendation algorithm privileges instantaneous reactions in content scoring, thereby accelerating misinformation dissemination. To investigate this, we conduct the first component-level analysis of the open-sourced algorithm, integrating simulation modeling, calibration experiments, and empirical evaluation using the USC X 2024 Election Corpus. Our findings reveal a fundamental limitation: merely adjusting engagement weights cannot curb the proliferation of low-credibility content. Accordingly, we propose a “reflective threshold gating” intervention that introduces deliberative interaction prerequisites before amplifying content. Experimental results demonstrate that this mechanism significantly narrows the exposure disparity between false and authentic information without compromising overall platform engagement. This work thus offers both theoretical insights into algorithmic amplification dynamics and a practical mitigation strategy for safeguarding information integrity on social media platforms.
📝 Abstract
Misinformation is widely reported to propagate faster on engagement-based platforms, yet prior work largely focused on empirical analysis, without identifying a specific algorithmic mechanism that results in this phenomenon. Thanks to the open-sourcing of X's recommendation algorithms, we conduct what is, to our knowledge, the first component-level study of the recommendation algorithm deployed by a social media platform, which examines how each of its components affects misinformation propagation. Specifically, we identify the engagement fungibility mechanism in the algorithm, where the final recommendation score is constructed as a weighted sum of all predicted user activities. As a result, a tweet can be repeatedly recommended simply because it is predicted to draw many instant reactions (e.g., likes and retweets), even when it is not expected to draw thoughtful responses (e.g., replies and quotes). Since misinformation typically draws a larger share of its engagement from instant reactions, this mechanism enables it to receive more recommendation exposure and to propagate faster.
To empirically validate this mechanism, we re-implement X's recommendation algorithm on the USC X 2024 election corpus, and build a calibrated simulation study to analyze the impact of different scoring rules. We find that re-tuning the metric weights has little or even a negative impact on reducing the credibility exposure gap, while those scoring rules that set a precondition of thoughtful engagement for amplification would be able to alleviate the gap significantly, across 46 robustness checks. Our diagnosis, therefore, yields a simple and deployable fix, a reflective-threshold gate that withholds amplification until a tweet is predicted to draw thoughtful engagement, which we find to reallocate exposure away from low-credibility content at no cost to mainstream exposure and with no loss of engagement.