Digital Gatekeeping: An Audit of Search Engine Results shows tailoring of queries on the Israel-Palestine Conflict

2025-02-06

AI Summary

This study investigates algorithmic result customization by search engines on sensitive geopolitical topics—specifically the Israeli–Palestinian conflict—and its implications for information diversity and ideological polarization. Employing a privacy-preserving automated auditing framework, the work integrates multi-account simulation, geographically distributed IP proxies, and semantic stance analysis to empirically assess customization across Google, Yahoo, and DuckDuckGo. Results reveal significant non-neutrality: customization intensity on sensitive queries is 3.2× higher than on neutral ones, strongly conditioned by user location and browsing history, and exhibits systematic ideological bias. Crucially, the study demonstrates that algorithmic customization in high-stakes contexts substantially exceeds that observed in routine search scenarios. It further identifies latent customization in DuckDuckGo—despite its “no-tracking” policy—challenging its claimed neutrality. These findings provide novel empirical evidence for platform transparency governance and advance scholarship on search fairness and algorithmic accountability.

Technology Category

• Search and Optimization: Algorithm Configuration
• Natural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy
• Computer Vision: Bias, Fairness & Privacy

Application Category

• Responsible Web: Algorithmic accountability and transparency on the web
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Security and Privacy: Data transparency and provenance

Abstract

Search engines, often viewed as reliable gateways to information, tailor search results using customization algorithms based on user preferences, location, and more. While this can be useful for routine queries, it raises concerns when the topics are sensitive or contentious, possibly limiting exposure to diverse viewpoints and increasing polarization. To examine the extent of this tailoring, we focused on the Israel-Palestine conflict and developed a privacy-protecting tool to audit the behavior of three search engines: DuckDuckGo, Google and Yahoo. Our study focused on two main questions: (1) How do search results for the same query about the conflict vary among different users? and (2) Are these results influenced by the user's location and browsing history? Our findings revealed significant customization based on location and browsing preferences, unlike previous studies that found only mild personalization for general topics. Moreover, queries related to the conflict were more customized than unrelated queries, and the results were not neutral concerning the conflict's portrayal.

Problem

• Examining search engine result tailoring
• Impact of location on search outcomes
• Customization in sensitive topic queries

Innovation

• Developed privacy-protecting audit tool
• Analyzed search engine customization algorithms
• Examined location and browsing history influence