Epistemic Substitution: How Grokipedia's AI-Generated Encyclopedia Restructures Authority

2025-12-03

AI Summary

This study investigates the fundamental differences in knowledge authority construction between generative AI–curated encyclopedias (Grokipedia) and human-edited ones (Wikipedia). Using a matched sample of 72 article pairs, we apply multi-scale citation network analysis and an eight-category cognitive coding framework. Results reveal that Grokipedia systematically downweights scholarly sources in favor of user-generated content and civil-society resources; further, it employs distinct cognitive structures for sensitive sociopolitical topics versus leisure-oriented subjects. We introduce, for the first time, a scaling law governing AI-driven knowledge provenance. Crucially, our findings demonstrate that LLM-powered encyclopedias do not automate knowledge production but instead reconfigure the epistemic foundations of legitimacy. This work establishes a novel paradigm for algorithmic auditing and cognitive impact assessment of AI-generated knowledge systems, grounded in empirical evidence from large-scale comparative analysis.

Technology Category

• Philosophy and Ethics of AI: AI & Epistemology
• Data Mining & Knowledge Management: Knowledge Acquisition from the Web
• Humans and AI: Other Foundations of Human Computation & AI

Application Category

• Semantics and Knowledge: Scalable techniques for the creation, curation, publication, maintenance, and consumption of large, Web-based, structured, reusable, knowledge graphs and ontologies
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI

Abstract

A quarter century ago, Wikipedia's decentralized, crowdsourced, and consensus-driven model replaced the centralized, expert-driven, and authority-based standard for encyclopedic knowledge curation. The emergence of generative AI encyclopedias, such as Grokipedia, possibly presents another potential shift in epistemic evolution. This study investigates whether AI- and human-curated encyclopedias rely on the same foundations of authority. We conducted a multi-scale comparative analysis of the citation networks from 72 matched article pairs, which cite a total of almost 60,000 sources. Using an 8-category epistemic classification, we mapped the"epistemic profiles"of the articles on each platform. Our findings reveal several quantitative and qualitative differences in how knowledge is sourced and encyclopedia claims are epistemologically justified. Grokipedia replaces Wikipedia's heavy reliance on peer-reviewed"Academic&Scholarly"work with a notable increase in"User-generated"and"Civic organization"sources. Comparative network analyses further show that Grokipedia employs very different epistemological profiles when sourcing leisure topics (such as Sports and Entertainment) and more societal sensitive civic topics (such as Politics&Conflicts, Geographical Entities, and General Knowledge&Society). Finally, we find a"scaling-law for AI-generated knowledge sourcing"that shows a linear relationship between article length and citation density, which is distinct from collective human reference sourcing. We conclude that this first implementation of an LLM-based encyclopedia does not merely automate knowledge production but restructures it. Given the notable changes and the important role of encyclopedias, we suggest the continuation and deepening of algorithm audits, such as the one presented here, in order to understand the ongoing epistemological shifts.

Problem

• Compares authority foundations in AI vs human encyclopedias
• Analyzes citation networks to map epistemic profiles of knowledge
• Examines how AI restructures knowledge sourcing and justification

Innovation

• AI encyclopedia uses different citation sources than Wikipedia
• Epistemic profiles vary by topic in AI-generated content
• AI shows linear scaling law for citation density