When Language Models Lose Their Mind: The Consequences of Brain Misalignment

2026-03-24

AI Summary

This study investigates the functional role of brain alignment in enhancing the linguistic capabilities of large language models, moving beyond its conventional use as a cognitive modeling tool. To this end, we introduce the first “brain-mismatched” models—architectures deliberately designed to degrade their ability to predict neural activity while preserving core language modeling performance—and systematically compare them against brain-aligned counterparts across more than 200 tasks spanning semantics, syntax, discourse, reasoning, and morphology. Our results demonstrate that impairing brain alignment significantly degrades downstream language task performance, revealing that alignment with human neural representations provides an independent and critical contribution to robust and efficient language understanding. This finding underscores a deep functional link between neurocognitive mechanisms and computational language processing.

Technology Category

• Natural Language Processing: (Large) Language Models
• Machine Learning: Large Multimodal Models (LMMs)
• Cognitive Modeling & Cognitive Systems: (Computational) Cognitive Architectures

Application Category

• Search and Retrieval-Augmented AI: Large language models for search
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation

Abstract

While brain-aligned large language models (LLMs) have garnered attention for their potential as cognitive models and for potential for enhanced safety and trustworthiness in AI, the role of this brain alignment for linguistic competence remains uncertain. In this work, we investigate the functional implications of brain alignment by introducing brain-misaligned models--LLMs intentionally trained to predict brain activity poorly while maintaining high language modeling performance. We evaluate these models on over 200 downstream tasks encompassing diverse linguistic domains, including semantics, syntax, discourse, reasoning, and morphology. By comparing brain-misaligned models with well-matched brain-aligned counterparts, we isolate the specific impact of brain alignment on language understanding. Our experiments reveal that brain misalignment substantially impairs downstream performance, highlighting the critical role of brain alignment in achieving robust linguistic competence. These findings underscore the importance of brain alignment in LLMs and offer novel insights into the relationship between neural representations and linguistic processing.

Problem

• brain alignment
• large language models
• linguistic competence
• brain-misaligned models
• language understanding

Innovation

• brain alignment
• brain-misaligned models
• linguistic competence
• neural representations
• large language models