PaperMentor: A Human-Centered Multi-Agent Writing Tutor for AI Research Papers on Overleaf

📅 2026-06-07
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the longstanding challenge that early-career researchers often lack access to high-quality, actionable feedback on academic writing, as existing AI tools typically offer only grammatical corrections or generic evaluations. To bridge this gap, the authors propose a human-centered, multi-agent writing coaching system natively integrated into Overleaf, which delivers fine-grained, context-aware revision suggestions directly as inline comments while preserving full author control. The system combines an expert-curated knowledge base—constructed by experienced researchers—with twelve specialized agents, each targeting distinct dimensions of scholarly writing, and leverages natural language processing for seamless integration. User studies demonstrate that 90.6% of the generated comments are rated as actionable and 67.5% as effective, significantly outperforming a GPT-5.2 baseline without the expert skill repository. The implementation is publicly released.
📝 Abstract
Expert writing feedback from experienced researchers is critical for early-career scholars to improve their manuscripts, yet high-quality feedback often remains scarce because reviewing research papers is labor-intensive. Emerging AI-powered writing assistants largely focus on grammar fixes or simulating peer review with final scores, yet they fall short of providing concrete, actionable suggestions that help students improve their papers during drafting. We present PaperMentor, a human-centered writing assistant system that delivers actionable suggestions as Overleaf-native inline comments while leaving the actual writing entirely to human authors. PaperMentor integrates an expert skill library carefully curated from established researchers' writing advice with 12 specialized agents covering different aspects of paper writing, such as formatting compliance, phrasing accuracy, and terminology consistency. In a user study (n=14), 90.6% of the generated comments were rated actionable and 67.5% were rated valid, significantly outperforming a GPT-5.2 baseline uswithout the skill library. We release PaperMentor as open source for public use. Our code is publicly available under the AGPL-3.0 license at https://github.com/jiarui-liu/overleaf
Problem

Research questions and friction points this paper is trying to address.

writing feedback
research papers
actionable suggestions
AI writing assistant
early-career scholars
Innovation

Methods, ideas, or system contributions that make the work stand out.

multi-agent system
expert skill library
actionable feedback
AI writing assistant
Overleaf integration
Jiarui Liu
Jiarui Liu
Carnegie Mellon University
Natural Language Processing
Terry Jingchen Zhang
Terry Jingchen Zhang
ETH Zurich
(Multimodal) ReasoningAI SafetyActionable InterpretabilityAI4ScienceAstrophysics
Ryan Faulkner
Ryan Faulkner
Research Engineer, Google DeepMind
Machine LearningDeep LearningReinforcement Learning
X
X. Angelo Huang
Jinesis Lab, University of Toronto & Vector Institute
Vilém Zouhar
Vilém Zouhar
PhD, ETH Zürich
Natural Language ProcessingQuality EstimationMachine Translation
D
Dominik Glandorf
EPFL
I
Isabel Dahlgren
Jinesis Lab, University of Toronto & Vector Institute
V
Van Q. Truong
Jinesis Lab, University of Toronto & Vector Institute
Rishit Dagli
Rishit Dagli
University of Toronto, NVIDIA
Machine LearningComputer Vision
Yuen Chen
Yuen Chen
University of Illinois at Urbana-Champaign
Machine LearningCausalityTrustworthy ML
Felix Leeb
Felix Leeb
Max Planck Institute for Intelligent Systems
structured representation learningcausal reasoning
P
Punya Syon Pandey
Jinesis Lab, University of Toronto & Vector Institute
Y
Yves Bicker
Jinesis Lab, University of Toronto & Vector Institute
S
Suvajit Majumder
Jinesis Lab, University of Toronto & Vector Institute
W
Wenyuan Jiang
ETHZ
Zeju Qiu
Zeju Qiu
PhD Student at Max Planck Institute for Intelligent Systems and IMPRS-IS
Machine LearningComputer Vision
Sankalan Pal Chowdhury
Sankalan Pal Chowdhury
Doctoral Student, ETH Zurich
NLPEducation
Bernhard Schölkopf
Bernhard Schölkopf
Director, Max Planck Institute for Intelligent Systems & ELLIS Institute Tübingen; Professor at ETH
Machine LearningCausal InferenceArtificial IntelligenceComputational PhotographyStatistics
Mona Diab
Mona Diab
Professor & Director of Language Technologies Institute, Carnegie Mellon University, ACL Fellow
Responsible AINLP/CLArabic NLPCross lingual/multilingual & Low Resource Lang Processing
Zhijing Jin
Zhijing Jin
Max Planck Institute
Natural Language ProcessingCausal InferenceMachine LearningArtificial IntelligenceLLMs