MinerU.Chem: A High-Precision System for Optical Chemical Structure and Reaction Recognition

📅 2026-08-04
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the challenge of accurately extracting molecular structures and reaction schemes from organic chemistry literature, a task that general-purpose document parsing systems struggle with, thereby hindering AI-driven chemical research. Building upon the MinerU framework, the authors propose CARBON—a novel representation scheme—and integrate five specialized modules for chemical relevance filtering, molecular detection, identifier extraction, and reaction diagram parsing to enable end-to-end, high-precision conversion of chemical images into standard formats such as SMILES and MolFile. Evaluated on the MolRecBench-Wild dataset, the method achieves a SMILES exact-match accuracy of 93.02%, substantially outperforming the previous state-of-the-art approach (74.87%). The system is now publicly available as part of the MinerU platform.
📝 Abstract
In organic chemistry papers and patents, molecular structures, reaction schemes, and experimental conditions are often presented as molecular structure depictions, reaction diagrams, and complex tables or figures. Such information is difficult for general-purpose document parsing systems to directly convert into machine-readable data. This limits data production for organic chemistry knowledge base construction and for AI for Chemistry tasks such as reaction prediction, retrosynthesis, condition recommendation, molecular property prediction, and drug molecule design. This report introduces MinerU.Chem, a document parsing system for organic chemistry literature integrated into the MinerU online platform. Built on top of MinerU's general document parsing pipeline, MinerU.Chem adds five chemistry-specific modules: chemistry relevance filtering, molecular structure detection, molecule identifier extraction, molecular structure recognition, and reaction scheme parsing. Together, these modules convert organic-chemistry-related image regions in documents into a Molecule Summary List and a Reaction Summary List. For molecular structure recognition, MinerU.Chem uses CARBON (Complex Atomic Representation and Bonding Object Notation) as its core representation. CARBON enables recognition results to preserve both the visual layout of the original image and complex chemical semantics, while supporting the export of standard downstream formats such as MolFile and SMILES. On the SMILES-evaluable subset of MolRecBench-Wild (N=2,392), MinerU.Chem's molecular structure recognition module achieves a SMILES exact-match accuracy of 93.02%, outperforming the best evaluated comparison system, GPT-5.6-Sol (74.87%), by 18.15 percentage points. The system has been integrated into the MinerU online platform and is available at https://mineru.net/OpenSourceTools/Extractor .
Problem

Research questions and friction points this paper is trying to address.

optical chemical structure recognition
reaction scheme parsing
document parsing
machine-readable chemical data
chemistry knowledge base
Innovation

Methods, ideas, or system contributions that make the work stand out.

CARBON
molecular structure recognition
reaction scheme parsing
chemistry-specific document parsing
SMILES accuracy
Haote Yang
Haote Yang
PJLab
CVLLMMLLMAI4S
Jiang Wu
Jiang Wu
Shanghai Artificial Intelligence Laboratory
large language modelvision language model
Jingchao Wang
Jingchao Wang
East China Normal University
AI
Xingjian Wei
Xingjian Wei
shanghai AI lab
data-centric-aiLLMVLMEngineer
L
Lixin Ma
Tongji University
L
Linye Li
Fudan University
C
Chen Zhu
East China University of Science and Technology
Xiaolong Wu
Xiaolong Wu
Georgia Institute of Technology
SLAMLocalizationRobotics
Yuheng Lu
Yuheng Lu
Peking University
3D Computer Vision
Z
Ziran Zhu
Shanghai Artificial Intelligence Laboratory
J
Junyuan Gao
Shanghai Artificial Intelligence Laboratory
L
Lingli Ge
Shanghai Jiao Tong University
Y
Yuan Xu
Jilin University
H
Huijie Ao
Fudan University
Q
QianQian Wu
Shanghai Artificial Intelligence Laboratory
D
Dechen Lin
Shanghai Artificial Intelligence Laboratory
H
Huaiyu Gu
Shanghai Artificial Intelligence Laboratory
L
Lu Chen
Shanghai Artificial Intelligence Laboratory
S
Shengxin Lu
Shanghai Artificial Intelligence Laboratory
S
ShaSha Wang
Shanghai Artificial Intelligence Laboratory
Y
Yuanyuan Cao
Shanghai Artificial Intelligence Laboratory
Z
Zhejia Yu
Shanghai Artificial Intelligence Laboratory
R
Ruijie Zhang
Shanghai Artificial Intelligence Laboratory
Z
Zimai Tian
Shanghai Artificial Intelligence Laboratory
J
Jiaxing Sun
Shanghai Artificial Intelligence Laboratory