🤖 AI Summary
This study addresses the degradation of semantic coherence in retrieval indexing caused by fragmentation of structured documents. To mitigate this issue, the authors propose a parser-agnostic pipeline that constructs semantically coherent “evidence units” by aggregating visual elements—such as figures and tables—with their surrounding textual context into unified retrieval blocks. The approach integrates ontology-driven role normalization, a global semantic allocation algorithm, and a graph-based decision-layer verification mechanism. It leverages an extended DoCO ontology, an optimized full similarity matrix, and Neo4j-based rule modeling to ensure compatibility with mainstream parsers like MinerU and Docling. Evaluated on OmniDocBench v1.0, the method achieves a 0.31 improvement in LCS, increases Recall@1 from 0.15 to 0.51 (a 3.4× gain), attains a Recall@1 of 0.47 for text queries, and demonstrates consistent performance across different document parsers.
📝 Abstract
Structured documents--tables paired with captions, figures with explanations, equations with the paragraphs that interpret them--are routinely fragmented when indexed for retrieval. Element-level indexing treats every parsed element as an independent chunk, scattering semantically cohesive units across separate retrieval candidates. This paper presents a parser-independent pipeline that constructs Evidence Units (EUs): semantically complete document chunks that group visual assets with their contextual text. We introduce four contributions: (1) ontology-grounded role normalization extending DoCO that maps heterogeneous parser outputs to a unified semantic schema; (2) a semantic global assignment algorithm that optimally assigns paragraphs to EUs via a full similarity matrix; (3) a graph-based decision layer in Neo4j that formalizes EU construction rules and validates completeness through two invariants; and (4) cross-parser validation showing EU spatial footprints converge across MinerU and Docling, with gains preserved under parser-induced bbox variance. Experiments on OmniDocBench v1.0 (1,340 pages; 1,551 QA pairs) show EU-based chunking improves retrieval LCS by +0.31 (0.50 to 0.81). Recall@1 increases from 0.15 to 0.51 (3.4x) and MinK decreases from 2.58 to 1.72. Cross-parser results confirm the gain (LCS +0.23 to +0.31) is preserved across parsers. Text queries show the most dramatic gain: Recall@1 rises from 0.08 to 0.47.