ChartRevive: Reconstructing Data Visualizations from Chart Images Using MLLM

📅 2026-09-22
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
为解决图表图像中数据和视觉设计难以复用的问题,研究通过评估多种多模态大语言模型,采用GPT-5.4作为基础,开发了ChartRevive系统以辅助用户高效校验与修正重建的图表。
📝 Abstract
Static chart images are widely used in scientific publications, business reports, and presentations, yet recovering both the underlying data and visual design from chart images remains a labor-intensive manual process, making them difficult to reuse. While prior work has primarily focused on data extraction, the extraction of visual design specifications, including colors, marker shapes, and axis configurations, remains underexplored. To identify a suitable model for chart reconstruction, we systematically benchmark five multimodal large language models (MLLMs) across five basic chart types on both data and design extraction tasks. Our evaluation shows that textual and categorical information can generally be extracted reliably, whereas numeric and spatial information remain challenging. Among the evaluated models, GPT-5.4 achieves the best overall performance and is adopted as the backbone of our system. Guided by these findings, we present ChartRevive, a mixed-initiative system that combines MLLM-based extraction with an interactive verification interface, supporting users to efficiently inspect, correct, and refine reconstructed charts through overlay-based verification and real-time rebuilding.
Problem

Research questions and friction points this paper is trying to address.

chart images
data extraction
visual design specifications
Innovation

Methods, ideas, or system contributions that make the work stand out.

multimodal large language models
visual design extraction
interactive verification
🔎 Similar Papers
No similar papers found.
Y
Yuki Ueno
Arizona State University
A
Aditeya Pandey
Eli Lilly and Company