🤖 AI Summary
This work addresses the longstanding challenge of effectively parsing high-dimensional data from parallel coordinate plots. We propose the first deep learning framework specifically designed for data extraction from parallel coordinates, leveraging a tailored neural network architecture to end-to-end recover line coordinates and reconstruct original data samples directly from images. To support this endeavor, we introduce the first large-scale dataset of parallel coordinate visualizations and demonstrate precise parsing of densely packed, high-dimensional line structures. Experimental results show that our method significantly outperforms general-purpose baselines, achieving, for the first time, accurate and fully automatic reconstruction of individual data samples from parallel coordinate plots. This advance marks a significant step toward deeper integration between visualization and computer vision.
📝 Abstract
Extracting data from visualizations has long challenged computer vision, with current research focused on bar, line, and pie charts, among other low-dimensional visualizations. However, parallel coordinates as a widely used high-dimensional data visualization approach, remain largely unexplored in this context. As parallel coordinate plots can quickly become cluttered and difficult to interpret when poorly designed or densely populated, automated data extraction from such visualizations is of particular interest. In this paper, we propose PaCoNet, the first approach for parallel coordinate data extraction. PaCoNet not only extracts line coordinates, but also enables the extraction of individual data samples for further analysis. Towards this end, we make the following contributions. We present the first deep learning approach tailored for parallel coordinate analysis, and demonstrate that it outperforms unadapted baselines by a significant margin. We further introduce a large-scale parallel coordinate dataset for training and testing. Together, these key contributions enable for the first time the automated analysis and redesign of parallel coordinate plots. PaCoNet thus lays the groundwork for complex visualization analysis, and further advances the intersection of computer vision and data visualization. All code, trained models, and data generation scripts will be made publicly available upon acceptance of the paper.