Inferring the Graph Structure of Images for Graph Neural Networks

📅 2025-09-04
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
Graph neural networks (GNNs) for image data are typically constrained by predefined topologies—e.g., regular grids or hand-crafted superpixels—that fail to capture semantically meaningful pixel relationships. To address this, we propose a data-driven dynamic graph construction method based on pixel intensity correlations: specifically, intra-row, intra-column, and row–column cross-product correlations. This approach yields adaptive, semantically informed graph structures that jointly model local and global pixel dependencies without relying on manually designed topologies. We evaluate our method on MNIST and Fashion-MNIST using representative GNN architectures—including Graph CNN, GAT, and GatedGCN—and demonstrate consistent improvements in classification accuracy. Our learned graph structures outperform conventional grid-based and superpixel-based baselines by an average of 1.2–2.8 percentage points, confirming that data-adaptive graph construction significantly enhances the representational capacity of image GNNs.

Technology Category

Machine Learning: Graph-based Machine LearningComputer Vision: Generative Adversarial Networks (GANs) for VisionData Mining & Knowledge Management: Graph Mining, Social Network Analysis & Community

Application Category

Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphsSemantics and Knowledge: Scalable techniques for the creation, curation, publication, maintenance, and consumption of large, Web-based, structured, reusable, knowledge graphs and ontologiesWeb Mining and Content Analysis: Large pretrained models with web data
📝 Abstract
Image datasets such as MNIST are a key benchmark for testing Graph Neural Network (GNN) architectures. The images are traditionally represented as a grid graph with each node representing a pixel and edges connecting neighboring pixels (vertically and horizontally). The graph signal is the values (intensities) of each pixel in the image. The graphs are commonly used as input to graph neural networks (e.g., Graph Convolutional Neural Networks (Graph CNNs) [1, 2], Graph Attention Networks (GAT) [3], GatedGCN [4]) to classify the images. In this work, we improve the accuracy of downstream graph neural network tasks by finding alternative graphs to the grid graph and superpixel methods to represent the dataset images, following the approach in [5, 6]. We find row correlation, column correlation, and product graphs for each image in MNIST and Fashion-MNIST using correlations between the pixel values building on the method in [5, 6]. Experiments show that using these different graph representations and features as input into downstream GNN models improves the accuracy over using the traditional grid graph and superpixel methods in the literature.
Problem

Research questions and friction points this paper is trying to address.

Inferring optimal graph structures from image datasets
Improving GNN accuracy by finding alternative graph representations
Exploring pixel correlation methods for enhanced image classification
Innovation

Methods, ideas, or system contributions that make the work stand out.

Alternative graph representations for images
Correlation-based graph construction methods
Improved GNN accuracy with new graphs
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
M
Mayur S Gowda
Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA
John Shi
John Shi
Unknown affiliation
A
Augusto Santos
Instituto de Telecomunicacões-IT, Lisbon, Portugal
J
José M. F. Moura
Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA