Improving Graph Neural Network Training Efficiency By Using Top Non-Robust Samples In The Training Set

๐Ÿ“… 2024-12-19
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
Graph neural networks (GNNs) suffer from degraded training efficiency and generalization performance due to noise in graph topology and node features. To address this, we propose a model-sensitivity-based framework for identifying and actively selecting non-robust samplesโ€”marking the first work to quantify sample-level non-robustness as a principled criterion for constructing training subsets. Our method integrates gradient sensitivity analysis, localized perturbation assessment, and a Top-k sampling strategy, enabling seamless integration into standard GNN training pipelines (e.g., GCN, GAT) without architectural modifications. Evaluated on multiple benchmark graph datasets, our approach accelerates training by 23%โ€“37%, improves average classification accuracy by 1.8%, and achieves significantly superior robustness compared to state-of-the-art baselines.

Technology Category

Machine Learning: Graph-based Machine LearningNatural Language Processing: Safety and RobustnessComputer Vision: Adversarial Attacks & Robustness

Application Category

Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphsWeb Mining and Content Analysis: Robustness and generalizability of Web mining methodsSemantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
๐Ÿ“ Abstract
Graph Neural Networks (GNNs) are a highly effective neural network architecture for processing graph-structured data. Unlike traditional neural networks that rely solely on the features of the data as input, GNNs leverage both the graph structure, which represents the relationships between data points, and the feature matrix of the data to optimize their feature representation. This unique capability enables GNNs to achieve superior performance across various tasks. However, it also makes GNNs more susceptible to noise from both the graph structure and the data features, which can significantly degrade their performance in common tasks such as classification and prediction. To address this issue, this paper proposes a novel method for constructing training sets by identifying training samples that are particularly sensitive to noise for a given model. These samples are then used to enhance the model's ability to handle noise-prone instances effectively. Experimental results demonstrate that this approach can significantly improve training efficiency.
Problem

Research questions and friction points this paper is trying to address.

Graph Neural Networks
Robustness
Error Sensitivity
Innovation

Methods, ideas, or system contributions that make the work stand out.

Graph Neural Networks
Robustness Enhancement
Unstable Instance Learning
๐Ÿ”Ž Similar Papers
No similar papers found.
๐Ÿ’ผ Related Jobs
No related jobs found.
JD Logistics
Y
Yongyu Wang
JD Logistics, Beijing 101111, China