Deep Learning Network-Temporal Models For Traffic Prediction

๐Ÿ“… 2026-03-11
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
Existing statistical and shallow machine learning approaches struggle to effectively model the complex spatiotemporal dependencies inherent in multivariate network traffic. To address this limitation, this work proposes two deep learning methodologies: first, a tailored graph attention network (GAT) that jointly captures topological structure and temporal dynamics; and second, a novel framework that integrates clustering-based preprocessing with fine-tuned multimodal large language models (LLMs) for traffic forecastingโ€”an approach not previously explored in this domain. Experimental results on real-world datasets demonstrate that the LLM-based method achieves superior overall accuracy and generalization performance, while the GAT significantly reduces prediction variance across diverse sequences and time horizons, thereby overcoming key constraints of conventional time-series models.

Technology Category

Machine Learning: Large Multimodal Models (LMMs)Planning, Routing, and Scheduling: Optimization of Spatio-temporal SystemsData Mining & Knowledge Management: Mining of Spatial, Temporal or Spatio-Temporal Data

Application Category

Graph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphsSemantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMsWeb Mining and Content Analysis: Large pretrained models with web data
๐Ÿ“ Abstract
Time series analysis is critical for emerging net- work intelligent control and management functions. However, existing statistical-based and shallow machine learning models have shown limited prediction capabilities on multivariate time series. The intricate topological interdependency and complex temporal patterns in network data demand new model approaches. In this paper, based on a systematic multivariate time series model study, we present two deep learning models aiming for learning both temporal patterns and network topological correlations at the same time: a customized network-temporal graph attention network (GAT) model and a fine-tuned multi-modal large language model (LLM) with a clustering overture. Both models are studied against an LSTM model that already outperforms the statistical methods. Through extensive training and performance studies on a real-world network dataset, the LLM-based model demonstrates superior overall prediction and generalization performance, while the GAT model shows its strength in reducing prediction variance across the time series and horizons. More detailed analysis also reveals important insights into correlation variability and prediction distribution discrepancies over time series and different prediction horizons.
Problem

Research questions and friction points this paper is trying to address.

traffic prediction
multivariate time series
network topology
temporal patterns
deep learning
Innovation

Methods, ideas, or system contributions that make the work stand out.

graph attention network
large language model
multivariate time series
network topology
temporal modeling
๐Ÿ”Ž Similar Papers
No similar papers found.
Y
Yufeng Xin
RENCI, University of North Carolina at Chapel Hill
E
Ethan Fan
RENCI, University of North Carolina at Chapel Hill