QoS-Aware Federated Learning for Multimodal In-Cabin Interaction in Smart Vehicles

2026-09-17

AI Summary

为解决智能车辆中多模态融合与协作训练受QoS限制问题，提出FedQoS框架，通过异步事件触发机制优化本地计算与全局通信，有效减少QoS违规、降低通信开销和延迟。

Abstract

Modern smart vehicles leverage multimodal sensors, ranging from high-bandwidth vision systems to low-rate physiological monitors, to provide personalized in-cabin services. However, integrating high-fidelity multimodal fusion with collaborative training is often hindered by the heterogeneous and time-varying Quality of Service (QoS) constraints of vehicular networks. Standard Federated Learning (FL) approaches enforce rigid synchronous rounds that fail to account for these resource asymmetries, leading to safety-critical timing violations and energy exhaustion. In this paper, we propose FedQoS, a novel asynchronous, event-triggered FL framework that decouples local computation from global communication via a two-phase gating mechanism. First, we introduce a resource-aware training gate that initializes local learning only when sensing buffers and energy reserves meet safety thresholds, preventing ML tasks from compromising core vehicle mobility. Second, a QoS-aware transmission policy gates uplink updates based on an efficiency score that balances model novelty against instantaneous latency and energy costs. Locally, clients optimize an objective featuring a staleness-aware proximal term that dynamically adjusts the global anchor strength based on update age. Extensive experiments on multimodal vehicular datasets demonstrate that FedQoS achieves competitive personalized accuracy with only marginal performance loss compared to FedAvg, while substantially reducing QoS violations, cutting communication overhead by 76.7\%, and lowering latency cost by 26.0\%, demonstrating a highly favorable accuracy and efficiency balance for real-world vehicular deployments.

Problem

• QoS
• Federated Learning
• Multimodal Interaction
• Smart Vehicles
• Resource Asymmetries

Innovation

• asynchronous federated learning
• event-triggered FL
• QoS-aware transmission policy
• resource-aware training gate
• staleness-aware proximal term