Resolution-Flexible Decoding for Hybrid Neural Video Representations

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种分辨率灵活的解码框架,用于解决混合神经视频表示在高分辨率视频中因上采样因子大而不均匀导致的问题。
📝 Abstract
Neural video representations (NVRs) represent videos using neural network parameters and, in hybrid formulations, frame-wise latent embeddings. Although hybrid NVRs can improve reconstruction quality by using content-adaptive latent embeddings, their latent spatial sizes and decoder upsampling schedules are tied to the target frame resolution. For high-resolution videos, this dependency may require large and non-uniform upsampling factors and can affect the parameter allocation between the latent embeddings and the decoder. In this paper, we propose a resolution-flexible decoder framework for hybrid NVRs. The decoder is constructed from uniform \(2\times\) upsampling stages, whose target feature sizes are obtained by tracing the spatial resolution backward from the final output resolution. After each upsampling stage, the feature map is aligned with the target size by minimal padding or cropping when necessary. To support this progressive decoding process, we further use intermediate reconstruction supervision and a reconstruction-difficulty-aware frame sampling strategy based on recent frame-wise losses. The framework preserves the basic representation format of hybrid NVRs and can therefore be applied to different backbones. Experiments on the UVG dataset show that the proposed approach improves reconstruction quality over the corresponding NVR baselines.
Problem

Research questions and friction points this paper is trying to address.

Neural Video Representations
Hybrid NVRs
Resolution Dependency
Upsampling Factors
Parameter Allocation
Innovation

Methods, ideas, or system contributions that make the work stand out.

resolution-flexible decoding
uniform upsampling stages
intermediate reconstruction supervision
reconstruction-difficulty-aware frame sampling
T
Taiga Hayami
Graduate School of FSE, Waseda University, Tokyo, Japan
M
Masaya Takabe
Graduate School of FSE, Waseda University, Tokyo, Japan
H
Hiroshi Watanabe
Graduate School of FSE, Waseda University, Tokyo, Japan