MSR: Multiple Subject Reference for Video Generation

📅 2026-09-16
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
本文提出MSR方法,通过为每个参考图像分配独立的潜在标记组,并使用时隙感知条件方案来解决视频生成中多图像条件下的外观保持问题。
📝 Abstract
Conditioning a video generator on multiple images requires preserving appearance while associating each reference with its intended role. We present MSR (Multiple Subject Reference), a slot-aware conditioning scheme for LTX-based video generation. Each reference image is independently encoded as a static clip and represented by a separate latent-token group. A compact Fourier-feature multilayer perceptron adds a numeric slot embedding, while slot-dependent temporal offsets modify the group's rotary coordinates. The reference groups are prepended to noisy target tokens and serve as clean context during target-only flow-matching training. We implement this scheme through low-rank adaptation and release the resulting weights and inference workflows. Qualitative examples demonstrate compositions containing distinct characters and referenced environments in realistic and stylized scenes. Development observations suggest reduced reference confusion relative to an earlier continuous-reference baseline, while similar clothing, complex garments, and viewpoint changes remain challenging. We describe the conditioning mechanism, the retained training configuration, and the observed strengths and limitations of the released system. A supplementary audio-reference experiment adds voice conditioning while keeping the visual parameters frozen.
Problem

Research questions and friction points this paper is trying to address.

video generation
multiple images
appearance preservation
role association
Innovation

Methods, ideas, or system contributions that make the work stand out.

Multiple Subject Reference
slot-aware conditioning
Fourier-feature multilayer perceptron
temporal offsets
rotary coordinates
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
G
Guannan Li
Licon Studio
J
Jiaji Chen
Licon Studio
J
Jingyuan Liao
Licon Studio
Y
Yu Geng
Licon Studio
B
Baolan Qiu
Licon Studio