Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory
This study addresses the challenge of managing long-range spatial context caused by growing memory sequences in long-video world models. To this end, it proposes SMI, the first framework that leverages understanding models to systematically manage spatial memory. Specifically, SMI pioneers the integration of the spatial reasoning capabilities of multimodal large language models into world model memory management. It achieves efficient memory optimization through four synergistic atomic operations: spatial clustering, intra-cluster sparsification, action-aware retrieval, and reliability filtering. Experimental results demonstrate that SMI significantly improves memory sparsity, generation stability, and spatial consistency across multiple benchmarks and backbone architectures.