SENDAI: A Hierarchical Sparse-measurement, EfficieNt Data AssImilation Framework

2026-01-29

AI Summary

This study addresses the challenge of spatiotemporal field reconstruction under extremely sparse observations, distributional shifts, and coexisting multi-scale dynamics. The authors propose a hierarchical, efficient data assimilation framework that innovatively integrates physics-based simulation priors with a learnable bias-correction module. By leveraging multi-scale feature fusion and a hierarchical assimilation architecture, the method effectively preserves structural fidelity even under ultra-sparse observational conditions, demonstrating particular robustness in complex boundary settings and scenarios involving distributional shifts. Evaluated on MODIS vegetation index reconstruction, the approach achieves up to a 185% improvement in SSIM over conventional methods and a 36% gain over recent high-frequency approaches, significantly retaining critical structural information such as terrain and land cover patterns.

Technology Category

• Computer Vision: Multi-modal Vision
• Intelligent Robots: State Estimation
• Machine Learning: Feature Construction/Reformulation

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Graph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphs
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications

Abstract

Bridging the gap between data-rich training regimes and observation-sparse deployment conditions remains a central challenge in spatiotemporal field reconstruction, particularly when target domains exhibit distributional shifts, heterogeneous structure, and multi-scale dynamics absent from available training data. We present SENDAI, a hierarchical Sparse-measurement, EfficieNt Data AssImilation Framework that reconstructs full spatial states from hyper sparse sensor observations by combining simulation-derived priors with learned discrepancy corrections. We demonstrate the performance on satellite remote sensing, reconstructing MODIS (Moderate Resolution Imaging Spectroradiometer) derived vegetation index fields across six globally distributed sites. Using seasonal periods as a proxy for domain shift, the framework consistently outperforms established baselines that require substantially denser observations -- SENDAI achieves a maximum SSIM improvement of 185% over traditional baselines and a 36% improvement over recent high-frequency-based methods. These gains are particularly pronounced for landscapes with sharp boundaries and sub-seasonal dynamics; more importantly, the framework effectively preserves diagnostically relevant structures -- such as field topologies, land cover discontinuities, and spatial gradients. By yielding corrections that are more structurally and spectrally separable, the reconstructed fields are better suited for downstream inference of indirectly observed variables. The results therefore highlight a lightweight and operationally viable framework for sparse-measurement reconstruction that is applicable to physically grounded inference, resource-limited deployment, and real-time monitor and control.

Problem

• spatiotemporal field reconstruction
• sparse measurements
• distributional shift
• multi-scale dynamics
• heterogeneous structure

Innovation

• hierarchical data assimilation
• sparse measurement reconstruction
• simulation-informed learning
• spatiotemporal field reconstruction
• domain shift robustness