Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimation

📅 2026-01-11
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the degraded performance of conventional filtering methods in joint state and parameter estimation for nonlinear systems subject to non-Gaussian, multimodal uncertainties. To this end, we propose a forward–backward estimation framework based on conditional normalizing flows. Conditional embeddings are generated using MLPs, Transformers, or Mamba-SSMs, and their efficacy is systematically evaluated for the first time in time-reversal and sequential prediction tasks. Furthermore, we introduce a kinetic-energy regularization term derived from optimal transport theory to mitigate over-parameterization and enhance training stability in deep flow models. Empirical evaluations on real-world scenarios—including autonomous driving and a COVID-19 SIR epidemiological model—demonstrate that the proposed method significantly outperforms traditional filters, achieving notably higher estimation accuracy under complex, non-Gaussian uncertainty distributions.

Technology Category

Intelligent Robots: State EstimationReasoning under Uncertainty: Relational Probabilistic ModelsMachine Learning: Deep Generative Models & Autoencoders

Application Category

Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAGUser Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendationSemantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
📝 Abstract
Traditional filtering algorithms for state estimation -- such as classical Kalman filtering, unscented Kalman filtering, and particle filters - show performance degradation when applied to nonlinear systems whose uncertainty follows arbitrary non-Gaussian, and potentially multi-modal distributions. This study reviews recent approaches to state estimation via nonlinear filtering based on conditional normalizing flows, where the conditional embedding is generated by standard MLP architectures, transformers or selective state-space models (like Mamba-SSM). In addition, we test the effectiveness of an optimal-transport-inspired kinetic loss term in mitigating overparameterization in flows consisting of a large collection of transformations. We investigate the performance of these approaches on applications relevant to autonomous driving and patient population dynamics, paying special attention to how they handle time inversion and chained predictions. Finally, we assess the performance of various conditioning strategies for an application to real-world COVID-19 joint SIR system forecasting and parameter estimation.
Problem

Research questions and friction points this paper is trying to address.

state estimation
nonlinear systems
non-Gaussian uncertainty
parameter estimation
joint estimation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Conditional Normalizing Flows
Nonlinear Filtering
Optimal Transport
State and Parameter Estimation
Mamba-SSM
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
L
Luke S. Lagunowich
Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN, 46556, USA
G
Guoxiang Grayson Tong
Department of Pediatrics, Stanford University, Stanford, CA, 94305, USA
D
Daniele E. Schiavazzi
Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, IN, 46556, USA