Lapras: Latent Reasoning for Time Series Language Models

📅 2026-10-07
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the error propagation and inefficiency in explicit chain-of-thought (CoT) reasoning for temporal language models caused by discrete textual descriptions. To this end, it proposes Lapras, a framework that pioneers the transformation of CoT into latent continuous-state reasoning. This enables the model to perform intermediate thinking within a joint temporal-linguistic space while outputting only the final answer. Furthermore, teacher-student self-distillation is introduced to align hidden layers, thereby facilitating continuous thought modeling. Experimental results demonstrate that Lapras achieves an average F1 improvement of 10.79% and reduces generated tokens by 23.9×. Notably, the latent representations remain decodable into human-readable reasoning trajectories, effectively balancing computational efficiency with interpretability.
📝 Abstract
Time Series Language Models (TSLMs) offer a promising path toward time series understanding by reasoning over temporal signals and producing natural language answers and explanations. A common approach is Chain-of-Thought (CoT), which generates step-by-step rationales linking relevant signal patterns to final answers. Although these models learn from reference CoT traces during post-training, generating faithful descriptions of input time series at inference remains challenging. Expressing high-dimensional, continuous temporal representations in discrete language tokens may cause the model to neglect task-relevant patterns or describe them inaccurately. Because later reasoning steps build on these descriptions, early errors propagate, leading to incorrect answers with plausible explanations that are inconsistent with the input signal. We propose Lapras (Latent Post-trained Reasoning Across Series), a post-training framework that equips TSLMs with latent reasoning. A model trained with Lapras reasons through a sequence of continuous thoughts in the joint time series-language space, producing text only for the final answer. It learns this through teacher-student self-distillation, where a teacher trained on CoT reference traces reasons explicitly through text. The student aligns its hidden states with the teacher's at the answer stage, transferring the teacher's reasoning ability into its latent computation. We evaluate Lapras across four TSLM backbones on five time series question answering benchmarks. Lapras improves average F1 by up to 10.79% over explicit CoT while generating 23.9x fewer tokens. Lapras's continuous thoughts can also be decoded into readable reasoning traces via standard language decoding, preserving textual explanations. Together, these results highlight Lapras as a promising post-training paradigm for efficient, effective, and interpretable TSLM reasoning.
Problem

Research questions and friction points this paper is trying to address.

Time Series Language Models
Chain-of-Thought
error propagation
latent reasoning
discrete language tokens
Innovation

Methods, ideas, or system contributions that make the work stand out.

Latent Reasoning
Time Series Language Models
Self-Distillation
Chain-of-Thought
Continuous Thoughts
Yuliang Chen
Yuliang Chen
University of California, San Diego
Self-Supervised LearningMultimodal Learning
Y
Yu Yvonne Wu
Dartmouth College
P
Patrick Langer
Aionic Labs, Agentic Systems Lab, ETH Zurich, Stanford University
A
Arvind Pillai
Dartmouth College
Sudarshan Regmi
Sudarshan Regmi
Dartmouth College
Machine Learning
Martin Maritsch
Martin Maritsch
Machine Learning Engineer, Amazon Web Services (AWS)
Generative AIMachine LearningDigital Health
J
Juncheng Liu
National University of Singapore
R
Robert Jakob
Aionic Labs, Agentic Systems Lab, ETH Zurich
T
Thomas Kaar
Aionic Labs, Agentic Systems Lab, ETH Zurich, Stanford University
T
Tess Z. Griffin
Dartmouth College
Lisa Marsch
Lisa Marsch
Dartmouth College
M
Michael V. Heinz
Dartmouth College
Nicholas C. Jacobson
Nicholas C. Jacobson
Dartmouth College
Digital PhenotypingDigital InterventionsArtificial IntelligenceMental HealthChatbots
A
Andrew Campbell
Dartmouth College