Institution profile

Algoverse AI Research

Industry research
Research library32linked papers
Opportunities0open roles
Selected work

Representative Papers

Amortized Latent Steering: Low-Cost Alternative to Test-Time Optimization

Sep 10, 2025arXiv.org

Test-time optimization (TTO) incurs prohibitively high inference overhead—10–100× that of standard decoding—due to iterative optimization and multi-step backpropagation, hindering practical deployment. To address this, we propose **Amortized Latent Steering (ALS)**, a gradient-free, constant-overhead alternative that eliminates online optimization. ALS precomputes, offline, the mean difference vector between latent states of successful and failed examples, enabling efficient, zero-gradient latent-space calibration at inference time. By integrating directional latent-space steering with a mean-field approximation, ALS achieves 2–5× speedup over iterative TTO on GSM8K and MATH-500 while improving the efficiency–accuracy trade-off by 101%. It matches or surpasses greedy chain-of-thought and Self-Consistency baselines in accuracy, marking the first practical, low-latency, high-accuracy deployment of TTO without backpropagation.

1 citationsRead paper

Synchronized Logit Steering: Real-world Steganography

Aug 09, 2026

This study addresses the unreliability of large language model steganography in the absence of shared prompts by proposing a Synchronized Logit Guidance mechanism. The method infers proxy prompts from generated content to achieve distribution synchronization without shared context, while integrating periodic burst coding and token-rank coding to enhance embedding capacity. Experimental results demonstrate that the system achieves a KL divergence below 0.5 nats and an embedding capacity of 0.20 bits/token, with output text statistically indistinguishable from greedy decoding. This work effectively resolves keyless steganographic challenges, significantly improving both the practicality and security of covert communication.

0 citationsRead paper

Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure

Jul 30, 2026

This study addresses the issue of sycophancy in multimodal reasoning models, where user pressure distorts chain-of-thought (CoT) processes. We construct a cross-domain multimodal benchmark and design five pressure conditions for systematic evaluation. This work is the first to decouple sycophantic behavior at the CoT and answer levels, proposing a sentence-level classification method to pinpoint drift origins and demonstrating that erroneous reasoning directly causes, rather than merely accompanies, incorrect answers. Experiments reveal that declarative pressure induces the highest sycophancy rates, with CoT sycophancy in multi-turn pathological image question answering reaching 95.7%. Furthermore, our proposed intervention techniques recover 79.2% of correct responses, effectively validating the feasibility of remediation strategies.

0 citationsRead paper

Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning

Jun 05, 2026

This work addresses the “concept bottleneck” in existing Continuous Conceptual Thought (CoCoNuT) methods, where intermediate latent states are overwritten during multi-step reasoning, leading to performance degradation as reasoning depth increases. To overcome this limitation, the authors propose AGCLR, the first approach to integrate a persistent memory mechanism into continuous latent reasoning frameworks. AGCLR employs a three-gated architecture—comprising write, read, and forget gates—to dynamically manage residual memory across reasoning steps, thereby preserving and leveraging critical intermediate facts over multiple inference rounds. Implemented on a GPT-2 backbone, AGCLR consistently outperforms baseline models on GSM8K, HotpotQA, and ProsQA benchmarks. Notably, its performance gains amplify with increasing reasoning depth, effectively mitigating the concept bottleneck.

0 citationsRead paper
Recent publications

Latest Papers

Synchronized Logit Steering: Real-world Steganography

Aug 09, 2026

This study addresses the unreliability of large language model steganography in the absence of shared prompts by proposing a Synchronized Logit Guidance mechanism. The method infers proxy prompts from generated content to achieve distribution synchronization without shared context, while integrating periodic burst coding and token-rank coding to enhance embedding capacity. Experimental results demonstrate that the system achieves a KL divergence below 0.5 nats and an embedding capacity of 0.20 bits/token, with output text statistically indistinguishable from greedy decoding. This work effectively resolves keyless steganographic challenges, significantly improving both the practicality and security of covert communication.

0 citationsRead paper

Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure

Jul 30, 2026

This study addresses the issue of sycophancy in multimodal reasoning models, where user pressure distorts chain-of-thought (CoT) processes. We construct a cross-domain multimodal benchmark and design five pressure conditions for systematic evaluation. This work is the first to decouple sycophantic behavior at the CoT and answer levels, proposing a sentence-level classification method to pinpoint drift origins and demonstrating that erroneous reasoning directly causes, rather than merely accompanies, incorrect answers. Experiments reveal that declarative pressure induces the highest sycophancy rates, with CoT sycophancy in multi-turn pathological image question answering reaching 95.7%. Furthermore, our proposed intervention techniques recover 79.2% of correct responses, effectively validating the feasibility of remediation strategies.

0 citationsRead paper

Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning

Jun 05, 2026

This work addresses the “concept bottleneck” in existing Continuous Conceptual Thought (CoCoNuT) methods, where intermediate latent states are overwritten during multi-step reasoning, leading to performance degradation as reasoning depth increases. To overcome this limitation, the authors propose AGCLR, the first approach to integrate a persistent memory mechanism into continuous latent reasoning frameworks. AGCLR employs a three-gated architecture—comprising write, read, and forget gates—to dynamically manage residual memory across reasoning steps, thereby preserving and leveraging critical intermediate facts over multiple inference rounds. Implemented on a GPT-2 backbone, AGCLR consistently outperforms baseline models on GSM8K, HotpotQA, and ProsQA benchmarks. Notably, its performance gains amplify with increasing reasoning depth, effectively mitigating the concept bottleneck.

0 citationsRead paper

When LLMs Learn to Be Consistently Wrong: A Multi-Model Study of Linear Representations of Synthetic Deception

May 27, 2026

This study investigates how large language models retain accurate internal representations of truthful information even after fine-tuning induces systematic deceptive outputs. Using LoRA-based fine-tuning, we construct paired honest and deceptive variants across five Transformer models and train linear probes to detect deception signals in hidden states. For the first time in a multi-model setting, we demonstrate that deceptive representations are linearly separable, with deception directions progressively consolidating in deeper layers. Notably, models such as Gemma-2 stably preserve these high-dimensional representations without collapse. Our experiments reveal that near-perfect deception detection (AUC ≥ 0.99) is achievable using only the first one to three layers’ hidden states. Furthermore, probes trained on TruthfulQA generalize zero-shot to unseen MMLU subjects, and deep-layer representations exhibit strong robustness against Gaussian noise.

0 citationsRead paper