Memory vs. Context? Influential Factors of Factual Recall in Language Models
研究通过在31个模型上复现和压力测试，探讨语言模型如何在记忆知识和上下文陈述间抉择，揭示了模型大小、实体频率等因素的影响。
0 citationsRead paper
Selected work
Representative Papers
CAST: Alternating State-Value Targets and Expanded Policy Gradients for Model-Based Reinforcement Learning
本文提出CAST方法，通过结合规划引导行为和当前策略来改进值学习，以解决模型基础强化学习中的动作选择问题。
0 citationsRead paper
Two-level domain-decomposition AdaGrad method for scalable training of graph neural networks
本文提出了一种两级域分解AdaGrad方法（2DD-AG2m），以解决图神经网络在分布式环境下的高效训练问题，通过交替优化全局和分区图，降低了计算成本并提高了预测性能。
0 citationsRead paper
BODHI: Do LLMs Branch Out and Discover Heterogeneous Inferences?
This study investigates whether reinforcement learning with verifiable rewards (RLVR) genuinely enhances the reasoning capabilities of large language models or merely improves sampling efficiency. To this end, we introduce BODHI-Trees—a novel tree-based representation that extracts semantically equivalent structures from mathematical reasoning trajectories—and propose semantic branching entropy as a new metric to quantify reasoning diversity. Through controlled maze experiments and trajectory analyses, we find that while RLVR strengthens constraint adherence and backtracking abilities, it substantially contracts the semantic reasoning space, leading to a concurrent collapse in both policy entropy and semantic branching entropy. These findings suggest that the efficiency gains conferred by RLVR may come at the cost of reduced reasoning diversity.
0 citationsRead paper
Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation
Existing 3D morphable face models (3DMMs) exhibit shape biases due to limited training data, compromising their generalization and fairness across diverse populations. This work proposes the first evaluation framework integrating curvature-aware and spectral geometric analysis, leveraging the Laplace–Beltrami operator to generate high-resolution curvature error maps that enable precise localization, quantification, and visualization of reconstruction biases. Experimental results demonstrate that the proposed error metric aligns closely with human perception and significantly outperforms conventional Euclidean distance measures. Systematic evaluation across multiple state-of-the-art 3DMMs reveals pronounced reconstruction biases correlated with age, gender, and ethnicity, with age-related discrepancies being particularly substantial.
0 citationsRead paper
Recent publications
Latest Papers
Memory vs. Context? Influential Factors of Factual Recall in Language Models
研究通过在31个模型上复现和压力测试，探讨语言模型如何在记忆知识和上下文陈述间抉择，揭示了模型大小、实体频率等因素的影响。
0 citationsRead paper
CAST: Alternating State-Value Targets and Expanded Policy Gradients for Model-Based Reinforcement Learning
本文提出CAST方法，通过结合规划引导行为和当前策略来改进值学习，以解决模型基础强化学习中的动作选择问题。
0 citationsRead paper
Two-level domain-decomposition AdaGrad method for scalable training of graph neural networks
本文提出了一种两级域分解AdaGrad方法（2DD-AG2m），以解决图神经网络在分布式环境下的高效训练问题，通过交替优化全局和分区图，降低了计算成本并提高了预测性能。
0 citationsRead paper
BODHI: Do LLMs Branch Out and Discover Heterogeneous Inferences?
This study investigates whether reinforcement learning with verifiable rewards (RLVR) genuinely enhances the reasoning capabilities of large language models or merely improves sampling efficiency. To this end, we introduce BODHI-Trees—a novel tree-based representation that extracts semantically equivalent structures from mathematical reasoning trajectories—and propose semantic branching entropy as a new metric to quantify reasoning diversity. Through controlled maze experiments and trajectory analyses, we find that while RLVR strengthens constraint adherence and backtracking abilities, it substantially contracts the semantic reasoning space, leading to a concurrent collapse in both policy entropy and semantic branching entropy. These findings suggest that the efficiency gains conferred by RLVR may come at the cost of reduced reasoning diversity.
0 citationsRead paper
Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation
Existing 3D morphable face models (3DMMs) exhibit shape biases due to limited training data, compromising their generalization and fairness across diverse populations. This work proposes the first evaluation framework integrating curvature-aware and spectral geometric analysis, leveraging the Laplace–Beltrami operator to generate high-resolution curvature error maps that enable precise localization, quantification, and visualization of reconstruction biases. Experimental results demonstrate that the proposed error metric aligns closely with human perception and significantly outperforms conventional Euclidean distance measures. Systematic evaluation across multiple state-of-the-art 3DMMs reveals pronounced reconstruction biases correlated with age, gender, and ethnicity, with age-related discrepancies being particularly substantial.
0 citationsRead paper