Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
为了解决大语言模型难以适应多样化个人偏好的问题,本文提出了一种新的个性化群体相对策略优化框架P-GRPO,通过针对不同偏好组的历史奖励进行优势估计,从而更好地学习和对齐不同的用户偏好。
为了解决大语言模型难以适应多样化个人偏好的问题,本文提出了一种新的个性化群体相对策略优化框架P-GRPO,通过针对不同偏好组的历史奖励进行优势估计,从而更好地学习和对齐不同的用户偏好。
This work addresses the key challenge of balancing inference accuracy and error risk control under limited computational budgets in large language model reasoning. The authors reformulate the computational budget allocation problem as an adaptive stopping decision task under explicit risk constraints and propose a dynamic termination mechanism based on dual confidence thresholds. By parameterizing a lower threshold to early-exit hopeless samples and integrating a distribution-free risk control method to optimize the stopping policy, the approach ensures rigorous adherence to user-specified risk limits. Furthermore, an efficiency loss metric is introduced to select the optimal exit strategy across multiple criteria. Experimental results demonstrate that the proposed method significantly improves computational efficiency across diverse tasks and models while strictly satisfying prescribed risk upper bounds.
This work challenges the prevailing reliance on deterministic outputs in large language model (LLM) inference, which obscures inherent uncertainties, vulnerabilities, and safety risks while suppressing emergent capabilities and multi-path reasoning. To address this, the authors propose the “Stochastic CHAOS” framework, which treats output distribution variability as a core cognitive signal. By integrating multi-path sampling, non-deterministic attention mechanisms, and multi-sample evaluation, the framework systematically uncovers the true capabilities and latent risks of LLMs. Experimental results demonstrate that deterministic inference substantially underestimates both model performance and tail-end risks. In contrast, the proposed approach effectively recovers emergent phenomena, enhances reasoning accuracy, and reveals hidden safety hazards, thereby questioning conventional assumptions about reliability and reproducibility in LLM deployment.
This study addresses the challenge of modeling interpretable speech quality dimensions to characterize speaker styles in atypical and affective speech. We propose the first systematically defined set of seven phonatory quality primitives—e.g., clarity, glottalization, and breathiness—and train linear probes on frozen Wav2Vec 2.0 embeddings using the Speech Accessibility Project (SAP) dataset. Our method achieves strong interpretability and cross-domain generalizability: it attains state-of-the-art performance on SAP and, for the first time, enables zero-shot transfer across languages (English/Italian) and tasks (atypical vs. emotional speech), with average accuracy exceeding 82%. These results validate the framework’s efficacy as a universal, style-sensitive speech representation. The core contribution is the first interpretable, transferable, and multilingual-compatible speech quality dimension modeling framework.
To address the challenge of balancing privacy preservation and query efficiency in large-scale private database search, this paper proposes Wally—a scalable system achieving $(varepsilon,delta)$-differential privacy under high concurrency. Wally integrates four key techniques: (i) an adaptive dummy-query attenuation mechanism—where the number of dummy queries decreases with the number of honest users; (ii) Tor-based anonymous routing; (iii) randomized query submission timing; and (iv) lightweight homomorphic encryption. This design ensures that per-query privacy overhead asymptotically approaches zero as system scale increases. To our knowledge, Wally is the first system to enable efficient private search at the scale of ten million database entries and one million concurrent users. Experiments on a 3.2-million-entry dataset show that Wally achieves 7–28× higher QPS than Tiptoe while reducing communication overhead by 6.69–31×.
本文提出了一种基于LLM的系统,通过结构化分解和模式验证方法将自然语言访问控制策略转换为可执行代码,以提高生成策略的可靠性和安全性。
研究通过生成-提取循环协议,评估语言模型在处理树结构表达式时的信息损失问题,并提出训练可改善模型表现。
为解决MCI患者的智能支持需求,PV-Care通过低密度EEG和AI技术提供主动、情境感知的帮助,利用SFR-Net识别认知状态并生成指导性提示。
MintAct通过统一视觉代理解决跨移动、桌面和网页的多步骤导航问题,使用强化学习方法在不同环境中训练模型。
研究通过改进Mixture-of-Experts (MoE)路由设计,结合Speculative Decoding提高模型推理速度,特定设计选择显著增强了专家协同激活,提高了吞吐量。