Adaptive Resource Allocation for Effective and Efficient LLM Social Survey Simulation

📅 2026-09-28
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the inefficiency and noise interference caused by fixed configurations in large language model-based social survey simulations. To this end, we propose E2Sim, an adaptive resource allocation framework that jointly optimizes model selection and historical budget for individual queries via a lightweight policy. Furthermore, it introduces a response history dropout augmentation technique and a boundary-based curriculum learning strategy to enhance model robustness against incomplete histories. Experimental results demonstrate that E2Sim achieves up to a 6.3 percentage point improvement in accuracy while reducing costs by 55.3% across multiple datasets, significantly outperforming existing state-of-the-art fixed configuration approaches.
📝 Abstract
Large Language Models (LLMs) enable scalable social survey simulation, yet existing pipelines typically use the same strong general-purpose model and a fixed, often large, respondent history for every respondent-question request. This uniform approach overlooks three factors. First, stronger models may rely on their own knowledge rather than respondent-specific evidence while costing more. Second, additional history can help when evidence is limited, but irrelevant responses may add noise and increase input length. Third, the preferred model and history budget can depend on each other. We propose E2Sim, an adaptive resource allocation framework that jointly selects a model and history budget for each request. Given a respondent persona, ranked response history, and target question, a lightweight policy predicts the accuracy and cost of each configuration and selects the most suitable one. We use respondent-history drop-and-swap augmentation to improve robustness to incomplete or variable histories, and a margin-based curriculum that progresses from easier allocation decisions to harder ones. Experiments on four real-world social survey datasets, multiple model pools, and different history-budget spaces show improvements over the oracle best-fixed configurations, with accuracy gains of up to 6.3 percentage points and cost reductions of up to 55.3 percent. Code is available at https://anonymous.4open.science/r/E2Sim-DE66.
Problem

Research questions and friction points this paper is trying to address.

Large Language Models
Social Survey Simulation
Resource Allocation
Model Selection
History Budget
Innovation

Methods, ideas, or system contributions that make the work stand out.

Adaptive Resource Allocation
LLM Social Survey Simulation
Drop-and-Swap Augmentation
Margin-based Curriculum
E2Sim
🔎 Similar Papers
2024-10-06Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (System Demonstrations)Citations: 13