🤖 AI Summary
This study addresses the inefficiency and noise interference caused by fixed configurations in large language model-based social survey simulations. To this end, we propose E2Sim, an adaptive resource allocation framework that jointly optimizes model selection and historical budget for individual queries via a lightweight policy. Furthermore, it introduces a response history dropout augmentation technique and a boundary-based curriculum learning strategy to enhance model robustness against incomplete histories. Experimental results demonstrate that E2Sim achieves up to a 6.3 percentage point improvement in accuracy while reducing costs by 55.3% across multiple datasets, significantly outperforming existing state-of-the-art fixed configuration approaches.
📝 Abstract
Large Language Models (LLMs) enable scalable social survey simulation, yet existing pipelines typically use the same strong general-purpose model and a fixed, often large, respondent history for every respondent-question request. This uniform approach overlooks three factors. First, stronger models may rely on their own knowledge rather than respondent-specific evidence while costing more. Second, additional history can help when evidence is limited, but irrelevant responses may add noise and increase input length. Third, the preferred model and history budget can depend on each other. We propose E2Sim, an adaptive resource allocation framework that jointly selects a model and history budget for each request. Given a respondent persona, ranked response history, and target question, a lightweight policy predicts the accuracy and cost of each configuration and selects the most suitable one. We use respondent-history drop-and-swap augmentation to improve robustness to incomplete or variable histories, and a margin-based curriculum that progresses from easier allocation decisions to harder ones. Experiments on four real-world social survey datasets, multiple model pools, and different history-budget spaces show improvements over the oracle best-fixed configurations, with accuracy gains of up to 6.3 percentage points and cost reductions of up to 55.3 percent. Code is available at https://anonymous.4open.science/r/E2Sim-DE66.