🤖 AI Summary
This work addresses the vulnerability of autonomous LLM agents to prompt injection and reasoning errors when handling data with mixed confidentiality levels. Traditional dynamic information flow control severely compromises usability due to permanent context tainting. To overcome this, the paper proposes APPA, a novel framework that introduces engine-managed context branching and a proactive permission evaluation mechanism, formalized via a bimonoidal model to guarantee invariance of parent context labels and enforce merge isolation. APPA safely validates external inputs through subtrace execution and a trusted sanitizer, producing restricted derivative outputs without contaminating the main context. Empirical evaluation on a multi-round, multi-model toolchain benchmark shows that APPA reduces attack success rates from 31%–50% to 0%–7% and significantly restores task utility degraded by taint tracking across three models.
📝 Abstract
Autonomous LLM agents processing mixed-confidentiality data face severe security risks from prompt injection attacks and reasoning errors. While dynamic Information Flow Control (IFC) provides structural security guarantees, traditional taint tracking permanently taints an agent's context upon reading unvetted data, severely restricting downstream utility. We present APPA (Agentic Permissions Policy Algebra), an IFC framework that resolves this usability bottleneck through engine-managed context branching and prospective acquisition enforcement. Before data acquisition occurs, APPA prospectively evaluates label descents and missing prerequisites, generating actionable remedy plans (Authorize, Accept). To inspect unvetted data without polluting the primary context, a label-seeded child trajectory is spawned, absorbing label descent locally and allowing a trusted sanitizer to return a bounded derivative to the unchanged parent. Governed by a two-monoid model over security labels and shared event logs, we formally prove parent label preservation and merge confinement. Finally, we evaluate APPA on a multi-turn tool-chaining benchmark across four models: it suppresses exfiltration (31%-50% down to 0%-7% attack success), and on three of the four, branching recovers a substantial share of the utility that taint tracking alone forfeits.