Not to Break, but to Attest: Adversarial Probes for Privacy-Preserving LLM Verification

📅 2026-08-28
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
为解决大语言模型部署后更改检测问题,提出一种基于zk-SNARK的隐私保护审计框架,使用不同类型的探针来放大已批准模型和修改后模型之间的logit差异。
📝 Abstract
Post-deployment changes to large language models can alter behavior while leaving routine outputs largely unchanged, creating a challenge for AI governance when model weights are proprietary. We present a privacy-preserving zk-SNARK-based audit framework that searches for probes designed in the spirit of adversarial examples to amplify logit drift between an approved model and a modified deployment. Our framework explores complementary probe families under different access models. Token-based probes operate in a black-box setting and require only the input interface, tokenizer, and vocabulary. Embedding-based probes require gray-box access to the embedding interface. Stress probes rely on additional interface capabilities but do not require full white-box access to model weights or architecture. This range allows probe selection to balance sensitivity, access requirements, and deployment cost. We evaluate probe constructions across LLM architectures, model-tampering scenarios representative of post-deployment attacks, and GPU platforms. Importantly, our experimental results demonstrate that token-based probes consistently deliver the strongest mean sensitivity across models and GPU platforms, although operating in a black-box setting. Our Groth16 zk-SNARK workflow remains practical as the probe set scales from 1 to 50, where proving time increases from 1.02 to 1.78 seconds, verification remains near 0.84 seconds, and proof size remains constant.
Problem

Research questions and friction points this paper is trying to address.

large language models
post-deployment changes
AI governance
proprietary model weights
adversarial probes
Innovation

Methods, ideas, or system contributions that make the work stand out.

zk-SNARK
adversarial probes
privacy-preserving
logit drift
black-box
🔎 Similar Papers
2024-02-21arXiv.orgCitations: 7
C
Cameron Wilding
Worcester Polytechnic Institute
M
Mina Shaker
Worcester Polytechnic Institute
F
Fatemeh Ganji
Worcester Polytechnic Institute