DeceptionAnalyser: A Web-Based AI Tool for Performing Structured Deception Analysis with Argumentation Schemes and LLMs

📅 2026-09-21
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文通过引入十个论证方案和开发基于LLM的DeceptionAnalyser工具,解决了系统分析欺骗性文本的问题。
📝 Abstract
Deception plays a central role in Intelligence operations, yet it remains difficult to analyse systematically without expert knowledge of reasoning patterns and cognitive manipulation. In computational argumentation, for instance, no scheme-level ground-truth corpora currently exist to support statistical validation. In this paper, we address this by introducing a set of ten argument schemes designed to model distinct forms of deception, each accompanied by structured premises and critical questions. In doing so, we introduce the first dedicated library of argumentation schemes specifically designed for deception analysis, providing a structured foundation for systematically modelling and analysing deception in narrative text. We then present \textit{DeceptionAnalyser}, a browser-based tool that implements these schemes through a two-stage methodology combining LLM-based premise extraction with critical-question-driven evaluation. Our aim is to provide a conceptual and methodological foundation for analysing deceptive reasoning in narrative text. This is precisely what we address in this paper by demonstrating how structured argumentation theory and AI-assisted analysis can support transparent, explainable assessments of potential deception. Because the schemes are designed to flag claims for scrutiny rather than to output a deception verdict, we do not benchmark classification accuracy; instead, we assess the \emph{reliability} of the methodology by measuring the consistency of the tool's premise and conclusion assessments across ten contemporary large language models and repeated runs. We find that scheme detection is highly stable for clear-cut deception and degrades gracefully, in interpretable ways, on more ambiguous intelligence-style narratives.
Problem

Research questions and friction points this paper is trying to address.

deception
intelligence operations
argumentation schemes
computational argumentation
narrative text
Innovation

Methods, ideas, or system contributions that make the work stand out.

argumentation schemes
deception analysis
LLMs
structured analysis
critical questions
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
S
Stefan Sarkadi
University of Lincoln, UK
X
Xabier Garmendia
University of the Basque Country, Spain
J
Jack Mumford
University of Liverpool, UK
T
Trevor Bench-Capon
University of Liverpool, UK