🤖 AI Summary
This work addresses the risks of generative interfaces in high-stakes settings—such as hallucinations, semantic distortion, bias, and accessibility barriers—that arise from insufficient human oversight and undermine user understanding and control. To mitigate these issues, the paper proposes a “supervision-by-design” architecture that deeply integrates human judgment into the generative pipeline. This framework employs automated risk detection across dimensions including readability, semantic fidelity, factual consistency, and accessibility compliance, coupled with explicit UI controls and a tiered escalation protocol that triggers mandatory human review upon violations. By combining human-in-the-loop (HITL) interventions with human-on-the-loop (HOTL) continuous monitoring, the approach establishes a scalable, verifiable governance loop. The resulting system significantly enhances transparency, reliability, and inclusivity, thereby strengthening accountability and user agency in high-risk human-AI collaborative decision-making.
📝 Abstract
LLM-generated interfaces are increasingly used in high-consequence workflows (e.g., healthcare communication), where how information is presented can impact downstream actions. These interfaces and their content support human interaction with AI-assisted decision-making and communication processes and should remain accessible and usable for people with disabilities. Accessible plain-language interfaces serve as an enabling infrastructure for meaningful human oversight. In these contexts, ethical and trustworthiness risks, including hallucinations, semantic distortion, bias, and accessibility barriers, can undermine reliability and limit users'ability to understand, monitor, and intervene in AI-supported processes. Yet, in practice, oversight is often treated as a downstream check, without clear rules for when human intervention is required or who is accountable. We propose oversight-by-design: embedding human judgment across the pipeline as an architectural commitment, implemented via escalation policies and explicit UI controls for risk signalling and intervention. Automated checks flag risk in generated UI communication that supports high-stakes workflows (e.g., readability, semantic fidelity, factual consistency, and standards-based accessibility constraints) and escalate to mandatory Human-in-the-Loop (HITL) review before release when thresholds are violated, or uncertainty is high. Human-on-the-Loop (HOTL) supervision monitors system-level signals over time (alerts, escalation rates, and compliance evidence) to tune policies and detect drift. Structured review feedback is translated into governance actions (rule and prompt updates, threshold calibration, and traceable audit logs), enabling scalable intervention and verifiable oversight for generative UI systems that support high-stakes workflows.