Deep Learning-based Compression Detection for explainable Face Image Quality Assessment

📅 2025-01-07
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
JPEG and JPEG 2000 compression degrades facial image fidelity, leading to reduced face recognition accuracy. Method: This paper proposes an interpretable, pre-processing quality control framework for facial image quality assessment. It unifies detection of artifacts from both compression standards—using PSNR/SSIM-derived weak supervision labels—and trains a lightweight, end-to-end EfficientNetV2 binary classifier without manual annotation. The model supports real-time deployment and achieves a compression-type classification error rate of only 2–3%. Contribution/Results: Extensive evaluation across multiple open-source and commercial face recognition systems demonstrates that filtering out high-artifact images significantly reduces downstream recognition error rates. The proposed method has been integrated into the open-source OFIQ framework, providing actionable, interpretable quality feedback to enhance robustness in face recognition pipelines.

Technology Category

Computer Vision: Bias, Fairness & PrivacyMachine Learning: Learning on the Edge & Model CompressionNatural Language Processing: Fact-Checking / Misinformation Detection (NLP Focus)

Application Category

Search and Retrieval-Augmented AI: Web evaluation methodologies and metricsEconomics, Online Markets and Human Computation: Data quality aspects of human-annotated datasetsUser Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking
📝 Abstract
The assessment of face image quality is crucial to ensure reliable face recognition. In order to provide data subjects and operators with explainable and actionable feedback regarding captured face images, relevant quality components have to be measured. Quality components that are known to negatively impact the utility of face images include JPEG and JPEG 2000 compression artefacts, among others. Compression can result in a loss of important image details which may impair the recognition performance. In this work, deep neural networks are trained to detect the compression artefacts in a face images. For this purpose, artefact-free facial images are compressed with the JPEG and JPEG 2000 compression algorithms. Subsequently, the PSNR and SSIM metrics are employed to obtain training labels based on which neural networks are trained using a single network to detect JPEG and JPEG 2000 artefacts, respectively. The evaluation of the proposed method shows promising results: in terms of detection accuracy, error rates of 2-3% are obtained for utilizing PSNR labels during training. In addition, we show that error rates of different open-source and commercial face recognition systems can be significantly reduced by discarding face images exhibiting severe compression artefacts. To minimize resource consumption, EfficientNetV2 serves as basis for the presented algorithm, which is available as part of the OFIQ software.
Problem

Research questions and friction points this paper is trying to address.

Face Photo Quality
JPEG Compression
JPEG 2000 Compression
Innovation

Methods, ideas, or system contributions that make the work stand out.

Deep Learning Network
JPEG Compression Artifact Detection
EfficientNetV2
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
L
Laurin Jonientz
Technische Hochschule Brandenburg, Brandenburg an der Havel, Germany; secunet Security Networks AG, Essen, Germany
J
Johannes Merkle
secunet Security Networks AG, Essen, Germany
C
C. Rathgeb
secunet Security Networks AG, Essen, Germany; Hochschule Darmstadt, Darmstadt, Germany
B
Benjamin Tams
secunet Security Networks AG, Essen, Germany
G
Georg Merz
Technische Hochschule Brandenburg, Brandenburg an der Havel, Germany