screen-space artifact removal

Designs, builds, or evaluates algorithms that identify and separate screen-space (2D image-plane) artifacts from authentic scene content and produce artifact-suppressed renderings or image sequences while preserving legitimate overlay appearance and consistency. This includes methods for artifact disentanglement, suppression, mitigation, and removal that may operate without ground-truth supervision or explicit artifact masks.

screen-spaceartifactremoval

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
0.08
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$200K/year
Oct 01, 2026Oct 01, 2026

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

This work addresses the challenge that screen-space artifacts in real-world images—such as lens smudges and UI watermarks—are often erroneously reconstructed as floating 3D objects, severely degrading novel view synthesis quality. To resolve this, we propose the first unsupervised framework that jointly optimizes a 3D Gaussian point cloud and a learnable 2D overlay layer. By leveraging multi-view geometric consistency, our method automatically disentangles static artifacts from genuine 3D structure without requiring manual annotations or prior knowledge. Evaluated on both synthetic and real-world datasets, the approach achieves up to a 9 dB PSNR improvement over the original 3D Gaussian Splatting baseline, significantly enhancing reconstruction fidelity while accurately preserving artifact content.

3D Gaussian Splattingnovel view synthesisscreen-space artifacts

This work addresses the geometric and photometric degradation in 3D Gaussian Splatting (3DGS) under sparse-view settings by proposing a unified inpainting framework leveraging video diffusion models. The authors construct a large-scale video dataset comprising 107.5K paired samples and introduce an isomorphic dual-model architecture featuring fine-grained 3DGS artifact classification and an Artifact-Aware Triplet Fusion mechanism guided by artifact heatmaps. For the first time, intensity-aware restoration is integrated into the self-attention structure, enabling precise spatiotemporal consistent inpainting. The proposed method significantly outperforms existing approaches in sparse novel-view synthesis and robust 3D reconstruction, effectively enhancing multi-view consistency and generalization capability.

3D Gaussian Splattingartifact restorationmulti-view consistency

Proxies for Distortion and Consistency with Applications for Real-World Image Restoration

Jan 21, 2025
SM
Sean Man
🏛️ Technion | Israel Institute of Technology

Addressing blind image restoration under unknown real-world degradations without ground-truth images, this work proposes a holistic solution. First, we introduce a learnable degradation chain estimator to accurately model complex, realistic degradations. Second, we design a consistency-driven, plug-and-play diffusion prior framework enabling end-to-end lightweight optimization. Third, we pioneer reference-free proxy metrics—MSE and LPIPS computed on synthetically degraded samples—that overcome the longstanding challenge of unreliable performance evaluation in blind restoration. To our knowledge, this is the first work unifying degradation modeling, restoration algorithm design, and no-reference assessment within a single coherent pipeline. Extensive experiments demonstrate substantial improvements in ranking accuracy over SOTA methods across multiple blind restoration benchmarks, significantly enhancing algorithmic assessability, comparability, and practical applicability.

Algorithm EvaluationImage RestorationUnknown Degradation

Evaluating 3D reconstruction quality without ground-truth images faces two key challenges: the absence of reliable reference views and the inability of prevailing no-reference metrics to localize fine-grained artifacts in novel synthesized views. To address this, we propose Puzzle Similarity (PS), the first no-reference metric capable of spatially localizing artifact regions. Its core innovation lies in modeling scene-specific distributions via local patch statistics extracted from the input multi-view images, enabling adaptive distribution matching for fine-grained, reference-free artifact localization. Evaluated on human-perception datasets, PS significantly outperforms existing full-reference and no-reference metrics, achieving high correlation with subjective quality judgments. Crucially, PS operates entirely without ground-truth imagery, making it suitable for downstream applications such as artifact-driven automatic restoration, acquisition optimization, and sparse-view reconstruction.

Addresses the challenge of assessing novel view quality without ground truth.Develops a metric to detect artifacts in 3D scene reconstructions.Introduces a human-labeled dataset for evaluating artifact localization methods.

Latest Papers

What's happening recently
View more

Existing image inpainting methods often struggle to preserve fine details and produce natural-looking results when handling complex semi-transparent degradations—such as cracks and stains—in artistic images, primarily due to their reliance on predefined degradation models. This work addresses this limitation by introducing the first controllable benchmark for blind restoration of artistic imagery, accompanied by a new dataset, MDTD-Art, which features semi-transparent degradation masks at multiple opacity levels. Through systematic evaluation of general-purpose inpainting models, image editing models, and vision-language models, the study demonstrates that image editing models enhanced with structured prompt engineering consistently outperform specialized inpainting approaches across arbitrary degradations. Notably, these models excel when guided by semantic cues that emphasize structural coherence and fine-grained detail, underscoring the critical role of semantically controllable generation in blind restoration of artistic images.

art image restorationblind restorationimage degradation

This work addresses the growing challenge of verifying the authenticity of increasingly realistic AI-generated images, a task for which existing methods struggle to jointly perform detection and artifact correction. The paper proposes GenShield, the first unified autoregressive framework that integrates detection and controllable artifact repair through a synergistic “diagnose-and-repair” mechanism operating in a closed loop, enabling interpretable detection and targeted restoration. GenShield innovatively establishes a mutually reinforcing relationship between detection and repair, incorporating a Visual Chain-of-Thought curriculum learning strategy that supports multi-step self-explanatory refinement with an explicit stopping criterion. Evaluated on both established detection benchmarks and a newly curated large-scale dataset of artifact–repair image pairs using a comprehensive protocol, GenShield achieves state-of-the-art performance and demonstrates exceptional generalization across diverse generation models.

AI-generated imagesartifact correctiondiffusion-based synthesis

Existing approaches struggle to jointly handle scene text editing tasks—deletion, generation, and replacement—within a unified framework that simultaneously ensures precise textual appearance control and background integrity. To address this, this work proposes a unified model that decomposes complex text editing into two atomic operations: rendering and erasure. It introduces Overlay-Reference Positional Encoding (ORPE) to achieve pixel-level layout fidelity and exemplar-driven style control, complemented by a Region-Adaptive Suppression (RAS) strategy to ensure clean text removal. The study also establishes TextWand-Bench, the first comprehensive benchmark for general scene text editing. Experimental results demonstrate that the proposed method significantly outperforms both open-source and closed-source models across all three editing tasks in terms of text accuracy, layout-style consistency, and overall image quality.

scene text editingtext generationtext removal

Hot Scholars

AK

Antonio Krüger

Saarland University, DFKI, Saarland Informatics Campus
Intelligent User InterfacesHuman Computer InteractionArtificial Intelligence
CU

Chamira U. S. Edussooriya

University of Moratuwa
Multi-dimensional Signal ProcessingDigital FiltersLight FieldsGraph Signal Processing
JS

Jivko Sinapov

Associate Professor, Tufts University
RoboticsMachine LearningArtificial Intelligence
QL

Qiegen Liu

Nanchang university
medical imagingimage processing
KZ

Kaipeng Zhang

Shanghai AI Laboratory
LLMMultimodal LLMsAIGC