Awesome-Image-Inpainting-Methods

Papers

🔥 Text-Guided Image Inpainting

• Year 2024
  • ICLR
    • MaGIC: Multi-modality Guided Image Completion [Paper] [Code]
  • ECCV
    • BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion [Paper] [Code] [Project] [Demo] [Video]
  • arXiv
    • Outline-Guided Object Inpainting with Diffusion Models [Paper]
    • ATask is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting [Paper][Code] [[Project]]
    • DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editing [Paper] [Code] [Project]
• Year 2023
  • CVPR
    • NÜWA-LIP: Language-guided Image Inpainting with Defect-free VQGAN [Paper] [Code]
    • Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting [Paper]
    • SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model [Paper]
    • Paint by Example: Exemplar-based Image Editing with Diffusion Models [Paper] [Code] [Demo]
  • CVPRW
    • Scene Graph Driven Text-Prompt Generation for Image Inpainting [Paper]
  • ACM MM
    • Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model [Paper] [Code]
  • SIGGRAPH
    • Blended Latent Diffusion [Paper] [Code] [Project]
  • WACV
    • An Unified Framework for Language Guided Image Completion [Paper]
    • Interactive Image Manipulation with Complex Text Instructions [Paper]
• Year 2022
  • CVPR
    • Blended Diffusion for Text-driven Editing of Natural Images [Paper] [Code]
• Year 2021
  • CVPRW
    • Grounded, Controllable and Debiased Image Completion With Lexical Semantics [Paper]
  • ACM MM
    • Adversarial Learning with Mask Reconstruction for Text-Guided Image Inpainting [Paper]
• Year 2020
  • ACM MM
    • MMFL: Multimodal Fusion Learning for Text-Guided Image Inpainting [Paper] [Code]
    • Text-Guided Neural Image Inpainting [Paper] [Code]
    • Text-Guided Image Inpainting [Paper]

<🎯Back to Top>

Vanilla Image Inpainting

• Year 2024
  • CVPR
    • ⚠️ Don't Look into the Dark: Latent Codes for Pluralistic Image Inpainting [Paper]
    • ⚠️ Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting [Paper]
  • WACV
    • Efficient Layout-Guided Image Inpainting for Mobile Use [Paper]
  • AAAI
    • Text Image Inpainting via Global Structure-Guided Diffusion Models [Paper] [Code]
    • ⚠️ SyFormer: Structure-Guided Synergism Transformer for Large-Portion Image Inpainting [Paper]
    • ⚠️ Large Occluded Human Image Completion via Image-Prior Cooperating [Paper]
  • ICLR
    • Image Inpainting via Tractable Steering of Diffusion Models [Paper]
    • Image Inpainting via Iteratively Decoupled Probabilistic Modeling [Paper] [Code]
  • TMM
    • Mutual Dual-Task Generator With Adaptive Attention Fusion for Image Inpainting [Paper]
  • TCSVT
    • Transformer-Based Image Inpainting Detection via Label Decoupling and Constrained Adversarial Training [Paper]
  • arXiv
    • HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention [Paper]
    • Rethinking Referring Object Removal [Paper]

<🎯Back to Top>

• Year 2023
  • CVPRW
    • Image Inpainting with Hypergraphs for Resolution Improvement in Scanning Acoustic Microscopy [Paper]
    • Internal Diverse Image Completion [Paper] [Code]
  • ICCVW
    • TransInpaint: Transformer-based Image Inpainting with Context Adaptation [Paper]
  • AAAI
    • CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Querying [Paper] [Code]
    • Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learning [Paper] [Code]
  • WACV
    • Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand [Paper] [Code]
    • GeoFill: Reference-Based Image Inpainting with Better Geometric Understanding [Paper]
    • Image Completion with Heterogeneously Filtered Spectral Hints [Paper] [Code]
  • TMM
    • Learning Adaptive Patch Generators for Mask-Robust Image Inpainting [Paper]
    • W-Net: Structure and Texture Interaction for Image Inpainting [Paper] [Code]
  • TIP
    • Progressive Contextual Aggregation Empowered by Pixel-Wise Confidence Scoring for Image Inpainting [Paper]
    • MagConv: Mask-Guided Convolution for Image Inpainting [Paper]
    • Context Adaptive Network for Image Inpainting [Paper]
  • TPAMI
    • Partial Convolution for Padding, Inpainting, and Image Synthesis [Paper] [Code]
  • TCSVT
    • Deep Image Inpainting With Enhanced Normalization and Contextual Attention [Paper]

<🎯Back to Top>

• Year 2022
  • CVPR
    • MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting [Paper] [Code]
    • MAT: Mask-Aware Transformer for Large Hole Image Inpainting [Paper] [Code]
    • Reduce Information Loss in Transformers for Pluralistic Image Inpainting [Paper] [Code]
    • Dual-path Image Inpainting with Auxiliary GAN Inversion [Paper]
    • RePaint: Inpainting using Denoising Diffusion Probabilistic Models [Paper] [Code]
    • TFill: Bridging Global Context Interactions for High-Fidelity Image Completion [Paper] [Code] [Project] [Video]
  • CVPRW
    • Zoom-to-Inpaint: Image Inpainting with High-Frequency Details [Paper] [Code]
    • Boundary-aware Image Inpainting with Multiple Auxiliary Cues [Paper] [Code]
    • Comparison of CoModGANs, LaMa and GLIDE for Art Inpainting Completing M.C Escher's Print Gallery [Paper]
    • Image Multi-Inpainting via Progressive Generative Adversarial Networks [Paper]
    • NTIRE 2022 Image Inpainting Challenge: Report [Paper] [Code]
    • GLaMa: Joint Spatial and Frequency Loss for General Image Inpainting [Paper]
    • PersonGONE: Image Inpainting for Automated Checkout Solution [Paper] [Code]
  • ECCV
    • MAE-FAR: Learning Prior Feature and Attention Enhanced Image Inpainting [Paper] [Code]
    • InvertFill: High-Fidelity Image Inpainting with GAN Inversion [Paper] [Code]
    • CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training [Paper] [Code]
    • Unbiased Multi-Modality Guidance for Image Inpainting [Paper] [Code]
    • Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation [Paper] [Code]
    • Hourglass Attention Network for Image Inpainting [Paper] [Code]
    • Diverse Image Inpainting with Normalizing Flow [Paper]
    • Perceptual Artifacts Localization for Inpainting [Paper] [Code]
    • Iterative Geometry-Aware Cross Guidance Network for Stereo Image Inpainting [Paper]
  • ACM MM
    • Delving Globally into Texture and Structure for Image Inpainting [Paper] [Code]
    • Atrous Pyramid Transformer with Spectral Convolution for Image Inpainting [Paper]
    • Deep Multi-Resolution Mutual Learning for Image Inpainting [Paper]
    • T-former: An Efficient Transformer for Image Inpainting [Paper] [Code]
  • WACV
    • LaMa: Resolution-robust Large Mask Inpainting with Fourier Convolutions [Paper] [Code]
  • NeurIPS
    • Cross-Image Context for Single Image Inpainting [Paper]
  • TMM
    • Deep Generative Model for Image Inpainting With Local Binary Pattern Learning and Spatial Attention [Paper] [Code]
  • TIP
    • Image Inpainting With Local and Global Refinement [Paper]
    • Pseudo Decoder Guided Light-Weight Architecture for Image Inpainting [Paper]
  • TPAMI
    • Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation [Paper] [Code] [Video]
  • TCSVT
    • Dual-Pyramidal Image Inpainting With Dynamic Normalization [Paper]

<🎯Back to Top>

• Year 2021
  • CVPR
    • TransFill: Reference-Guided Image Inpainting by Merging Multiple Color and Spatial Transformations [Paper] [Code]
    • Image Inpainting With External-Internal Learning and Monochromic Bottleneck [Paper] [Code]
    • Image Inpainting Guided by Coherence Priors of Semantics and Textures [Paper]
    • PD-GAN: Probabilistic Diverse GAN for Image Inpainting [Paper] [Code]
    • Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE [Paper] [Code]
  • ICCV
    • Distillation-guided Image Inpainting [Paper]
    • WaveFill: A Wavelet-based Generation Network for Image Inpainting [Paper] [Code]
    • CR-Fill: Generative Image Inpainting with Auxiliary Contextual Reconstruction [Paper] [Code]
    • Parallel Multi-Resolution Fusion Network for Image Inpainting [Paper]
    • ICT: High-Fidelity Pluralistic Image Completion with Transformers [Paper] [Code] [Project]
  • IJCAI
    • Context-Aware Image Inpainting with Learned Semantic Priors [Paper] [Code]
  • ACM MM
    • BAT-Fill: Diverse Image Inpainting with Bidirectional and Autoregressive Transformers [Paper] [Code]
    • JPGNet: Joint Predictive Filtering and Generative Network for Image Inpainting [Paper] [Code]
    • Learning Contextual Transformer Network for Image Inpainting [Paper]
    • GCM-Net: Towards Effective Global Context Modeling for Image Inpainting [Paper] [Code]
    • An Adaptive Iterative Inpainting Method with More Information Exploration [Paper]
    • Large Scale Image Completion via Co-Modulated Generative Adversarial Networks [[Paper]](Large Scale Image Completion via Co-Modulated Generative Adversarial Networks) [Code]
  • WACV
    • R-MNet: A Perceptual Adversarial Network for Image Inpainting [Paper] [Code]
    • Multi-Level Generative Chaotic Recurrent Network for Image Inpainting [Paper]
    • Hyperrealistic Image Inpainting with Hypergraphs [Paper] [Code]
  • TIP
    • Dynamic Selection Network for Image Inpainting [Paper] [Code]
    • Thanka Mural Inpainting Based on Multi-Scale Adaptive Partial Convolution and Stroke-Like Mask [Paper]
    • Image Inpainting by End-to-End Cascaded Refinement With Mask Awareness [Paper] [Code]
    • Texture Memory-Augmented Deep Patch-Based Image Inpainting [Paper]
  • TCSVT
    • Reference-Guided Landmark Image Inpainting With Deep Feature Matching [Paper] [Project]
    • Generative Memory-Guided Semantic Reasoning Model for Image Inpainting [Paper]

<🎯Back to Top>

• Year 2020
  • CVPR
    • UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation [Paper]
    • Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting [Paper] [Code]
    • RFR-Net: Recurrent Feature Reasoning for Image Inpainting [Paper] [Code]
    • Prior Guided GAN Based Semantic Inpainting [Paper]
    • Semantic Image Manipulation Using Scene Graph [Paper] [Code]
  • ECCV
    • MEDFE: Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations [Paper] [Code]
    • High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling [Paper]
    • Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes [Paper]
    • Deep Generative Prior: Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation [Paper] [Code] [Video]
  • AAAI
    • Learning to Incorporate Structure Knowledge for Image Inpainting [Paper] [Code]
    • Region Normalization for Image Inpainting [Paper] [Code]
    • The Missing Data Encoder: Cross-Channel Image Completion with Hide-and-Seek Adversarial Network [Paper] [Code]
  • ACM MM
    • Image Inpainting Based on Multi-frequency Probabilistic Inference Model [Paper]

<🎯Back to Top>

• Year 2019
  • CVPR
    • Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting [Paper] [Code]
    • Foreground-Aware Image Inpainting [Paper]
    • PEPSI: Fast Image Inpainting With Parallel Decoding Network [Paper] [Code]
    • Pluralistic Image Completion [Paper] [Code]
  • ICCV
    • StructureFlow: Image Inpainting via Structure-Aware Appearance Flow [Paper] [Code]
    • Coherent Semantic Attention for Image Inpainting [Paper] [Code]
    • LBAM: Image Inpainting With Learnable Bidirectional Attention Maps [Paper] [Code]
  • ICCVW
    • Deep Hyperspectral Prior: Single-Image Denoising, Inpainting, Super-Resolution. [Paper] [Code]
  • IJCAI
    • Generative Image Inpainting with Submanifold Alignment [Paper]
    • Coarse-to-Fine Image Inpainting via Region-wise Convolutions and Non-Local Correlation [Paper]
    • MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting [Paper] [Code]
    • Single-shot Semantic Image Inpainting with Densely Connected Generative Networks [Paper]
    • GAIN: Gradient Augmented Inpainting Network for Irregular Holes [Paper]
    • Progressive Image Inpainting with Full-Resolution Residual Network [Paper] [Code]
    • Deep Fusion Network for Image Completion [Paper] [Code]

<🎯Back to Top>

• Year 2018
  • CVPR
    • DeepFill-v1: Generative Image Inpainting With Contextual Attention [Paper] [Code] [Video]
    • Disentangling Structure and Aesthetics for Style-Aware Image Completion [Paper]
  • ECCV
    • Contextual-based Image Inpainting: Infer, Match, and Translate [Paper]
    • Shift-Net: Image Inpainting via Deep Feature Rearrangement [Paper] [Code]
    • Image Inpainting for Irregular Holes Using Partial Convolutions [Paper] [Code] [Video] [Demo]
  • ACM MM
    • Semantic Image Inpainting with Progressive Generative Networks [Paper] [Code]
  • NeurIPS
    • Image Inpainting via Generative Multi-column Convolutional Neural Networks [Paper] [Code]
  • Photo Realistic Image Completion via Dense Correspondence [Paper]
• Year 2017
  • CVPR
    • High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis [Paper] [Code]
    • Semantic Image Inpainting with Deep Generative Models [Paper] [Code]
    • Structural inpainting [Paper]

<🎯Back to Top>

• Year 2016
  • CVPR
    • Context Encoders: Feature Learning by Inpainting [Paper] [Code]

<🎯Back to Top>

Blind Image Inpainting

• Year 2023
  • CVPRW
    • Blind Image Inpainting via Omni-dimensional Gated Attention and Wavelet Queries [Paper] [Code]
  • TMM
    • FT-TDR: Frequency-Guided Transformer and Top-Down Refinement Network for Blind Face Inpainting [Paper]
  • TPAMI
    • Self-Prior Guided Pixel Adversarial Networks for Blind Image Inpainting [Paper]
• Year 2022
  • ACM MM
    • TransCNN-HAE: Transformer-CNN Hybrid AutoEncoder for Blind Image Inpainting [Paper]
  • IPTA
    • ARIN: Adaptive Resampling and Instance Normalization for Robust Blind Inpainting of Dunhuang Cave Paintings [Paper]
• Year 2020
  • ECCV
    • VCNet: A Robust Approach to Blind Image Inpainting [Paper] [Reproduced Code]

<🎯Back to Top>

Edge-Based Image Inpainting

• Year 2023
  • TPAMI
    • ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors [Paper] [Code] [Project]
• Year 2022
  • CVPR
    • ZITS: Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding [Paper] [Code] [Project]
• Year 2021
  • ICCV
    • Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes [Paper]
    • CTSDG: Image Inpainting via Conditional Texture and Structure Dual Generation [Paper] [Code]
  • TCSVT
    • E2I: Generative Inpainting From Edge to Image [Paper] [Code]
• Year 2019
  • ICCV
    • DeepFill-v2: Free-Form Image Inpainting With Gated Convolution [Paper] [Code] [Project] [Video]
    • PRVS: Progressive Reconstruction of Visual Structure for Image Inpainting [Paper] [Code]
  • ICCVW
    • EdgeConnect: Structure Guided Image Inpainting using Edge Prediction [Paper] [Code]

<🎯Back to Top>

Sketch-Guided Image Inpainting

• Year 2024
  • TMM
    • SketchRefiner: Towards Interactive Image Inpainting via Robust Sketch Refinement [Paper] [Code] [Project]
• Year 2023
  • ACM MM
    • Draw2Edit: Mask-Free Sketch-Guided Image Manipulation [Paper] [Code]
• Year 2022
  • CVPR
    • SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches [Paper] [Code] [Project]
• Year 2021
  • CVPR
    • DeFLOCNet: Deep Image Editing via Flexible Low-Level Controls [Paper] [Code]
• Year 2020
  • ECCV
    • Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketches [Paper] [Code] [Project]
• Year 2019
  • ICCV
    • DeepFill-v2: Free-Form Image Inpainting With Gated Convolution [Paper] [Code] [Project] [Video]
    • SC-FEGAN: Face Editing Generative Adversarial Network With User's Sketch and Color [Paper] [Code]

<🎯Back to Top>

Conventional Methods

• Year 2024
  • arXiv
    • HySim: An Efficient Hybrid Similarity Measure for Patch Matching in Image Inpainting [Paper]
• Year 2020
  • TIP
    • Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering [Paper]
    • Truncated Low-Rank and Total p Variation Constrained Color Image Completion and its Moreau Approximation Algorithm [Paper]
• Year 2019
  • Multiple Pyramids Based Image Inpainting Using Local Patch Statistics and Steering Kernel Feature [Paper]
• Year 2018
  • TIP
    • A Group-Based Image Inpainting Using Patch Refinement in MRF Framework [Paper]
• Year 2016
  • CVPR
    • Multiview Image Completion with Space Structure Propagation [Paper]
  • TIP
    • Image Inpainting Through Metric Labeling via Guided Patch Mixing [Paper]
• Year 2011
  • ICIG
    • Structure-Aware Image Completion with Texture Propagation [Paper]
• Year 2005
  • TIP
    • Edge-Based Image Restoration [Paper]
  • SIGGRAPH
    • Image Completion with Structure Propagation [Paper]
• Year 2004
  • TIP
    • Region Filling and Object Removal by Exemplar-Based Image Inpainting [Paper]
• Year 2000
  • SIGGRAPH
    • Image Inpainting [Paper]

<🎯Back to Top>

Survey Papers

• [IJCV 2024] Deep Learning-based Image and Video Inpainting: A Survey [Paper]
• [Pattern Recognit. 2023] Deep Learning for Image Inpainting: A Survey [Paper]

<🎯Back to Top>

Datasets

• Paris StreetView: Context Encoders: Feature Learning by Inpainting [Paper] [Code] (Since Google's terms of service has forbidden anyone from creating repositories of streetview data, the dataset is currently not available.)
• Places: A 10 Million Image Database for Scene Recognition [Paper] [Dataset]
• ImageNet: A Large-Scale Hierarchical Image Database [Paper] [Dataset]
• CelebA-HQ: Progressive Growing of GANs for Improved Quality, Stability, and Variation [Paper] [Dataset]
• FFHQ: A Style-Based Generator Architecture for Generative Adversarial Networks [Paper] [Dataset]

<🎯Back to Top>

Q&A

• Q: The conference sequence of this paper list?
  • This paper list is organized according to the following sequence:
    • Conferences
      • CVPR
      • CVPRW
      • ICCV
      • ICCVW
      • ECCV
      • AAAI
      • IJCAI
      • WACV
      • NeurIPS
      • ICLR
      • ACM MM
      • SIGGRAPH
      • IPTA
    • Journals
      • TMM
      • TIP
      • TPAMI
      • TCSVT
    • arXiv

<🎯Back to Top>