Code and models for "Rethinking Deep Image Prior for Denoising" (ICCV 2021)

Last update: Dec 29, 2022

Related tags

Overview

DIP-denosing

This is a code repo for Rethinking Deep Image Prior for Denoising (ICCV 2021).

Addressing the relationship between Deep image prior and effective degrees of freedom, DIP-SURE with STE(stochestic temporal ensemble) shows reasonable result on single image denoising.

If you use any of this code, please cite the following publication:

@article{jo2021dipdenoising,
  author  = {Yeonsik Jo, Se young chun,  and Choi, Jonghyun},
  title     = {Rethinking Deep Image Prior for Denoising},
  booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
  month     = {October},
  year      = {2021},
  pages     = {5087-5096}
}

Working environment

TITAN Xp
ubuntu 18.04.4
pytorch 1.6

Note: Experimental results were not checked in other environments.

Set-up

Make your own environment

conda create --name DIP --file requirements.txt
conda avtivate DIP
pip install tqdm

Inference

Produce CSet9 result

bash exp_denoising.sh CSet9 <GPU ID>

For your own data with sigma=25 setup

mkdir testset/<YOUR_DATASET>
python main.py --dip_type eSURE_new --net_type s2s --exp_tag <EXP_NAME> --optim RAdam --force_steplr --desc sigma25   denoising --sigma 25 --eval_data <YOUR_DATASET>

Browsing experimental result

We provide reporting code with invoke.

invoke showtable csv/<exp_type>/<exp_tag>

Example.

invoke showtable csv/poisson/MNIST/
PURE_dc_scale001_new                     optimal stopping : 384.30,     31.97/0.02      | ZCSC : 447.60,         31.26/0.02 | STE 31.99/0.02
PURE_dc_scale01_new                      optimal stopping : 94.70,      24.96/0.12      | ZCSC : 144.60,         24.04/0.14 | STE 24.89/0.12
PURE_dc_scale02_new                      optimal stopping : 70.30,      22.92/0.20      | ZCSC : 110.00,         21.82/0.22 | STE 22.83/0.20
<EXEPRIMENTAL NAME>                      optimal stopping :<STEP>,      <PSNR>/<LPIPS>  | ZCSC : <STEP>,      <PSNR>/<LPIPS>| STE <PSNR>/<LPIPS>

The reported numbers are PSNR/LPIPS.

Results in paper

For the result used on paper, please refer this link.

SSIM score

For SSIM score of color images, I used matlab code same as the author of S2S.
This is the demo code I received from the S2S author.
Thank you Mingqin!

% examples
ref = im2double(imread('gt.png'));
noisy = im2double(imread('noisy.png'));
psnr_result = psnr(ref, noisy);
ssim_result = ssim(ref, noisy);

License

MIT license.

Contacts

For questions, please send an email to [email protected]

Code and models for "Rethinking Deep Image Prior for Denoising" (ICCV 2021)

Related tags

Overview

DIP-denosing

Working environment

Set-up

Inference

Browsing experimental result

Results in paper

SSIM score

License

Contacts

Owner

Computer Vision Lab. @ GIST

Artifacts for paper "MMO: Meta Multi-Objectivization for Software Configuration Tuning"

On the Adversarial Robustness of Visual Transformer

Node Editor Plug for Blender

BalaGAN: Image Translation Between Imbalanced Domains via Cross-Modal Transfer

ktrain is a Python library that makes deep learning and AI more accessible and easier to apply

Deep Text Search is an AI-powered multilingual text search and recommendation engine with state-of-the-art transformer-based multilingual text embedding (50+ languages).

PICARD - Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

Using the provided dataset which includes various book features, in order to predict the price of books, using various proposed methods and models.

Implementation of association rules mining algorithms (Apriori|FPGrowth) using python.

A simple interface for editing natural photos with generative neural networks.

LOFO (Leave One Feature Out) Importance calculates the importances of a set of features based on a metric of choice,

Utilities and information for the signals.numer.ai tournament

Implementation for HFGI: High-Fidelity GAN Inversion for Image Attribute Editing

Tensorflow implementation of Human-Level Control through Deep Reinforcement Learning

Developing your First ML Workflow of the AWS Machine Learning Engineer Nanodegree Program

Analyses of the individual electric field magnitudes with Roast.

Convert Python 3 code to CUDA code.

Unsupervised Image to Image Translation with Generative Adversarial Networks

Code for Estimating Multi-cause Treatment Effects via Single-cause Perturbation (NeurIPS 2021)

Semi-supervised Adversarial Learning to Generate Photorealistic Face Images of New Identities from 3D Morphable Model