Trainable Bilateral Filter Layer (PyTorch)

Last update: Dec 25, 2022

Overview

Trainable Bilateral Filter Layer (PyTorch)

This repository contains our GPU-accelerated trainable bilateral filter layer (three spatial and one range filter dimension) that can be directly included in any Pytorch graph, just as any conventional layer (FCL, CNN, ...). By calculating the analytical derivative of the bilateral filter with respect to its parameters and its input, the (so far) hyperparameters can be automatically optimized via backpropagation for a calculated loss.

Our corresponding paper Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography can be found on arXiv.

Implementation:

The general structure of the implementation follows the PyTorch documentation for creating custom C++ and CUDA extensions. The forward pass implementation of the layer is based on code from the Project MONAI framework, originally published under the Apache License, Version 2.0. The correct implementation of the analytical forward and backward pass can be verified by running the gradcheck.py script, comparing numerical gradients with the derived analytical gradient using the PyTorch built-in gradcheck function.

Setup:

The C++/CUDA implemented forward and backward functions are compiled via the setup.py script using setuptools:

Create and activate a python environment (python>=3.7).
Install Torch (tested versions: 1.7.1, 1.9.0).
Navigate into the extracted repo.
Compile/install the bilateral filter layer by calling

python setup.py install

Example scripts:

Try out the forward pass by running the example_filter.py (requires Matplotlib and scikit-image).
Run the gradcheck.py script to verify the correct gradient implementation.
Run example_optimization.py to optimize the parameters of a bilateral filter layer to automatically denoise an image.

Optimized bilateral filter prediction:

Citation:

If you find our code useful, please cite our work

@article{wagner2022ultra,
  title={Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography},
  author={Wagner, Fabian and Thies, Mareike and Gu, Mingxuan and Huang, Yixing and Pechmann, Sabrina and Patwari, Mayank and Ploner, Stefan and Aust, Oliver and Uderhardt, Stefan and Schett, Georg and Christiansen, Silke and Maier, Andreas},
  journal={arXiv preprint arXiv:2201.10345},
  year={2022}
}

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re

189 Nov 22, 2022

Comments

3D case example

Hi, I am grateful that you have shared such awesome codes. I have downloaded the codes and tested 2D case. It works well. But when I used 3D images, the results seemed weird. As shown below.

The input 3D image is like this:

Could you provide 3D demo case? Thank you very much!

opened by cs123951 2

Trainable Bilateral Filter Layer (PyTorch)

Related tags

Overview

Trainable Bilateral Filter Layer (PyTorch)

Implementation:

Setup:

Example scripts:

Optimized bilateral filter prediction:

Citation:

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

PyTorch Implementation of NCSOFT's FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesis

[CVPR 2021] Official PyTorch Implementation for "Iterative Filter Adaptive Network for Single Image Defocus Deblurring"

Pytorch Implementation of Continual Learning With Filter Atom Swapping (ICLR'22 Spolight) Paper

Predictive AI layer for existing databases.

Predictive AI layer for existing databases.

An abstraction layer for mathematical optimization solvers.

Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning (ICLR 2021)

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Comments

3D case example

Releases(1.1.0)

1.1.0(Aug 1, 2022)

Owner

FabianWagner

A library for performing coverage guided fuzzing of neural networks

Spectralformer: Rethinking hyperspectral image classification with transformers

Good Classification Measures and How to Find Them

Rethinking the U-Net architecture for multimodal biomedical image segmentation

Rethinking Transformer-based Set Prediction for Object Detection

Kaggle competition: Springleaf Marketing Response

The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression (AAAI2022).

This is an official implementation for "Self-Supervised Learning with Swin Transformers".

D-NeRF: Neural Radiance Fields for Dynamic Scenes

On Generating Extended Summaries of Long Documents

An implementation of the WHATWG URL Standard in JavaScript

Image augmentation library in Python for machine learning.

基于Pytorch实现优秀的自然图像分割框架！(包括FCN、U-Net和Deeplab)

Official Implementation and Dataset of "PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency", CVPR 2021

Official implementation of our neural-network-based fast diffuse room impulse response generator (FAST-RIR)

HNECV: Heterogeneous Network Embedding via Cloud model and Variational inference

Dirty Pixels: Towards End-to-End Image Processing and Perception

Fuzzing the Kernel Using Unicornafl and AFL++

3ds-Ghidra-Scripts - Ghidra scripts to help with 3ds reverse engineering