Trainable Bilateral Filter Layer (PyTorch)

Last update: Dec 25, 2022

Overview

Trainable Bilateral Filter Layer (PyTorch)

This repository contains our GPU-accelerated trainable bilateral filter layer (three spatial and one range filter dimension) that can be directly included in any Pytorch graph, just as any conventional layer (FCL, CNN, ...). By calculating the analytical derivative of the bilateral filter with respect to its parameters and its input, the (so far) hyperparameters can be automatically optimized via backpropagation for a calculated loss.

Our corresponding paper Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography can be found on arXiv.

Implementation:

The general structure of the implementation follows the PyTorch documentation for creating custom C++ and CUDA extensions. The forward pass implementation of the layer is based on code from the Project MONAI framework, originally published under the Apache License, Version 2.0. The correct implementation of the analytical forward and backward pass can be verified by running the gradcheck.py script, comparing numerical gradients with the derived analytical gradient using the PyTorch built-in gradcheck function.

Setup:

The C++/CUDA implemented forward and backward functions are compiled via the setup.py script using setuptools:

Create and activate a python environment (python>=3.7).
Install Torch (tested versions: 1.7.1, 1.9.0).
Navigate into the extracted repo.
Compile/install the bilateral filter layer by calling

python setup.py install

Example scripts:

Try out the forward pass by running the example_filter.py (requires Matplotlib and scikit-image).
Run the gradcheck.py script to verify the correct gradient implementation.
Run example_optimization.py to optimize the parameters of a bilateral filter layer to automatically denoise an image.

Optimized bilateral filter prediction:

Citation:

If you find our code useful, please cite our work

@article{wagner2022ultra,
  title={Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography},
  author={Wagner, Fabian and Thies, Mareike and Gu, Mingxuan and Huang, Yixing and Pechmann, Sabrina and Patwari, Mayank and Ploner, Stefan and Aust, Oliver and Uderhardt, Stefan and Schett, Georg and Christiansen, Silke and Maier, Andreas},
  journal={arXiv preprint arXiv:2201.10345},
  year={2022}
}

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re

189 Nov 22, 2022

Comments

3D case example

Hi, I am grateful that you have shared such awesome codes. I have downloaded the codes and tested 2D case. It works well. But when I used 3D images, the results seemed weird. As shown below.

The input 3D image is like this:

Could you provide 3D demo case? Thank you very much!

opened by cs123951 2

Trainable Bilateral Filter Layer (PyTorch)

Related tags

Overview

Trainable Bilateral Filter Layer (PyTorch)

Implementation:

Setup:

Example scripts:

Optimized bilateral filter prediction:

Citation:

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

PyTorch Implementation of NCSOFT's FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesis

[CVPR 2021] Official PyTorch Implementation for "Iterative Filter Adaptive Network for Single Image Defocus Deblurring"

Pytorch Implementation of Continual Learning With Filter Atom Swapping (ICLR'22 Spolight) Paper

Predictive AI layer for existing databases.

Predictive AI layer for existing databases.

An abstraction layer for mathematical optimization solvers.

Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning (ICLR 2021)

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Comments

3D case example

Releases(1.1.0)

1.1.0(Aug 1, 2022)

Owner

FabianWagner

3D-printable hand-strapped keyboard

Llvlir - Low Level Variable Length Intermediate Representation

Perform Linear Classification with Multi-way Data

Alpha-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression

Google-drive-to-sqlite - Create a SQLite database containing metadata from Google Drive

An Open Source Machine Learning Framework for Everyone

Multiview 3D object detection on MultiviewC dataset through moft3d.

Planner_backend - Academic planner application designed for students and counselors.

[NeurIPS 2021] Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

More than a hundred strange attractors

KAPAO is an efficient multi-person human pose estimation model that detects keypoints and poses as objects and fuses the detections to predict human poses.

Python library for computer vision labeling tasks. The core functionality is to translate bounding box annotations between different formats-for example, from coco to yolo.

Level Based Customer Segmentation

This is RFA-Toolbox, a simple and easy-to-use library that allows you to optimize your neural network architectures using receptive field analysis (RFA) and create graph visualizations of your architecture.

Music library streaming app written in Flask & VueJS

3D AffordanceNet is a 3D point cloud benchmark consisting of 23k shapes from 23 semantic object categories, annotated with 56k affordance annotations and covering 18 visual affordance categories.

An expansion for RDKit to read all types of files in one line

Canonical Appearance Transformations

Pytoydl: A toy deep learning framework built upon numpy.

quantize aware training package for NCNN on pytorch