FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

Latex code for making neural networks diagrams

Simple machine learning library / 簡單易用的機器學習套件

Official implementation of the paper Label-Efficient Semantic Segmentation with Diffusion Models

RealTime Emotion Recognizer for Machine Learning Study Jam's demo

Betafold - AlphaFold with tunings

This repository includes the official project for the paper: TransMix: Attend to Mix for Vision Transformers.

Simulation of moving particles under microscopic imaging

Multiple custom object count and detection using YOLOv3-Tiny method

PyTorch Code for NeurIPS 2021 paper Anti-Backdoor Learning: Training Clean Models on Poisoned Data.

Pytorch implementation of Implicit Behavior Cloning.

Mercer Gaussian Process (MGP) and Fourier Gaussian Process (FGP) Regression

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

Bootstrapped Representation Learning on Graphs

This project intends to use SVM supervised learning to determine whether or not an individual is diabetic given certain attributes.

Boston House Prediction Valuation Tool

InsTrim: Lightweight Instrumentation for Coverage-guided Fuzzing

Modeling Category-Selective Cortical Regions with Topographic Variational Autoencoders

Source Code for ICSE 2022 Paper - ``Can We Achieve Fairness Using Semi-Supervised Learning?''

My implementation of Image Inpainting - A deep learning Inpainting model

Accelerate Neural Net Training by Progressively Freezing Layers