A curated list of neural rendering resources.

Overview

Awesome-of-Neural-Rendering Awesome

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering

Type View `` `` `` `` `` Other
Explanation View Synthesis other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title Venue Type Code Star
ICCV Other PyTorch(Author) ``
Self-Calibrating Neural Radiance Fields ICCV Other PyTorch(Author) 72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering ICLR-Oral Other PyTorch(Author) ``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields ICCV-Oral Other PyTorch(Author) ``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering ICCV Other PyTorch(Author) 128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting CVPR Other PyTorch(Author) 33
IBRNet: Learning Multi-View Image-Based Rendering CVPR View PyTorch(Author) 126
NeX: Real-time View Synthesis with Neural Basis Expansion CVPR-Oral View PyTorch(Author) 320
Neural Lumigraph Rendering CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) 80
pixelNeRF: Neural Radiance Fields from One or Few Images CVPR View PyTorch(Author) 456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes CVPR View PyTorch(Author) 32
D-NeRF: Neural Radiance Fields for Dynamic Scenes CVPR Other PyTorch(Author) 61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) ``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields CVPR-BestPaper Other PyTorch(Author) 609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination SIGGRAPH Asia Other PyTorch(Author) 104

2020

Title Venue Type Code Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material NeurIPS Other PyTorch(Author) 223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis NeurIPS Other PyTorch(Author) 183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision CVPR Other PyTorch(Author) 471
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ECCV-Oral View TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd) 3.6k/1.1k/429/19.2k

2019

Title Venue Type Code Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines SIGGRAPH View PyTorch(Author) 691
Deferred Neural Rendering: Image Synthesis using Neural Textures SIGGRAPH Other PyTorch(Author) 123
Geometry-Aware Neural Rendering NeurIPS Other PyTorch(Author) ``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations NeurIPS-Oral Other PyTorch(Author) 287
Monocular Neural Image Based Rendering with Continuous View Control ICCV Other PyTorch(Author) 43
CVPR Other PyTorch(Author) ``

2018

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2017

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2016

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

Previous Venues

Title Venue Type Code Star
Ray-casting Point-in-polyhedron Test 2012-CESCG Other -

Arxiv

Title Date Type Code Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2021.08.04 View -
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs 2021.08.02 Other PyTorch(Author) 169
Neural Rays for Occlusion-aware Image-based Rendering 2021.07.28 Other PyTorch(Author) 13
Fast and Explicit Neural View Synthesis 2021.07.12 View -
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields 2021.06.24 Other PyTorch(Author) ``
Volume Rendering of Neural Implicit Surfaces 2021.06.22 Other -
Learning to Stylize Novel Views 2021.05.27 `` -
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 2021.04.28 Other PyTorch(Author) 7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling 2021.04.17 `` PyTorch(Author) ``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation 2021.04.02 Other PyTorch(Author) ``
Inverting Neural Radiance Fields for Pose Estimation 2021.04.01 Other -
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination 2021.01.04 Other PyTorch(Author) 115
2021.08.10 `` PyTorch(Author) ``
2021.08.10 `` PyTorch(Author) ``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner
Zhiwei ZHANG
Zhiwei ZHANG
Pytorch implementation of PTNet for high-resolution and longitudinal infant MRI synthesis

Pyramid Transformer Net (PTNet) Project | Paper Pytorch implementation of PTNet for high-resolution and longitudinal infant MRI synthesis. PTNet: A Hi

Xuzhe Johnny Zhang 6 Jun 08, 2022
Multi-modal Vision Transformers Excel at Class-agnostic Object Detection

Multi-modal Vision Transformers Excel at Class-agnostic Object Detection

Muhammad Maaz 206 Jan 04, 2023
Official code repository for A Simple Long-Tailed Rocognition Baseline via Vision-Language Model.

BALLAD This is the official code repository for A Simple Long-Tailed Rocognition Baseline via Vision-Language Model. Requirements Python3 Pytorch(1.7.

peng gao 42 Nov 26, 2022
GAN-based 3D human pose estimation model for 3DV'17 paper

Tensorflow implementation for 3DV 2017 conference paper "Adversarially Parameterized Optimization for 3D Human Pose Estimation". @inproceedings{jack20

Dominic Jack 15 Feb 27, 2021
A simple AI that will give you si ple task and this is made with python

Crystal-AI A simple AI that will give you si ple task and this is made with python Prerequsites: Python3.6.2 pyttsx3 pip install pyttsx3 pyaudio pip i

CrystalAnd 1 Dec 25, 2021
LSSY量化交易系统

LSSY量化交易系统 该项目是本人3年来研究量化慢慢积累开发的一套系统,属于早期作品慢慢修改而来,仅供学习研究,回测分析,实盘交易部分未公开

55 Oct 04, 2022
Yolov5 + Deep Sort with PyTorch

딥소트 수정중 Yolov5 + Deep Sort with PyTorch Introduction This repository contains a two-stage-tracker. The detections generated by YOLOv5, a family of obj

1 Nov 26, 2021
This project helps to colorize grayscale images using multiple exemplars.

Multiple Exemplar-based Deep Colorization (Pytorch Implementation) Pretrained Model [Jitendra Chautharia](IIT Jodhpur)1,3, Prerequisites Python 3.6+ N

jitendra chautharia 3 Aug 05, 2022
Official PyTorch implementation of BlobGAN: Spatially Disentangled Scene Representations

BlobGAN: Spatially Disentangled Scene Representations Official PyTorch Implementation Paper | Project Page | Video | Interactive Demo BlobGAN.mp4 This

148 Dec 29, 2022
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

Tensorpack is a neural network training interface based on TensorFlow. Features: It's Yet Another TF high-level API, with speed, and flexibility built

Tensorpack 6.2k Jan 09, 2023
MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation

MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation This repo is the official implementation of "MHFormer: Multi-Hypothesis Transforme

Vegetabird 281 Jan 07, 2023
Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

235 Dec 26, 2022
Official PyTorch implementation of "The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose Estimation" (ICCV 21).

CenterGroup This the official implementation of our ICCV 2021 paper The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person P

Dynamic Vision and Learning Group 43 Dec 25, 2022
Code for the paper BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks

Biomedical Entity Linking This repo provides the code for the paper BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Res

Tuan Manh Lai 24 Oct 24, 2022
PyTorch implementation of saliency map-aided GAN for Auto-demosaic+denosing

Saiency Map-aided GAN for RAW2RGB Mapping The PyTorch implementations and guideline for Saiency Map-aided GAN for RAW2RGB Mapping. 1 Implementations B

Yuzhi ZHAO 20 Oct 24, 2022
The Official Implementation of the ICCV-2021 Paper: Semantically Coherent Out-of-Distribution Detection.

SCOOD-UDG (ICCV 2021) This repository is the official implementation of the paper: Semantically Coherent Out-of-Distribution Detection Jingkang Yang,

Jake YANG 62 Nov 21, 2022
On-device speech-to-intent engine powered by deep learning

Rhino Made in Vancouver, Canada by Picovoice Rhino is Picovoice's Speech-to-Intent engine. It directly infers intent from spoken commands within a giv

Picovoice 510 Dec 30, 2022
DeepProbLog is an extension of ProbLog that integrates Probabilistic Logic Programming with deep learning by introducing the neural predicate.

DeepProbLog DeepProbLog is an extension of ProbLog that integrates Probabilistic Logic Programming with deep learning by introducing the neural predic

KU Leuven Machine Learning Research Group 94 Dec 18, 2022
Image data augmentation scheduler for albumentations transforms

albu_scheduler Scheduler for albumentations transforms based on PyTorch schedulers interface Usage TransformMultiStepScheduler import albumentations a

19 Aug 04, 2021
Microscopy Image Cytometry Toolkit

Cytokit Cytokit is a collection of tools for quantifying and analyzing properties of individual cells in large fluorescent microscopy datasets with a

Hammer Lab 106 Jan 06, 2023