A curated list of neural rendering resources.

Overview

Awesome-of-Neural-Rendering Awesome

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering

Type View `` `` `` `` `` Other
Explanation View Synthesis other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title Venue Type Code Star
ICCV Other PyTorch(Author) ``
Self-Calibrating Neural Radiance Fields ICCV Other PyTorch(Author) 72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering ICLR-Oral Other PyTorch(Author) ``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields ICCV-Oral Other PyTorch(Author) ``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering ICCV Other PyTorch(Author) 128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting CVPR Other PyTorch(Author) 33
IBRNet: Learning Multi-View Image-Based Rendering CVPR View PyTorch(Author) 126
NeX: Real-time View Synthesis with Neural Basis Expansion CVPR-Oral View PyTorch(Author) 320
Neural Lumigraph Rendering CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) 80
pixelNeRF: Neural Radiance Fields from One or Few Images CVPR View PyTorch(Author) 456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes CVPR View PyTorch(Author) 32
D-NeRF: Neural Radiance Fields for Dynamic Scenes CVPR Other PyTorch(Author) 61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) ``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields CVPR-BestPaper Other PyTorch(Author) 609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination SIGGRAPH Asia Other PyTorch(Author) 104

2020

Title Venue Type Code Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material NeurIPS Other PyTorch(Author) 223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis NeurIPS Other PyTorch(Author) 183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision CVPR Other PyTorch(Author) 471
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ECCV-Oral View TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd) 3.6k/1.1k/429/19.2k

2019

Title Venue Type Code Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines SIGGRAPH View PyTorch(Author) 691
Deferred Neural Rendering: Image Synthesis using Neural Textures SIGGRAPH Other PyTorch(Author) 123
Geometry-Aware Neural Rendering NeurIPS Other PyTorch(Author) ``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations NeurIPS-Oral Other PyTorch(Author) 287
Monocular Neural Image Based Rendering with Continuous View Control ICCV Other PyTorch(Author) 43
CVPR Other PyTorch(Author) ``

2018

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2017

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2016

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

Previous Venues

Title Venue Type Code Star
Ray-casting Point-in-polyhedron Test 2012-CESCG Other -

Arxiv

Title Date Type Code Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2021.08.04 View -
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs 2021.08.02 Other PyTorch(Author) 169
Neural Rays for Occlusion-aware Image-based Rendering 2021.07.28 Other PyTorch(Author) 13
Fast and Explicit Neural View Synthesis 2021.07.12 View -
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields 2021.06.24 Other PyTorch(Author) ``
Volume Rendering of Neural Implicit Surfaces 2021.06.22 Other -
Learning to Stylize Novel Views 2021.05.27 `` -
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 2021.04.28 Other PyTorch(Author) 7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling 2021.04.17 `` PyTorch(Author) ``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation 2021.04.02 Other PyTorch(Author) ``
Inverting Neural Radiance Fields for Pose Estimation 2021.04.01 Other -
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination 2021.01.04 Other PyTorch(Author) 115
2021.08.10 `` PyTorch(Author) ``
2021.08.10 `` PyTorch(Author) ``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner
Zhiwei ZHANG
Zhiwei ZHANG
WaveFake: A Data Set to Facilitate Audio DeepFake Detection

WaveFake: A Data Set to Facilitate Audio DeepFake Detection This is the code repository for our NeurIPS 2021 (Track on Datasets and Benchmarks) paper

Chair for Sys­tems Se­cu­ri­ty 27 Dec 22, 2022
Official implementation of the paper Image Generators with Conditionally-Independent Pixel Synthesis https://arxiv.org/abs/2011.13775

CIPS -- Official Pytorch Implementation of the paper Image Generators with Conditionally-Independent Pixel Synthesis Requirements pip install -r requi

Multimodal Lab @ Samsung AI Center Moscow 201 Dec 21, 2022
MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutions

MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutions Project Page | Paper If you find our work useful for your research, please con

96 Jan 04, 2023
Normal Learning in Videos with Attention Prototype Network

Codes_APN Official codes of CVPR21 paper: Normal Learning in Videos with Attention Prototype Network (https://arxiv.org/abs/2108.11055) Overview of ou

11 Dec 13, 2022
Implementation of Pooling by Sliced-Wasserstein Embedding (NeurIPS 2021)

PSWE: Pooling by Sliced-Wasserstein Embedding (NeurIPS 2021) PSWE is a permutation-invariant feature aggregation/pooling method based on sliced-Wasser

Navid Naderializadeh 3 May 06, 2022
A lightweight face-recognition toolbox and pipeline based on tensorflow-lite

FaceIDLight 📘 Description A lightweight face-recognition toolbox and pipeline based on tensorflow-lite with MTCNN-Face-Detection and ArcFace-Face-Rec

Martin Knoche 16 Dec 07, 2022
for taichi voxel-challange event

Taichi Voxel Challenge Figure: result of python3 example6.py. Please replace the image above (demo.jpg) with yours, so that other people can immediate

Liming Xu 20 Nov 26, 2022
Official Pytorch Implementation of Relational Self-Attention: What's Missing in Attention for Video Understanding

Relational Self-Attention: What's Missing in Attention for Video Understanding This repository is the official implementation of "Relational Self-Atte

mandos 43 Dec 07, 2022
This repository is a basic Machine Learning train & validation Template (Using PyTorch)

pytorch_ml_template This repository is a basic Machine Learning train & validation Template (Using PyTorch) TODO Markdown 사용법 Build Docker 사용법 Anacond

1 Sep 15, 2022
Parametric Contrastive Learning (ICCV2021)

Parametric-Contrastive-Learning This repository contains the implementation code for ICCV2021 paper: Parametric Contrastive Learning (https://arxiv.or

DV Lab 156 Dec 21, 2022
Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentation (ACM MM 2020)

Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentation (ACM MM 2020) Official implementation of: Forest R-CNN: Large-Vo

Jialian Wu 54 Jan 06, 2023
A Python implementation of global optimization with gaussian processes.

Bayesian Optimization Pure Python implementation of bayesian global optimization with gaussian processes. PyPI (pip): $ pip install bayesian-optimizat

fernando 6.5k Jan 02, 2023
Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

PyMAF This repository contains the code for the following paper: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop Hongwe

Hongwen Zhang 450 Dec 28, 2022
pytorch implementation of openpose including Hand and Body Pose Estimation.

pytorch-openpose pytorch implementation of openpose including Body and Hand Pose Estimation, and the pytorch model is directly converted from openpose

Hzzone 1.4k Jan 07, 2023
Exadel CompreFace is a free and open-source face recognition GitHub project

Exadel CompreFace is a leading free and open-source face recognition system Exadel CompreFace is a free and open-source face recognition service that

Exadel 2.6k Jan 04, 2023
Deep Multimodal Neural Architecture Search

MMNas: Deep Multimodal Neural Architecture Search This repository corresponds to the PyTorch implementation of the MMnas for visual question answering

Vision and Language Group@ MIL 23 Dec 21, 2022
Lightwood is Legos for Machine Learning.

Lightwood is like Legos for Machine Learning. A Pytorch based framework that breaks down machine learning problems into smaller blocks that can be glu

MindsDB Inc 312 Jan 08, 2023
Experimental code for paper: Generative Adversarial Networks as Variational Training of Energy Based Models

Experimental code for paper: Generative Adversarial Networks as Variational Training of Energy Based Models, under review at ICLR 2017 requirements: T

Shuangfei Zhai 18 Mar 05, 2022
FeTaQA: Free-form Table Question Answering

FeTaQA: Free-form Table Question Answering FeTaQA is a Free-form Table Question Answering dataset with 10K Wikipedia-based {table, question, free-form

Language, Information, and Learning at Yale 40 Dec 13, 2022