Photographic Image Synthesis with Cascaded Refinement Networks - Pytorch Implementation

Last update: Mar 27, 2022

Overview

1707.09405)

This is a Pytorch implementation of cascaded refinement networks to synthesize photographic images from semantic layouts. Now the pretrained model and codes for training the network from scratch are available for 256x512 resolution. Thanks to Qifeng Chen for his tensorflow implementation which helped a lot in developing this pytorch version.

Testing

Download this package and keep all the subsequent mentioned files in the same folder.
Download the pretrained VGG19 Net from VGG19
Download the pretrained weights for the CRN network for 256x512 CRN
Keep the mode=test and mention the semantic image name to be tested in the Cascadaed_Network_LM_256.py
The synthesized images will be saved in current folder.

Training

Follow steps 1 to 3 from the testing steps.
Resize all the training images to 256x512. Keep the semantic segmentated training images in Label256Full folder and
the RGB training images in RGB256Full (without any subfolders).
Set mode=train in Cascadaed_Network_LM_256.py and run it for desired epochs (default is 200).

Future Work

Soon the pretrained weights for resolution 512x1024 and 1024x20148 will be available along with training scripts.

Note

All the codes are written to run on GPU. Suitable changes should be done if you want to run on CPU. Also feel free to
customize it according to your need.

Photographic Image Synthesis with Cascaded Refinement Networks - Pytorch Implementation

Related tags

Overview

Photographic Image Synthesis with Cascaded Refinement Networks-Pytorch (https://arxiv.org/abs/1707.09405)

Owner

Soumya Tripathy

BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment

Deep-learning-roadmap - All You Need to Know About Deep Learning - A kick-starter

DFFNet: An IoT-perceptive Dual Feature Fusion Network for General Real-time Semantic Segmentation

Reinforcement learning for self-driving in a 3D simulation

Code for "Unsupervised Source Separation via Bayesian inference in the latent domain"

This repository contains Prior-RObust Bayesian Optimization (PROBO) as introduced in our paper "Accounting for Gaussian Process Imprecision in Bayesian Optimization"

This is the official source code of "BiCAT: Bi-Chronological Augmentation of Transformer for Sequential Recommendation".

OpenDelta - An Open-Source Framework for Paramter Efficient Tuning.

PyTorch implementation of Deep HDR Imaging via A Non-Local Network (TIP 2020).

Black-Box-Tuning - Black-Box Tuning for Language-Model-as-a-Service

PyBullet CartPole and Quadrotor environments—with CasADi symbolic a priori dynamics—for learning-based control and reinforcement learning

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

Code for "Causal autoregressive flows" - AISTATS, 2021

Time-Optimal Planning for Quadrotor Waypoint Flight

Chainer Implementation of Fully Convolutional Networks. (Training code to reproduce the original result is available.)

Object Detection with YOLOv3

Official implementation of "A Unified Objective for Novel Class Discovery", ICCV2021 (Oral)

Official implementation of "Learning Not to Reconstruct" (BMVC 2021)

TorchDistiller - a collection of the open source pytorch code for knowledge distillation, especially for the perception tasks, including semantic segmentation, depth estimation, object detection and instance segmentation.

Blind Video Temporal Consistency via Deep Video Prior