Re-implement CycleGAN in Tensorlayer

Last update: Aug 15, 2022

Overview

CycleGAN_Tensorlayer

Re-implement CycleGAN in TensorLayer

Original CycleGAN
Improved CycleGAN with resize-convolution

Prerequisites:

TensorLayer
TensorFlow
Python

Run:

CUDA_VISIBLE_DEVICES=0 python main.py

(if datasets are collected by yourself, you can use dataset_clean.py or dataset_crop.py to pre-process images)

Theory:

The generator process:

The discriminator process:

Result Improvement

Data augmentation
Resize convolution[4]
Instance normalization[5]

data augmentation:

Instance normalization（comparision by original paper https://arxiv.org/abs/1607.08022）:

Resize convolution (Remove Checkerboard Artifacts):

Final Results:

Reference:

[1] Original Paper: https://arxiv.org/pdf/1703.10593.pdf
[2] Original implement in Torch: https://github.com/junyanz/CycleGAN/
[3] TensorLayer by HaoDong: https://github.com/zsdonghao/tensorlayer
[4] Resize Convolution: https://distill.pub/2016/deconv-checkerboard/
[5] Instance Normalization: https://arxiv.org/abs/1607.08022

Comments

Difference from original code
HI very nice implemented cyclegan I have a few questions...

What does "Resize Convolution" mean?

I wonder what is different from the original code of the author.
opened by taki0112 7
Color inversion, black image and nan in loss after ~20 epochs

I've tried to train the model on original summer2winter_yosemite dataset. After ~20 epochs all sample images turned completely black, and all all loss parameters turned to nan. However, the model continued to run for 30 more epochs regularly saving checkpoints until I stopped it.

I've also used another, my own dataset, and it ran correctly for 70 epochs at least, unfortunately the only result I had was color inversion of images. Any advice on changing training parameters (I used default)?

opened by victor-felicitas 0
How to change test output size?

Hi! It is a great implementation of Cyclegan, providing excellent results on Hiptensorflow and ROCm. However, I could not use it to generate test images of different from 256x256 sizes. How can I change that?

For now, I have trained the model on 256x256 images and try to test it on bigger ones. I tried adding two more flags to main.py: flags.DEFINE_integer("image_width", 420, "The size of image to use (will be center cropped) [256]") flags.DEFINE_integer("image_height", 420, "The size of image to use (will be center cropped) [256]")

Which I use later in Test section: test_A = tf.placeholder(tf.float32, [FLAGS.batch_size, FLAGS.image_height, FLAGS.image_width, FLAGS.c_dim], name='test_x') test_B = tf.placeholder(tf.float32, [FLAGS.batch_size, FLAGS.image_height, FLAGS.image_width, FLAGS.c_dim], name='test_y')

However, I always get error: Invalid argument: Conv2DSlowBackpropInput: Size of out_backprop doesn't match computed: actual = 105, computed = 64 Traceback (most recent call last): File "main.py", line 285, in tf.app.run() File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py", line 44, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "main.py", line 281, in main test_cyclegan() File "main.py", line 262, in test_cyclegan fake_img = sess.run(net_g_logits, feed_dict={in_var: sample_image}) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 767, in run run_metadata_ptr) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 965, in _run feed_dict_string, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1015, in _do_run target_list, options, run_metadata) File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1035, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DSlowBackpropInput: Size of out_backprop doesn't match computed: actual = 105, computed = 64 [[Node: gen_A2B/u64/conv2d_transpose = Conv2DBackpropInput[T=DT_FLOAT, data_format="NHWC", padding="SAME", strides=[1, 2, 2, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/gpu:0"](gen_A2B/u64/conv2d_transpose/output_shape, gen_A2B/u64/W_deconv2d/read, gen_A2B/b_residual_add/8)]]

Is there any way to choose output image size? Original Cyclegan has special option to choose it - how can i implement it? resize_or_crop = 'resize_and_crop', -- resizing/cropping strategy: resize_and_crop | crop | scale_width | scale_height

Any help would be appreciated!

opened by victor-felicitas 0
About the imagepool.

I noticed in https://github.com/luoxier/CycleGAN_Tensorlayer/blob/master/main.py#L88 you obtain the logit of image sampled from imagepool but do not use it, is that for some reason or just do not intend to implement it?

opened by Zardinality 0
Error in main.py?

Hi @zsdonghao @luoxier , Is there an error in your main.py: _, errGB2A = sess.run([g_b2a_optim, g_b2a_loss], feed_dict={real_A: batch_imgB, real_B: batch_imgB}) Does it should be: _, errGB2A = sess.run([g_b2a_optim, g_b2a_loss], feed_dict={real_A: batch_imgA, real_B: batch_imgB}) Could you please check it and let me know, thanks.

opened by yongqiangzhang1 2
Where are datasets shown in readme?

There are sunflower2daisy and leopard2tiger results shown in readme, but I don't find any clue about where to download them in code. In https://github.com/luoxier/CycleGAN_Tensorlayer/blob/master/main.py#L32 an optional value for dataset_dir is sunflower2daisy, where can I get it? The author of original paper doesn't seem to provide it.

opened by Zardinality 7

Releases(0.1)

0.1(Sep 30, 2017)
TensorFlow 1.3

TensorLayer (self-contained)

Source code(tar.gz)
Source code(zip)

Owner

GitHub Repository

Neural Style and MSG-Net

PyTorch-Style-Transfer This repo provides PyTorch Implementation of MSG-Net (ours) and Neural Style (Gatys et al. CVPR 2016), which has been included

904 Dec 21, 2022

Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network

ild-cnn This is supplementary material for the manuscript: "Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neur

22 Nov 05, 2022

A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).

189 Dec 28, 2022

Implement of "Training deep neural networks via direct loss minimization" in PyTorch for 0-1 loss

This is the implementation of "Training deep neural networks via direct loss minimization" published at ICML 2016 in PyTorch. The implementation targe

1 Jan 18, 2022

Project dự đoán giá cổ phiếu bằng thuật toán LSTM gồm: code train và code demo

Web predicts stock prices using Long - Short Term Memory algorithm Give me some start please!!! User interface image: Choose: DayBegin, DayEnd, Stock

8 Nov 11, 2022

This repository contains the code to replicate the analysis from the paper "Moving On - Investigating Inventors' Ethnic Origins Using Supervised Learning"

Replication Code for 'Moving On' - Investigating Inventors' Ethnic Origins Using Supervised Learning This repository contains the code to replicate th

0 Jan 04, 2022

Useful materials and tutorials for 110-1 NTU DBME5028 (Application of Deep Learning in Medical Imaging)

7 Jun 22, 2022

Bling's Object detection tool

BriVL for Building Applications This repo is used for illustrating how to build applications by using BriVL model. This repo is re-implemented from fo

47 Nov 01, 2022

ESTDepth: Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks (CVPR 2021)

ESTDepth: Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks (CVPR 2021) Project Page | Video | Paper | Data We present a novel metho

65 Nov 28, 2022

AugLiChem - The augmentation library for chemical systems.

AugLiChem Welcome to AugLiChem! The augmentation library for chemical systems. This package supports augmentation for both crystaline and molecular sy

17 Jan 08, 2023

Lbl2Vec learns jointly embedded label, document and word vectors to retrieve documents with predefined topics from an unlabeled document corpus.

Lbl2Vec Lbl2Vec is an algorithm for unsupervised document classification and unsupervised document retrieval. It automatically generates jointly embed

61 Dec 20, 2022

Data-driven reduced order modeling for nonlinear dynamical systems

SSMLearn Data-driven Reduced Order Models for Nonlinear Dynamical Systems This package perform data-driven identification of reduced order model based

27 Dec 13, 2022

This is the source code for our ICLR2021 paper: Adaptive Universal Generalized PageRank Graph Neural Network.

GPRGNN This is the source code for our ICLR2021 paper: Adaptive Universal Generalized PageRank Graph Neural Network. Hidden state feature extraction i

92 Jan 03, 2023

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models Benchmark and Efficient Evaluation

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models Benchmark and Efficient Evaluation This reposi

1 Aug 21, 2022

Re-implement CycleGAN in Tensorlayer

Related tags

Overview

CycleGAN_Tensorlayer

Prerequisites:

Run:

Theory:

Result Improvement

data augmentation:

Instance normalization（comparision by original paper https://arxiv.org/abs/1607.08022）:

Resize convolution (Remove Checkerboard Artifacts):

Final Results:

Reference:

Comments

Difference from original code

Color inversion, black image and nan in loss after ~20 epochs

How to change test output size?

About the imagepool.

Error in main.py?

Where are datasets shown in readme?

Releases(0.1)

0.1(Sep 30, 2017)