Cycle-GAN training about gcc-sfcn

[gjy3035]

For SE Cycle GAN, we add a loss in Cycle GAN during the reconstruction process.
In practice, we add a .py file and modify the model file.

Considering the minor improvement based on Cycle GAN, we provide some related files.
SE CycleGAN.zip

pytorch_ssim: loss computation.
cycle_gan_model.py: SE Cycle GAN model file
filter.py: Scene Regulization.

[gjy3035]

Because of many deadlines in March and April, we don't have enough time to check the entire SE Cycle GAN code and release it. After April, we will try our best to open source it ASAP.
If you have any problems during training SE Cycle GAN, you can submit issues or send email to me: [email protected]. Thanks for your attention!

[IssamLaradji]

Thanks a lot @gjy3035 that's very helpful! Would it be okay if you provide the hyperparameters you used with Cycada/SSIM?

For example,

• the lambda in the reconstruction loss;
• the crop size of the input image;
• the batch size; and
• the network architectures of the discriminators and generators?

Thanks a lot for your engagement! :)

[gjy3035]

Other settings are followed by pix2pix's (pytorch 0.3.1) default configuration (the paper also mentions it). To be specific,

• lambda is 10.0;
• size setting:
  • pre process: resize GCC to 540*960
  • training: crop size 360*360
• batch size is 2 on two 1080Ti GPUs (you may adopt a larger value on Titan V or other high-performance devices);
• same as the default selection: basic and resnet_9blocks

Here, we provide the opt.txt for you.
opt.txt
Two key setting:
loadSize: 540: height size for pre processing;
resize_or_crop: scale_height_and_crop: keeping the ratio and resize GCC to height of 540, i.e., the entire resolution is 540*960 (you may add some code similar to "scale_width_and_crop" in data/base_dataset.py).

[CommissarMa]

I wonder if the process of generating realistic GCC images are as follows:

1. use 'scale_height_and_crop' to get 360*360 patches for CycleGAN training as your opt.txt above.
2. use trained netG to get realistic GCC images with 540*960.
   Thank you.