Comments (6)
Hi @xa0082249956 ,
Can you please clarify what you mean by "the Toonify model provided in the readme as the weight."
Are you training on your 50,000 pairs of (reals, toons) starting from the pretrained model we uploaded to the repo?
from pixel2style2pixel.
Hi, we are training by
python scripts/train.py \
--dataset_type=ffhq_encode \
--exp_dir=experiment_disney \
--workers=8 \
--batch_size=2 \
--test_batch_size=2 \
--test_workers=8 \
--val_interval=2500 \
--save_interval=5000 \
--encoder_type=GradualStyleEncoder \
--start_from_latent_avg \
--lpips_lambda=0.8 \
--l2_lambda=1 \
--id_lambda=1 \
--w_norm_lambda=0.025 \
--stylegan_weights /data/pixel2style2pixel/ffhq_cartoon_blended.pt
And the data are pairs like (real,toon).
from pixel2style2pixel.
Cool. So a few points:
- We train our toonify model using only real images (no paired data) and therefore the loss lambdas we use may not be optimal for your training which you do with paired data. I would consider playing with trying to decrease the w_norm_lambda.
- In any case, I think the results you got are not bad at all (especially the second one). With that said, playing with the lambda values may give slightly better results since you have paired data to work with.
Please note that the results you can't may not be as good as the results you get with optimization, which takes a substantially longer time for inference compared to our method.
from pixel2style2pixel.
Great! Thanks for your reply. I will try it.
from pixel2style2pixel.
Two questions regarding "we use about 50k pairs of pictures generated by Toonify Stylegan to do pairs-training".
- Where to find the model of 'Toonify Stylegan'?
- How to do pair-training?
from pixel2style2pixel.
Hi @brightmart
The toonify StyleGAN model is provided in the README and can be downloaded here:
https://drive.google.com/file/d/1r3XVCt_WYUKFZFxhNH-xO2dTtF6B5szu/view?usp=sharing
To do paired training, you need to first generated pairs of (real, toon) images. While I don't know exactly how the paired data was generated in this case, you can check out the following Google Colab from Justin Pinkney to see an example of how to generate the paired images:
https://colab.research.google.com/drive/1s2XPNMwf6HDhrJ1FMwlW1jl-eQ2-_tlk?usp=sharing#scrollTo=cuMEHnpmI1Mj
from pixel2style2pixel.
Related Issues (20)
- do a huggingface demo HOT 1
- How to train on paired data? HOT 1
- latent image editing HOT 1
- About celebs_seg_to_face HOT 1
- multiple GPUs HOT 4
- Using my own pretrained model from vanilla StyleGAN2 HOT 3
- Is it possible video2anime train? like this project? HOT 3
- A problem about how to get diverse images? HOT 1
- the output image become brown HOT 3
- Need help with running the code on CPU HOT 1
- loading pretrained weights, STACK_GLOBAL requires str HOT 1
- How to train pSp on Z+ space? HOT 2
- Is it possible to create output images in profile (side-on) perspective using sketch to face? HOT 1
- Single channel input with Moco loss not working. HOT 2
- Some error reporting problems encountered during operation HOT 1
- How to use other identity loss rather than Arcface or Moco HOT 2
- How to use psp for Face beautification
- loss jump problem HOT 1
- Retraining
- How can I use the style mixing to just change the hair color.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pixel2style2pixel.