wswdx / c2f-fwn Goto Github PK

Thanks for your great work!

Could you share the SSIM, PSNR, LPIPS, FID, TCM metrics code?

I am looking forward to your reply, thanks!

Thanks for your great work firstly!

when I run "bash scripts/stage1/train_1.sh", the errors come as below:

raceback (most recent call last):
File "train_stage1.py", line 10, in
from models.models import create_model_parser, create_optimizer_parser, save_models, update_models
ModuleNotFoundError: No module named 'models.models'
root@notebook-tekxt-jg27l:/workspace/cpfs-data/C2F-FWN-main# bash scripts/stage1/train_1.sh
Traceback (most recent call last):
File "train_stage1.py", line 10, in
from models.models import create_model_parser, create_optimizer_parser, save_models, update_models
ModuleNotFoundError: No module named 'models.models'

I am looking forward to your reply, thanks!

thank you very much for your article C2F-FWN, which has made me gain a lot in human movement transfer. But I still have some doubts in some aspects. Specifically, in the Baselines of Experiments in the paper, you mentioned that each character uses 3000 frames to train EDN, but the video frames of each person wearing the same clothes in the IPER data set do not reach 3000 frames even if they are added up. I want to know how you solve this contradiction in the training and testing stages. I hope you can solve my doubts and tell me more details about this. Thank you very much!

Hi will the pretrained weights be released and can you please make a google colab for inference thanks

opened two issues due to github not responded by accident, can delete this one

Hello! when I run train_2.sh and set the batchsize as 4, it comes errors as below:

Traceback (most recent call last):
File "train_stage2.py", line 154, in
train()
File "train_stage2.py", line 61, in train
fg_tps, fg_dense, lo_tps, lo_dense, flow_tps, flow_dense, flow_totalp, real_input_1, real_input_2, real_SFG, real_SFG_fullp, flow_total_last = ClothWarper(input_TParsing, input_TFG, input_SParsing, input_SFG, input_SFG_full, flow_total_prev_last)
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/workspace/cpfs-data/C2F-FWN-main/models/models.py", line 69, in forward
outputs = self.model(*inputs, **kwargs, dummy_bs=self.pad_bs)
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/anaconda3/lib/python3.6/site-packages/torch/nn/parallel/data_parallel.py", line 141, in forward
return self.module(*inputs[0], **kwargs[0])
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/workspace/cpfs-data/C2F-FWN-main/models/model_stage2.py", line 111, in forward
warped_fg_tps, warped_fg_dense, warped_lo_tps, warped_lo_dense, flow_tps, flow_dense, flow_total = self.generate_frame_train(net, real_input_1, real_input_2, real_input_TFG, flow_total_prev, start_gpu, is_first_frame)
File "/workspace/cpfs-data/C2F-FWN-main/models/model_stage2.py", line 142, in generate_frame_train
= net.forward(real_input_1_reshaped, real_input_2_reshaped, real_input_3_reshaped, real_input_tfg_reshaped)
File "/workspace/cpfs-data/C2F-FWN-main/models/networks.py", line 474, in forward
feature_T_1 = self.model_down_target_1([feature_T_0, input_tlo_0, input_tlo_1])
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/container.py", line 92, in forward
input = module(input)
File "/anaconda3/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/workspace/cpfs-data/C2F-FWN-main/models/dconv/modules/modulated_deform_conv.py", line 173, in forward
sample_LO = torch.nn.functional.grid_sample(input_LO, sample_location, mode='bilinear', padding_mode='border')
File "/anaconda3/lib/python3.6/site-packages/torch/nn/functional.py", line 2597, in grid_sample
return torch.grid_sampler(input, grid, mode_enum, padding_mode_enum)
RuntimeError: grid_sampler(): expected grid and input to have same batch size, but got input with sizes [64, 3, 128,96] and grid with sizes [256, 64, 48, 2]

the train_2.sh are shown below:

python train_stage2.py --name clothwarp_256p
--dataroot /workspace/cpfs-data/data/ICCV2021/SoloDance/SoloDance_upload/train --dataset_mode cloth --model cloth --nThreads 16
--input_nc_T_2 4 --input_nc_S_2 3 --input_nc_P_2 10 --ngf 64 --n_downsample_warper 4 --label_nc_2 3 --grid_size 3
--resize_or_crop scaleHeight --loadSize 256 --random_drop_prob 0 --color_aug
--gpu_ids 0 --n_gpus_gen 1 --batchSize 4 --max_frames_per_gpu 12 --display_freq 40 --print_freq 40 --save_latest_freq 1000
--niter 5 --niter_decay 5 --n_scales_temporal 3 --n_frames_D 2
--no_first_img --n_frames_total 12 --max_t_step 4 --tf_log --continue

hope for your replay!

您好！请问test_output_SI路径下是最后合成的motion transfer路径吗？为什么我训出来的人物衣着都是黑色的？

你好，非常感谢您的分享。
我下载了您的数据集，但是里面是26个单独的文件，你的readme文件里面说，把他们放在train和test文件夹下，请问这26个文件，哪些是训练集，哪些是测试集？
另外，预训练模型可以提供一下吗
非常期待您的回复

Thanks for your great work firstly!

when I run "bash scripts/stage2/train_2.sh", the errors come as below:

2021-02-02T03:36:20.050232142Z Traceback (most recent call last):
2021-02-02T03:36:20.050261277Z File "train_stage2.py", line 148, in
2021-02-02T03:36:20.050276234Z train()
2021-02-02T03:36:20.050280035Z File "train_stage2.py", line 38, in train
2021-02-02T03:36:20.050283718Z for idx, data in enumerate(dataset, start=epoch_iter):
2021-02-02T03:36:20.050287632Z File "/anaconda3/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 637, in next
2021-02-02T03:36:20.050291185Z return self._process_next_batch(batch)
2021-02-02T03:36:20.050307614Z File "/anaconda3/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 658, in _process_next_batch
2021-02-02T03:36:20.050311369Z raise batch.exc_type(batch.exc_msg)
2021-02-02T03:36:20.050314555Z IndexError: Traceback (most recent call last):
2021-02-02T03:36:20.050317753Z File "/anaconda3/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 138, in _worker_loop
2021-02-02T03:36:20.050321226Z samples = collate_fn([dataset[i] for i in batch_indices])
2021-02-02T03:36:20.050324425Z File "/anaconda3/lib/python3.6/site-packages/torch/utils/data/dataloader.py", line 138, in
2021-02-02T03:36:20.050327926Z samples = collate_fn([dataset[i] for i in batch_indices])
2021-02-02T03:36:20.050331102Z File "/workspace/cpfs-data/C2F-FWN-main-v1/data/data_stage2.py", line 57, in getitem
2021-02-02T03:36:20.050334599Z sparsing_path = self.sparsing_paths[seq_idx][start_idx + i * t_step]
2021-02-02T03:36:20.050337893Z IndexError: list index out of range

I am looking forward to your reply, thanks!

Thanks for your great work!

Could you share the keypoints and the paring results of the iPER datasets?

I am looking forward to your reply, thanks!