bai-yt / consistencytta Goto Github PK

Thank you very much for your excellent work!

I am a beginner currently learning about diffusion models, and I would like to ask whether the teacher model used to finally train the consistency model has been distilled from TANGO, which was trained with DDPM schedule, using the DDIM method? If I want to perform a similar consistency distillation, does my teacher need to be one that was trained using the DDIM schedule, or can it be one trained with the DDPM schedule instead?

I use the same config as the author, but the "loss_wrt_gt" keep rising while training and the generate result just like random noise at about epoch10, I use tango pretrained model as the stage1 model as I don't train stage1 and only train stage2, is that the cause resulting in my situation?