ml-lab / dancing2music

Dancing to Music

Pytorch implementation for music-to-dance generation.

License

Copyright (C) 2018 NVIDIA Corporation. All rights reserved. Licensed under the CC BY-NC-SA 4.0 license (https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode).

Paper

Hsin-Ying Lee, Xiaodong Yang, Ming-Yu Liu, Ting-Chun Wang, Yu-Ding Lu, Ming-Hsuan Yang, and Jan Kautz
Dancing to Music
In Neural Information Processing Systems (NeurIPS) 2019

Results Video

For videos with audio, please visit our youtube video

• Generated Dance Sequences second row: music beats; third row: kinematic beats

• Multimodality Generation given same music and same initial poses

• Long Sequence

• Photo Realisitc Video

Citation

If you find this code useful for your research, please cite our paper:

@inproceedings{lee2019dancing2music,
  title={Dancing to Music},
  author={Lee, Hsin-Ying and Yang, Xiaodong and Liu, Ming-Yu and Wang, Ting-Chun and Lu, Yu-Ding and Yang, Ming-Hsuan and Kautz, Jan},
  booktitle={NeurIPS},
  year={2019}
}

Code and Data Coming Soon