joaen / maya-auto-lip-sync Goto Github PK
View Code? Open in Web Editor NEWA tool to automatically generate lip sync animations in Autodesk: Maya using Montreal Forced Aligner.
License: MIT License
A tool to automatically generate lip sync animations in Autodesk: Maya using Montreal Forced Aligner.
License: MIT License
make sure your input data and poses are correctly set up......
i have tried 2 different audios on 2 different rigs still the same error please help me out
Another failure case I found: if a word in the transcript isn't in the lexicon (librispeech-lexicon.txt), the tool will fail. (This includes hyphenated words, like "head-on"! Sheesh!)
I notice MFA says something like "found undefined words, would you ilke to define them?" but the ALS script ignores that prompt, causing the transcription to fail.
Suggested simplest solution: trap that error, and report it to the user. Updating the lexicon or fixing the transcript isn't hard, IMHO.
Hi all, I'm hoping someone could shed some light on my issue with this tool. I got as far as creating all of the files needed for the tool to theoretically work, and in theory it does work, just not fully. It imports the audio file onto the timeline, but does not create any keyframes with it, despite everything being "connected" to the right areas. I will try to add a short clip of this, if anyone has any idea what I may have done wrong, please do let me know as I really want/ need this tool to do its thing.
TIA
-Pabs[
](url)
LOG
select -r POLYWINK_Louise ;
import auto_lip_sync
auto_lip_sync.start()
b'Setting up corpus information...\r\n'
b'Number of speakers in corpus: 1, average number of utterances per speaker: 1.0\r\n'
b'Creating dictionary information...\r\n'
b'Setting up training data...\r\n'
b'Calculating MFCCs...\r\n'
b'Calculating CMVN...\r\n'
b'Number of speakers in corpus: 1, average number of utterances per speaker: 1.0\r\n'
b'Done with setup.\r\n'
b'Done! Everything took 6.46065616607666 seconds\r\n'
b'\r 0%| | 0/2 [00:00<?, ?it/s]\r 50%|##### | 1/2 [00:01<00:01, 1.03s/it]\r100%|##########| 2/2 [00:02<00:00, 1.18s/it]\r\n'
self.create_keyframes()
tg = textgrid.TextGrid.fromFile(textgrid_path)
tg.read(f)
encoding = detectEncoding(f)
with codecs.open(f, 'r', encoding='utf-16') as source:
file = builtins.open(filename, mode, buffering)
Hi,
I seem to be having issues using this .wav file (resampled to 16kHz mono) and accompanying text file in generating keyframes for my animation.
wav and txt files: https://drive.google.com/drive/folders/1ghHfuH8O9Xg-8JUCLX91fQIZulmw9doo?usp=sharing
Any solution would be greatly appreciated, thanks :)
Hey, thanks for sharing this tool, the code is very organized and i rly wanna try it but i can't seem to get it to work :v
i went through the step by step and used the auto-installer for the dependencies, but when i run the starter script in maya (2019) i only get the error:
I tried it on two computers and get the same error, am i doing something wrong?
Hello joaen, thank you for creating and sharing this script!
I downloaded this script today and currently having some problems when generating the keyframes. The .wav file is resampled to 16kHz mono and has the same name as the .txt file. After I pressed the "Generate Keyframes" button, it showed "Done! Everything took..." in the script editor and then suddenly jumped to the situation that shows in the screenshot below
The "Cancel" button did not work, nor were the keyframes generated on the timeline. The progress bar didn't move no matter how long you wait. I also tried several times with different rigs and the results are the same. (I'm using Maya 2022).
Greatly appreciated any solution. Thank you! :)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.