Coder Social home page Coder Social logo

maya-auto-lip-sync's People

Contributors

adamgravois avatar joaen avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

maya-auto-lip-sync's Issues

error

make sure your input data and poses are correctly set up......
i have tried 2 different audios on 2 different rigs still the same error please help me out

Script fails if transcript words are missing from lexicon

Another failure case I found: if a word in the transcript isn't in the lexicon (librispeech-lexicon.txt), the tool will fail. (This includes hyphenated words, like "head-on"! Sheesh!)

I notice MFA says something like "found undefined words, would you ilke to define them?" but the ALS script ignores that prompt, causing the transcription to fail.

Suggested simplest solution: trap that error, and report it to the user. Updating the lexicon or fixing the transcript isn't hard, IMHO.

Tool doesn't work

Hi all, I'm hoping someone could shed some light on my issue with this tool. I got as far as creating all of the files needed for the tool to theoretically work, and in theory it does work, just not fully. It imports the audio file onto the timeline, but does not create any keyframes with it, despite everything being "connected" to the right areas. I will try to add a short clip of this, if anyone has any idea what I may have done wrong, please do let me know as I really want/ need this tool to do its thing.

TIA
-Pabs[

Maya.Auto.Lip.Sync.Issue.mp4

](url)

error with generating keyframe

LOG
select -r POLYWINK_Louise ;
import auto_lip_sync
auto_lip_sync.start()

b'Setting up corpus information...\r\n'
b'Number of speakers in corpus: 1, average number of utterances per speaker: 1.0\r\n'
b'Creating dictionary information...\r\n'
b'Setting up training data...\r\n'
b'Calculating MFCCs...\r\n'
b'Calculating CMVN...\r\n'
b'Number of speakers in corpus: 1, average number of utterances per speaker: 1.0\r\n'
b'Done with setup.\r\n'
b'Done! Everything took 6.46065616607666 seconds\r\n'
b'\r 0%| | 0/2 [00:00<?, ?it/s]\r 50%|##### | 1/2 [00:01<00:01, 1.03s/it]\r100%|##########| 2/2 [00:02<00:00, 1.18s/it]\r\n'

Traceback (most recent call last):

# File "C:\Users/solomon/Documents/maya/2024/scripts\auto_lip_sync\auto_lip_sync.py", line 322, in generate_animation

self.create_keyframes()

# File "C:\Users/solomon/Documents/maya/2024/scripts\auto_lip_sync\auto_lip_sync.py", line 373, in create_keyframes

tg = textgrid.TextGrid.fromFile(textgrid_path)

# File "C:\Users/solomon/Documents/maya/2024/scripts\textgrid\textgrid.py", line 807, in fromFile

tg.read(f)

# File "C:\Users/solomon/Documents/maya/2024/scripts\textgrid\textgrid.py", line 698, in read

encoding = detectEncoding(f)

# File "C:\Users/solomon/Documents/maya/2024/scripts\textgrid\textgrid.py", line 87, in detectEncoding

with codecs.open(f, 'r', encoding='utf-16') as source:

# File "C:\Program Files/Autodesk/Maya2024\Python\lib\codecs.py", line 905, in open

file = builtins.open(filename, mode, buffering)

FileNotFoundError: [Errno 2] No such file or directory: ''

can't start the tool

Hey, thanks for sharing this tool, the code is very organized and i rly wanna try it but i can't seem to get it to work :v
i went through the step by step and used the auto-installer for the dependencies, but when i run the starter script in maya (2019) i only get the error:

Error: SyntaxError: file C:/Users/me/Documents/maya/2019/scripts\auto_lip_sync_init_.py line 2: invalid syntax

I tried it on two computers and get the same error, am i doing something wrong?

Probelm in Generating Key Frame

Hello joaen, thank you for creating and sharing this script!

I downloaded this script today and currently having some problems when generating the keyframes. The .wav file is resampled to 16kHz mono and has the same name as the .txt file. After I pressed the "Generate Keyframes" button, it showed "Done! Everything took..." in the script editor and then suddenly jumped to the situation that shows in the screenshot below
lipsnc_issue

The "Cancel" button did not work, nor were the keyframes generated on the timeline. The progress bar didn't move no matter how long you wait. I also tried several times with different rigs and the results are the same. (I'm using Maya 2022).

Greatly appreciated any solution. Thank you! :)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.