cuustom character about talking_avatar

[bornfree]

Unfortunately the process to create a character with the correct blendshapes is quite cumbersome.
I'll record a video and share it. Maybe that can help.

[rezadadashian2]

@jahnaviraj For starter, create a simple model in Blender, then you can use a practical add-on called "Faceit" to make all the required 52 "Shape Keys" (these are the keys that has the same name with Azure API keys) for the face in less than an hour. Then export the model in .glb file with default export settings. Just remember to comment-out unnecessary codes which make the project break. for example you have to comment this code for now because most of the simple avatars doesn't have a LowerTeeth (LowerJaw is correct):
// createAnimation(blendData, morphTargetDictionaryLowerTeeth, 'HG_TeethLower')
if you have TeethLower (Lower Jaw) then you use Faceit to create Shape Keys for that too.

I do not recommend using the model in this project as it breaks how ever you export it.

[Utkarshkapil]

bro died after creating repo lmao

[itsaizaz]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Can you please share the instruction to [email protected] please, i stuck at the same place

hey bro I can help you

[rezadadashian2]

@robegamesios No, the default export settings are just fine.

[rezadadashian2]

@Shivamkumar285 There's lots of things you have to consider while creating the avatar, therefore I won't be able to tell it all here and there's no public repository i currently would have for this.

But, the best clue i can you is to use a tool named "FaceIt" on Blender to assign each and every shape key the developer used in this repository to make the avatar talk (and 90% of all errors are related to shape keys and talking functionality)

[microscopes2468]

Unfortunately the process to create a character with the correct blendshapes is quite cumbersome.
I'll record a video and share it. Maybe that can help.

I also want to know how to do custom characters.

[longdang2709]

@bornfree I love your project too and would like to learn how to create a custom character and theme.
Please share

[premiumleads]

Unfortunately the process to create a character with the correct blendshapes is quite cumbersome. I'll record a video and share it. Maybe that can help.

Yes please we need to put video avatars

[jahnaviraj]

Please share the video.
Also did you make this character or you downloaded it from somewhere? @bornfree

[lukevink-dentsu]

Hey @bornfree can you share that video? Or perhaps you could share the blender file so we can understand how to? I am very curious how you rigged it etc. Cheers

Hi @bornfree how did you trained the model ? Is there any resource to follow ?

[brianmabua]

Hello, @bornfree. Can you point me to where I can information on how to customise the avatar?

[guilhermelia]

The website he used to create avatar is unavailable (3dify.me). Maybe never come back again. Sorry.

[robegamesios]

hi @bornfree can show us how to change the avatar and voice please. thanks

[robegamesios]

Hey thanks again for this. I used it as a starting point to integrate GPT, I can talk to it now. I still haven’t figured out how to change the avatar though, I tried modifying the glb in blender but it breaks when I export it again. Anyway here is the demo https://youtu.be/iv8bP2X0IQM

[rezadadashian2]

Hi @bornfree. Any update?

Hey thanks again for this. I used it as a starting point to integrate GPT, I can talk to it now. I still haven’t figured out how to change the avatar though, I tried modifying the glb in blender but it breaks when I export it again. Anyway here is the demo https://youtu.be/iv8bP2X0IQM

Hi Rob, did you find a way to generate or create your own avatar (model)? We've been trying for days and it was not successful yet.

[robegamesios]

Hi @bornfree. Any update?

Hey thanks again for this. I used it as a starting point to integrate GPT, I can talk to it now. I still haven’t figured out how to change the avatar though, I tried modifying the glb in blender but it breaks when I export it again. Anyway here is the demo https://youtu.be/iv8bP2X0IQM

Hi Rob, did you find a way to generate or create your own avatar (model)? We've been trying for days and it was not successful yet.

hi, nope I’ve tried for a week but not easy. I’ve tried replacing the model using a rigged avatar but no luck. I also tried to reuse the existing model’s rig and apply to a different model. I even tried just modifying the existing avatar’s face in blender but it stopped working after. There are ‘cold targets’ in the avatar that are mapped to the face. I’m gonna try to recreate those targets on a different model and see if that works (mimicing how this existing model was made) probably next week when I free up. If you know blender then you can recreate it (I think). I’ll keep you posted if I get it to work.

[rezadadashian2]

@robegamesios just exactly like us :))))) we went the same way. We have a 3D designer on our team but i had no luck interacting with her about this project so i'm starting to learn Blender myself. I'll let you know too if i find something worthy.

[robegamesios]

@robegamesios just exactly like us :))))) we went the same way. We have a 3D designer on our team but i had no luck interacting with her about this project so i'm starting to learn Blender myself. I'll let you know too if i find something worthy.

Fyi, I tried importing the model.glb and exporting it back out again using blender without even modifying anything and it’s totally broke the model. The head position looks up like in a horror film and I get errors when running it in threejs. I tried all the export glb options in blender and nothing worked for me. Have you tried this?

[rezadadashian2]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

[robegamesios]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Thanks! Did you have to change any of the default export to glb settings in blender?

[jahnaviraj]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Hi, Could you please share the intructions with me also? I would appreciate it :)

[robegamesios]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Hi, Could you please share the intructions with me also? I would appreciate it :)

Also if you have an existing rigged model, you can try to rename the shapekeys to match the azure blendshape names. Easiest test is to rename the open mouth to jawOpen and export to glb binary and see if it works before renaming the rest. The cleanest way is to do as @rezadadashian2 mentioned above. I tried this on an existing model but since the file size is huge, it affects the initial loading time of the browser . I also got some unwanted side effects like the teeth went missing on my exported glb and I’m not sure why

[toozande]

@jahnaviraj For starter, create a simple model in Blender, then you can use a practical add-on called "Faceit" to make all the required 52 "Shape Keys" (these are the keys that has the same name with Azure API keys) for the face in less than an hour. Then export the model in .glb file with default export settings. Just remember to comment-out unnecessary codes which make the project break. for example you have to comment this code for now because most of the simple avatars doesn't have a LowerTeeth (LowerJaw is correct): // createAnimation(blendData, morphTargetDictionaryLowerTeeth, 'HG_TeethLower') if you have TeethLower (Lower Jaw) then you use Faceit to create Shape Keys for that too.

I do not recommend using the model in this project as it breaks how ever you export it.

good job but do you know if there is free API like Azure API key ?

[rezadadashian2]

@jahnaviraj For starter, create a simple model in Blender, then you can use a practical add-on called "Faceit" to make all the required 52 "Shape Keys" (these are the keys that has the same name with Azure API keys) for the face in less than an hour. Then export the model in .glb file with default export settings. Just remember to comment-out unnecessary codes which make the project break. for example you have to comment this code for now because most of the simple avatars doesn't have a LowerTeeth (LowerJaw is correct): // createAnimation(blendData, morphTargetDictionaryLowerTeeth, 'HG_TeethLower') if you have TeethLower (Lower Jaw) then you use Faceit to create Shape Keys for that too.
I do not recommend using the model in this project as it breaks how ever you export it.

good job but do you know if there is free API like Azure API key ?

@toozande Azure text-to-speech API is free.
maybe you wanted to ask about open-source?
No I don't know any.

[VanshRana12]

@jahnaviraj For starter, create a simple model in Blender, then you can use a practical add-on called "Faceit" to make all the required 52 "Shape Keys" (these are the keys that has the same name with Azure API keys) for the face in less than an hour. Then export the model in .glb file with default export settings. Just remember to comment-out unnecessary codes which make the project break. for example you have to comment this code for now because most of the simple avatars doesn't have a LowerTeeth (LowerJaw is correct): // createAnimation(blendData, morphTargetDictionaryLowerTeeth, 'HG_TeethLower') if you have TeethLower (Lower Jaw) then you use Faceit to create Shape Keys for that too.

I do not recommend using the model in this project as it breaks how ever you export it.

Thanks a lot! Gonna try this.

[subinoybiswas]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Can you send it to me also?

[Shivamkumar285]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Can you please send the instructions as well to me? Might be some repo that you have created?

[MS-YUN]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Hello. Can you send it to me as well? I didn't know the graphics at all, but I've tried various methods while studying for a month, but I'm constantly getting lost. I sincerely ask you to do that. Thank you.

[itsaizaz]

We're excited to announce that we've recently enhanced our system with some cutting-edge new features! First, we've integrated an AI chatbot that's designed to provide you with faster, more efficient support and assistance. This chatbot is equipped with advanced natural language processing capabilities, ensuring a smooth and intuitive interaction experience. Additionally, we've revamped our model design, introducing a sleeker, more user-friendly interface that not only looks better but also enhances usability. These updates are part of our ongoing commitment to improving user experience and delivering value through innovative solutions. We can't wait for you to try them out!

[ssreeram]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Can you please share the instruction to [email protected] please, i stuck at the same place

[ssreeram]

@itsaizaz Please let me know how to do this? can u share the instructions on above shared email? please

[ssreeram]

@robegamesios We managed to make it work by creating a new avatar on our own. I've sent you an Email for the instructions.

Can you please share the instruction to [email protected] please, i stuck at the same place

hey bro I can help you

Can u help me, stuck in generating the new character working with lip sync

[itsaizaz]

@itsaizaz Please let me know how to do this? can u share the instructions on above shared email? please

check your email

[eyperrone]

@itsaizaz please can you help me to do this? my email is [email protected] thanks!

[TeemuSo]

@itsaizaz Could you please send me some instructions on how to do it? I would appreciate a lot. [email protected]

[raimondogiordano]

@itsaizaz Please let me know how to do this? can u share the instructions on above shared email? please

check your email

@itsaizaz Can you please send also to me the instructions? my email is [email protected]

[sunilsingh2019]

Hey @itsaizaz, @robegamesios can you please share me instruction to create character ? [email protected]