Coder Social home page Coder Social logo

关于添加自定义TTS功能 about muvtuber HOT 1 OPEN

Paraworks avatar Paraworks commented on July 28, 2024
关于添加自定义TTS功能

from muvtuber.

Comments (1)

cdfmlr avatar cdfmlr commented on July 28, 2024

TTS 模块是完全独立,可以灵活替换的,并不依赖于 Azure。可以在 muvtuberdriver 的配置中设置使用任意服务:

sayer:
server: externalsayer:50010
role: default
lipsyncstrategy: audio_analyze

这里的 sayer.server 可以是任意实现了 muvtuber-proto/muvtuber/sayer/v1 接口的 grpc 服务。

externalsayer 是一个上述 muvtuber-proto/muvtuber/sayer/v1 接口的具体实现。这个程序旨在通过调用外部 Web API 来提供 sayer 服务,所以叫做 external sayer。externalsayer 可以支持实现、配置多种接口。而 Azure 只是 externalsayer 中提供的一种可以调用的接口(虽然目前是唯一一种)。你可以参考 Azure 的实现,添加调用任意 API 的实现。如果你的 sovits 或者其他任意 TTS 实现有 API 可以调用,你可以考虑在 externalsayer 中添加一种调用的实现。

如果没有 Web API 可用,或者你可以七天无理由不喜欢 externalsayer 的实现,那么你也可以从更底层入手,封装 sovits 的调用方法,直接提供一个 muvtuber-proto/muvtuber/sayer/v1 服务,cdfmlr/mac_sayer 是一个(相比于 externalsayer)更简单的实现例子。如果你写 Go 语音,还可以考虑复用 murchinroom/sayerapigo,这里已经写好了 endpoint 层。当然你也可以写 python 或其他任何拥有 grpc 支持的语言,只是可能会多写几行非常机械无聊的开服务的那种代码。

P.s. 这个 issue 和 #42 是重复的。Prefer this, close #42.

from muvtuber.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.