Comments (7)
The tool is mainly built to be used via the accompanying UI. However, it can indeed also run headless (I know of people using it on a web hosted server), it's just that I haven't really designed it for that. You can start the server.exe (or if you want to manage your own dependencies, python server.py), and then you can call localhost requests from a separate script, to simulate the actions of the front-end UI. Have a look through the server.py and javascript files to see exactly what is needed for each call, but it's mostly just one localhost http call for loading a model, and then another call for each inference
from xva-synth.
Thank you! That worked.
from xva-synth.
Actually this is useful. I'm just going to start it then preload a model. Thanks for this.
from xva-synth.
@DanRuta When I try to start server.exe in the command prompt I'm getting this: D:\DExtraSteamGames\steamapps\common\xVASynth\resources\app\cpython_gpu>server.exe
Traceback (most recent call last):
File "server.py", line 15, in
FileNotFoundError: [Errno 2] No such file or directory: './resources/app/javascript/script.js'
[11488] Failed to execute script server
Do you think this is because I have the xVASynth program installed through steam or on a driver other than C? Or something else? I do see resources/app/javascript/script.js in my install.
from xva-synth.
For the compiled .exe, you need to launch it from the same directory as the main app .exe file is. So for example, the following command should work for the GPU backend, from the folder where xVASynth.exe is:
./resources/app/cpython_gpu/server.exe
from xva-synth.
By the way for whatever it's worth, I think you could see a lot of new interest in this program from the boom of people experimenting with AI-generated content now. I know that the person who created the Skyrim ChatGPT addon is using it, but there are a lot of people looking for "better than windows/engine text to speech gen that is locally generated" right now as they experiment with creating characters that provide AI responses. That's what I'm going to try to use this for - combined with GPT4All running locally. I'm imagining that this plugin reference basically gives the values needed for the local server commands in script.js: https://github.com/DanRuta/xVA-Synth/wiki/Plugins, but is there any other documentation of the exact values needed in a post request to the local server to load the model and synthesize the voice from a text prompt? (Sorry for the questions about "off-label" use of your project!)
from xva-synth.
No use is "off-label" use 😄 Yes, I spoke briefly with ArtFromTheMachine, they've done an amazing job.
That plugin reference covers most things for plugins, though there isn't yet much documentation for other things. I've not given enough attention to this haha, just been answering any questions on Discord. I'll try to put something together soon (or maybe ChatGPT can do it lol). There's a plugin here which uses the http calls, as an example/reference: https://www.nexusmods.com/skyrimspecialedition/mods/62944
I'll also post some permissive license v3 voices to the nexusmods xvatrainer page too, for any non-gaming-related uses, once v3 is out (imminently).
from xva-synth.
Related Issues (20)
- Work Offline HOT 1
- Can this work offline? HOT 3
- Cannot use xVASynth Fuz Ro Bork plugin v1.2 anymore since xVASynth v3.0.0. HOT 1
- xVASynth v3.0.0. / xVASynthVoices.json HOT 2
- [ Feature Request ] An option to enable command-line-interface/cli. HOT 1
- Loading new model does not reset Styles HOT 1
- Implement Smoothness parameter
- Bug: Phoneme editor container stretches longer than its content HOT 1
- Nexus Mods Premium - File integrity check HOT 1
- Error generating batch voice for Cirilla HOT 1
- Drag & Drop voice model archives on sidebar - progressbar
- Allow plugin to change emotional modifiers to whole sequence
- Nexus Mods Premium - install stalls if no game folder found HOT 2
- ffmpeg: MP3 format crash with Deesing HOT 2
- ARPABet dictionaries are not loaded for v3 models HOT 2
- AM cleanup crash v3 models if sentence begins with "Am" HOT 1
- ARPAbet "the orc" fusion on v3 voices
- xVAPitch/v3 models <PAD> symbols ignored by modifier if done one by one HOT 2
- Add audio streaming support HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from xva-synth.