Model stumbling on its words about parler-tts

[bkutasi]

This looks like a way too long prompt, I would do 1 prompt/sentence at most.

[ai-bits]

@bkutasi Hey Balázs, any idea how to pimp things to make longer prompts work? Got 256GB RAM and 2x 20GB VRAM RTX 4000.
Sorta waste. ;-) Thought I had a util now to read articles to me. Maybe sth like in helpers\model_init_scripts\init_dummy_model.py

# set other default generation config params
model.generation_config.max_length = int(30 * model.audio_encoder.config.frame_rate)

Greetings from Upper Austria!
G.

[bkutasi]

@ai-bits Hallo Günter and greetings from Tirol!
So I think we won't be able to ever generate minutes long audios ever, but maybe if we get chucks or some kind of sequential generation implemented (at the moment it was trained on 30 sec voice samples).
So this is kind of a software limitation and wish I had time to fork/contribute to this because I'm really interested in good TTS implementations. If you just want simply more output, you can build a pipeline to call it multiple times for every sentence or line, but the voices will be vastly different as this cant reproduce the same exact voice.
There were some talks about this here:
#9
#11

[platform-kit]

@bkutasi why not ever? What's the blocker to re-training with longer samples?

[ai-bits]

wish I had time to fork/contribute

Just too many fronts. @ current pace give Parler coupla weeks to mature & use alts 2 do tts.
stt Whisper pretty good v Dragon Naturally Speaking in 90ies. <grin>
Been talking to GPT since July & VS Code for weeks.

Cheers
G.
PS: 49" moni, 4 hd Chrome Windoze: this, Code, Bayern-Ars, MCI-RMA
FCB just won. MCI overtime w/ projector in bed.

[ai-bits]

@bkutasi Been following the whole AI craze, but lost track what's free & local (and really open needed?) in TTS.

Not yet decided what to think of LocalAI.io, but just got TTS debugged on the M3 Mac. (AMD64 via Docker) Still don't know what special chars sometimes throw it off w/ text from the clipboard.

curl http://localhost:8080/tts -H "Content-Type: application/json" -d "{ \"model\":\"tts-1\", \"input\": \"$(pbpaste)\" }" --output ~/local-ai.wav

Bark,.. available.
Hungarian (?) im Heiligen Landl? ;-)
Cheers
G.