pydantic>=2.5.0 not compatible with deepspeed & extension load fail about alltalk_tts

[S95Sedan]

it's not the openai extension in my case, i don't have it enabled and even removed it to test.

okay just installed deepspeed 11.2 and it seems fixed.

@erew123 seems it was deepspeed 11.1 that broke stuff, 11.2 seems like a hard requirement now (which is fine), just hard to figure out.

Just had a look but deepspeed 11.2 has a patch for pydantic in it, so thats why the error was there, see:
microsoft/DeepSpeed#4407

Hence 11.1 gives errors (same here when i rolled back the version.)

@erew123 No problem and you too. Rest aswell offcourse.
Hopefully not more breaks when times goes by as 12.6 compiling is still a no-go.

[S95Sedan]

Edit as the first comment is a different error but the same module used:
The error here seems to originate from the openai extension.

No idea if thats used to parse variables, but it seems linked to that.

Edit attached error:

[erew123]

@S95Sedan Good to know, well, good to know its something else in the mix. Are you suffering this issue too?

@rktvr The minus thing, that's a GitHub thing. As far as I know, I have no control over removing that - from the name, but you are correct, things in the extensions folder doesn't like a - in the name. Maybe ill put a note on them for people to rename them.

[erew123]

@rktvr Glad its sorted for you. And glad it was someone who knew their way around a system :) much easier to diagnose! Have a good Christmas

@S95Sedan Also a Happy Christmas to you too (and thanks for the info)

[rktvr]

retrying on a fully new ooba install to make sure it's not something random i did on accident

[erew123]

Im running both here without an issue... humm. Though I can see other references to that issue on the internet.

Let me think a minute

[erew123]

maybe try an update to pydantic 2.5.3 like me... it may be a 2.5.0-2.5.2 pydantic issue... its an ass of a app at times.

pip install pydantic==2.5.3 when you have started the text-gen-webui with cmd_yourOS

[erew123]

Ive downgraded pydantic to 2.5.0 on my system and its still all loading both AllTalk and FineTune ok. Humm. Your TTS version is 0.21.3 as well I assume pip show tts

[rktvr]

yeah, not sure what the issue is.

currently installing a fresh ooba to see there. if it works there then something broke along the way i suppose.

[erew123]

Right, I sort of know whats going on now.... model_persistence_threshold ok, so pydantic had this big issue about things being called "model" because it started internally using "model" and it complained that if you use "model" in your code, then there could be an issue where some variables get swapped between scripts. (something of that jist). It caused me a huge pain in the ass a week or so ago (which is why we now have a new confignew.json, rather than the config.json, as I had to re-name some variables).

Are you using one of the DeepSpeed installs that I put up? https://github.com/erew123/alltalk_tts/releases/tag/deepspeed

Im wondering if other versions from other people could have an issue maybe, as they all compile up differently.

[rktvr]

i have an older version of deepspeed, a wheel that someone posted a while back. deepspeed-11.1.
am going to install the deepspeed 11.2 that you linked in the new ooba install. then if that works go back to my old one and see if changing to 11.2 fixes the issues.

as a unrelated side note, the extension folder can't have a minus "-" or "." in the name it seems, for those that install it manually by downloading from the release tab. the name "alltalk_tts-1.7" causes it to fail to load but works when renamed to "alltalk_tts"

[rktvr]

it's not the openai extension in my case, i don't have it enabled and even removed it to test.

okay just installed deepspeed 11.2 and it seems fixed.

@erew123 seems it was deepspeed 11.1 that broke stuff, 11.2 seems like a hard requirement now (which is fine), just hard to figure out.

[rktvr]

something with the new pydantic then either way. but might be an issue for those that somehow rely on the openai extension

[erew123]

@S95Sedan Ahh I see. Yeah, they just have to rename things in the openAI script not to have the name "model". I had to rename 2x variables in AllTalk to stop it clashing (according to Pydantic). I guess Ill pass a friendly message on to whomever codes the OpenAI add in and let them know. It should just be a find/replace on the script. Might be able to do it myself.

"model_loaded": true,
"model_name": "tts_models/multilingual/multi-dataset/xtts_v2",

are now

"tts_model_loaded": true,
"tts_model_name": "tts_models/multilingual/multi-dataset/xtts_v2",

[erew123]

FYI, just so you know Pydantic 2.5.3 is now the base version Text-gen-webui installs as factory. The full "factory list" is at the bottom of this link here