ponlponl123 / -prototype-aivtuber

I'm not Neuro-Sama, I'm an artificial intelligence created by DevPattarapong It is currently in development using OpenAI models and Live2D characters.

Hi there 👋

-prototype-aivtuber's Issues

I dont even know

I followed everything as best as i could but its still not working would someone be able to walk me through this to understand

Don't make the AI respond to bots

As the title suggests, it would be a good idea to prevent the AI from responding to bots such as streamelements, moobots and so on

npm install error

hi i am getting a npm error wen installing the speaker library
it fails in VS and cmd at this stage reify🔈 timing reify:audit Completed in 449ms

i attached a complet log file
NPM_LOG2.txt
NPM_LOG1.txt

Error when reading from chatgpt

First when I run node main.js everything seems to work fine

Even if I use the "pronounce by yourself" function it goes well.
The problem is when it has to read directly from twitch chat, when I send a message on chat I instantly got the following on my cmd window:

Here in the midle I have a lot of info directly from the code, I wont put it since it has some sensitive data, but if requested i can provide it. Then the error message ends like this:

I have a error :(

I have a error. When i type text in Pronounce by yourself: i get ConfigError

I tried my best but...

Hiya, so I had this idea after seeing some vids and I wanted to run an AI locally, not directly on twitch channel as you describe but I cant figure out how to do so... I dont need a model, neither some twitch codes and whatnot because all I wanted was to have the AI locally on PC which would mean that the AI would use TTS voice to talk back to me and I could use mic to talk to the AI, also internet access for the AI so if I have a question about something, the AI could browse the internet to find an answer and could also analyze what is on my screen to potentially help find information about video/picture on the internet if needed... I dont want to use anything ChatGPT related cuz they cut off access to the internet and its database is ancient... Like for example when I ask about Overwatch 2, it still thinks that the game was not yet announced a release date even though the game is already out for almost 9 months and was announced release date at the end of 2021... And much more it doesnt know and since it doesnt have access to the internet, its kinda useless... But what I saw was videos where some people had this or something similar to this and it could do wonders and when I asked them how to get access to that they responded "just run it locally but expect high usage on your PC HW" but they didnt say where or how or anything...

Anyways, I am stuck at the point where I shut input the API keys and whatnot because you say just
"Before running the application, you will need to configure the following variables in the code"
but what code? and what application? I have everything installed and or downloaded like ffmpeg, nmp properly installed without issues and then im bricked...

If anyone can help, my discord is James (コジロウ)#5213

Undefiend data

Hi, i have this problem, when i text on channel the app crash Can someone help me?
my discord il_Nikk#5936
thx

Error: Request failed with status code 429
    at createError (C:\Users\nicol\Desktop\AI4\node_modules\axios\lib\core\createError.js:16:15)
    at settle (C:\Users\nicol\Desktop\AI4\node_modules\axios\lib\core\settle.js:17:12)
    at IncomingMessage.handleStreamEnd (C:\Users\nicol\Desktop\AI4\node_modules\axios\lib\adapters\http.js:322:11)
    at IncomingMessage.emit (node:events:525:35)
    at IncomingMessage.emit (node:domain:489:12)
    at endReadableNT (node:internal/streams/readable:1359:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {

C:\Users\nicol\Desktop\AI4\main.js:122
                Text: '<speak><prosody pitch="high">'+message+".................... "+gptResponse.data.choices[0].text+'</prosody></speak>',
                                                                                                  ^

TypeError: Cannot read properties of undefined (reading 'data')
    at client.<anonymous> (C:\Users\nicol\Desktop\AI4\main.js:122:99)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Node.js v18.16.0

i get an error when running the main.js file

either error this file is not js or syntax error 23 line 1 character

commit

hey can you create another branch so i can push some proposed changes to it.

Question

1. how do I enable Subtitles?
2. How can I change the voice and language we want?
3. Can we add some backstory to the Ai?

Login Authentication Failed

Am I doing smth wrong?
Getting

listening on localhost:8000
[09:18] info: Connecting to irc-ws.chat.twitch.tv on port 443..
[09:18] info: Sending authentication to server..
[09:18] info: Connected to server.
[09:18] info: Executing command: JOIN #k3noxofficial
[09:18] info: Joined #k3noxofficial
Pronounce by yourself: test
test
AccessDeniedException
a user connected
a user connected

Error Connecting to irc-ws.chat.twitch.tv on port 443..

Hello, love the project trying to get me set up and getting this error.

Possible know what I am doing wrong attempting to make 24-hour twitch and just love to fine-tune things

Thank you for any help

i will let you do the rest

there you go the code has been put into dev, i will allow you to review the changes and update accordingly

login aunthentication failed

Is there something wrong?

how do I install npm

I kenw that I didn't have a JSON file, I searched on Google and used 'npm init' to create a JSON file, and then used 'npm install'. After that, it showed 'up to date, audited 1 package in 57ms, found 0 vulnerabilities'. Although I know this request was ridiculous and foolish, I still hope someone can teach me."

Is there code without the AWS?

Error after 'npm install dotenv'.

The following error occurs when running 'npm install dotenv'.
Is there any way to solve it?

npm WARN deprecated [email protected]: request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated [email protected]: The querystring API is considered Legacy. new code should use the URLSearchParams API instead.
npm ERR! code 1
npm ERR! path C:\AI_Vtuber\tts\node_modules\speaker
npm ERR! command failed
npm ERR! command C:\WINDOWS\system32\cmd.exe /d /s /c C:\Users\user\AppData\Local\Temp\install-ecccdb01.cmd
npm ERR! gyp info it worked if it ends with ok
npm ERR! gyp info using [email protected]
npm ERR! gyp info using [email protected] | win32 | x64
npm ERR! gyp info find Python using Python version 3.8.6 found at "C:\Users\user\AppData\Local\Programs\Python\Python38\python.exe"
npm ERR! gyp ERR! find VS
npm ERR! gyp ERR! find VS msvs_version not set from command line or npm config
npm ERR! gyp ERR! find VS VCINSTALLDIR not set, not running in VS Command Prompt
npm ERR! gyp ERR! find VS checking VS2022 (17.5.33424.131) found at:
npm ERR! gyp ERR! find VS "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools"
npm ERR! gyp ERR! find VS - found "Visual Studio C++ core features"
npm ERR! gyp ERR! find VS - found VC++ toolset: v143
npm ERR! gyp ERR! find VS - missing any Windows SDK
npm ERR! gyp ERR! find VS could not find a version of Visual Studio 2017 or newer to use
npm ERR! gyp ERR! find VS looking for Visual Studio 2015
npm ERR! gyp ERR! find VS - not found
npm ERR! gyp ERR! find VS not looking for VS2013 as it is only supported up to Node.js 8
npm ERR! gyp ERR! find VS
npm ERR! gyp ERR! find VS **************************************************************
npm ERR! gyp ERR! find VS You need to install the latest version of Visual Studio
npm ERR! gyp ERR! find VS including the "Desktop development with C++" workload.
npm ERR! gyp ERR! find VS For more information consult the documentation at:
npm ERR! gyp ERR! find VS https://github.com/nodejs/node-gyp#on-windows
npm ERR! gyp ERR! find VS **************************************************************
npm ERR! gyp ERR! find VS
npm ERR! gyp ERR! configure error
npm ERR! gyp ERR! stack Error: Could not find any Visual Studio installation to use
npm ERR! gyp ERR! stack     at VisualStudioFinder.fail (C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\find-visualstudio.js:122:47)
npm ERR! gyp ERR! stack     at C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\find-visualstudio.js:75:16
npm ERR! gyp ERR! stack     at VisualStudioFinder.findVisualStudio2013 (C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\find-visualstudio.js:363:14)
npm ERR! gyp ERR! stack     at C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\find-visualstudio.js:71:14
npm ERR! gyp ERR! stack     at C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\find-visualstudio.js:384:16
npm ERR! gyp ERR! stack     at C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\util.js:54:7
npm ERR! gyp ERR! stack     at C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\util.js:33:16
npm ERR! gyp ERR! stack     at ChildProcess.exithandler (node:child_process:408:5)
npm ERR! gyp ERR! stack     at ChildProcess.emit (node:events:513:28)
npm ERR! gyp ERR! stack     at maybeClose (node:internal/child_process:1093:16)
npm ERR! gyp ERR! System Windows_NT 10.0.19044
npm ERR! gyp ERR! command "C:\\Program Files\\nodejs\\node.exe" "C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\bin\\node-gyp.js" "rebuild"
npm ERR! gyp ERR! cwd C:\AI_Vtuber\tts\node_modules\speaker
npm ERR! gyp ERR! node -v v16.17.1
npm ERR! gyp ERR! node-gyp -v v9.0.0
npm ERR! gyp ERR! not ok

Error after 'npm install dotenv'. (Pronounce by yourself:

#5 I've referred to it, but the error hasn't been resolved.

I have replaced line 68 in main.js with

try {
fs.unlinkSync('path/to/output.wav');
} catch (err) {
console.log('No previous file to delete');
}

Also change ffmpeg_path to a valid path

But still the same problem
’
listening on localhost:8000
Pronounce by yourself: [21:37] error: Reconnecting in 2 seconds..
Unable to connect.
[21:38] error: Reconnecting in 2 seconds..
[21:38] error: Unable to connect.
‘

SUGGESTION: allow her to be used as a desktop asssitant

you can drag her arosss the screen as well

TTS issues

ElevenLabs is pretty much money hungry, you only get 10k chars for free!!
youre better of using azure tts (the one that neuro-sama uses and its the best) or even google tts

Error after 'node main.js'.

The following error occurs when running 'node main.js'.
Is there any way to solve it?

`node:internal/modules/cjs/loader:1024
throw err;
^

Error: Cannot find module 'dotenv'
Require stack:

• I:\aivtuber\AIVTuber-main\TTS\main.js
  �[90m at Function.Module._resolveFilename (node:internal/modules/cjs/loader:1021:15)�[39m
  �[90m at Function.Module._load (node:internal/modules/cjs/loader:866:27)�[39m
  �[90m at Module.require (node:internal/modules/cjs/loader:1093:19)�[39m
  �[90m at require (node:internal/modules/cjs/helpers:108:18)�[39m
  at Object. �[90m(I:\aivtuber\AIVTuber-main\TTS\�[39mmain.js:9:1�[90m)�[39m
  �[90m at Module._compile (node:internal/modules/cjs/loader:1191:14)�[39m
  �[90m at Object.Module._extensions..js (node:internal/modules/cjs/loader:1245:10)�[39m
  �[90m at Module.load (node:internal/modules/cjs/loader:1069:32)�[39m
  �[90m at Function.Module._load (node:internal/modules/cjs/loader:904:12)�[39m
  �[90m at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)�[39m {
  code: �[32m'MODULE_NOT_FOUND'�[39m,
  requireStack: [ �[32m'I:\aivtuber\AIVTuber-main\TTS\main.js'�[39m ]
  }`

Is there a code using Azure TTS?

hello, I really admire your work and everything that you've accomplished. I know how hard you've been working, and it really shows.
I was wondering if you could help me out with something. I was thinking about using Azure TTS instead of AWS TTS for this project, and I was wondering if it would be possible for you to write me a code using Azure TTS? I would really appreciate your help!

Thanks so much, and I hope to hear from you soon!

Is there code for youtube?