allanbunch / node-red-openai-api Goto Github PK

Hi!

Would it be possible to provide custom API url when setting up the node?
This could potentially play along when running local llm models, such as text-generation-webui-docker or LM Studio.

Then tokens don't really matter.

Thanks :)

Discussed in #12

Node is createChatCompletion endpoint is duplicating messages due to _msgid property reuse.

I have a working text-generation-webui api url that I am using with many other things here locally. I just installed the node-red-openai-api and configured as per the docs for local llm as below and I get the error specified in title.

The only property path being honored by the node is the base msg.payload property. Custom property paths, e.g. msg.assistant; msg.custom.props; flow.payload cause errors.