Changing AI API about researchgpt

[EverythingNeurodiversity]

https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2 and https://huggingface.co/EleutherAI/gpt-neo-2.7B

[mukulpatnaik]

Sounds really interesting! Have you made a fork where I can check out some of the modifications you're trying? I can think of a way for the embeddings but not sure about inference for gpt-neo

[EverythingNeurodiversity]

Not yet, having issues trying to get it working running locally on my machine. I think it this is sort of close to what is needed in the gpt function:

def gpt(self, prompt): print('Sending request to GPT-Neo') r = response = requests.post(HF_API_URL, headers=HF_headers, json=prompt) answer = r.choices[0]['text'] print('Done sending request to GPT-3') response = {'answer': answer, 'sources': sources} return response

where HF_API_URL = API_URL = "https://api-inference.huggingface.co/models/EleutherAI/gpt-neo-2.7B"
and headers = {"Authorization": "Bearer Hugging face API key"}

Was trying to test it with some dummy data on the HF playground but haven't figured it out yet. Will upload a fork if I get something going.

[mukulpatnaik]

@EverythingNeurodiversity Sounds great, looking forward to it!