This application facilitates seamless integration of GPT language models (LLM) into various AI sites by utilizing Flask to host the LLM locally and globally. The implementation involves LLM wrappers, ensuring compatibility with any site using the "/chat/completions" route for text generation. It is essential to adhere to the terms of service of the LLM provider. Usable as a free OpenAI reverse proxy.
The application supports integration with any site employing the "/chat/completions" route for text generation.
- Python 3.10
- Unzipped directory
- Run the
install_requirements.bat
file for automatic installation or executepip3.10 install -r requirements.txt
in the command prompt in the application directory.
- After installation, launch the server by double-clicking the
app.py
file or using thestart.bat
file. - Ensure successful server initiation by checking the command prompt for the indicated success message.
This application is also compatible with Google Colab. Access the hosted version on Google Colab here.
- This application does not utilize the resources of the user's PC as a language model.
- The
gpt4free
module is used in the development, and any errors related to it are beyond the control of the developer.
GPT Generation Client for AI Sites: A hosted wrapper for AI sites. Copyright (C) 2023 Recentaly
This program is distributed under the terms of the GNU General Public License as published by the Free Software Foundation. For details, refer to GNU General Public License.
Developed with gpt4free module.