- Clone this repository:
git clone [email protected]:abel-blue/prompt-evaluation.git
cd prompt-evaluation
- Setup environment variables on
.env
:
(create .env file in the root directory)
#################
# Development env
#################
OPENAI_API_KEY=""
VECTORDB_MODEL="gpt-3.5-turbo"
Run
# create virtual environment
python3 -m venv venv
# activate
source venv/bin/activate
# install requirements
pip install -r requirements.txt
# to generate test data
make data_generate
# to evaluate user input data (prob., accur., confid.)
make data_evaluate