- Download SummEval evaluation dataset by yourself
- Generate multiple aspects for consideration when assessing the relevance (gen_relevance_aspect.py)
- Scoring each generated aspect and assess the final score (relevance.py)
Note Setting openai_key, aspects, input_path, output_path to yours.