LLM-Math-Analysis
conda create -n math -y python=3.9
conda activate math
pip install -r requirements.txt
bash run_cc_data.sh
python3 merge_cc_data.py
bash run_cc_analyze.sh
python3 merge_cc_data.py --merge_clear
bash generate_split.sh
cd ./RedPajama-Data/data_prep/stack_exchange/
python3 download.py
For arithmetic tasks, please download pre-training dataset from MathGLM-dataset. For amth word problem, the reconstructed Ape210K dataset is provided in MathGLM_MWP/dataset/data.jsonl