Framework: Pytorch
Full folder at: Notion site
Model list
- SVM
- PhoBERT
- XLM-R
Loss function: Cross Entropy
Optimizers: AdamW
Batch size: 8
Gradient Accumulation steps: 5
Learning rate: 3e-5
Warmup ratio: 0.1
Weight decay: 1e-2
Epoch: 3
Firstly, you need to install all the required dependencies:
pip install -r requirements.txt
Secondly, you need to go to this link and download data
SVM: Run file SVM.ipynb
Fine-tune: Run file Finetune.ipynb
Run file Inference.ipynb