- ~ 9Gb VRAM (Batch size 2, Accumulate Grad 4)
source scripts/setup_colab.sh
source scripts/setup_kaggle.sh
source scripts/train_function_calling.sh \
--hf_username <YOUR_USENAME> \
--hf_token <YOUR_HUGGINGFACE_TOKEN> \
--wandb_token <YOUR_WANDB_TOKEN>
- Coming Soon
- Instruction Fine-tuning.
- DPO Trainer.
- Custom dataset for different task.