Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks
This is an official implementation of the paper arXiv:2406.02550.
- Tested Environment:
- Python == 3.11.4
- PyTorch >= 2.2
- Run
pip install -r requirements.txt
before using
We offer separate README files in each folder.