A learning roadmap from the tensor to large language models (LLMs).
Inspired by fromthetensor and tinygrad.
Setting up a virtual environment is highly recommended.
python3 -m venv env
source env/bin/activate
pip install -e .
- Deep Learning in Neural Networks (2014)
- Deep Residual Learning for Image Recognition (2015)
- Transformers for Image Recognition at Scale (2020)
- Attention Is All You Need (2017)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding(2019)
- Language Models are Unsupervised Multitask Learners (2019)