This repository contains PyTorch evaluation code, training code and pretrained models for the following projects:
- Scalable Transformer on DeiT (scalable transformers for neural machine translation)
We provide baseline DeiT models pretrained on ImageNet 2012.
name | acc@1 | acc@5 | #params | url |
---|---|---|---|---|
DeiT-base | 81.8 | 95.6 | 86M | model |
Scalable | 82.5 | N/A | 86M | [model] |
This repository is released under the Apache 2.0 license as found in the LICENSE file.
We actively welcome your pull requests! Please see CONTRIBUTING.md and CODE_OF_CONDUCT.md for more info.