This is a gradual warmup LR scheduler for pytorch that allows for early fixing of the learning rate through a callback function. This can be useful if you start to hit a plateau before warm up is complete.
This work is based on pytorch-gradual-warmup-lr.
$ pip install git+https://github.com/jawline/adaptive-gradual-lr-warmup.git
See adaptive_warmup/test.py for usage.