pytorch.cyclic.learning.rate

This is an accompanying repo for my article explaining the Cycling Learning Rate.

References:

Cyclical Learning Rates for Training Neural Networks 2015, Leslie N. Smith
fast.ai library where this was taught to participants
Brad Kenstler's Keras implementation of CLR
PyTorch implementation (under review)