Super-convergence: Supercharge your Neural Networks

A look at 1Cycle scheduling, one of my favourite techniques at improving model performance and practical guidance on how to use it