How To Let Lightning Find the Best Learning Rate
Lightning is a lightweight PyTorch wrapper for high-performance AI research that reduces the boilerplate without limiting flexibility. In this series, we are covering all the tricks Lightning offers to supercharge your machine learning training.
In this video, we give a short intro to Lightning’s flag auto_lr_find. Using this flag, Lightning attempts to find the best learning rate for your particular problem. Learning rate is one of the most important hyperparameters you will have to tune for your neural networks. Watch the video to learn more!