I have published a blog on Bayesian optimization. The aim is to provide a simple hands-on tutorial for learning rate optimization. The tutorial concentrates on a classification task using the K-MNIST dataset. Check it out!
Categories
Day: May 12, 2021
Within this blog, I am giving a short introduction into Bayesian optimization to find a near optimal learning rate. There exists a lot of great tutorials regarding the theory of Bayesian optimization. The main objective of this blog is to give a hands-on tutorial for hyperparameter optimization. As I will cover the theory only very briefly, it is recommend to read about the latter first before going through this tutorial. I am training a small ResNet implemented in PyTorch on the Kuzushiji-MNIST (or K-MNIST) dataset