Hyperparameter tuning

Requirements

• You should understand what hyperparameters are and how they affect the training of a neural network.
• You should know how to use Keras Tuner to find the best hyperparameters for your neural network model.

Theory

Articles

• Using Keras Tuner to Find the Best Hyperparameters for Your Neural Network Model: https://medium.com/@viniciusqroz/using-keras-tuner-to-find-the-best-parameters-for-your-neural-network-model-2dc02e0a1203
• Hyperparameter Tuning with Keras Tuner and TensorFlow: https://medium.com/@sanjay_dutta/hyperparameter-tuning-with-keras-tuner-and-tensorflow-48ab5ea69cc5

Video

• Simple Methods for Hyperparameter Tuning: https://www.youtube.com/watch?v=vnXx7t2pnvQ
• A Review of Hyperparameter Tuning Techniques for Neural Networks: https://www.youtube.com/watch?v=5Xh9FusE8iE
• Cutting Edge TensorFlow: New Techniques (Google I/O'19): https://www.youtube.com/watch?v=Un0JDL3i5Hg
  • Only the first 7 minutes are relevant to hyperparameter tuning

Manuals

• KerasTuner: https://keras.io/keras_tuner/
• KerasTuner API: https://keras.io/api/keras_tuner/