Gradient Descent Viz

Gradient Descent Viz

Interactive visualization of gradient descent methods

Description

Learning ML, the differences between Momentum, RMSProp and Adam are hard to feel from equations. Gradient Descent Viz is a desktop app visualizing five popular gradient descent methods interactively.

It steps through each method on 3D surfaces with tunable hyperparameters to compare convergence.

Features



Five methods:SGD to Adam.

Step by step:Every move.

Hyperparameters:Live tuning.

3D surfaces:Intuitive.