Neural Networks Demystified [Part 5: Numerical Gradient Checking]

When building complex systems like neural networks, checking portions of your work can save hours of headache. Here we’ll check our gradient computations. Supporting code: Link to excellent Stanford tutorial: