Back Propagation
Back Propagation Back Propagation, few people refer it as a magic box, is one of the most frequently used word in Neural Network communities and said that it holds the most difficult and complex math behind it. What actually is Back Propagation ? What is the math under-hood ? Why it is so difficult yet important to know the concept ? In this article I'll take you through the path of Back Propagation and how it works between our Neural Layers. (If you are reading this I'll take granted that you know the basics of Deep Learning and Calculus) OK. Let's dive into concept... Let us first define a simple Neural Network. To make and look thing very simple here, I consider the Neural Network of Logistic Regression with a single set of Input values at Input Layer, a Hidden Layer and expected a single Output value at an Output Layer. Source: https://www.simonho.ca/wp-content/uploads/2018/02/ann.jpg We h...