Note: Please utilize the template below as a reference for your contribution. Adapt the template when deemed necessary
What is TOPIC-NAME?
Brief description.
Recommended Path for Learning
- This less than 15 minute video introduces backpropagation conceptually, without the accompanying mathematical algorithms. What is backpropagation really doing?
- For those interested in understanding the mathematics behind the algorithm, this site provides a brief introduction to backpropagation and then gives an in-depth explanation of how the algorithm works. How the backpropagation algorithm works
Further Learning
Video
- This video dives into the calculus underlying the backpropagation algorithm. It is less conceptual and more math-heavy. Backpropagation calculus
Applied paper
- This blog post briefly introduces the backpropagation concept but mostly focuses on the mathematics of the backpropagation algorithm. It provides visual depictions of all equations embedded within neural networks, which is super helpful. Calculus on Computational Graphs: Backpropagation
Online tutorial
- This is a tutorial for implementing the backpropagation algorithm for a neural network from scratch with Python. It reviews how to forward-propagate an input to calculate an output, how to back-propagate error and train a network, and how to apply the backpropagation algorithm to a real-world predictive modeling problem. How to Code a Neural Network with Backpropagation In Python (from scratch)
Theory paper
- This chapter presents a survey of the elementary theory of the basic backpropagation neural network architecture, covering the areas of architectural design, performance measurement, function approximation capability, and learning. It also discusses how backpropagation may be implemented in the mammalian brain. Theory of the Backpropagation Neural Network