An attempt to implement a simple neural network based on the following article:
Other articles and examples that I used:
- Neural Networks and Deep Learning (free online ebook)
- How to Build a Neural Network
- Neural network with learning by backward error propagation
- A Step by Step Backpropagation Example
- Basis of Neural Networks in C#
- Machine Learning using a Neural Network written in C#
And these Youtube videos helped me to better understand what's happening in the backpropagation algorithm:
From the 3Blue1Brown channel:
- But what is a Neural Network? | Chapter 1
- Gradient descent, how neural networks learn | Chapter 2
- What is backpropagation really doing? | Chapter 3
- Backpropagation calculus | Appendix to deep learning chapter 3
From the Welch Labs channel: