뉴럴 네트워크 - Multi Layer Perceptron

Neural networks are computing systems vaguely inspired by the biological neural networks that constitute animal brains.

$$\begin{aligned} \frac{\partial \operatorname{loss}}{\partial w} &=\frac{\partial}{\partial w} \frac{1}{N} \sum_{i=1}^{N}\left(y_{i}-\hat{y}_{i}\right)^{2} \\ &=\frac{\partial}{\partial w} \frac{1}{N} \sum_{i=1}^{N}\left(y_{i}-w x_{i}-b\right)^{2} \\ &=-\frac{1}{N} \sum_{i=1}^{N}-2\left(y_{i}-w x_{i}-b\right) x_{i} \end{aligned}$$ $$\begin{aligned} &w \leftarrow w-\eta \frac{\partial \operatorname{loss}}{\partial w} \\ &b \leftarrow b-\eta \frac{\partial l o s s}{\partial b} \end{aligned}$$