What is Epoch, Batch Size and Iterations?

One Epoch is when an ENTIRE dataset is passed forward and backward through the neural network only ONCE. Since, one epoch is too big to feed at once it is divided into several smaller batches of size batch_size. Iterations is the number of batches needed to complete one epoch. For example, a dataset of 1000 samples […]

Weights update process

The process of updating weights is one training iteration involving backpropagation. The latter can be broken down into 4 distinct steps: Forward pass In this first training step, the intention is to extract weight from the first pass of the training data into the neural network. Loss function The training loss (precision) is calculated from […]