Up till now, I was relentlessly pursuing the best accuracy I can get with my neural network. The size of my Core ML app is of course increasing. While going through the presentation slides of What’s New in Core ML, Part 1, Apple talked about the size of weight being a factor in the overall …
Category Archives: neural network
What is Epoch, Batch Size and Iterations?
One Epoch is when an ENTIRE dataset is passed forward and backward through the neural network only ONCE. Since, one epoch is too big to feed at once it is divided into several smaller batches of size batch_size. Iterations is the number of batches needed to complete one epoch. For example, a dataset of 1000 samples …
Continue reading “What is Epoch, Batch Size and Iterations?”
Weights update process
The process of updating weights is one training iteration involving backpropagation. The latter can be broken down into 4 distinct steps: Forward pass In this first training step, the intention is to extract weight from the first pass of the training data into the neural network. Loss function The training loss (precision) is calculated from …