- Epoch: forward and backward pass over all examples in the dataset
- Batch: number of examples processed in one forward and backward pass. Defined by the user.
- Iterations: number of examples in the dataset / batch size
Let's walk through an example:
8,000 training examples. One epoch would be passing through all those. Let's take a batch size of
8. That would make the total number of iterations: