Hiroki Naganuma
Optimizer Comparison
Main Papers
- On Empirical Comparisons of Optimizers for Deep Learning: for steps and generalization
- Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model: for steps and batchsize
Other Reference
Adam の バイアス補正
