Sgd on The Standard Errorhttps://jongha-jeon-dev.github.io/standarderror/tags/sgd/Recent content in Sgd on The Standard ErrorHugo -- 0.123.7en-gbTue, 13 Oct 2026 00:00:00 +0000ML 22: Learning Rate and Batch Size Are One Knob, Until the Rate Hits a Wallhttps://jongha-jeon-dev.github.io/standarderror/lectures/ml-22-lr-batch/Tue, 13 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-22-lr-batch/With plain SGD and a fixed number of examples, multiplying the batch size and the learning rate by the same factor gives the same training run, until the learning rate reaches the point where training fails.