Gradient-Boosting on The Standard Errorhttps://jongha-jeon-dev.github.io/standarderror/tags/gradient-boosting/Recent content in Gradient-Boosting on The Standard ErrorHugo -- 0.123.7en-gbMon, 12 Oct 2026 00:00:00 +0000ML 14: Boosting Overfits Its Probabilities Long Before Its Accuracyhttps://jongha-jeon-dev.github.io/standarderror/lectures/ml-14-boosting/Mon, 12 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-14-boosting/Whether boosting overfits depends on what you measure. Over 2,000 rounds its test error never turns up after the first few dozen; its test log loss turns after a few dozen, and below a learning rate of 0.1 shrinkage only postpones the turn.