https://jongha-jeon-dev.github.io/standarderror/tags/model-selection/Recent content in Model-Selection on The Standard ErrorHugo -- 0.123.7en-gbWed, 14 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-20-rashomon/Mon, 12 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-20-rashomon/Two models with the same test accuracy are usually treated as interchangeable. On a hard task, networks that differ only in their seed give different answers on a fifth of the rows.https://jongha-jeon-dev.github.io/standarderror/lectures/ml-57-bic/Wed, 14 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-57-bic/Given one cluster shaped like a square, the BIC asked for more Gaussian components the more data it saw, 18 at 20,000 points. It was answering a question about shape and sample size, not about clusters.https://jongha-jeon-dev.github.io/standarderror/lectures/ml-60-stability/Wed, 14 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-60-stability/Resampling found k-means' two-way split of a single Gaussian as reproducible as three real clusters. Stability measures whether the method has one best answer, and cannot say that there are no clusters.