Data-Leakage on The Standard Error

Data-Leakage on The Standard Errorhttps://jongha-jeon-dev.github.io/standarderror/tags/data-leakage/Recent content in Data-Leakage on The Standard ErrorHugo -- 0.123.7en-gbWed, 14 Oct 2026 00:00:00 +0000ML 3: Not Every Leak Leaks, and the Ones That Do Can Be Measuredhttps://jongha-jeon-dev.github.io/standarderror/lectures/ml-3-leakage/Thu, 08 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-3-leakage/'Fit every preprocessing step inside the folds' is right, and taught as if every violation were equally bad. Measured, seven of them range from nothing to a third of the accuracy scale.ML 52: A Leaked Benchmark Shows in the Set, Not in the Itemhttps://jongha-jeon-dev.github.io/standarderror/lectures/ml-52-contamination/Wed, 14 Oct 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/ml-52-contamination/A model trained on a benchmark's answers scored higher on them and no higher on anything else. Its own likelihoods could not say which problems had leaked; a fresh set from the same source could say that some had.