Transformers on The Standard Errorhttps://jongha-jeon-dev.github.io/standarderror/tags/transformers/Recent content in Transformers on The Standard ErrorHugo -- 0.123.7en-gbFri, 18 Sep 2026 00:00:00 +0000School Maths 1: The Only Difference Between These Two Models Is the Order of the Lineshttps://jongha-jeon-dev.github.io/standarderror/lectures/school-maths-1-shortcut/Fri, 18 Sep 2026 00:00:00 +0000https://jongha-jeon-dev.github.io/standarderror/lectures/school-maths-1-shortcut/One of them adds. The other reads the answer off the line above and reverses it, including when that line is wrong. Their held-out losses differ by less than a tenth of a nat, and the leaky one's is *lower*.