AI Grimoire
08 — siblings
numerics/
conventions/

Miscellany / conventions

Conventions

Axis order, pairing schemes, whether the epsilon goes inside or outside the square root. None of these change the mathematics and all of them change the checkpoint, which makes them the most common source of a port that runs, produces plausible output, and is quietly wrong.

1 entry.

Entries

08.02.1
Tensor Layout Conventionscommon
Axis order, pairing schemes and epsilon placement: arbitrary until weights exist.