Shelves

Categories

Seven shelves, ordered roughly the way a forward pass is built and then taken apart again. Each divides into branches — 34 of them in all — and an entry lives on exactly one branch. Cross-references do the rest.

Architectures

attention variants, position schemes, normalisation, sparse blocks

attention/ 11 position/ 10 normalisation/ 9 ffn/ 8 sparse/ 8 recurrence/ 8

54 entries · 2 stubs

Training

optimisers, schedules, sharding, RL objectives, stability failures

objectives/ 8 optimisers/ 8 scaling/ 8 memory/ 8 distributed/ 8

40 entries · 1 stub

Fine-tuning

PEFT families, adapter merging, data curation, catastrophic drift

sft/ 1 peft/ 4

5 entries · 1 stub

Inference

kernels, KV-cache layouts, quantisation, speculative decoding

kv-cache/ 3 decoding/ 2 quantisation/ 1 kernels/ 1 serving/ 1

8 entries · 1 stub

Interpretability

circuits, SAEs, causal interventions, probing, feature geometry

features/ 3 circuits/ 1 causal/ 4 probing/ 1

9 entries · 2 stubs

Adversarial ML

evasion, extraction, poisoning, privacy leakage, agent hijacks

evasion/ 2 poisoning/ 1 privacy/ 1 stealing/ 1 agents/ 1

6 entries

Evaluation

metrics, preference aggregation, contamination, statistical power

metrics/ 3 data/ 2

5 entries

Miscellany

numerics, tensor conventions, the things every other shelf assumes

numerics/ 2 conventions/ 1

3 entries

Tooling

what the software is for, when to reach for it, and what it hides

serving/ 4 tuning/ 4 orchestration/ 5

13 entries

Shelves

Categories

Contents