Concepts

Every idea the lab teaches has a card: 22 of them, from backpropagation through time and the adjoint to the curriculum, each loss term, gradient clipping and the fixed benchmark. Each explains its idea in plain language, shows it as a formula and, for most, names the section of the analysis that derives it.

Search by title, keyword or symbol, such as wX, clip or forgetting; every word must match. The formulas here use the default training settings; in the lab, cards follow the live settings and have a Show me button that runs their tool.

Training

The loss

Backward pass

Network

Driving and evaluation