Neural Networks and Language Models

Each post is accompanied by source code in the makemore-and-friends repository.

Neural Networks — Autograd

• A Scalar-Valued Autograd Engine
• More Autograd: Arithmetic Operations, Nonlinearities, and a Simple Neural Network Library

Language Models

• A Statistical Character Bigram Language Model
• N-Grams and Other Experiments
• A Neural Character Bigram Language Model