Transformers from Scratch
A patient, jargon-light walkthrough of how transformer models work, building the idea from simple pieces up to attention and embeddings, with no prior ML background assumed.
No account needed · sign in to keep your taste everywhere
More like this
Pages that share Transformers from Scratch's themes. Or browse all of Tech.
Animated AI
Short animated explainers that show how neural networks and convolutions actually work, with clear moving diagrams that…
Kanji RNN
A sketch-rnn model trained on kanji that draws plausible-looking but invented characters stroke by stroke in your browse…
Can You Reverse Engineer Our Neural Network?
Jane Street presents a machine learning puzzle: given a trained network and no documentation, work out what it actually…
Training a 125M-Parameter Model to Autocomplete Piano
A write-up of training a small transformer to autocomplete piano MIDI performances in real time on-device, covering the…
Self Driving Cars Are Fun!
A student's write-up of building a self-driving car autopilot in Keras, walking through training a neural network to ste…
Jay Alammar's Illustrated Guides
Illustrated guides that break down how transformers, GPT, and other AI models work using detailed step-by-step diagrams…
Stumble onto more like this
One click takes you to a page you didn't know you were looking for. Rate it and the next one lands closer to your taste.
Add to Browser — it's freeWorks in Chrome, Edge and Brave. No account needed.