Training a 125M-Parameter Model to Autocomplete Piano
A write-up of training a small transformer to autocomplete piano MIDI performances in real time on-device, covering the data, the model design, and what it can do.
No account needed · sign in to keep your taste everywhere
More like this
Pages that share this page's themes. Or browse all of Tech.
Fourhands
A browser jam room where two pianists play together over a peer-to-peer link, using a MIDI keyboard or the ASDFGHJK keys…
Piano Trainer
A browser piano trainer where you drop in a MIDI file and play along using a MIDI keyboard or your computer keyboard, wi…
Dot Piano
A web-based visual piano you can play with a MIDI keyboard or your computer keyboard, with each note drawn on screen as…
Jay Alammar's Illustrated Guides
Illustrated guides that break down how transformers, GPT, and other AI models work using detailed step-by-step diagrams…
Sergiy Bondaryev
Interactive articles that build intuition for machine learning, such as a diffusion transformer turning random dots into…
LLM Attention Visualization
An interactive visualization with a short explanation of how attention lets a language model draw selectively on earlier…
Stumble onto more like this
One click takes you to a page you didn't know you were looking for. Rate it and the next one lands closer to your taste.
Add to Browser — it's freeWorks in Chrome, Edge and Brave. No account needed.