Building a Web Search Engine From Scratch

A deep-dive write-up on building a web search engine in two months with 3 billion neural embeddings, from a GPU cluster to sharded HNSW indexes.

Tonble
Share X Reddit Bluesky Email
Screenshot of blog.wilsonl.in

Stumble onto more like this

One click takes you to a page you didn't know you were looking for. Rate it and the next one lands closer to your taste.

Add to Browser — it's free

Works in Chrome, Edge and Brave. No account needed.