Vish Sangale

Notes from a
quiet lab on
& craft, capacity,
constraints. Vish Sangale · est. 2013

Staff ML Researcher at Meta. I work on large-scale AI architectures and recommendation systems — and on the long, slow project of teaching computation to mirror the robustness of biology.

/ now

what's loaded into RAM,
updated when it changes

this week
Scaling Slate-Q to a real catalog. Watching variance climb past slate=12.
this month
Reading on hierarchical semantic IDs & codebook collapse. Inference-time entropy keeps eating my catalog.
on the bench
Bonsai-LLM, training a 1B at home. Quality > quantity, capacity matters, constraints are the point.

Recent thinking.

Total solar eclipse — totality
aside · photography

The day surrendered to night, and the corona danced.

When I'm not training models I am, more often than is reasonable, pointed at the sky. Light from a long way off, captured patiently.

Open the collection →