Chroma's Context-1 is a small model that outperforms much larger ones at retrieval. The interesting part isn't the parameter count — it's what it says about where the intelligence in a RAG system actually belongs.
I build contract-intelligence systems that run air-gapped. No API calls, no cloud inference, nothing leaves the building. That constraint shapes every architectural decision I make, and it's why a headline about a 20B model beating frontier models at retrieval reads very differently to me than it probably does to you.
For most teams, a smaller model that performs well is a cost story. For me it's an existence story. A frontier model behind an API isn't expensive in my environment — it's unavailable. So the question I care about isn't “can I save on tokens.” It's “does the capability exist inside my perimeter or not.”