product · 2026-03-18
Why we host fewer models.
Six models at launch vs. 200 in a catalog. The operational reality of serving 405B-class at production latency.
product · 5 min read
// writing
Thinking on inference infrastructure.
Architecture decisions, research notes, and operational lessons from running frontier open models at production scale.