infrastructure · 2026-03-08
vLLM on B200 SXM5: first 90 days.
What changed from H100 to B200, what broke, what we patched upstream, and what we're still tuning.
eng · 15 min read
// writing
Thinking on inference infrastructure.
Architecture decisions, research notes, and operational lessons from running frontier open models at production scale.