fine-tuning · 2026-04-18
LoRA fine-tuning cost anatomy.
Where the GPU hours go during a $5,000 LoRA run — GPU utilization, checkpoint saves, eval, and idle.
eng · 10 min read
// writing
Thinking on inference infrastructure.
Architecture decisions, research notes, and operational lessons from running frontier open models at production scale.
fine-tuning · 2026-02-10
DeepSeek-V3 fine-tuning on LoRA: benchmark report.
Baseline vs. 5k-sample LoRA adapter on three domain tasks. What moved, what didn't, and at what cost.
research · 11 min read