llama-3.1-70b-instruct-fp8
Llama-3.1-70B-Instruct · FP8
40% cheaper, ~2× throughput. Pick this once you've A/B-tested quality.
70.6B · FP8
128k context
$0.35 / $0.45 per 1M
us · eu · in
best forHigh-volume summarization, RAG, classification.
not forQuality-critical work you haven't validated on FP8 yet.
Llama 3.1 Communitycost-optimised