Llama 3.1 405B
meta/llama-3-1-405b
Catalog data
Providers
The catalog stores one provider for Llama 3.1 405B, with that provider's input price, output price, and latency.
| Provider | Input | Output | Latency |
|---|---|---|---|
| Meta | $3.50 | $12.00 | 410ms |
Catalog data
Pricing
Token pricing uses the same dollar figures as the model marketplace. Input and output shares use the catalog mix.
TypeToken pricing
Input$3.50
Output$12.00
Token pricing$3.50 / $12.00
Input share 30% · Output share 70%
Catalog data
Performance
These are catalog figures, not live p50. The context bar uses the catalog contextProgress value.
- Latency
- 410ms
- ELO score
- 1237
Context window128K tokens
Catalog data
Activity
Catalog 30-day usage and trend. Not a request log.
Catalog data
Capabilities
Llama 3.1 405B is classified as Embedding & rerank. The strengths below are the ones stored on this catalog entry.
- Open stack
- Retrieval
- Customization
Catalog data
Frequently asked questions
- What is Llama 3.1 405B?
- Llama 3.1 405B is a Meta model in the ONE catalog, listed for Self-hosted stacks.
- What is the listed price?
- Token pricing is $3.50 input and $12.00 output. Those are the same dollar figures the model marketplace shows, with no extra unit attached.
- How long is the context window?
- Llama 3.1 405B lists a context window of 128K tokens.
- What modality and strengths does it have?
- Llama 3.1 405B is classified as Embedding & rerank. Listed strengths: Open stack, Retrieval, Customization.
Model marketplace