Description
The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs. Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
API Usage Examples
OpenAI Compatible Endpoint
Use this endpoint with any OpenAI-compatible library. Model: Meta: Llama 3.1 405B Instruct (meta-llama/llama-3.1-405b-instruct)
curl https://api.ridvay.com/v1/chat/completions -H "Content-Type: application/json" -H "Authorization: Bearer YOUR_API_KEY" -d '{
"model": "meta-llama/llama-3.1-405b-instruct",
"messages": [
{
"role": "user",
"content": "Explain the capabilities of the Meta: Llama 3.1 405B Instruct model"
}
],
"temperature": 0.7,
"max_tokens": 1024
}'Supported Modalities
- Text
API Pricing
- Input: 3.5$ / 1M tokens
- Output: 3.5$ / 1M tokens
Token Limits
- Max Output: 130,815 tokens
- Max Context: 130,815 tokens
Subscription Tiers
- free
- pro
- ultimate