llama-3.1-405b-instruct

completions

bydeepinfra

llama-3.1-405b-instruct

completions

Published by: metaProvider:

deepinfra

The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs. Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

Released

Jul 23, 2024

Knowledge

Jan 25, 2024

License

llama_3_1_community_license

Context

32768

Input

$0.8 / 1M tokens

Output

$0.8 / 1M tokens

Capabilities: tools

Accepts: text

Returns: text

Released Jul 23, 2024Knowledge Cutoff: Jan 25, 2024License: llama_3_1_community_license

Context: 32768 Input: $0.8 / 1M tokensOutput: $0.8 / 1M tokensCapabilities: toolsAccepts: textReturns: text

Access llama-3.1-405b-instruct through LangDB AI Gateway

Recommended

Integrate with meta's llama-3.1-405b-instruct and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Benchmark Results for llama-3.1-405b-instruct

Category Performance Scores:

Academia: Score 38.40 (Top 65% - Rank #218)
Finance: Score 14.35 (Top 91% - Rank #305)
Marketing: Score 35.14 (Top 76% - Rank #255)
Maths: Score 3.00 (Top 97% - Rank #325)
Programming: Score 22.20 (Top 73% - Rank #245)
Science: Score 54.50 (Top 64% - Rank #215)
Writing: Score 36.15 (Top 77% - Rank #258)

Overall Performance: 29.105396825396827 average score across all categories

Detailed Benchmark Scores:

Benchmark	Score	Percentile	Domain
AIME	21.30	Top 59%	Mathematics
AA Coding Index	22.20	Top 73%	Programming
AAII	25.70	Top 67%	General
AA Math Index	3.00	Top 97%	Mathematics
DROP	84.80	Top 26%	General Knowledge
GPQA	51.10	Top 62%	STEM (Physics, Chemistry, Biology)
HLE	4.20	Top 74%	General Knowledge
HumanEval	89.00	Top 21%	Programming
LiveCodeBench	30.50	Top 57%	Programming
MATH-500	70.30	Top 70%	Mathematics
MMLU	87.30	Top 33%	General Knowledge
MMLU-Pro	73.25	Top 59%	General Knowledge
SciCode	29.90	Top 50%	Scientific

MMLU Score: 87.30 - Massive Multitask Language Understanding benchmark

HumanEval Score: 89.00 - Coding capability benchmark

GPQA Score: 51.10 - Graduate-level reasoning benchmark

Model Comparison:

Provider: deepinfra

Model Type: completions

Context Size: 32768 tokens

Comparing against 335 models in the database

Category Scores

Benchmark Tests

View Other Benchmarks

AIME

21.3

Mathematics

AA Coding Index

22.2

Programming

AAII

25.7

General

AA Math Index

3.0

Mathematics

DROP

84.8

General Knowledge

GPQA

51.1

STEM (Physics, Chemistry, Biology)

HLE

4.2

General Knowledge

HumanEval

89.0

Programming

LiveCodeBench

30.5

Programming

MATH-500

70.3

Mathematics

MMLU

87.3

General Knowledge

MMLU-Pro

73.3

General Knowledge

SciCode

29.9

Scientific

Metric	AIME	AA Coding Index	AAII	AA Math Index	DROP	GPQA	HLE	HumanEval	LiveCodeBench	MATH-500	MMLU	MMLU-Pro	SciCode
Score	21.3	22.2	25.7	3.0	84.8	51.1	4.2	89.0	30.5	70.3	87.3	73.3	29.9

Compare with Similar Models

gemini-2.5-pro-preview

Code Examples

Integration samples and API usage

Code Samples for llama-3.1-405b-instruct

Python SDK Example:

from openai import OpenAI

client = OpenAI(
    base_url="https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    api_key="<your_api_key>"
)

response = client.chat.completions.create(
    model="llama-3.1-405b-instruct",
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ]
)

print(response.choices[0].message.content)

TypeScript SDK Example:

import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: "https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    apiKey: "<your_api_key>"
});

const response = await client.chat.completions.create({
    model: "llama-3.1-405b-instruct",
    messages: [
        { role: "user", content: "Hello, how are you?" }
    ]
});

console.log(response.choices[0].message.content);

cURL Example:

curl -X POST "https://api.us-east-1.langdb.ai/projects/<your_project_id>/v1/chat/completions" \
  -H "Authorization: Bearer <your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-405b-instruct",
    "messages": [
        {"role": "user", "content": "Hello, how are you?"}
    ]
  }'

Model: llama-3.1-405b-instruct

Provider: deepinfra

API Endpoint: $https://api.us-east-1.langdb.ai

Create API Key

Related Models

Similar models from deepinfra

llama-3.1-405b-instruct

llama-3.1-405b-instruct

Access llama-3.1-405b-instruct through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

deepseek-chat-v3-0324

deepseek-chat-v3.1

deepseek-prover-v2

DeepSeek-R1

deepseek-r1-0528

DeepSeek-R1-Distill-Llama-70B

llama-3.1-405b-instruct by deepinfra - AI Model Details, Pricing, and Performance Metrics

llama-3.1-405b-instruct

llama-3.1-405b-instruct

Access llama-3.1-405b-instruct through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

deepseek-chat-v3-0324

deepseek-chat-v3.1

deepseek-prover-v2

DeepSeek-R1

deepseek-r1-0528

DeepSeek-R1-Distill-Llama-70B