llama-3.1-70b-instruct

completions

bydeepinfra

llama-3.1-70b-instruct

completions

Published by: metaProvider:

deepinfra

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

Released

Jul 23, 2024

Knowledge

Jan 25, 2024

License

llama_3_1_community_license

Context

131072

Input

$0.1 / 1M tokens

Output

$0.28 / 1M tokens

Capabilities: tools

Accepts: text

Returns: text

Released Jul 23, 2024Knowledge Cutoff: Jan 25, 2024License: llama_3_1_community_license

Context: 131072 Input: $0.1 / 1M tokensOutput: $0.28 / 1M tokensCapabilities: toolsAccepts: textReturns: text

Access llama-3.1-70b-instruct through LangDB AI Gateway

Recommended

Integrate with meta's llama-3.1-70b-instruct and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Benchmark Results for llama-3.1-70b-instruct

Category Performance Scores:

Maths: Score 4.00 (Top 95% - Rank #331)
Finance: Score 8.25 (Top 94% - Rank #328)
Science: Score 47.45 (Top 81% - Rank #282)
Writing: Score 33.73 (Top 91% - Rank #317)
Academia: Score 26.90 (Top 85% - Rank #296)
Marketing: Score 32.42 (Top 87% - Rank #303)
Programming: Score 10.90 (Top 82% - Rank #286)

Overall Performance: 23.379285714285714 average score across all categories

Detailed Benchmark Scores:

Benchmark	Score	Percentile	Domain
HLE	4.60	Top 65%	General Knowledge
AIME	17.30	Top 64%	Mathematics
DROP	79.60	Top 59%	General Knowledge
GPQA	41.30	Top 85%	STEM (Physics, Chemistry, Biology)
SciCode	26.70	Top 70%	Scientific
MATH-500	64.90	Top 80%	Mathematics
MMLU-Pro	67.60	Top 77%	General Knowledge
LiveCodeBench	23.20	Top 80%	Programming
AA Math Index	4.00	Top 95%	Mathematics
AA Coding Index	10.90	Top 82%	Programming
AAII	12.50	Top 82%	General

GPQA Score: 41.30 - Graduate-level reasoning benchmark

Model Comparison:

Provider: deepinfra

Model Type: completions

Context Size: 131072 tokens

Comparing against 348 models in the database

Category Scores

Benchmark Tests

View Other Benchmarks

HLE

4.6

General Knowledge

AIME

17.3

Mathematics

DROP

79.6

General Knowledge

GPQA

41.3

STEM (Physics, Chemistry, Biology)

SciCode

26.7

Scientific

MATH-500

64.9

Mathematics

MMLU-Pro

67.6

General Knowledge

LiveCodeBench

23.2

Programming

AA Math Index

4.0

Mathematics

AA Coding Index

10.9

Programming

AAII

12.5

General

Metric	HLE	AIME	DROP	GPQA	SciCode	MATH-500	MMLU-Pro	LiveCodeBench	AA Math Index	AA Coding Index	AAII
Score	4.6	17.3	79.6	41.3	26.7	64.9	67.6	23.2	4.0	10.9	12.5

Compare with Similar Models

claude-opus-4.5

claude-opus-4.6

gemini-3-flash-preview

claude-sonnet-4.5

gemini-3-pro-preview

claude-sonnet-4

Code Examples

Integration samples and API usage

Code Samples for llama-3.1-70b-instruct

Python SDK Example:

from openai import OpenAI

client = OpenAI(
    base_url="https://api.langdb.ai/projects/<your_project_id>",
    api_key="<your_api_key>"
)

response = client.chat.completions.create(
    model="llama-3.1-70b-instruct",
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ]
)

print(response.choices[0].message.content)

TypeScript SDK Example:

import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: "https://api.langdb.ai/projects/<your_project_id>",
    apiKey: "<your_api_key>"
});

const response = await client.chat.completions.create({
    model: "llama-3.1-70b-instruct",
    messages: [
        { role: "user", content: "Hello, how are you?" }
    ]
});

console.log(response.choices[0].message.content);

cURL Example:

curl -X POST "https://api.langdb.ai/projects/<your_project_id>/v1/chat/completions" \
  -H "Authorization: Bearer <your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-70b-instruct",
    "messages": [
        {"role": "user", "content": "Hello, how are you?"}
    ]
  }'

Model: llama-3.1-70b-instruct

Provider: deepinfra

API Endpoint: $https://api.langdb.ai

Create API Key

Related Models

Similar models from deepinfra

llama-3.1-70b-instruct

llama-3.1-70b-instruct

Access llama-3.1-70b-instruct through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

deepseek-chat-v3-0324

deepseek-chat-v3.1

deepseek-prover-v2

DeepSeek-R1

deepseek-r1-0528

DeepSeek-R1-Distill-Llama-70B

llama-3.1-70b-instruct by deepinfra - AI Model Details, Pricing, and Performance Metrics

llama-3.1-70b-instruct

llama-3.1-70b-instruct

Access llama-3.1-70b-instruct through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

deepseek-chat-v3-0324

deepseek-chat-v3.1

deepseek-prover-v2

DeepSeek-R1

deepseek-r1-0528

DeepSeek-R1-Distill-Llama-70B