llama3-1-70b-instruct-v1.0

completions

bybedrock

llama3-1-70b-instruct-v1.0

completions

Published by: metaProvider:

bedrock

Ideal for content creation, conversational AI, language understanding, research development, and enterprise applications. With new latency-optimized inference capabilities available in public preview, this model sets a new performance benchmark for AI solutions that process extensive text inputs, enabling applications to respond more quickly and handle longer queries more efficiently.

Released

Jul 23, 2024

Knowledge

Jan 25, 2024

License

Meta Llama Community

Context

128K

Input

$0.72 / 1M tokens

Output

$0.72 / 1M tokens

Capabilities: tools

Accepts: text

Returns: text

Released Jul 23, 2024Knowledge Cutoff: Jan 25, 2024License: Meta Llama Community

Context: 128K Input: $0.72 / 1M tokensOutput: $0.72 / 1M tokensCapabilities: toolsAccepts: textReturns: text

Access llama3-1-70b-instruct-v1.0 through LangDB AI Gateway

Recommended

Integrate with meta's llama3-1-70b-instruct-v1.0 and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Benchmark Results for llama3-1-70b-instruct-v1.0

Category Performance Scores:

Maths: Score 4.00 (Top 94% - Rank #303)
Finance: Score 13.30 (Top 94% - Rank #303)
Science: Score 47.22 (Top 77% - Rank #248)
Writing: Score 33.58 (Top 89% - Rank #287)
Academia: Score 31.95 (Top 77% - Rank #248)
Marketing: Score 33.28 (Top 86% - Rank #277)
Programming: Score 17.60 (Top 83% - Rank #268)

Overall Performance: 25.84738095238095 average score across all categories

Detailed Benchmark Scores:

Benchmark	Score	Percentile	Domain
HLE	4.60	Top 58%	General Knowledge
AIME	17.30	Top 64%	Mathematics
DROP	79.60	Top 60%	General Knowledge
GPQA	41.30	Top 80%	STEM (Physics, Chemistry, Biology)
MMLU	83.60	Top 55%	General Knowledge
SciCode	26.70	Top 62%	Scientific
MATH-500	64.90	Top 80%	Mathematics
MMLU-Pro	67.00	Top 74%	General Knowledge
HumanEval	80.50	Top 69%	Programming
LiveCodeBench	23.20	Top 78%	Programming
AA Math Index	4.00	Top 94%	Mathematics
AA Coding Index	17.60	Top 83%	Programming
AAII	22.60	Top 75%	General

MMLU Score: 83.60 - Massive Multitask Language Understanding benchmark

HumanEval Score: 80.50 - Coding capability benchmark

GPQA Score: 41.30 - Graduate-level reasoning benchmark

Model Comparison:

Provider: bedrock

Model Type: completions

Context Size: 128000 tokens

Comparing against 322 models in the database

Category Scores

Benchmark Tests

View Other Benchmarks

HLE

4.6

General Knowledge

AIME

17.3

Mathematics

DROP

79.6

General Knowledge

GPQA

41.3

STEM (Physics, Chemistry, Biology)

MMLU

83.6

General Knowledge

SciCode

26.7

Scientific

MATH-500

64.9

Mathematics

MMLU-Pro

67.0

General Knowledge

HumanEval

80.5

Programming

LiveCodeBench

23.2

Programming

AA Math Index

4.0

Mathematics

AA Coding Index

17.6

Programming

AAII

22.6

General

Metric	HLE	AIME	DROP	GPQA	MMLU	SciCode	MATH-500	MMLU-Pro	HumanEval	LiveCodeBench	AA Math Index	AA Coding Index	AAII
Score	4.6	17.3	79.6	41.3	83.6	26.7	64.9	67.0	80.5	23.2	4.0	17.6	22.6

Compare with Similar Models

claude-opus-4.5

gemini-3-flash-preview

Code Examples

Integration samples and API usage

Code Samples for llama3-1-70b-instruct-v1.0

Python SDK Example:

from openai import OpenAI

client = OpenAI(
    base_url="https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    api_key="<your_api_key>"
)

response = client.chat.completions.create(
    model="llama3-1-70b-instruct-v1.0",
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ]
)

print(response.choices[0].message.content)

TypeScript SDK Example:

import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: "https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    apiKey: "<your_api_key>"
});

const response = await client.chat.completions.create({
    model: "llama3-1-70b-instruct-v1.0",
    messages: [
        { role: "user", content: "Hello, how are you?" }
    ]
});

console.log(response.choices[0].message.content);

cURL Example:

curl -X POST "https://api.us-east-1.langdb.ai/projects/<your_project_id>/v1/chat/completions" \
  -H "Authorization: Bearer <your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama3-1-70b-instruct-v1.0",
    "messages": [
        {"role": "user", "content": "Hello, how are you?"}
    ]
  }'

Model: llama3-1-70b-instruct-v1.0

Provider: bedrock

API Endpoint: $https://api.us-east-1.langdb.ai

Create API Key

Related Models

Similar models from bedrock

llama3-1-70b-instruct-v1.0

llama3-1-70b-instruct-v1.0

Access llama3-1-70b-instruct-v1.0 through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

llama3-2-3b-instruct-v1.0

mistral-7b-instruct-v0.2

command-r-plus-v1.0

command-r-v1.0

llama3-1-8b-instruct-v1.0

llama3-2-1b-instruct-v1.0

llama3-1-70b-instruct-v1.0 by bedrock - AI Model Details, Pricing, and Performance Metrics

llama3-1-70b-instruct-v1.0

llama3-1-70b-instruct-v1.0

Access llama3-1-70b-instruct-v1.0 through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

llama3-2-3b-instruct-v1.0

mistral-7b-instruct-v0.2

command-r-plus-v1.0

command-r-v1.0

llama3-1-8b-instruct-v1.0

llama3-2-1b-instruct-v1.0