llama-3.1-nemotron-70b-instruct by deepinfra - AI Model Details, Pricing, and Performance Metrics

nvidia
llama-3.1-nemotron-70b-instruct
nvidia

llama-3.1-nemotron-70b-instruct

completions
bydeepinfra

NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).

Released
Oct 1, 2024
Knowledge
Dec 1, 2023
License
llama_3_1_community_license
Context
131072
Input
$0.12 / 1M tokens
Output
$0.3 / 1M tokens
Capabilities: tools
Accepts: text
Returns: text

Access llama-3.1-nemotron-70b-instruct through LangDB AI Gateway

Recommended

Integrate with nvidia's llama-3.1-nemotron-70b-instruct and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API
Cost Optimization
Enterprise Security
Get Started Now

Free tier available • No credit card required

Instant Setup
99.9% Uptime
10,000+Monthly Requests

Category Scores

Benchmark Tests

View Other Benchmarks
AIME
24.7
Mathematics
AA Coding Index
20.1
Programming
AAII
23.6
General
AA Math Index
11.0
Mathematics
GPQA
46.5
STEM (Physics, Chemistry, Biology)
HLE
4.6
General Knowledge
LiveCodeBench
16.9
Programming
MATH-500
73.3
Mathematics
MMLU
80.2
General Knowledge
MMLU-Pro
69.0
General Knowledge
SciCode
23.3
Scientific

Code Examples

Integration samples and API usage