llama-3.1-nemotron-ultra-253b-v1

completions

byopenrouter

llama-3.1-nemotron-ultra-253b-v1

completions

Published by: nvidiaProvider:

openrouter

Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.

Released

Apr 7, 2025

Knowledge

Dec 1, 2023

License

llama_3_1_community_license

Context

131072

Input

$0.6 / 1M tokens

Output

$1.8 / 1M tokens

Accepts: text

Returns: text

Released Apr 7, 2025Knowledge Cutoff: Dec 1, 2023License: llama_3_1_community_license

Context: 131072 Input: $0.6 / 1M tokensOutput: $1.8 / 1M tokensAccepts: textReturns: text

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Recommended

Integrate with nvidia's llama-3.1-nemotron-ultra-253b-v1 and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Benchmark Results for llama-3.1-nemotron-ultra-253b-v1

Category Performance Scores:

Academia: Score 56.45 (Top 23% - Rank #80)
Finance: Score 51.10 (Top 26% - Rank #90)
Marketing: Score 41.85 (Top 48% - Rank #166)
Maths: Score 63.70 (Top 22% - Rank #76)
Programming: Score 49.40 (Top 16% - Rank #56)
Science: Score 70.19 (Top 20% - Rank #69)
Writing: Score 43.97 (Top 46% - Rank #159)

Overall Performance: 53.807761904761904 average score across all categories

Detailed Benchmark Scores:

Benchmark	Score	Percentile	Domain
AIME	74.70	Top 13%	Mathematics
AA Coding Index	49.40	Top 16%	Programming
AAII	38.50	Top 27%	General
AA Math Index	63.70	Top 22%	Mathematics
GPQA	74.41	Top 18%	STEM (Physics, Chemistry, Biology)
HLE	8.10	Top 15%	General Knowledge
LiveCodeBench	64.10	Top 15%	Programming
MATH-500	95.20	Top 15%	Mathematics
MMLU-Pro	82.50	Top 16%	General Knowledge
SciCode	34.70	Top 29%	Scientific

GPQA Score: 74.41 - Graduate-level reasoning benchmark

Model Comparison:

Provider: openrouter

Model Type: completions

Context Size: 131072 tokens

Comparing against 345 models in the database

Category Scores

Benchmark Tests

View Other Benchmarks

AIME

74.7

Mathematics

AA Coding Index

49.4

Programming

AAII

38.5

General

AA Math Index

63.7

Mathematics

GPQA

74.4

STEM (Physics, Chemistry, Biology)

HLE

8.1

General Knowledge

LiveCodeBench

64.1

Programming

MATH-500

95.2

Mathematics

MMLU-Pro

82.5

General Knowledge

SciCode

34.7

Scientific

Metric	AIME	AA Coding Index	AAII	AA Math Index	GPQA	HLE	LiveCodeBench	MATH-500	MMLU-Pro	SciCode
Score	74.7	49.4	38.5	63.7	74.4	8.1	64.1	95.2	82.5	34.7

Compare with Similar Models

gemini-2.5-pro-preview

grok-4

Code Examples

Integration samples and API usage

Code Samples for llama-3.1-nemotron-ultra-253b-v1

Python SDK Example:

from openai import OpenAI

client = OpenAI(
    base_url="https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    api_key="<your_api_key>"
)

response = client.chat.completions.create(
    model="llama-3.1-nemotron-ultra-253b-v1",
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ]
)

print(response.choices[0].message.content)

TypeScript SDK Example:

import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: "https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    apiKey: "<your_api_key>"
});

const response = await client.chat.completions.create({
    model: "llama-3.1-nemotron-ultra-253b-v1",
    messages: [
        { role: "user", content: "Hello, how are you?" }
    ]
});

console.log(response.choices[0].message.content);

cURL Example:

curl -X POST "https://api.us-east-1.langdb.ai/projects/<your_project_id>/v1/chat/completions" \
  -H "Authorization: Bearer <your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-nemotron-ultra-253b-v1",
    "messages": [
        {"role": "user", "content": "Hello, how are you?"}
    ]
  }'

Model: llama-3.1-nemotron-ultra-253b-v1

Provider: openrouter

API Endpoint: $https://api.us-east-1.langdb.ai

Create API Key

Related Models

Similar models from openrouter

llama-3.1-nemotron-ultra-253b-v1

llama-3.1-nemotron-ultra-253b-v1

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

aion-1.0

aion-1.0-mini

aion-rp-llama-3.1-8b

coder-large

codestral-2501

codestral-2508

llama-3.1-nemotron-ultra-253b-v1 by openrouter - AI Model Details, Pricing, and Performance Metrics

llama-3.1-nemotron-ultra-253b-v1

llama-3.1-nemotron-ultra-253b-v1

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

aion-1.0

aion-1.0-mini

aion-rp-llama-3.1-8b

coder-large

codestral-2501

codestral-2508