llama-3.1-nemotron-ultra-253b-v1

completions

byopenrouter

llama-3.1-nemotron-ultra-253b-v1

completions

Published by: nvidiaProvider:

openrouter

Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.

Released

Apr 7, 2025

Knowledge

Dec 1, 2023

License

llama_3_1_community_license

Context

131072

Input

$0.6 / 1M tokens

Output

$1.8 / 1M tokens

Accepts: text

Returns: text

Released Apr 7, 2025Knowledge Cutoff: Dec 1, 2023License: llama_3_1_community_license

Context: 131072 Input: $0.6 / 1M tokensOutput: $1.8 / 1M tokensAccepts: textReturns: text

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Recommended

Integrate with nvidia's llama-3.1-nemotron-ultra-253b-v1 and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Benchmark Results for llama-3.1-nemotron-ultra-253b-v1

Category Performance Scores:

Academia: Score 56.45 (Top 27% - Rank #91)
Finance: Score 51.10 (Top 34% - Rank #114)
Marketing: Score 41.85 (Top 55% - Rank #185)
Maths: Score 63.70 (Top 28% - Rank #94)
Programming: Score 33.70 (Top 40% - Rank #134)
Science: Score 70.19 (Top 22% - Rank #74)
Writing: Score 43.97 (Top 51% - Rank #171)

Overall Performance: 51.564904761904764 average score across all categories

Detailed Benchmark Scores:

Benchmark	Score	Percentile	Domain
AIME	74.70	Top 16%	Mathematics
AA Coding Index	33.70	Top 40%	Programming
AAII	38.50	Top 34%	General
AA Math Index	63.70	Top 28%	Mathematics
GPQA	74.41	Top 22%	STEM (Physics, Chemistry, Biology)
HLE	8.10	Top 20%	General Knowledge
LiveCodeBench	64.10	Top 20%	Programming
MATH-500	95.20	Top 21%	Mathematics
MMLU-Pro	82.50	Top 17%	General Knowledge
SciCode	34.70	Top 35%	Scientific

GPQA Score: 74.41 - Graduate-level reasoning benchmark

Model Comparison:

Provider: openrouter

Model Type: completions

Context Size: 131072 tokens

Comparing against 335 models in the database

Performance Analytics for llama-3.1-nemotron-ultra-253b-v1

Usage Statistics (Last 1 Days):

Total Requests: 4 API calls
Average TPS: 205.65 tokens per second
Average Response Time: 9139.40ms
Average Time to First Token: 9139.40ms
Total Cost: $0.01
Average Request Cost: $0.0019

Daily Performance Breakdown:

Date	Requests	TPS	Response Time	TTFT	Cost
10/8/2025	4	205.65	9139.40ms	9139.40ms	$0.01

Performance Summary:

Model: llama-3.1-nemotron-ultra-253b-v1 by openrouter

Monitoring Period: 10/2/2025 to 10/9/2025

Average Daily Requests: 4

Peak Daily Requests: 4

Statistics

View Full Statistics

Request Volume

Daily API requests

Performance (TPS)

Tokens per second

205.65 tokens/s

Category Scores

Benchmark Tests

View Other Benchmarks

AIME

74.7

Mathematics

AA Coding Index

33.7

Programming

AAII

38.5

General

AA Math Index

63.7

Mathematics

GPQA

74.4

STEM (Physics, Chemistry, Biology)

HLE

8.1

General Knowledge

LiveCodeBench

64.1

Programming

MATH-500

95.2

Mathematics

MMLU-Pro

82.5

General Knowledge

SciCode

34.7

Scientific

Metric	AIME	AA Coding Index	AAII	AA Math Index	GPQA	HLE	LiveCodeBench	MATH-500	MMLU-Pro	SciCode
Score	74.7	33.7	38.5	63.7	74.4	8.1	64.1	95.2	82.5	34.7

Compare with Similar Models

gemini-2.5-pro-preview

Code Examples

Integration samples and API usage

Code Samples for llama-3.1-nemotron-ultra-253b-v1

Python SDK Example:

from openai import OpenAI

client = OpenAI(
    base_url="https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    api_key="<your_api_key>"
)

response = client.chat.completions.create(
    model="llama-3.1-nemotron-ultra-253b-v1",
    messages=[
        {"role": "user", "content": "Hello, how are you?"}
    ]
)

print(response.choices[0].message.content)

TypeScript SDK Example:

import OpenAI from 'openai';

const client = new OpenAI({
    baseURL: "https://api.us-east-1.langdb.ai/projects/<your_project_id>",
    apiKey: "<your_api_key>"
});

const response = await client.chat.completions.create({
    model: "llama-3.1-nemotron-ultra-253b-v1",
    messages: [
        { role: "user", content: "Hello, how are you?" }
    ]
});

console.log(response.choices[0].message.content);

cURL Example:

curl -X POST "https://api.us-east-1.langdb.ai/projects/<your_project_id>/v1/chat/completions" \
  -H "Authorization: Bearer <your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-nemotron-ultra-253b-v1",
    "messages": [
        {"role": "user", "content": "Hello, how are you?"}
    ]
  }'

Model: llama-3.1-nemotron-ultra-253b-v1

Provider: openrouter

API Endpoint: $https://api.us-east-1.langdb.ai

Create API Key

Related Models

Similar models from openrouter

llama-3.1-nemotron-ultra-253b-v1

llama-3.1-nemotron-ultra-253b-v1

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Statistics

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

afm-4.5b

aion-1.0

aion-1.0-mini

aion-rp-llama-3.1-8b

coder-large

cogito-v2-preview-deepseek-671b

llama-3.1-nemotron-ultra-253b-v1 by openrouter - AI Model Details, Pricing, and Performance Metrics

llama-3.1-nemotron-ultra-253b-v1

llama-3.1-nemotron-ultra-253b-v1

Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway

Statistics

Category Scores

Benchmark Tests

Compare with Similar Models

Code Examples

Related Models

afm-4.5b

aion-1.0

aion-1.0-mini

aion-rp-llama-3.1-8b

coder-large

cogito-v2-preview-deepseek-671b