llama-3.1-nemotron-ultra-253b-v1
completions
Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.
Input:$0.6 / 1M tokens
Output:$1.8 / 1M tokens
Context:131072 tokens
text
text
Category Rankings
finance#15
maths#13
programming#12
Access llama-3.1-nemotron-ultra-253b-v1 through LangDB AI Gateway
Recommended
Integrate with nvidia's llama-3.1-nemotron-ultra-253b-v1 and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.
Unified API
Cost Optimization
Enterprise Security
Get Started Now
Free tier available • No credit card required
Instant Setup
99.9% Uptime
10,000+Monthly Requests
Code Example
Configuration
Base URL
API Keys
Headers
Project ID in header
X-Run-Id
X-Thread-Id
Model Parameters
12 availablefrequency_penalty
-202
include_reasoning
logit_bias
logprobs
max_tokens
presence_penalty
-201.999
seed
stop
temperature
012
top_k
top_logprobs
top_p
011
Additional Configuration
Tools
Guards
User:
Id:
Name:
Tags:
Publicly Shared Threads0
Discover shared experiences
Shared threads will appear here, showcasing real-world applications and insights from the community. Check back soon for updates!
Share your threads to help others
Popular Models10
deepseek-chat-v3-0324deepseekDeepSeek V3, a 685B-parameter, mixture-of-experts model, is the latest iteration of the flagship chat model family from the DeepSeek team. It succeeds the [DeepSeek V3](/deepseek/deepseek-chat-v3) model and performs really well on a variety of tasks.Input:$0.25 / 1M tokensOutput:$0.85 / 1M tokensContext:163840 tokenstexttext- deepseek-chatdeepseekDeepSeek-Chat is an advanced conversational AI model designed to provide intelligentInput:$0.14 / 1M tokensOutput:$0.28 / 1M tokensContext:64K tokenstoolstexttext
glm-4.5z-aiGLM-4.5 is our latest flagship foundation model, purpose-built for agent-based applications. It leverages a Mixture-of-Experts (MoE) architecture and supports a context length of up to 128k tokens. GLM-4.5 delivers significantly enhanced capabilities in reasoning, code generation, and agent alignment. It supports a hybrid inference mode with two options, a "thinking mode" designed for complex reasoning and tool use, and a "non-thinking mode" optimized for instant responses. Users can control the reasoning behaviour with the `reasoning` `enabled` boolean. [Learn more in our docs](https://openrouter.ai/docs/use-cases/reasoning-tokens#enable-reasoning-with-default-config)Input:$0.2 / 1M tokensOutput:$0.2 / 1M tokensContext:131072 tokenstoolstexttext- deepseek-r1deepseekDeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass. Fully open-source model & [technical report](https://api-docs.deepseek.com/news/news250120). MIT licensed: Distill & commercialize freely!Input:$0.4 / 1M tokensOutput:$2 / 1M tokensContext:163840 tokenstexttext
- deepseek-r1-0528deepseekMay 28th update to the [original DeepSeek R1](/deepseek/deepseek-r1) Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass. Fully open-source model.Input:$0.27 / 1M tokensOutput:$0.27 / 1M tokensContext:163840 tokenstexttext
- qwen3-235b-a22bqwenQwen3-235B-A22B is a 235B parameter mixture-of-experts (MoE) model developed by Qwen, activating 22B parameters per forward pass. It supports seamless switching between a "thinking" mode for complex reasoning, math, and code tasks, and a "non-thinking" mode for general conversational efficiency. The model demonstrates strong reasoning ability, multilingual support (100+ languages and dialects), advanced instruction-following, and agent tool-calling capabilities. It natively handles a 32K token context window and extends up to 131K tokens using YaRN-based scaling.Input:$0.13 / 1M tokensOutput:$0.6 / 1M tokensContext:40960 tokenstoolstexttext
claude-sonnet-4anthropicOur high-performance model with exceptional reasoning and efficiencyInput:$3 / 1M tokensOutput:$15 / 1M tokensContext:200K tokenstoolstextimagetext
gpt-4.1-miniopenaiGPT-4.1 mini provides a balance between intelligence, speed, and cost that makes it an attractive model for many use cases.Input:$0.4 / 1M tokensOutput:$1.6 / 1M tokensContext:1047576 tokenstoolstextimagetext- gpt-4o-miniopenaiGPT-4o mini (o for omni) is a fast, affordable small model for focused tasks. It accepts both text and image inputs, and produces text outputs (including Structured Outputs). It is ideal for fine-tuning, and model outputs from a larger model like GPT-4o can be distilled to GPT-4o-mini to produce similar results at lower cost and latency.The knowledge cutoff for GPT-4o-mini models is October, 2023.Input:$0.15 / 1M tokensOutput:$0.6 / 1M tokensContext:128K tokenstoolstextimagetext
- deepseek-chatdeepseekDeepSeek-V3 is the latest model from the DeepSeek team, building upon the instruction following and coding abilities of the previous versions. Pre-trained on nearly 15 trillion tokens, the reported evaluations reveal that the model outperforms other open-source models and rivals leading closed-source models. For model details, please visit [the DeepSeek-V3 repo](https://github.com/deepseek-ai/DeepSeek-V3) for more information, or see the [launch announcement](https://api-docs.deepseek.com/news/news1226).Input:$0.27 / 1M tokensOutput:$0.27 / 1M tokensContext:163840 tokenstexttext