llama-2-70b-chat
completions
The flagship, 70 billion parameter language model from Meta, fine tuned for chat completions. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align to human preferences for helpfulness and safety.
Input:$0.9 / 1M tokens
Output:$0.9 / 1M tokens
Context:4096 tokens
text
text
Access llama-2-70b-chat through LangDB AI Gateway
Recommended
Integrate with meta-llama's llama-2-70b-chat and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.
Unified API
Cost Optimization
Enterprise Security
Get Started Now
Free tier available • No credit card required
Instant Setup
99.9% Uptime
10,000+Monthly Requests
Code Example
Configuration
Base URL
API Keys
Headers
Project ID in header
X-Run-Id
X-Thread-Id
Model Parameters
11 availablefrequency_penalty
-202
logit_bias
max_tokens
min_p
001
presence_penalty
-201.999
repetition_penalty
012
response_format
stop
temperature
012
top_k
top_p
011
Additional Configuration
Tools
Guards
User:
Id:
Name:
Tags:
Publicly Shared Threads0
Discover shared experiences
Shared threads will appear here, showcasing real-world applications and insights from the community. Check back soon for updates!
Share your threads to help others
Popular Models10
GPT-4o mini Search Preview is a specialized model trained to understand and execute web search queries with the Chat Completions API.Input:$0.15 / 1M tokensOutput:$0.6 / 1M tokensContext:128K tokenstexttext- gpt-4o-search-previewopenaiGPT-4o Search Preview is a specialized model trained to understand and execute web search queries with the Chat Completions APIInput:$2.5 / 1M tokensOutput:$10 / 1M tokensContext:128K tokenstexttext
claude-sonnet-4anthropicOur high-performance model with exceptional reasoning and efficiencyInput:$3 / 1M tokensOutput:$15 / 1M tokensContext:200K tokenstoolstextimagetext- claude-opus-4anthropicOur most capable and intelligent model yet. Claude Opus 4 sets new standards in complex reasoning and advanced codingInput:$15 / 1M tokensOutput:$75 / 1M tokensContext:200K tokenstoolstextimagetext
- gpt-4.1openaiGPT-4.1 is OpenAI's flagship model for complex tasks. It is well suited for problem solving across domains.Input:$2 / 1M tokensOutput:$8 / 1M tokensContext:1047576 tokenstoolstextimagetext
gemini-2.5-pro-previewgeminiGemini 2.5 Pro Experimental is Google's state-of-the-art thinking model, capable of reasoning over complex problems in code, math, and STEM, as well as analyzing large datasets, codebases, and documents using long context.Input:$1.25 / 1M tokensOutput:$10 / 1M tokensContext:1M tokenstoolstextimageaudiovideotext- gemini-2.5-flash-previewgeminiGoogle's best model in terms of price-performance, offering well-rounded capabilities. Gemini 2.5 Flash rate limits are more restricted since it is an experimental / preview model.Input:$0.15 / 1M tokensOutput:$0.6 / 1M tokensContext:1M tokenstoolstextimageaudiovideotext
- gemini-2.0-flashgeminiGoogle's most capable multi-modal model with great performance across all tasks, with a 1 million token context window, and built for the era of Agents.Input:$0.1 / 1M tokensOutput:$0.4 / 1M tokensContext:1M tokenstoolstextimageaudiovideotext
- claude-3.7-sonnetanthropicIntelligent model, with visible step‑by‑step reasoningInput:$3 / 1M tokensOutput:$15 / 1M tokensContext:200K tokenstoolstexttextimage
- gemini-2.0-flash-litegeminiGoogle's smallest and most cost effective model, built for at scale usage.Input:$0.07 / 1M tokensOutput:$0.3 / 1M tokensContext:1M tokenstextimageaudiovideotext