DeepSeek-R1-Distill-Llama-70B

deepinfra • Performance Analytics

Core Performance Metrics

Total Requests

4000.0%

Error Rate

0.00%

0.0%

Total Input Tokens

383,327

1457.5%

Total Output Tokens

34,116

3370.6%

Access DeepSeek-R1-Distill-Llama-70B through LangDB AI Gateway

Recommended

Integrate with deepseek's DeepSeek-R1-Distill-Llama-70B and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Performance Percentiles

Response Time

4.38s

17.8%

TTFT

4.38s

17.8%

TPS (Tokens/Second)

1162.5 TPS

51.6%

TPOT (Time/Output Token)

0.010ms

Performance Analytics for DeepSeek-R1-Distill-Llama-70B

Usage Statistics (Last 1 Days):

Total Requests: 82 API calls
Average TPS: 1162.53 tokens per second
Average Response Time: 4379.00ms
Average Time to First Token: 4379.00ms
Total Cost: $0.27
Average Request Cost: $0.0033

Daily Performance Breakdown:

Date	Requests	TPS	Response Time	TTFT	Cost
11/11/2025	82	1162.53	4379.00ms	4379.00ms	$0.27

Performance Summary:

Model: DeepSeek-R1-Distill-Llama-70B by deepinfra

Monitoring Period: 11/11/2025 to 11/18/2025

Average Daily Requests: 82

Peak Daily Requests: 82

Performance Trends

Nov 11 - Nov 18, 2025

Request Volume

Daily API requests

Performance (TPS)

Tokens per second

1162.53 tokens/s

Response Time

Average response latency (ms)

4379.00 ms

TTFT

Time to First Token (ms)

4379.00 ms

Token Analytics

Token usage distribution and efficiency metrics

Token Distribution

Input vs Output token usage

Input Tokens:383,327

Output Tokens:34,116

Total Tokens:417,443

Token Usage Timeline