llama-3.1-8b-instruct

deepinfra • Performance Analytics

Core Performance Metrics

Total Requests

55.6%

Error Rate

0.00%

0.0%

Total Input Tokens

30,310

46.9%

Total Output Tokens

1,089

112.3%

Access llama-3.1-8b-instruct through LangDB AI Gateway

Recommended

Integrate with meta's llama-3.1-8b-instruct and 250+ other models through a unified API. Monitor usage, control costs, and enhance security.

Unified API

Cost Optimization

Enterprise Security

Get Started Now

Free tier available • No credit card required

Instant Setup

99.9% Uptime

10,000+Monthly Requests

Performance Percentiles

Response Time

1.94s

30.3%

TTFT

1.94s

30.4%

TPS (Tokens/Second)

1154.9 TPS

36.9%

TPOT (Time/Output Token)

0.020ms

Performance Analytics for llama-3.1-8b-instruct

Usage Statistics (Last 3 Days):

Total Requests: 14 API calls
Average TPS: 1154.93 tokens per second
Average Response Time: 1941.90ms
Average Time to First Token: 1941.90ms
Total Cost: $0.00
Average Request Cost: $0.0000

Daily Performance Breakdown:

Date	Requests	TPS	Response Time	TTFT	Cost
10/2/2025	2	2128.79	977.30ms	977.30ms	$0.00
10/7/2025	8	849.98	2477.00ms	2477.00ms	$0.00
10/9/2025	4	1919.14	1354.10ms	1354.10ms	$0.00

Performance Summary:

Model: llama-3.1-8b-instruct by deepinfra

Monitoring Period: 10/2/2025 to 10/9/2025

Average Daily Requests: 5

Peak Daily Requests: 8

Performance Trends

Oct 2 - Oct 9, 2025

Request Volume

Daily API requests

Performance (TPS)

Tokens per second

1154.93 tokens/s

Response Time

Average response latency (ms)

1941.90 ms

TTFT

Time to First Token (ms)

1941.90 ms

Token Analytics

Token usage distribution and efficiency metrics

Token Distribution

Input vs Output token usage

Input Tokens:30,310

Output Tokens:1,089

Total Tokens:31,399

Token Usage Timeline