Model Comparison

claude-sonnet-4vsphi-3.5-mini-128k-instruct

Compare performance, benchmarks, and characteristics

anthropic

Context200K tokens

Input Price$3 / 1M tokens

Output Price$15 / 1M tokens

openrouter

Context128K tokens

Input Price$0.1 / 1M tokens

Output Price$0.1 / 1M tokens

Model Comparison

Metric	claude-sonnet-4 anthropic	phi-3.5-mini-128k-instruct openrouter
Pricing
Input Price	$3 / 1M tokens	$0.1 / 1M tokens
Output Price	$15 / 1M tokens	$0.1 / 1M tokens
Capabilities
Context Window	200K tokens	128K tokens
Capabilities	tools	tools
Input type	text, image	text
Category Scores
Overall Average	64.9	0.0
Maths	74.3	N/A
Finance	65.4	N/A
Science	72.7	N/A
Writing	63.5	N/A
Academia	67.1	N/A
Marketing	66.4	N/A
Programming	45.1	N/A
Benchmark Tests
HLE	9.6	_
AIME	77.3	_
GPQA	77.7	_
SciCode	40.0	_
MATH-500	99.1	_
MMLU-Pro	84.2	_
LiveCodeBench	65.5	_
AA Math Index	74.3	_
AA Coding Index	45.1	_
AAII	56.5	_

claude-sonnet-4 Advantages

phi-3.5-mini-128k-instruct Advantages

Loading comparison...

Model Comparison

Metric	claude-sonnet-4 anthropic	phi-3.5-mini-128k-instruct openrouter
Pricing
Input Price	$3 / 1M tokens	$0.1 / 1M tokens
Output Price	$15 / 1M tokens	$0.1 / 1M tokens
Capabilities
Context Window	200K tokens	128K tokens
Capabilities	tools	tools
Input type	text, image	text
Category Scores
Overall Average	64.9	0.0
Maths	74.3	N/A
Finance	65.4	N/A
Science	72.7	N/A
Writing	63.5	N/A
Academia	67.1	N/A
Marketing	66.4	N/A
Programming	45.1	N/A
Benchmark Tests
HLE	9.6	_
AIME	77.3	_
GPQA	77.7	_
SciCode	40.0	_
MATH-500	99.1	_
MMLU-Pro	84.2	_
LiveCodeBench	65.5	_
AA Math Index	74.3	_
AA Coding Index	45.1	_
AAII	56.5	_

claude-sonnet-4 Advantages

phi-3.5-mini-128k-instruct Advantages