Model Comparison

mistral-small-24b-instruct-2501vsclaude-sonnet-4

Compare performance, benchmarks, and characteristics

deepinfra

Context32768 tokens

Input Price$0.05 / 1M tokens

Output Price$0.08 / 1M tokens

anthropic

Context200K tokens

Input Price$3 / 1M tokens

Output Price$15 / 1M tokens

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	claude-sonnet-4 anthropic
Pricing
Input Price	$0.05 / 1M tokens	$3 / 1M tokens
Output Price	$0.08 / 1M tokens	$15 / 1M tokens
Capabilities
Context Window	32768 tokens	200K tokens
Capabilities		tools
Input type	text	text, image
Category Scores
Overall Average	45.3	53.5
Science	45.3	75.4
Academia	N/A	59.9
Finance	N/A	55.7
Marketing	N/A	30.9
Maths	N/A	67.0
Programming	N/A	41.1
Vision	N/A	74.4
Writing	N/A	23.7
Benchmark Tests
AIME	_	40.7
AA Coding Index	_	41.1
AAII	_	44.4
AA Math Index	_	67.0
GPQA	45.3	75.4
HLE	_	4.0
HumanEval	84.8	_
LiveCodeBench	_	44.9
MATH-500	_	93.4
MMLU-Pro	66.3	83.7
MMMU	_	74.4
SciCode	_	37.3

mistral-small-24b-instruct-2501 Advantages

claude-sonnet-4 Advantages

Loading comparison...

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	claude-sonnet-4 anthropic
Pricing
Input Price	$0.05 / 1M tokens	$3 / 1M tokens
Output Price	$0.08 / 1M tokens	$15 / 1M tokens
Capabilities
Context Window	32768 tokens	200K tokens
Capabilities		tools
Input type	text	text, image
Category Scores
Overall Average	45.3	53.5
Science	45.3	75.4
Academia	N/A	59.9
Finance	N/A	55.7
Marketing	N/A	30.9
Maths	N/A	67.0
Programming	N/A	41.1
Vision	N/A	74.4
Writing	N/A	23.7
Benchmark Tests
AIME	_	40.7
AA Coding Index	_	41.1
AAII	_	44.4
AA Math Index	_	67.0
GPQA	45.3	75.4
HLE	_	4.0
HumanEval	84.8	_
LiveCodeBench	_	44.9
MATH-500	_	93.4
MMLU-Pro	66.3	83.7
MMMU	_	74.4
SciCode	_	37.3

mistral-small-24b-instruct-2501 Advantages

claude-sonnet-4 Advantages