Model Comparison

mistral-small-24b-instruct-2501vsgpt-4.1

Compare performance, benchmarks, and characteristics

deepinfra

Context32768 tokens

Input Price$0.05 / 1M tokens

Output Price$0.08 / 1M tokens

openai

Context1047576 tokens

Input Price$2 / 1M tokens

Output Price$8 / 1M tokens

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	gpt-4.1 openai
Pricing
Input Price	$0.05 / 1M tokens	$2 / 1M tokens
Output Price	$0.08 / 1M tokens	$8 / 1M tokens
Capabilities
Context Window	32768 tokens	1047576 tokens
Capabilities		tools
Input type	text	text, image
Category Scores
Overall Average	45.3	56.8
Science	45.3	66.5
Academia	N/A	54.9
Finance	N/A	55.5
Marketing	N/A	54.4
Maths	N/A	67.5
Programming	N/A	41.9
Vision	N/A	74.8
Writing	N/A	39.2
Benchmark Tests
AIME	_	43.7
AA Coding Index	_	41.9
AAII	_	43.4
AA Math Index	_	67.5
GPQA	45.3	66.5
HLE	_	4.6
HumanEval	84.8	_
LiveCodeBench	_	45.7
MATH-500	_	91.3
MMLU	_	90.2
MMLU-Pro	66.3	80.6
MMMU	_	74.8
SciCode	_	38.1

mistral-small-24b-instruct-2501 Advantages

gpt-4.1 Advantages

Loading comparison...

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	gpt-4.1 openai
Pricing
Input Price	$0.05 / 1M tokens	$2 / 1M tokens
Output Price	$0.08 / 1M tokens	$8 / 1M tokens
Capabilities
Context Window	32768 tokens	1047576 tokens
Capabilities		tools
Input type	text	text, image
Category Scores
Overall Average	45.3	56.8
Science	45.3	66.5
Academia	N/A	54.9
Finance	N/A	55.5
Marketing	N/A	54.4
Maths	N/A	67.5
Programming	N/A	41.9
Vision	N/A	74.8
Writing	N/A	39.2
Benchmark Tests
AIME	_	43.7
AA Coding Index	_	41.9
AAII	_	43.4
AA Math Index	_	67.5
GPQA	45.3	66.5
HLE	_	4.6
HumanEval	84.8	_
LiveCodeBench	_	45.7
MATH-500	_	91.3
MMLU	_	90.2
MMLU-Pro	66.3	80.6
MMMU	_	74.8
SciCode	_	38.1

mistral-small-24b-instruct-2501 Advantages

gpt-4.1 Advantages