Model Comparison

mistral-small-24b-instruct-2501vsgemini-2.5-pro

Compare performance, benchmarks, and characteristics

deepinfra

Context32768 tokens

Input Price$0.05 / 1M tokens

Output Price$0.08 / 1M tokens

gemini

Context1M tokens

Input Price$1.25 / 1M tokens

Output Price$10 / 1M tokens

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	gemini-2.5-pro gemini
Pricing
Input Price	$0.05 / 1M tokens	$1.25 / 1M tokens
Output Price	$0.08 / 1M tokens	$10 / 1M tokens
Capabilities
Context Window	32768 tokens	1M tokens
Capabilities		tools
Input type	text	text, image, audio, video
Category Scores
Overall Average	45.3	68.9
Science	45.3	83.7
Academia	N/A	71.7
Finance	N/A	76.2
Marketing	N/A	46.8
Maths	N/A	92.7
Programming	N/A	61.5
Vision	N/A	79.6
Writing	N/A	38.8
Benchmark Tests
AIME	_	88.7
AA Coding Index	_	61.5
AAII	_	59.6
AA Math Index	_	92.7
GPQA	45.3	83.7
HLE	_	21.1
HumanEval	84.8	_
LiveCodeBench	_	80.1
MATH-500	_	96.7
MMLU-Pro	66.3	86.2
MMMU	_	79.6
SciCode	_	42.8

mistral-small-24b-instruct-2501 Advantages

gemini-2.5-pro Advantages

Loading comparison...

Model Comparison

Metric	mistral-small-24b-instruct-2501 deepinfra	gemini-2.5-pro gemini
Pricing
Input Price	$0.05 / 1M tokens	$1.25 / 1M tokens
Output Price	$0.08 / 1M tokens	$10 / 1M tokens
Capabilities
Context Window	32768 tokens	1M tokens
Capabilities		tools
Input type	text	text, image, audio, video
Category Scores
Overall Average	45.3	68.9
Science	45.3	83.7
Academia	N/A	71.7
Finance	N/A	76.2
Marketing	N/A	46.8
Maths	N/A	92.7
Programming	N/A	61.5
Vision	N/A	79.6
Writing	N/A	38.8
Benchmark Tests
AIME	_	88.7
AA Coding Index	_	61.5
AAII	_	59.6
AA Math Index	_	92.7
GPQA	45.3	83.7
HLE	_	21.1
HumanEval	84.8	_
LiveCodeBench	_	80.1
MATH-500	_	96.7
MMLU-Pro	66.3	86.2
MMMU	_	79.6
SciCode	_	42.8

mistral-small-24b-instruct-2501 Advantages

gemini-2.5-pro Advantages