Back to GalleryBack

Model Comparison

claude-3-haiku-20240307vsgemini-2.5-flash-preview

Model Comparison

Compare performance, benchmarks, and characteristics

claude-3-haiku-20240307

anthropic

Context200K tokens

Input Price$0.25 / 1M tokens

Output Price$1.25 / 1M tokens

View Details →

gemini-2.5-flash-preview

gemini

Context1M tokens

Input Price$0.15 / 1M tokens

Output Price$0.6 / 1M tokens

View Details →

Loading comparison...

Model Comparison

Metric	claude-3-haiku-20240307 anthropic	gemini-2.5-flash-preview gemini
Pricing
Input Price	$0.25 / 1M tokens	$0.15 / 1M tokens
Output Price	$1.25 / 1M tokens	$0.6 / 1M tokens
Capabilities
Context Window	200K tokens	1M tokens
Capabilities	tools	tools
Input type	text, image	text, image, audio, video
Category Scores
Overall Average	29.0	0.0
Academia	22.7	N/A
Finance	16.1	N/A
Marketing	43.6	N/A
Maths	20.2	N/A
Programming	17.0	N/A
Science	33.3	N/A
Writing	50.0	N/A
Benchmark Tests
AIME	1.0	_
AA Coding Index	17.0	_
AAII	12.1	_
AA Math Index	20.2	_
DROP	78.4	_
GPQA	33.3	_
HumanEval	75.9	_
LiveCodeBench	15.4	_
MATH-500	39.4	_
MMLU	75.2	_
SciCode	18.6	_

claude-3-haiku-20240307 Advantages

• Higher benchmark scores (29.0 vs 0.0)

gemini-2.5-flash-preview Advantages

• Lower input token cost ($0.15 / 1M tokens vs $0.25 / 1M tokens)
• Larger context window (1M tokens vs 200K tokens)

Compare anthropic/claude-3-haiku-20240307 vs gemini/gemini-2.5-flash-preview