Back to GalleryBack

Model Comparison

gemini-1.5-flash-8bvsclaude-3.7-sonnet

Model Comparison

Compare performance, benchmarks, and characteristics

gemini-1.5-flash-8b

gemini

Context1M tokens

Input Price$0.04 / 1M tokens

Output Price$0.15 / 1M tokens

View Details →

claude-3.7-sonnet

anthropic

Context200K tokens

Input Price$3 / 1M tokens

Output Price$15 / 1M tokens

View Details →

Loading comparison...

Model Comparison

Metric	gemini-1.5-flash-8b gemini	claude-3.7-sonnet anthropic
Pricing
Input Price	$0.04 / 1M tokens	$3 / 1M tokens
Output Price	$0.15 / 1M tokens	$15 / 1M tokens
Capabilities
Context Window	1M tokens	200K tokens
Capabilities	tools	tools
Input type	text, image, audio, video	text
Category Scores
Overall Average	28.4	0.0
Academia	26.7	N/A
Finance	26.2	N/A
Marketing	12.4	N/A
Maths	36.1	N/A
Programming	22.3	N/A
Science	37.1	N/A
Vision	53.7	N/A
Writing	12.6	N/A
Benchmark Tests
AIME	3.3	_
AA Coding Index	22.3	_
AAII	16.3	_
AA Math Index	36.1	_
GPQA	37.1	_
HLE	4.5	_
LiveCodeBench	21.7	_
MATH-500	68.9	_
MMLU-Pro	57.8	_
MMMU	53.7	_
SciCode	22.9	_

gemini-1.5-flash-8b Advantages

• Higher benchmark scores (28.4 vs 0.0)
• Lower input token cost ($0.04 / 1M tokens vs $3 / 1M tokens)
• Larger context window (1M tokens vs 200K tokens)

claude-3.7-sonnet Advantages

Compare gemini/gemini-1.5-flash-8b vs anthropic/claude-3.7-sonnet