Back to GalleryBack
Model Comparison
Model Comparison
Compare performance, benchmarks, and characteristics
claude-3-opus-20240229
anthropic
Context200K tokens
Input Price$5 / 1M tokens
Output Price$75 / 1M tokens
Loading comparison...
Compare performance, benchmarks, and characteristics
Loading comparison...
Metric | ||
---|---|---|
Pricing | ||
Input Price | $5 / 1M tokens | $2 / 1M tokens |
Output Price | $75 / 1M tokens | $8 / 1M tokens |
Capabilities | ||
Context Window | 200K tokens | 1047576 tokens |
Capabilities | tools | tools |
Input type | text | text, image |
Category Scores | ||
Overall Average | 36.0 | 57.5 |
Academia | 36.7 | 56.6 |
Finance | 28.7 | 57.1 |
Marketing | 44.8 | 55.7 |
Maths | 33.7 | 67.5 |
Programming | 25.6 | 41.9 |
Science | 49.6 | 66.5 |
Writing | 33.1 | 39.5 |
Vision | N/A | 74.8 |
Benchmark Tests | ||
AIME | 3.3 | 43.7 |
AA Coding Index | 25.6 | 41.9 |
AAII | 23.7 | 46.8 |
AA Math Index | 33.7 | 67.5 |
DROP | 83.1 | _ |
GPQA | 49.6 | 66.5 |
HLE | 3.1 | 4.6 |
HumanEval | 84.9 | _ |
LiveCodeBench | 27.9 | 45.7 |
MATH-500 | 64.1 | 91.3 |
MMLU | 86.8 | 90.2 |
MMLU-Pro | 69.0 | 80.6 |
MMMU | _ | 74.8 |
SciCode | 23.3 | 38.1 |