LOADING COMPARISON
GROUNDED IN REAL HUMAN CONVERSATIONSYOUR BENCH
HEAD TO HEAD
Codellama vs Gemini 3.7 Flash vs Mercury 2.5
Community vibe score against API price per 1M tokens. Up and left wins: loved and cheap.
WHAT PEOPLE SAY
Codellama
LOVE
Popular for coding help
Gemini 3.7 Flash
LOVE
Popular for coding help
COMPLAINT
Sometimes makes things up
Mercury 2.5
LOVE
Popular for coding help
VALUE FOR MONEY
NOT ON THE CHART (NO PUBLIC API PRICE):CodellamaSTILL IN THE TABLE BELOW. THE CHART ONLY PLOTS MODELS WITH A KNOWN PRICE PER 1M TOKENS.
| Metric | |||
|---|---|---|---|
| VIBE SCORE | 5.3 | 7.2 | 7.5 |
| VOICES | 123 | 8,448 | 6,883 |
| RANK | #410 | #18 | #5 |
| CATEGORY | Code | Multimodal | Text |
| OPEN/CLOSED | OPEN WEIGHTS | CLOSED | CLOSED |
| PRICE IN (per 1M) | N/A | $0.75 / 1M | $0.04 / 1M |
| PRICE OUT (per 1M) | N/A | $3.75 / 1M | $0.15 / 1M |
| THE CROWD LOVES | Popular for coding help | Popular for coding help | Popular for coding help |
| THE CROWD GRUMBLES | Nobody is complaining yet | Sometimes makes things up | Nobody is complaining yet |
ADD A MODEL (3 OF 4 SLOTS USED)
Fair fights only: chat and coding models compare with each other.
