LOADING COMPARISON
GROUNDED IN REAL HUMAN CONVERSATIONSYOUR BENCH
HEAD TO HEAD
starcoder2 15B vs Mercury 2.5 vs Fugu Max
Community vibe score against API price per 1M tokens. Up and left wins: loved and cheap.
WHAT PEOPLE SAY
Mercury 2.5
LOVE
Popular for coding help
Fugu Max
LOVE
Good at writing and wording things
COMPLAINT
Outages, errors, or limits get in the way
VALUE FOR MONEY
NOT ON THE CHART (NO PUBLIC API PRICE):starcoder2 15BSTILL IN THE TABLE BELOW. THE CHART ONLY PLOTS MODELS WITH A KNOWN PRICE PER 1M TOKENS.
| Metric | |||
|---|---|---|---|
| VIBE SCORE | 5.5 | 7.6 | 7.6 |
| VOICES | 37 | 6,883 | 5,959 |
| RANK | #346 | #3 | #4 |
| CATEGORY | Code | Text | Multimodal |
| OPEN/CLOSED | OPEN WEIGHTS | CLOSED | CLOSED |
| PRICE IN (per 1M) | N/A | $0.04 / 1M | $2.00 / 1M |
| PRICE OUT (per 1M) | N/A | $0.15 / 1M | $6.00 / 1M |
| THE CROWD LOVES | Not enough talk yet | Popular for coding help | Good at writing and wording things |
| THE CROWD GRUMBLES | Nobody is complaining yet | Nobody is complaining yet | Outages, errors, or limits get in the way |
ADD A MODEL (3 OF 4 SLOTS USED)
Fair fights only: chat and coding models compare with each other.
