LOADING COMPARISON
GROUNDED IN REAL HUMAN CONVERSATIONSYOUR BENCH
HEAD TO HEAD
LFM2.5 24B A2B vs Step 3 vs Mercury 2.5
Community vibe score against API price per 1M tokens. Up and left wins: loved and cheap.
WHAT PEOPLE SAY
LFM2.5 24B A2B
LOVE
Popular for coding help
COMPLAINT
Outages, errors, or limits get in the way
Step 3
LOVE
Popular for coding help
COMPLAINT
Refuses or lectures more than people like
Mercury 2.5
LOVE
Popular for coding help
COMPLAINT
Outages, errors, or limits get in the way
VALUE FOR MONEY
NOT ON THE CHART (NO PUBLIC API PRICE):Step 3STILL IN THE TABLE BELOW. THE CHART ONLY PLOTS MODELS WITH A KNOWN PRICE PER 1M TOKENS.
| Metric | |||
|---|---|---|---|
| VIBE SCORE | 7.0 | 7.0 | 7.4 |
| VOICES | 2,475 | 2,073 | 6,982 |
| RANK | #21 of 346 assistants | #23 of 346 assistants | #7 of 346 assistants |
| OVERALL | #32 of 538 ranked | #34 of 538 ranked | #8 of 538 ranked |
| CATEGORY | Text | Multimodal | Text |
| OPEN/CLOSED | OPEN WEIGHTS | OPEN WEIGHTS | CLOSED |
| PRICE IN (per 1M) | $0.05 / 1M | N/A | $0.04 / 1M |
| PRICE OUT (per 1M) | $0.70 / 1M | N/A | $0.15 / 1M |
| THE CROWD LOVES | Popular for coding help | Popular for coding help | Popular for coding help |
| THE CROWD GRUMBLES | Outages, errors, or limits get in the way | Refuses or lectures more than people like | Outages, errors, or limits get in the way |
ADD A MODEL (3 OF 4 SLOTS USED)
Fair fights only: chat and coding models compare with each other.
