LOADING DATASHEET
LOADING DATASHEET
by Mistral
RANKED #248 OF 318 ASSISTANTS · OVERALL #374 OF 494 RANKED · VIBE SCORE 5.6 · 46 VOICES ·
COPY BADGE pastes a README snippet with the rank SVG.
Mistral-Small-3.2-24B-Instruct-2506 is an updated 24B parameter model from Mistral optimized for instruction following, repetition reduction, and improved function calling. Compared to the 3.1 release, version 3.2 significantly improves acc
9 mentions
1 mentions
26 weeks · 33 voices in this window
AGING WELL
The crowd is warmer now than it was at the start.
Open weights. You can use a hosted service, or download it and run it yourself, free.
Open weights: download Small 3.2 24B once and it's yours. No subscription, no rate limits, works offline.
24B parameters, a Q4 file is about 14.5 GB, FP16 is about 48 GB
Nvidia GeForce RTX 4060 Ti 16GB
16 GB VRAM
~$450 NEWIQ3_M or tight Q4_K_S, ~18 tok/s, 4k context
Nvidia GeForce RTX 4090 24GB
24 GB VRAM
~$1800 USEDQ4_K_M or Q5_K_M, ~44 tok/s, 16k context
Apple Mac Studio M2 Ultra (64GB)
64 GB UNIFIED MEMORY
~$3300 USEDQ8_0 or full FP16, ~25 tok/s, 128k context
No live install guides found yet. The hardware picks above still stand.
The three cards above are researched picks. Search the machine you actually have — we only say yes if it should reply at a usable speed, not just load the weights and crawl.
HARDWARE PICKS & PRICES ARE RESEARCHED FROM THE LIVE WEB AND REFRESHED AUTOMATICALLY. TREAT THEM AS BALLPARK, NOT GOSPEL.
Everyday jobs on each of those rigs: how long Small 3.2 24B takes, and how good the crowd says it is at that kind of work.
| THE JOB | BARE MINIMUMNvidia GeForce RTX 4060 Ti 16GB | SWEET SPOTNvidia GeForce RTX 4090 24GB | FULL POWERApple Mac Studio M2 Ultra (64GB) |
|---|---|---|---|
| Write an emaila paragraph or two, drafted from a one-line brief | ~28 S★★★★★ | ~11 S★★★★★ | ~20 S★★★★★ |
| Summarize a documenta long report boiled down to the points that matter | ~83 S★★★★★ | ~34 S★★★★★ | ~60 S★★★★★ |
| Build a websitea small landing page, markup and styles together | ~7.4 MIN★★★★★ | ~3 MIN★★★★★ | ~5.3 MIN★★★★★ |
| Build a backendan API with routes, storage and tests | ~23 MIN★★★★★ | ~9.5 MIN★★★★★ | ~17 MIN★★★★★ |
| Build a gamea playable browser game in one file | ~14 MIN★★★★★ | ~5.7 MIN★★★★★ | ~10 MIN★★★★★ |
STARS ARE THE COMMUNITY SCORE FOR THAT KIND OF WORK, DOCKED FOR HOW SQUASHED THE WEIGHTS GET AT EACH TIER. TIMES ARE COMPUTED FROM RESEARCHED SPEEDS. BALLPARK, NOT GOSPEL.
Not enough discussion about Small 3.2 24B yet to call it. We found 46 posts but people did not say much either way.
37 POSTS · 9 COMMENTS · HACKER NEWS · LEMMY · REDDIT · GITHUB · DEV.TO
Other models the crowd has fully reviewed, starting with multimodal models like this one.
Introducing Mistral 3
Introducing Mistral Small 3.2
Best models under 16GB
Universal Preset: Voyage v5
Gemma 3n Fine-tuning out now!
Character Creator V2 - Generate full characters from a few sentences on your PC
Mistral 3.2 24B Fixed tool calling final
Mistral Small 3.2 (24B-Instruct-2506)
Ban the em dash!
MOE Pipeline
Apply image rotation correction before sending images to vision models - Pixtral alternatives comparison revisited
Pixtral retirement - I tried 8 alternatives, this is what I found