LOADING DATASHEET
LOADING DATASHEET
by Stability AI
RANKED #223 OF 340 ASSISTANTS · OVERALL #354 OF 7,140 · VIBE SCORE 5.5 · 34 VOICES
stablelm-2-zephyr-1_6b on Hugging Face (text generation). 10,849 downloads. Open weights for local or hosted use.
9 mentions
0 mentions
26 weeks · 1 voices
TOO QUIET
Not enough weekly voices to call a trend yet.
Open weights. You can use a hosted service, or download it and run it yourself, free.
Open weights: download stablelm 2 zephyr 1 6B once and it's yours. No subscription, no rate limits, works offline.
1.6B parameters, a Q4 file is about 1 GB, unquantized FP16 is about 3.3 GB
Intel Core i5-8250U Laptop or Raspberry Pi 5
4 GB RAM
~$120 USEDQ4 quantization, ~12 tok/s, 4k context via CPU inference
Nvidia GeForce GTX 1650 4GB
4 GB VRAM
~$75 USEDQ8 / FP16 full offload, ~90 tok/s, 4k context
Nvidia GeForce RTX 3060 12GB
12 GB VRAM
~$280 NEWFP16 full precision, ~160 tok/s, full 4k context with massive batching
The three cards above are researched picks. Search the machine you actually have — we only say yes if it should reply at a usable speed, not just load the weights and crawl.
HARDWARE PICKS & PRICES ARE RESEARCHED FROM THE LIVE WEB AND REFRESHED AUTOMATICALLY. TREAT THEM AS BALLPARK, NOT GOSPEL.
Everyday jobs on each of those rigs: how long stablelm 2 zephyr 1 6B takes, and how good the crowd says it is at that kind of work.
| THE JOB | BARE MINIMUMIntel Core i5-8250U Laptop or Raspberry Pi 5 | SWEET SPOTNvidia GeForce GTX 1650 4GB | FULL POWERNvidia GeForce RTX 3060 12GB |
|---|---|---|---|
| Write an emaila paragraph or two, drafted from a one-line brief | ~42 S★★★★★ | ~6 S★★★★★ | ~3 S★★★★★ |
| Summarize a documenta long report boiled down to the points that matter | ~2.1 MIN★★★★★ | ~17 S★★★★★ | ~9 S★★★★★ |
| Build a websitea small landing page, markup and styles together | ~11 MIN★★★★★ | ~89 S★★★★★ | ~50 S★★★★★ |
| Build a backendan API with routes, storage and tests | ~35 MIN★★★★★ | ~4.6 MIN★★★★★ | ~2.6 MIN★★★★★ |
| Build a gamea playable browser game in one file | ~21 MIN★★★★★ | ~2.8 MIN★★★★★ | ~1.6 MIN★★★★★ |
STARS ARE THE COMMUNITY SCORE FOR THAT KIND OF WORK, DOCKED FOR HOW SQUASHED THE WEIGHTS GET AT EACH TIER. TIMES ARE COMPUTED FROM RESEARCHED SPEEDS. BALLPARK, NOT GOSPEL.
Not enough discussion about stablelm 2 zephyr 1 6B yet to call it. We found 34 posts but people did not say much either way.
3 POSTS · 31 COMMENTS · REDDIT
Other models the crowd has fully reviewed, starting with text models like this one.
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama
Comment in r/ollama