LOADING DATASHEET
LOADING DATASHEET
by Alibaba
RANKED #38 OF 316 ASSISTANTS · OVERALL #55 OF 493 RANKED · VIBE SCORE 6.5 · 750 VOICES ·
COPY BADGE pastes a README snippet with the rank SVG.
Qwen3.5 4B is a compact open-weight multimodal model from Alibaba for reasoning, coding, visual understanding, tool use, and structured output.
69 mentions
62 mentions
26 weeks · 876 voices in this window
HOLDING UP
Recent vibe is steady. No clear fade in the crowd.
Open weights. You can use a hosted service, or download it and run it yourself, free.
Open weights: download Qwen3.5 4B once and it's yours. No subscription, no rate limits, works offline.
4B parameters, a Q4 file is about 2.7 GB and full BF16 is around 8.5 GB
Nvidia GTX 1660 Super
6 GB VRAM
~$110 USEDQ4_K_M, ~35 tok/s, 8k context
Nvidia RTX 4060
8 GB VRAM
~$299 NEWQ8_0 or full BF16, ~75 tok/s, 32k context
Nvidia RTX 4070 Super
12 GB VRAM
~$590 NEWBF16 unquantized, ~110 tok/s, full extended context
The three cards above are researched picks. Search the machine you actually have — we only say yes if it should reply at a usable speed, not just load the weights and crawl.
HARDWARE PICKS & PRICES ARE RESEARCHED FROM THE LIVE WEB AND REFRESHED AUTOMATICALLY. TREAT THEM AS BALLPARK, NOT GOSPEL.
Everyday jobs on each of those rigs: how long Qwen3.5 4B takes, and how good the crowd says it is at that kind of work.
| THE JOB | BARE MINIMUMNvidia GTX 1660 Super | SWEET SPOTNvidia RTX 4060 | FULL POWERNvidia RTX 4070 Super |
|---|---|---|---|
| Write an emaila paragraph or two, drafted from a one-line brief | ~14 S★★★★★ | ~7 S★★★★★ | ~5 S★★★★★ |
| Summarize a documenta long report boiled down to the points that matter | ~43 S★★★★★ | ~20 S★★★★★ | ~14 S★★★★★ |
| Build a websitea small landing page, markup and styles together | ~3.8 MIN★★★★★ | ~1.8 MIN★★★★★ | ~73 S★★★★★ |
| Build a backendan API with routes, storage and tests | ~12 MIN★★★★★ | ~5.6 MIN★★★★★ | ~3.8 MIN★★★★★ |
| Build a gamea playable browser game in one file | ~7.1 MIN★★★★★ | ~3.3 MIN★★★★★ | ~2.3 MIN★★★★★ |
STARS ARE THE COMMUNITY SCORE FOR THAT KIND OF WORK, DOCKED FOR HOW SQUASHED THE WEIGHTS GET AT EACH TIER. TIMES ARE COMPUTED FROM RESEARCHED SPEEDS. BALLPARK, NOT GOSPEL.
The internet is split on Qwen3.5 4B. Biggest praise: speed. Biggest gripe: saying no too much.
680 POSTS · 70 COMMENTS · REDDIT · HACKER NEWS · GITHUB · BLUESKY · X · LEMMY · DEV.TO · DEV FORUMS · BLOG
7 thumbs up · 8 thumbs down
9 thumbs up · 0 thumbs down
0 thumbs up · 7 thumbs down
1 thumbs up · 6 thumbs down
2 thumbs up · 4 thumbs down
3 thumbs up · 0 thumbs down
Checked picks first: tags say why you would switch, stars say how fully each one stands in for Qwen3.5 4B.
You can now Fine-tune Qwen3.5 locally! (5GB VRAM)
Qwen3.5-4B is very powerful. It executes tool calls during thinking.
Train your own Decision model with our free notebook!
Train Qwen3.5 with RL locally!
Qwen3.5 9B GGUF Benchmarks
finetune a model to talk through html instead of markdown
I built an open-source RAG system that actually understands images, tables, and document structure — not just text chunks
Qwen3.5-4B-Base-ZitGen-V1
[P] TurboQuant for weights: near‑optimal 4‑bit LLM quantization with lossless 8‑bit residual – 3.2× memory savings
NuExtract3 is now available on Ollama: 4B VLM for document-to-Markdown and structured JSON extraction
tencent/EVIE-Preview-4.5B · Hugging Face
Smallest coding model possible