LOADING DATASHEET
LOADING DATASHEET
by Thinkingmachines
RANKED #172 OF 231 ASSISTANTS · OVERALL #270 OF 6,549 · VIBE SCORE 5.6 · 26 VOICES
Inkling Small is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 12B active parameters out of 276B total. It is positioned as the smaller, more efficient member of...
6 mentions
0 mentions
26 weeks · 40 voices
AGING WELL
The crowd is warmer now than it was at the start.
Open weights. You can use a hosted service, or download it and run it yourself, free.
People are mostly happy with Inkling Small. Biggest praise: help with code.
24 POSTS · 2 COMMENTS · REDDIT · GITHUB · X · BLOG
6 thumbs up · 0 thumbs down
3 thumbs up · 1 thumbs down
2 thumbs up · 2 thumbs down
Other models the crowd has fully reviewed, starting with multimodal models like this one.
If you have 2 DGX Sparks and work a lot with vision models, and want something with: - audio - video - image - agentic -
Inkling-Small-276B-12B, effort "max" VS Qwen3.6-27B
Inkling-Small 276B-A12B at ~2.9 tok/s on <10gb memory
We've gotten some great medium sized models lately (DSV4 Flash 0731, Inkling Small, Laguna S 2.1, Step 3.7 Flash) but does anybody else want to see some new 70-80b contenders?
Thinking Machine's smaller "Inkling Small" Artificial Analysis results
Housekeeping: I’m traveling so cannot make a voiceover for this post. EDIT — I added a bullet point 5 on the Chinese data industry after sending the email out. Today, Z.ai announced their GLM-5.3 model, currently only available in the coding plan, coming soon…
Exciting news! My book trying to share post-training knowledge with the world is done and shipping soon. Order on Manning or Amazon . Thanks for the support. It’s currently the #1 AI book on Amazon :). Nathan and Florian sit down to discuss everything…
One of our big “hero charts” a year ago (eventually adopted by Demis ) made the stunning observation that, holding LMSys Elo constant, GPT4 level intelligence fell by 1000x over 18 months : Back then, it was unclear if these were “noob gains” - going from…
Housekeeping: No voiceover for this post as I’m traveling. The oldest comparison people try to make is how what’s happening with open models compares to foundational open-source software projects like the Linux operating system. There are fairly clean…
The open source ecosystem is making it easier for AI enthusiasts and developers to build, customize and run increasingly capable agents locally. Throughout August, NVIDIA is celebrating the partners and open source communities moving local AI forward, along…
Now Suddenly too many choices for DGX Spark with Qwen 3.5 122B . What would be the next upgrade?
I've added Maple-Preview to Mference, got 40 tps generation with 500MB of used RAM on Air M4