Flux.2 Klein

4B and 9B parameters, a Q4 GGUF for the 4B model is about 2.6 GB while 9B FP8 requires about 15 GB VRAM

• BARE MINIMUM

  NVIDIA GeForce RTX 3060 12GB

  12 GB VRAM

  ~$230 USED

  Klein 4B at FP8 or Q4 GGUF with low-step generation in 2 to 4 seconds

  
• SWEET SPOT

  NVIDIA GeForce RTX 4070 Super 12GB

  12 GB VRAM

  ~$590 NEW

  Klein 4B at BF16 or Klein 9B at FP8 with sub-second to 2-second inference

  
• FULL POWER

  NVIDIA GeForce RTX 4090 24GB

  24 GB VRAM

  ~$1750 USED

  Klein 9B and 4B at full BF16 precision, multi-reference editing, and high-res batching in under 1 second

  

HARDWARE PICKS & PRICES ARE RESEARCHED FROM THE LIVE WEB AND REFRESHED AUTOMATICALLY. TREAT THEM AS BALLPARK, NOT GOSPEL.

STARS ARE THE COMMUNITY SCORE FOR THAT KIND OF WORK, DOCKED FOR HOW SQUASHED THE WEIGHTS GET AT EACH TIER. A DASH MEANS NO SPEED WAS RESEARCHED FOR THAT RIG. TIMES ARE COMPUTED FROM RESEARCHED SPEEDS. BALLPARK, NOT GOSPEL.

Community feedback on Flux.2 Klein is limited, but users note it tends to refuse prompts or lecture more often than desired.

584 POSTS · 228 COMMENTS · GITHUB · REDDIT · X · HACKER NEWS · LEMMY