NotAnotherBench
GROUNDED IN REAL HUMAN CONVERSATIONSYOUR BENCH
< GPT 6 ASTRA
PROBLEMS

GPT 6 Astra problems

Complaints distilled from real conversations, 26,660 voices so far. Nothing here is invented.

WHAT PEOPLE COMPLAIN ABOUT

  • Outages, errors, or limits get in the way (82 mentions)
  • People find it expensive (49 mentions)
  • Refuses or lectures more than people like (48 mentions)
  • Sometimes makes things up (38 mentions)

IN THEIR OWN WORDS

  • “[VS Code][Regression] Code comprehension quality down across GPT-6.1 Sol / GPT-6 Astra / GPT-5.6 Sol, with severe latency; web works better.”

    SOURCE >