❌

Normal view

Sakana AI's self-improving model gets better at solving and judging, but can't catch its own blind spots

12 October 2026 at 17:58

Robot stations equipped with conveyor belts sort colorful shapes and assemble them into complex cubes in a closed-loop process.

Sakana AI's MASS method lets one language model improve itself by solving tasks, judging results, and refining workflows, reaching a win rate of nearly 70 percent against the base model after two rounds. But when the model misses the same errors across all three roles, it can mistake them for progress and reinforce them during training.

The article Sakana AI's self-improving model gets better at solving and judging, but can't catch its own blind spots appeared first on The Decoder.

Clearing chat history helps AI agents find better solutions

12 October 2026 at 16:10

Microsoft researchers found that autonomous AI agents get trapped in what they call "idea basins" because of their growing chat context, local solution regions they can't escape. Their "Fork-and-Flush" method clears the chat history but keeps the workspace, achieving up to 66 percent better results on the same compute budget.

The article Clearing chat history helps AI agents find better solutions appeared first on The Decoder.

Google Deepmind's AlphaProof Nexus solved dozens of open math problems and actually got peer reviewed

12 October 2026 at 09:35

Google Deepmind's AlphaProof Nexus solved dozens of open math problems, including nine ErdΕ‘s problems two of which were unsolved for 56 years, per a study in Science. The publication comes as OpenAI faces a boycott for dumping AI proofs on GitHub without peer review. Deepmind had its results reviewed before publishing.

The article Google Deepmind's AlphaProof Nexus solved dozens of open math problems and actually got peer reviewed appeared first on The Decoder.

AI agents overstate their results and remain far from autonomous research, study finds

11 October 2026 at 13:44

Epoch AI and Anthropic independently found the same thing: current AI models like GPT-5.6 Sol and Claude Fable 5 can run experiments but lack scientific self-criticism and genuine creative thinking. At best, Sol reached 15 percent of the human reference score, and even that came from methods researchers already knew. The models' biggest weakness is still their inability to critically question their own results.

The article AI agents overstate their results and remain far from autonomous research, study finds appeared first on The Decoder.

❌