TAWS

From the Tuesday, November 3 show

MIT uses one AI to rewire another AI

AI-generated from the transcript

What happened
An MIT team used OpenAI's GPT-6 Astra to directly edit a small Qwen model (about 800 million parameters) without training. The edit touched far less than 1% of the model and its math score rose about six times. The team says the edit stopped the model from looping on answers. A Hugging Face engineer rebuilt and reran the test and found the gain came mostly from stopping endless loops. The method failed to help a different small model.
Austin's take
Austin calls it a phenomenal breakthrough and a step toward AI improving itself. He sees it as a way to get more out of small local models and spread that power to individuals who could use a big model to tune a small one for their own needs.
Why it matters
It hints that large models could make small, cheap, local models more capable, though the result is narrow so far.
What to do
Treat this as an early, isolated result. Watch for whether the approach works on other models before expecting practical tools.
Not confirmed yet
Independent replication found the gain was mostly from fixing looping, and the technique did not help a second model.

Watch from 25:40 on the episode page

The Loop

The weekly newsletter

The week in AI in one email: what happened, why it matters, what to do about it.