跳到正文
The Decoder· Jonathan Kemper·· 3 小时前AI 评分41

前 DeepMind 研究员创立 Metis Reasoning,用 AlphaGo 思路治理 AI 幻觉

Former Deepmind researcher thinks AlphaGo's playbook can cure AI hallucinations

AI 导读

前 DeepMind 研究员 Thore Graepel 创立 Metis Reasoning,提出借鉴 AlphaGo 的搜索与验证机制,用显式知识账本记录已知内容、置信度和待解问题,并由独立模块核验每条推理步骤,以减少模型幻觉。该方案目前仅为研究计划,尚无可用系统、benchmark 或与现有推理模型的对比。团队称该方法有望让知识可修改删除而无需重训,并适合边缘设备和机器人上的小模型。

正文

Former Deepmind researcher Thore Graepel wants to build AI systems that track what they know and check every conclusion against evidence. Larger language models won't fix this problem, his team says.

Thore Graepel believes the same idea that let AlphaGo beat Go professional Lee Sedol in 2016 can make AI systems more reliable, including in robots. The former Deepmind researcher founded Metis Reasoning and laid out the approach at Nvidia's GTC conference in Berlin, where the chipmaker has been expanding its platform for robotics and physical AI with the goal of turning robotics' data problem into a compute problem.

A knowledge ledger instead of knowledge baked into model weights

Today's language models amount to just AlphaGo's prediction network, which suggested possible moves, according to Metis. AlphaGo paired that network with a systematic search through game sequences and found the famous Move 37, a move the network would have given a human player roughly a one-in-ten-thousand chance of making. Metis wants to bring that kind of search to general reasoning.

Tabelle ordnet neun Elementen eines Spiels wie Position, Zug, Übergangsregel, Ziel, Policy, Value, Suche, Erfahrung und Spielende jeweils ihre Rolle im Reasoning-System zu.
Metis Reasoning applies AlphaGo's building blocks to general reasoning, with an explicit knowledge state taking the role of the game board. | Image: Metis

Doing so requires what the company's paper calls an explicit knowledge ledger, comparable to the game board. Similar ideas already exist: Microsoft's GraphRAG organizes knowledge outside model weights in a knowledge graph, and Google's AlphaGeometry2 pairs a language model with a symbolic engine that verifies mathematical proofs. Metis wants to extend those principles to open questions in the real world.

Its knowledge ledger records what is known, how confident the system is, and which questions remain open. A separate module checks new entries against calculations, formal proofs, or empirical evidence, and when an assumption falls away, every conclusion that depended on it gets re-evaluated. A "move" can be a question, an experiment, or a challenge to an existing assumption; the system picks whichever one reduces uncertainty about the original question the most, ultimately delivering either an answer or a justified abstention.

Flussdiagramm des Reasoning-Zyklus von Metis Reasoning mit den Schritten Zustand, Ziel und Budget prüfen, Zug wählen und ausführen, Begründung bewerten, Zustand aktualisieren oder Ergebnis protokollieren, Fortschritt bewerten und der Entscheidung, ob die Untersuchung weiterläuft oder mit Antwort, Enthaltung oder Grenzbericht endet.
In Metis Reasoning's approach, a reasoning step changes the system's knowledge state only if an independent check deems it sufficiently supported. | Image: Metis

As in AlphaGo, two neural networks suggest and evaluate moves, trained on logged prior investigations but unable to override the verification rules. Metis says the setup should produce fewer hallucinations, explanations with source citations, and knowledge that can be changed or deleted without retraining. Because reasoning breaks into small steps, the approach could also favor smaller models running on edge devices and in robots.

Companies still don't trust language models enough to deploy them

More data and compute improve language models but don't solve the technology's fundamental problems, according to Metis: the models fabricate answers, their reasoning chains can't be verified, and their knowledge is locked inside the weights. Hallucinations come from the training process itself, the paper argues, because models learn to produce plausible text rather than true text, and even the chains of thought in today's reasoning models often fail to show how an answer was actually reached.

That, the paper says, is why AI has had so little economic impact so far. When an agent acts on behalf of a company, errors are hard to trace back to their source and wrong knowledge can't be removed from the model. AI took off in software engineering because code is easy to test and roll back, but in medicine, finance, chip design, and robotics, the paper argues, AI needs to be verifiable from the ground up.

The white paper describes only a research program, with no working system, no benchmarks, and no comparisons with current reasoning models. The team acknowledges that the real world, unlike Go, provides only partial information, that evidence can be expensive to obtain, and that some questions simply have no answer. The biggest open question is how a verified knowledge ledger would take shape in messy domains beyond textbook examples, given that symbolic AI systems once failed precisely because all their knowledge had to be entered by hand.

After Silver and Rocktäschel, another Deepmind veteran strikes out on his own

Graepel earned his PhD in machine learning in Berlin in 2001, according to his website. At Microsoft Research he helped build TrueSkill, the matchmaking system behind Xbox Live. He then moved to Deepmind, where he worked on AlphaGo, AlphaZero, and MuZero. After a stint at Altos Labs he most recently served on Google Deepmind's post-AGI team, which he left over the summer. He also holds the machine learning chair at University College London. According to Bloomberg, Graepel is raising a low tens-of-millions round for Metis, with a follow-on of several hundred million dollars at a higher valuation already in the works.

He's the latest architect of Deepmind's best-known breakthroughs to build something outside Google. Former colleague David Silver founded Ineffable Intelligence and closed the largest seed round of any European startup. Tim Rocktäschel co-founded Recursive, now valued at $4.65 billion. Others are going straight to competitors. According to the Financial Times, Deepmind dissolved the team behind AlphaFold, and Nobel laureate John Jumper left for Anthropic with two colleagues. CNBC traces the talent drain partly to limited internal access to Google's TPU chips and bureaucracy, while Deepmind itself is losing its independence and founder Demis Hassabis has stepped back from day-to-day operations.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder · the-decoder.com