跳到正文
r/MachineLearning· /u/jnbrymn·· 9 小时前AI 评分46

AI 能直接读懂神经网络权重:模型仅凭 tokenized 文本识别出网络在玩 Pac-Man

AI can read neural network weights. I wasn't ready for that. [D]

AI 导读

把 17,253 参数的神经网络以 tokenized 文本形式输入,模型能推断出该网络在玩 Pac-Man,Astra、Opus 5.5 和 Muse Spark 1.3 均通过,其中 Astra 仅用极少推理。由于几乎没有关于具体权重作用的文本训练数据,这一能力可能来自实验室专门训练,也可能说明模型泛化程度远超预期。

正文

Give a model a 17,253-parameter net as plain tokenized text and it works out the net plays Pac-Man. Astra, Opus 5.5 and Muse Spark 1.3 all got it, and Astra did it with minimal reasoning.

Nobody writes essays about what specific weights do, so where does this skill come from? Either labs trained it in, or models generalize much further than I expected. I'm leaning toward the second and it's freaking me out a little.

https://arcturus-labs.com/blog/2026/11/03/ai-can-read-neural-network-weights-i-wasnt-ready-for-that/

submitted by /u/jnbrymn
[link] [留言]

来源:r/MachineLearning · reddit.com