跳到正文
r/LocalLLaMA· /u/ResearchCrafty1804·· 3 小时前AI 评分59

微软页面确认 OpenAI 在 GPT-6 系列中使用 Looped Transformer

Microsoft confirms OpenAI has been using Looped Transformers in the GPT-6 series

AI 导读

Reddit 用户称微软在公开网页上确认 OpenAI 在 GPT-6 系列中使用了 Looped Transformer,并提到 GPT-6.1 Sol 使用 2 次推理传递,页面还顺带提及“而非三次”。

正文
Microsoft confirms OpenAI has been using Looped Transformers in the GPT-6 series

Microsoft confirms on publicly accessible web page that OpenAI has been using Looped Transformers in the GPT-6 series, proving The Information's reporting was correct all along.

GPT-6.1 Sol uses 2 inference passes, with a passing mention of "instead of three".

For those confused by "same base model weights as GPT-6 Sol", I think Microsoft meant 6 & 6.1 are both post-trained models on top of the same pre-trained "base model", not that the final weights are identical

So different post-training (+ one less loop).

Update: Microsoft updated the web page to remove it

submitted by /u/ResearchCrafty1804
[link] [留言]

来源:r/LocalLLaMA · reddit.com