微软页面确认 OpenAI 在 GPT-6 系列中使用 Looped Transformer
Microsoft confirms OpenAI has been using Looped Transformers in the GPT-6 series
Reddit 用户称微软在公开网页上确认 OpenAI 在 GPT-6 系列中使用了 Looped Transformer,并提到 GPT-6.1 Sol 使用 2 次推理传递,页面还顺带提及“而非三次”。
| Microsoft confirms on publicly accessible web page that OpenAI has been using Looped Transformers in the GPT-6 series, proving The Information's reporting was correct all along. GPT-6.1 Sol uses 2 inference passes, with a passing mention of "instead of three". For those confused by "same base model weights as GPT-6 Sol", I think Microsoft meant 6 & 6.1 are both post-trained models on top of the same pre-trained "base model", not that the final weights are identical So different post-training (+ one less loop). Update: Microsoft updated the web page to remove it submitted by /u/ResearchCrafty1804[link] [留言] |
来源:r/LocalLLaMA · reddit.com