DAIR.AI 的 Elvis Saravia 表示,用 GPT 或 Claude 做自动研究循环已无法可靠开展前沿 AI 研究,频繁遭遇不准确的拒绝,并建议至少修复分类器。他主张不要锁定任何单一厂商,小型研究实验室应自建从 harness 到训练、部署的完整智能栈,并认为开源模型才是唯一出路。
Own your intelligence stack, folks!
We've reached the point where it's simply not possible to do reliable groundbreaking AI research (using autoresearch loops) with GPT or Claude.
I constantly get hammered with inaccurate refusals.
This is sad!
They should at least spend time fixing their classifiers.
But over the last year, I've learned to build my own thing and own more of the intelligence stack.
My advice: never lock yourself into any of these vendors if you really care about your business and customers.
Imagine trying to stay at the frontier and depending on these models. You simply won't be able to. They'll refuse requests (at the model and harness layer), and that will hurt you profoundly.
If you run a small research lab, or even plan to do minimal research (we all should be trying to) in the future (with RSI pipelines) for your business, you need to get this part right.
Many companies have already realized this and have started building their own intelligence stack.
From the harness to training and serving their own models.
It's not easy, but it is the way.
It's very clear to me that open-source models are truly the only path forward.
来源:elvis · x.com