跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分50
AI 导读

智能体集群把大部分新增 token 消耗导向更便宜的模型,agent token 量将超过前沿模型的收入。集群中父智能体负责规划,子智能体处理搜索文件、运行测试等易验证的窄任务,开发者可将其路由到通过验证的最便宜模型。这种 token 爆炸也使固定费率和按席位定价让位于按量计费,因为后者依赖人类提示速度限制用量,而智能体集群可 7×24 小时运行。

正文

Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.

In a swarm, a parent agent plans while child agents handle narrow jobs like searching files or running tests. Narrow jobs are usually easy to check, so developers can route them to the cheapest model that passes.

And this massive token-explosion is also the major reason, flat-rate and per-seat pricing for AI software will give way to metering, because it relied on human prompting speed to cap usage.
A person sends only so many prompts a day, so vendors could charge per user and still predict inference bills.
But that equation will not hold with agent swarms working 24x7.

引用a16z@a16z
Your next users are machines Agents burn nearly 5x the tokens people do, up 14x in six months
在 X 查看被引用的帖子

来源:Rohan Paul · x.com