跳到正文
elvis· @omarsar0 · X·· 4 小时前AI 评分40
AI 导读

与编码智能体协作的核心原则是尽量别挡路,让智能体自己发挥。建议尽可能多地跑 eval 持续测量,尤其是智能体对知识的使用;尽可能多地跑自动化,让智能体做更主动的工作,借此发现新用例。还应把智能体扩展到并行、批处理等更多任务,定期找出它们缺失的工具和知识,但不要盲目扩张,始终测量并保持怀疑。

正文

Highly recommended read if you work with coding agents.

My general rule of thumb is to get out of the agents' way as much as I can.

My top tips from the list:

- Run as many evals as you can; always be constantly measuring, especially on agents' use of knowledge.

- Run as many automations as you can and allow agents to do more proactive work; it's a good way to constantly test and push your agents further. This can even unlock new use cases along the way. I use complex automation to see what breaks, and it helps me find interesting new applications. My automations constantly evolve.

- Scale agents to do more tasks (either in parallel, batch, etc.) and regularly find out what tools/knowledge they're missing. This is how you really optimize workflows with agents and stay ahead. Yes, a few things will break, but that's for the best, as you can always improve it. The benefit is that you constantly find weak areas to improve and unlock new productivity tricks along the way. But don't blindly do it. Always measure and stay skeptical, but trust that the agent can figure out a lot with the right tools and permissions. Your job is to give it the right tools, context, and knowledge to scale. But how can you know what to give it if you don't actually try to scale anything?

Overall, just be more ambitious in every task you give your agents and get out of the way as much as you can.

引用Thorsten Ball@thorstenball
Finally summarized what I've been sending to friends in DMs https://x.com/i/article/2114385531811319808
在 X 查看被引用的帖子

来源:elvis · x.com