哪种 AI 最适合通过屏幕视频操作一个系统？

What ai is best to operate a system from screen video [p]

AI 导读

一位开发者已实现系统的程序化控制，可稳定发送输入并截屏作为视觉反馈，控制与反馈闭环已完成，现寻找能从视觉信息中学习、记住所见与所学并随时间提升操作能力的 AI。他尝试过的 AI 记忆能力不足，且常在决策前不参考视觉信息。

正文

I have working programmatic control over a system, I can send inputs reliably and capture the screen as visual feedback. The control/feedback loop is already done.

I need something that can learn from visual information, remember what it has seen and been taught, and get better at operating the system over time.

recommendations? the AI I have tried so far it's memory is not good enough and it often doesn't consult the visual information before making decisions which is very frustrating.

submitted by /u/angrykirby
[link] [留言]