跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分56
AI 导读

Perceptron 发布 Perceptron Egocentric 1.0,通过自助 API 提供第一人称视频标注,细粒度子任务质量对齐 Astra,成本约为其八分之一,并支持 SOTA 的 2D 和 3D 手部追踪,为每只手的每个动作和机器人夹爪给出独立时间线。

正文

So much brilliant work is happening on robot training.

A lot of the cost in robot learning sits in labeling video, step by step and hand by hand. If that cost can be reduced by about 8x at nearly the same quality, much more of the footage teams already have can be used.

And now we also have proof that specialized model harnesses are closing in on general frontier models for narrow video tasks, at a fraction of the cost.

Upload a first-person video of someone doing chores, and we have an API returns each step with timestamps, what each hand is doing.

Perceptron AI's research shows, For labeling robot training video, paying 8x more for the biggest AI model buys you almost no extra accuracy.
A smaller system built only for this job gets the same result for the price of a sandwich per hour of video.

https://x.com/perceptroninc/status/2118018939708182843/video/1

引用Perceptron AI@perceptroninc
Today we’re releasing Perceptron Egocentric 1.0: The frontier for egocentric annotations, now through a self-service API. • Fine-grained subtasks matching Astra quality at ~1/8 the cost • State-of-the-Art 2D and 3D hand tracking • Individual timelines for every action on each hand and robot gripper
在 X 查看被引用的帖子

来源:Rohan Paul · x.com