aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Perceptron AI introduces EgoHome benchmark for understanding hand actions in chore videosMachine translation

AI introduction

EgoHome uses human-annotated household-chore videos, recording hand positions, subtasks and actions for each clip. It includes over 750 segments shorter than 500 milliseconds, and its data, metrics and judge prompts are open. A related post says GPT-6 Astra ranked first on the benchmark, but the material gives no scores or margin over other models.

Original post · AI translation

@rohanpaul_ai
Translation · refer to the original

https://t.co/IDzWJcTwbj https://t.co/k7U2E8qcHI

ReplyRohan Paul@rohanpaul_ai
Translation
GPT-6 Astra 在 Perceptron AI 推出的新基准测试 EgoHome 中排名第一。该基准测试检验 AI 能否追踪人类双手在家务视频中的动作,而机器人要向人类学习,就需要具备这种能力。 AI 能告诉你有人正在洗碗,却说不清他们的手在做什么;而机器人需要知道后者。 这类基准测试非常重要,因为如今机器人训练使用大量人类视频,而 AI 被用来自动为这些视频添加标签(“左手拿起海绵,右手打开水龙头”)。如果这些标签有误,机器人学到的也会是错误的。 https://t.co/t5gL9ZYYmU
Original

GPT-6 Astra came out on top in EgoHome, a new benchmark from Perceptron AI, that tests whether AI can follow what human hands do in chore videos, the skill robots need to learn from people. AI can tell you someone is washing dishes, but not what their hands are doing, and robots need the second part. This kind of benchmarks are so important because Robotics training now happen on large amounts of human video, and AI is used to label those videos automatically (“left hand picks up sponge, right hand turns tap”). If those labels are wrong, the robots learn wrong. https://t.co/t5gL9ZYYmU

View this post on X ↗
Related contextPerceptron AI@perceptroninc
Translation
推出 EgoHome:一项用于密集、亚秒级第一人称视角理解的新开放基准测试。 由人工标注的家务视频,每个片段都有 4 种标注:手部边界框、子任务、手部动作和手部描述。 它包含超过 750 个时长不足 500 毫秒的片段。 数据、评测指标和评判提示词全部开放。🧵
Original

Introducing EgoHome: a new open benchmark for dense, sub-second egocentric understanding. Human-annotated household-chore video with 4 annotation types on every clip: hand boxes, subtasks, hand actions, hand captions. It features over 750 segments under 500ms. Data, metrics, and judge prompts are all open. 🧵

View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction