aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Google, UCLA and CMU researchers introduce GenXR-Bench for XR coding agentsMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

The researchers built 112 tasks covering feature work, bug fixes and full app builds, with tests that simulate hands and rooms. The cited results put Claude Opus 5 in the lead at 50.9%, while no model exceeded 29.2% on SDK feature tasks. Coordinate-frame mistakes appeared in 64.4% of failed runs.

Original post · Original

@rohanpaul_ai

– https://t.co/gYptG6nGX9

Title: "GenXR-Bench: Benchmarking Coding Agents for Interactive XR Development"

ReplyRohan Paul@rohanpaul_ai
New Google + UCLA + CMU paper finds that AI coding tools often fail to build virtual and mixed reality apps because they lose track of where things are in 3D space. Claude Opus 5 led at 50.9%, and no model topped 29.2% on SDK feature tasks. Coordinate-frame mistakes appeared in 64.4% of failed runs, and startup race conditions in 44.9%. XR apps run in 3D space and react to head motion, hands, and room sensing. Normal coding benchmarks use unit tests or browser clicks, which cannot check whether a virtual button follows your palm. They built GenXR-Bench, 112 expert-written tasks covering XR feature work, bug fixes, and full app builds. Its tests simulate hands and rooms, and matched blinded XR experts using real headsets 96.5% of the time. If you use agents for XR apps, test the result with simulated hand and room input, since agent-written unit tests often miss runtime bugs.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction