Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
arXiv:2610.04432v3 Announce Type: replace-cross Abstract: Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on manual environment construction and calibration. We study whether frontier foundation models and coding agents can automate this process end to end. We formulate \emph{autonomous video-to-simulation} as a software engineering task in which an agent observes an embodied video, constructs the c…