OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
arXiv:2610.22234v1 Announce Type: cross Abstract: Real desktop automation is neither purely visual nor purely programmatic. Agents must understand user-facing interfaces while efficiently manipulating files, scripts, and system state. However, native GUI/code coordination cannot be obtained by prompt-level tool composition. In our preliminary experiments, naively adding a code tool degrades a GUI agent, revealing that GUI/code routing must be internalized through training on high-quality hybrid…