V-SHARE: Provable Convergence Guarantees for Advantage-based Algorithms
arXiv:2610.21448v1 Announce Type: cross Abstract: In reinforcement learning, advantage-based value-learning methods, unlike standard Q-learning, share information across actions by decomposing the action-value function into a state-dependent value component and action-specific advantages. While this mechanism has proven effective in both tabular and deep reinforcement learning, its theoretical understanding remains incomplete. We introduce V-SHARE, an advantage-based value-learning algorithm th…