Orthogonal and Parametrized Multi-Attribute Steering of LLMs
arXiv:2610.37517v2 Announce Type: replace-cross Abstract: Activation steering offers an effective and efficient way to modify an LLM's behavior at inference time. However, it remains unclear how to apply steering such that the signal is consistently strong and the steering strength has a universally interpretable meaning. We address this first by identifying the most steerable interval for each steering vector and rescaling the steering range accordingly. Building on this, we introduce a more i…