CRAFT: Forgetting-Aware Intervention-Based Adaptation for Continual Learning
arXiv:2605.05732v3 Announce Type: replace-cross Abstract: Large language models (LLMs) can learn new tasks through fine-tuning, but learning tasks sequentially often leads to catastrophic forgetting of earlier ones. This paper proposes CRAFT, a continual learning framework that keeps model weights frozen and instead learns low-rank interventions on hidden representations. Similar tasks share an intervention to help knowledge transfer, with similarity judged by how each task alters the model's o…