Task-Level Natural Language Priors as Learning Signals for Low-Resource LLM Training
arXiv:2609.02244v2 Announce Type: replace Abstract: Large language models (LLMs) often struggle when low-resource training data are ambiguous or incomplete. Task-level natural-language priors can provide useful guidance in such settings, but existing approaches usually treat these priors as input context rather than as learning signals during training. We study how task-level natural-language priors can supply guidance missing from these data through Prior-Guided Tuning (PGT). Its implementatio…