Evaluation Awareness Beyond English: Do LLMs Act Differently When Tested in Indic Languages?
arXiv:2610.22333v1 Announce Type: new Abstract: Large language models (LLMs) can often tell when they are being tested. This ability, known as evaluation awareness, can lead models to act more cautiously during safety evaluations than in real use. Existing work has studied evaluation awareness almost entirely in English, although models serve users in many languages. Indic languages are spoken by over a billion people, yet evaluation awareness remains almost entirely unstudied in them. We test…