Representation-Aligned Auxiliary Supervision for Language Model Adaptation
This study addresses the performance instability of language models during structured domain adaptation, which often stems from insufficient representational compatibility. To this end, we propose an auxiliary supervision mechanism for representation alignment based on environment-derived tasks, revealing that semantically equivalent yet formally distinct inputs significantly influence model processing. Specifically, our method leverages multimodal chess representations (FEN and ASCII) alongside environment dynamics tasks to construct auxiliary training signals, achieving deep compatibility with pretrained models. Experimental results demonstrate that this mechanism substantially improves optimal move prediction accuracy, enhances cross-representational transferability, and effectively elevates the quality of open-ended commentary generation. Overall, this work establishes a novel paradigm for structured domain adaptation in language models.