Improving Cross-Lingual Transfer for Sequential Sentence Classification in Research Papers via Structural Similarity

2026-09-16

AI Summary

研究通过构建多语言数据集和利用生成模型的方法，解决了非英语语言科研论文序列句子分类中训练数据稀缺的问题，强调了结构相似性的重要性。

Abstract

Sequential sentence classification (SSC) is an essential task for structuring scientific publications, and extending SSC research to languages other than English can improve accessibility to scientific knowledge in multilingual digital libraries. Cross-lingual transfer is a promising approach to address the scarcity of training data in non-English languages. Prior work on other natural language processing tasks has shown the benefits of capturing linguistic similarity between source and target languages. However, SSC inherently depends on patterns at the discourse level, such as label sequences and positional regularities, which appear consistently across languages regardless of linguistic differences. To examine the factors that determine transfer success in SSC, we constructed a multilingual SSC dataset covering 13 non-English languages collected from five academic databases. Our cross-lingual transfer experiments, using both encoder-based and generative models, show that linguistic proximity has no consistent predictive power for transfer performance, whereas structural similarity in rhetorical organization shows a weak but consistent positive correlation across models. After controlling for source-language performance, the similarity of label distributions is the most consistent predictor. Building on this finding, we propose a set of three methods that explicitly leverage structural information using generative models. In the in-domain evaluation, the best combination reaches parity with the strongest encoder baselines, and in transfer to languages unseen during training, it outperforms the strongest encoder baseline.

Problem

• Cross-lingual transfer
• Sequential sentence classification
• Structural similarity
• Multilingual dataset

Innovation

• cross-lingual transfer
• structural similarity
• generative models
• sequential sentence classification