跳到正文
AI NEWS JOURNAL
arXiv cs.CLAI NEWS / JOURNAL

衡量低资源语言的研究进展与语言包容性

arXiv:2610.30296v1 发布类型:新 摘要:大型语言模型(LLMs)推动了低资源与多语言自然语言处理领域的研究进展,但其在构建公平研究生态方面的有效性仍有待探索。我们分析了2020年至2025年间发表的1,158篇同行评议的开放获取论文,考察了研究界对低资源语言(LRLs)的关注度以及在不同语言和语种群体中的代表性。为评估超越论文数量的语种包容性,我们提出了语言包容性框架(LIF),这是一个多维度的评价体系,从四个维度衡量语言包容性:研究增长、代表性扩展、代表性延续以及分布公平性。尽管年度论文发表量从52篇增至415篇,增幅达5.4倍,但在ACL文集中……

对应语言译文排队中,完成后自动更新。

arXiv:2610.30296v1 Announce Type: new

Abstract: Large Language Models (LLMs) have accelerated research on low-resource and multilingual NLP, but their effectiveness in creating an equitable landscape remains unmapped. We analyze 1,158 peer-reviewed open-access papers published between 2020 and 2025, examining research attention to low-resource languages (LRLs) and representation across language and speaker populations. To assess linguistic inclusion beyond publication counts, we introduce the Linguistic Inclusion Framework (LIF), a multidimensional framework that measures linguistic inclusion in four dimensions: research growth, representation expansion, representation continuity, and distributional equity. While annual publications grew from 52 to 415, a 5.4X increase in their ACL Anthology publication share, this growth largely concentrated on represented languages rather than expanding coverage of underrepresented languages. Further analysis shows that languages spoken in Asia account for 64.1% of speakers across LRLs we analyze but receive only 46.7% of the language representation share (0.7X their proportional share), while European languages receive 5.3X their proportional share. At the country level, linguistically diverse regions such as sub-Saharan Africa and Southeast Asia show the lowest language coverage ratios. Applying the framework at the continental level, we find that no region scores well on all four dimensions, showing that research growth alone is not a reliable metric of progress toward equitable and inclusive language technology\footnote{We will release all collected and annotated data for research purposes}.

资料来源

arXiv cs.CL
← 继续阅读全部动态