Research has released the Latin-specific language model LAMB, along with two new corpora: Acervus and Corpus Trinum.
On October 26, 2026, arXiv published the paper arXiv:2610.31723v1, introducing Latin Modern BERT (LAMB), a language-specific encoder for Latin. Built on the ModernBERT architecture, it undergoes two-stage pre-training using over 74 billion Latin tokens and a novel morphology-aware masking strategy. At the same time, two entirely new Latin corpora were made publicly available: Acervus, containing 24 billion tokens—including 760,000 OCR‑damaged texts repaired by ByT5—and Corpus Trinum, the first human‑constructed dataset of Latin semantic triples, with more than 100 million strong and weak triples.
Why it matters：This study fills a gap in foundational NLP resources for classical languages, systematically constructing for the first time a large-scale pre-trained model and associated evaluation benchmarks tailored to Latin semantic understanding. Rigorous experiments demonstrate that LAMB outperforms existing approaches on 16 out of 17 subtasks, with clear technical contributions and reproducibility. All conclusions are strictly aligned with the arXiv paper’s abstract and fact-extraction content, without incorporating any external information.