Model overview
XLM-RoBERTa model pre-trained on 2.5TB of filtered CommonCrawl data containing 100 languages. It was introduced in the paper Unsupervised Cross-lingual Representation Learning at Scale by Conneau et al. and first released in this repository. Disclaimer: The team releasing XLM-RoBERTa did not write a model card for this model so this model card has been written by the Hugging Face team. XLM-RoBERTa is a multilingual version of RoBERTa. It is pre-trained on 2.5TB of filtered CommonCrawl data containing 100 languages.
The summary below is compiled from sources by an AI model, not our own testing. Verify selection decisions against original sources and your workload.
Key features
- Pre-trained on 2.5TB of filtered CommonCrawl data spanning 100 languages
- Multilingual extension of RoBERTa architecture, designed for cross-lingual transfer
- Released under the MIT license, enabling broad academic and commercial use
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
What languages does XLM-RoBERTa-large support?
It was pre-trained on data containing 100 languages, though the specific language list is not provided in the given资料.
Is XLM-RoBERTa-large suitable for zero-shot cross-lingual tasks?
Yes, it was introduced in the paper 'Unsupervised Cross-lingual Representation Learning at Scale' with a focus on unsupervised cross-lingual representation learning.
Who authored the original XLM-RoBERTa model?
The model was introduced by Conneau et al., as stated in the cited paper.
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证:mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。