Home ›
Entities
› academia
› When Do You Need Billions of Words of Pretraining Data?
When Do You Need Billions of Words of Pretraining Data?
Research article (Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021) · cited 83× · AI/ML
Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.
APA4ort.xyz Knowledge Graph. (2026). When Do You Need Billions of Words of Pretraining Data?. Retrieved May 24, 2026, from https://4ort.xyz/entity/when-do-you-need-billions-of-words-of-pretraining-data
MLA“When Do You Need Billions of Words of Pretraining Data?.” 4ort.xyz Knowledge Graph, 4ort.xyz, 24 May. 2026, https://4ort.xyz/entity/when-do-you-need-billions-of-words-of-pretraining-data.
BibTeX@misc{4ortxyz_when-do-you-need-billions-of-words-of-pretraining-data_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{When Do You Need Billions of Words of Pretraining Data?}}, year = {2026}, url = {https://4ort.xyz/entity/when-do-you-need-billions-of-words-of-pretraining-data}, note = {Accessed: 2026-05-24}}
LLM promptAccording to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): When Do You Need Billions of Words of Pretraining Data? — https://4ort.xyz/entity/when-do-you-need-billions-of-words-of-pretraining-data (retrieved 2026-05-24)