# When Do You Need Billions of Words of Pretraining Data?

> Research article (Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021) · cited 83× · AI/ML

**Wikidata**: [openalex:W3176198948](https://www.wikidata.org/wiki/openalex:W3176198948)  
**Source**: https://4ort.xyz/entity/when-do-you-need-billions-of-words-of-pretraining-data