# How much pretraining data do language models need to learn syntax?

> Research article (Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021) · cited 31× · AI/ML

**Wikidata**: [openalex:W3198757395](https://www.wikidata.org/wiki/openalex:W3198757395)  
**Source**: https://4ort.xyz/entity/how-much-pretraining-data-do-language-models-need-to-learn-syntax
