# Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little

> Research article (Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021) · cited 179× · AI/ML

**Wikidata**: [openalex:W3152698349](https://www.wikidata.org/wiki/openalex:W3152698349)  
**Source**: https://4ort.xyz/entity/masked-language-modeling-and-the-distributional-hypothesis-order-word-matters-pre-training-for-little