# Pre-Training Transformers as Energy-Based Cloze Models

> Research article (Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020) · cited 64× · AI/ML

**Wikidata**: [openalex:W3106061119](https://www.wikidata.org/wiki/openalex:W3106061119)  
**Source**: https://4ort.xyz/entity/pre-training-transformers-as-energy-based-cloze-models