# Distilling Transformers into Simple Neural Networks with Unlabeled Transfer Data.

> Research article (2019) · cited 21× · AI/ML

**Wikidata**: [openalex:W2978832950](https://www.wikidata.org/wiki/openalex:W2978832950)  
**Source**: https://4ort.xyz/entity/distilling-transformers-into-simple-neural-networks-with-unlabeled-transfer-data