# MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

> Research article (Neural Information Processing Systems, 2020) · cited 12× · AI/ML

**Wikidata**: [openalex:W3101045333](https://www.wikidata.org/wiki/openalex:W3101045333)  
**Source**: https://4ort.xyz/entity/minilm-deep-self-attention-distillation-for-task-agnostic-compression-of-pre-trained-transformers