# Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers

> Research article (Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020) · cited 31× · AI/ML

**Wikidata**: [openalex:W3092173171](https://www.wikidata.org/wiki/openalex:W3092173171)  
**Source**: https://4ort.xyz/entity/why-skip-if-you-can-combine-a-simple-knowledge-distillation-technique-for-intermediate-layers