# Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability

> Research article (2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022) · cited 40× · AI/ML

**Wikidata**: [openalex:W4313144836](https://www.wikidata.org/wiki/openalex:W4313144836)  
**Source**: https://4ort.xyz/entity/knowledge-distillation-as-efficient-pre-training-faster-convergence-higher-data-efficiency-and-better-transferability