# Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

> Research article (Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022) · cited 14× · AI/ML

**Wikidata**: [openalex:W3205816523](https://www.wikidata.org/wiki/openalex:W3205816523)  
**Source**: https://4ort.xyz/entity/sparse-progressive-distillation-resolving-overfitting-under-pretrain-and-finetune-paradigm