# Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

> Research article (Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019) · cited 1,055× · AI/ML

**Wikidata**: [openalex:W2946794439](https://www.wikidata.org/wiki/openalex:W2946794439)  
**Source**: https://4ort.xyz/entity/analyzing-multi-head-self-attention-specialized-heads-do-the-heavy-lifting-the-rest-can-be-pruned