# Mixhead: Breaking the low-rank bottleneck in multi-head attention language models

> Research article (Knowledge-Based Systems, 2022) · cited 17× · AI/ML

**Wikidata**: [openalex:W4206297651](https://www.wikidata.org/wiki/openalex:W4206297651)  
**Source**: https://4ort.xyz/entity/mixhead-breaking-the-low-rank-bottleneck-in-multi-head-attention-language-models