# Escaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism

> Research article (IEEE Access, 2021) · cited 16× · AI/ML

**Wikidata**: [openalex:W3195473712](https://www.wikidata.org/wiki/openalex:W3195473712)  
**Source**: https://4ort.xyz/entity/escaping-the-gradient-vanishing-periodic-alternatives-of-softmax-in-attention-mechanism