# Multi-word units (and tokenization more generally): a multi-dimensional and largely information-theoretic approach

> Research article (Lexis, 2022) · cited 19× · AI/ML

**Wikidata**: [openalex:W4220816965](https://www.wikidata.org/wiki/openalex:W4220816965)  
**Source**: https://4ort.xyz/entity/multi-word-units-and-tokenization-more-generally-a-multi-dimensional-and-largely-information-theoretic-approach
