byte-pair encoding
algorithm for data compression and tokenization that iteratively replaces the most frequent pairs of consecutive bytes or symbols with a new representation
Facts
2 properties- Instance of
- algorithm
- Has use
- data compression, tokenization[2][3]
🏷️ Also known as
en BPE
en byte-pair encoding
ar ترميز زوج من البايتات
de Byte Pair Encoding
es Codificación de pares de bytes
fa کدگذاری جفت بایت
ja バイト対符号化
ko 바이트 페어 인코딩
uk Діграмне кодування
zh 字节对编码
zh-hant 字節對編碼
🔖 Identifiers · 2
- Freebase ID
- /m/0f7j32
- Microsoft Academic ID (discontinued)
- 2780233057
🔗 Connections
Subclass of 1
Press Enter · cited answer in seconds
0 sources
Summary
byte-pair encoding is an algorithm[1].