lexical token
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
Facts
2 properties
🏷️ Also known as
en lexical token
en token
ar توكن
fr jeton
fr jeton lexical
fr token lexical
it token lessicale
ja 字句要素
ja トークン
ja 字句
ru лексический токен
uk лексичний токен
uk токен лексичний
zh 词例
zh 词元
zh 词汇标记
zh 词素
zh-hant 符元
zh-hant 詞元
🔖 Identifiers · 2
- Google Knowledge Graph ID
- /g/12353dkw
🔗 Connections
Facet of 3
← Uses 1
Press Enter · cited answer in seconds