lexical token

in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence

Facts

2 properties
🏷️ Also known as
en lexical token en token ar توكن fr jeton fr jeton lexical fr token lexical it token lessicale ja 字句要素 ja トークン ja 字句 ru лексический токен uk лексичний токен uk токен лексичний zh 词例 zh 词元 zh 词汇标记 zh 词素 zh-hant 符元 zh-hant 詞元
🔖 Identifiers · 2
Google Knowledge Graph ID
/g/12353dkw
ISOCAT ID
1403, 4971

Report an error or request removal Lineage (PROV-JSON)

🔗 Connections
Facet of 3
Subclass of 2
← Uses 1
Press Enter · cited answer in seconds

📑 Cite this page

Use these citations when quoting this entity in research, articles, AI prompts, or wherever provenance matters. We aggregate Wikidata + Wikipedia + authoritative open-data sources; the stitched, scored, cross-referenced view is what 4ort.xyz contributes.

APA 4ort.xyz Knowledge Graph. (2026). lexical token. Retrieved November 15, 2026, from https://4ort.xyz/entity/lexical-token
MLA “lexical token.” 4ort.xyz Knowledge Graph, 4ort.xyz, 15 Nov. 2026, https://4ort.xyz/entity/lexical-token.
BibTeX @misc{4ortxyz_lexical-token_2026, author = {{4ort.xyz Knowledge Graph}}, title = {{lexical token}}, year = {2026}, url = {https://4ort.xyz/entity/lexical-token}, note = {Accessed: 2026-11-15}}
LLM prompt According to 4ort.xyz Knowledge Graph (aggregator of Wikidata, Wikipedia, and authoritative open-data sources): lexical token — https://4ort.xyz/entity/lexical-token (retrieved 2026-11-15)

Canonical URL: https://4ort.xyz/entity/lexical-token · Last refreshed:

Edit History

Rolling log of changes to this entity's Wikidata record. Values shown reflect the current state of each edited property — follow the history link to see the precise diff for any edit.

  1. 5w ago · عُثمان · 2026-10-13 view diff on Wikidata ↗
    ISOCAT ID → 1403, 4971
    "Created claim: ISOCAT ID: 4971, Matched to token (#7330005) in ISOCAT #mix'n'match"
  2. 5w ago · عُثمان · 2026-10-13 view diff on Wikidata ↗
    ISOCAT ID → 1403, 4971
    "Created claim: ISOCAT ID: 1403, Matched to token (#7327076) in ISOCAT #mix'n'match"
  3. 24w ago · Ericliu1912 · 2026-06-01 view diff on Wikidata ↗
    Subclass of → string, symbol, computer science term
    Facet of → compiler, lexical analysis, natural language processing +1
    "Merged from another item"
Live feed via Wikidata EventStreams. New edits appear within minutes of being made on Wikidata.