SHMARQL

lexical token

<http://www.wikidata.org/entity/Q2143407>

in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
rdfs:label
"lexical token"@en
skos:altLabel
"token"@en
schema:description
"in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence"@en
schema:dateModified "2026-10-20T22:57:35+00:00"^^xsd:dateTime
schema:version 2559404339
wikibase:identifiers 4
wikibase:sitelinks 7
wikibase:statements 11
p:P1269 wd:statement/Q2143407-0EB4D5AC-8BEF-4042-8EB4-76BF13467DE0
wd:statement/Q2143407-8302D911-8FA8-41D1-A66B-5C6426485AD6
wd:statement/Q2143407-8B168FA0-8B45-4913-AF5A-DEE651B54D60
wd:statement/Q2143407-a9976b10-461e-d4c3-1aa0-6aaf2d58161d
p:P2263 wd:statement/Q2143407-60F135E9-AA75-4B46-AE52-5A849E3DE0E4
wd:statement/Q2143407-84CED3A5-E2D4-4E6F-8DD2-0A29F2872A99
wd:statement/Q2143407-E6DE40F6-CCDE-45DA-BCD8-F906FDA824DF
p:P2671 wd:statement/Q2143407-113832EF-4AC8-4CA1-9515-5DA4DDB310ED
p:P279 wd:statement/Q2143407-1E51CE04-C080-4951-9732-415598FAB30C
wd:statement/Q2143407-86ECADA1-F625-4779-9D49-E029759B7E2B
wd:statement/Q2143407-fd601dde-45ed-85ad-c75d-85c52d83af9b
p:direct-normalized/P2263 <http://www.isocat.org/datcat/DC-1403>
<http://www.isocat.org/datcat/DC-4240>
<http://www.isocat.org/datcat/DC-4971>
p:direct-normalized/P2671 <http://g.co/kg/g/12353dkw>
wdt:P1269 tokenization
natural language processing
compiler
lexical analysis
wdt:P2263 "1403"
"4240"
"4971"
wdt:P2671 "/g/12353dkw"
wdt:P279 string
computer science term
symbol
Download as:
TurtleJSON-LDRDF/XML
data from SPARQL profile: Wikidata