mirror of
https://github.com/explosion/spaCy.git
synced 2024-11-14 05:37:03 +03:00
23 lines
559 B
Plaintext
23 lines
559 B
Plaintext
# TOKEN misc
|
|
|
|
TODO: html entities
|
|
IN : Molière-rol van.
|
|
OUT: <s><w>Molière-rol</w><ws> </ws><w>van</w><c>.</c></s>
|
|
|
|
|
|
&-t tartalmazo nagybatus szavak
|
|
IN : AT&T van.
|
|
OUT: <s><w>AT&T</w><ws> </ws><w>van</w><c>.</c></s>
|
|
|
|
|
|
zarojeles mondatkozi valtozatok
|
|
IN : (La)kik-e van?
|
|
OUT: <s><w>(La)kik</w><w>-e</w><ws> </ws><w>van</w><c>?</c></s>
|
|
IN : L(a)kik-e van?
|
|
OUT: <s><w>L(a)kik</w><w>-e</w><ws> </ws><w>van</w><c>?</c></s>
|
|
IN : Lak(ik)-e van?
|
|
OUT: <s><w>Lak(ik)</w><w>-e</w><ws> </ws><w>van</w><c>?</c></s>
|
|
|
|
|
|
|