spaCy/spacy/lang/lt
adrianeboyd 86c43e55fa
Improve Lithuanian tokenization (#5205)
* Improve Lithuanian tokenization

Modify Lithuanian tokenization to improve performance for
UD_Lithuanian-ALKSNIS.

* Update Lithuanian tokenizer tests
2020-03-25 11:28:12 +01:00
..
__init__.py Improve Lithuanian tokenization (#5205) 2020-03-25 11:28:12 +01:00
examples.py Lithuanian language support (#3895) 2019-07-08 10:25:22 +02:00
lex_attrs.py Lithuanian language support (#3895) 2019-07-08 10:25:22 +02:00
morph_rules.py Lithuanian language support (#3895) 2019-07-08 10:25:22 +02:00
punctuation.py Improve Lithuanian tokenization (#5205) 2020-03-25 11:28:12 +01:00
stop_words.py Lithuanian language support (#3895) 2019-07-08 10:25:22 +02:00
tag_map.py Update Lithuanian tag map 2019-09-08 20:57:58 +02:00
tokenizer_exceptions.py Improve Lithuanian tokenization (#5205) 2020-03-25 11:28:12 +01:00