mirror of
https://github.com/explosion/spaCy.git
synced 2024-12-25 01:16:28 +03:00
1914c488d3
* Exceptions for single letter words ending sentence Sentences ending in "i." (as in "... peka i."), "m." (as in "...än 2000 m."), should be tokenized as two separate tokens. * Add test |
||
---|---|---|
.. | ||
lemmatizer | ||
__init__.py | ||
examples.py | ||
morph_rules.py | ||
stop_words.py | ||
tokenizer_exceptions.py |