mirror of
https://github.com/explosion/spaCy.git
synced 2025-11-13 14:25:52 +03:00
* Exceptions for single letter words ending sentence Sentences ending in "i." (as in "... peka i."), "m." (as in "...än 2000 m."), should be tokenized as two separate tokens. * Add test |
||
|---|---|---|
| .. | ||
| lemmatizer | ||
| __init__.py | ||
| examples.py | ||
| morph_rules.py | ||
| stop_words.py | ||
| tokenizer_exceptions.py | ||