mirror of
https://github.com/explosion/spaCy.git
synced 2025-11-25 04:16:11 +03:00
- added some tests for tokenization issues - fixed some issues with tokenization of words with hyphen infix - rewrote the "tokenizer_exceptions.py" file (stemming from the German version) |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_exceptions.py | ||
| test_prefix_suffix_infix.py | ||
| test_text.py | ||