mirror of
https://github.com/explosion/spaCy.git
synced 2025-01-12 02:06:31 +03:00
29a9e636eb
Before this patch, half-width spaces between words were simply lost in Japanese text. This wasn't immediately noticeable because much Japanese text never uses spaces at all. |
||
---|---|---|
.. | ||
__init__.py | ||
test_lemmatization.py | ||
test_tokenizer.py |