mirror of
https://github.com/explosion/spaCy.git
synced 2025-02-22 14:30:32 +03:00
The `nlp` container should be unnecessary here. If so, we can test the tokenizer class just a little more directly. |
||
---|---|---|
.. | ||
__init__.py | ||
sun.txt | ||
test_customized_tokenizer.py | ||
test_exceptions.py | ||
test_tokenizer.py | ||
test_urls.py | ||
test_whitespace.py |