explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-12-03 08:14:20 +03:00
Code Issues Packages Projects Releases Wiki Activity
565e0eef73
spaCy/spacy/tests/tokenizer
History
Adriane Boyd 565e0eef73 Add tokenizer option for token match with affixes 
To fix the slow tokenizer URL (#4374) and allow `token_match` to take
priority over prefixes and suffixes by default, introduce a new
tokenizer option for a token match pattern that's applied after prefixes
and suffixes but before infixes.
2020-05-05 10:35:33 +02:00
..
__init__.py Revert #4334 2019-09-29 17:32:12 +02:00
sun.txt Revert #4334 2019-09-29 17:32:12 +02:00
test_exceptions.py Revert #4334 2019-09-29 17:32:12 +02:00
test_explain.py Detect more empty matches in tokenizer.explain() (#4675) 2019-11-20 16:31:29 +01:00
test_naughty_strings.py Revert #4334 2019-09-29 17:32:12 +02:00
test_tokenizer.py Revert #4334 2019-09-29 17:32:12 +02:00
test_urls.py Add tokenizer option for token match with affixes 2020-05-05 10:35:33 +02:00
test_whitespace.py Revert #4334 2019-09-29 17:32:12 +02:00