Adriane Boyd 565e0eef73 Add tokenizer option for token match with affixes ... To fix the slow tokenizer URL (#4374) and allow `token_match` to take priority over prefixes and suffixes by default, introduce a new tokenizer option for a token match pattern that's applied after prefixes and suffixes but before infixes.		2020-05-05 10:35:33 +02:00
..
__init__.py	Improve French tokenization (#5202)	2020-03-25 11:27:42 +01:00
_tokenizer_exceptions_list.py	Tidy up and auto-format	2019-08-20 17:36:34 +02:00
examples.py	Update exemples.py (#3838)	2019-06-14 09:31:05 +02:00
lemmatizer.py	Refactor lemmatizer and data table integration (#4353)	2019-10-01 21:36:03 +02:00
lex_attrs.py	Update lex_attrs.py (#3835)	2019-06-11 10:59:16 +02:00
punctuation.py	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
stop_words.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
syntax_iterators.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
tag_map.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py	Add tokenizer option for token match with affixes	2020-05-05 10:35:33 +02:00