Adriane Boyd 1139247532 Revert changes to token_match priority from #4374 ... * Revert changes to priority of `token_match` so that it has priority over all other tokenizer patterns * Add lookahead and potentially slow lookbehind back to the default URL pattern * Expand character classes in URL pattern to improve matching around lookaheads and lookbehinds related to #4882 * Revert changes to Hungarian tokenizer * Revert (xfail) several URL tests to their status before #4374 * Update `tokenizer.explain()` and docs accordingly		2020-03-09 12:09:41 +01:00
..
__init__.py	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
examples.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
punctuation.py	Revert changes to token_match priority from #4374	2020-03-09 12:09:41 +01:00
stop_words.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py	Fix regex deprecation warnings	2019-02-21 11:56:47 +01:00