Adriane Boyd 0c25725359 Update Tokenizer.explain for special cases with whitespace (#13086) ... * Update Tokenizer.explain for special cases with whitespace Update `Tokenizer.explain` to skip special case matches if the exact text has not been matched due to intervening whitespace. Enable fuzzy `Tokenizer.explain` tests with additional whitespace normalization. * Add unit test for special cases with whitespace, xfail fuzzy tests again		2023-11-06 17:29:59 +01:00
..
__init__.py
sun.txt
test_exceptions.py
test_explain.py	Update Tokenizer.explain for special cases with whitespace (#13086)	2023-11-06 17:29:59 +01:00
test_naughty_strings.py
test_tokenizer.py
test_urls.py
test_whitespace.py