explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-25 17:36:30 +03:00
Code Issues Packages Projects Releases Wiki Activity

Try fixing unicode inconsistencies on Python 2

Browse Source
This commit is contained in:
Ines Montani 2019-03-09 02:37:50 +01:00
parent d957d7a697
commit ae09b6a6cf
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/lang/fr/tokenizer_exceptions.py
View File

@ -423,5 +423,5 @@ _regular_exp.append(URL_PATTERN)
TOKENIZER_EXCEPTIONS = _exc
TOKEN_MATCH = re.compile(
"|".join("(?:{})".format(m) for m in _regular_exp), re.IGNORECASE
"|".join("(?:{})".format(m) for m in _regular_exp), re.IGNORECASE, re.UNICODE
).match