Fix flags

This commit is contained in:
Ines Montani 2019-03-09 02:46:04 +01:00
parent ae09b6a6cf
commit b9c71fc0f0

View File

@ -423,5 +423,5 @@ _regular_exp.append(URL_PATTERN)
TOKENIZER_EXCEPTIONS = _exc
TOKEN_MATCH = re.compile(
"|".join("(?:{})".format(m) for m in _regular_exp), re.IGNORECASE, re.UNICODE
"|".join("(?:{})".format(m) for m in _regular_exp), re.IGNORECASE | re.UNICODE
).match