explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-01-13 18:56:36 +03:00
Code Issues Packages Projects Releases Wiki Activity

Add = to tokenizer prefixes

Browse Source
This commit is contained in:
Ines Montani 2017-02-02 16:21:11 +01:00
parent ff04748eb6
commit 1219a5f513
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/language_data/punctuation.py
View File

@ -72,7 +72,7 @@ HYPHENS = _HYPHENS.strip().replace(' ', '|')
# Prefixes # Prefixes
TOKENIZER_PREFIXES = ( TOKENIZER_PREFIXES = (
['§', '%', r'\+'] + ['§', '%', '=', r'\+'] +
LIST_PUNCT + LIST_PUNCT +
LIST_ELLIPSES + LIST_ELLIPSES +
LIST_QUOTES + LIST_QUOTES +