explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-26 01:46:28 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix unicode regex for Python 2 (see #834)

Browse Source
This commit is contained in:
ines 2017-02-16 23:49:54 +01:00
parent 44de3c7642
commit aa92d4e9b5
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/vocab.pyx
View File

@ -472,7 +472,7 @@ cdef class Vocab:
cdef int32_t vec_len = -1
cdef double norm = 0.0
whitespace_pattern = re.compile(r'\s')
whitespace_pattern = re.compile(r'\s', re.UNICODE)
for line_num, line in enumerate(file_):
pieces = line.split()