explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-28 10:56:31 +03:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1079 from yuvalpinter/patch-1

Browse Source 
extend suffixes from first-by-character-order to last
This commit is contained in:
Matthew Honnibal 2017-05-23 10:59:49 +02:00 committed by GitHub
commit b885ab405d
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
website/docs/usage/customizing-tokenizer.jade
View File

@ -113,7 +113,7 @@ p
else:
tokens.append(substring)
substring = ''
tokens.extend(suffixes)
tokens.extend(reversed(suffixes))
return tokens
p