explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-25 01:16:28 +03:00
Code Issues Packages Projects Releases Wiki Activity

* Load tag for specials.json token

Browse Source
This commit is contained in:
Matthew Honnibal 2015-03-15 19:24:47 -04:00
parent 13520e6cf0
commit 7237c805c7
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/tokenizer.pyx
View File

@ -249,7 +249,7 @@ cdef class Tokenizer:
tokens[i].lemma = 0
if 'pos' in props:
# TODO: Clean up this mess...
tokens[i].tag = tag_names.index(props['pos'])
tokens[i].tag = self.vocab.strings[props['pos']]
tokens[i].pos = tag_map[props['pos']][0]
# These are defaults, which can be over-ridden by the
# token-specific props.