explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-01-12 10:16:27 +03:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #447 from stared/patch-1

Browse Source 
fixed sense2vec blog post code
This commit is contained in:
Matthew Honnibal 2016-08-10 05:17:12 +10:00 committed by GitHub
commit 8c24fd2928
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
website/blog/sense2vec-with-spacy.jade
View File

@ -37,7 +37,7 @@ p Here's how the current pre-processing function looks, at the time of writing.
# Merge them into single tokens # Merge them into single tokens
ent.merge(ent.root.tag_, ent.text, ent.label_) ent.merge(ent.root.tag_, ent.text, ent.label_)
token_strings = [] token_strings = []
for token in tokens: for token in doc:
text = token.text.replace(' ', '_') text = token.text.replace(' ', '_')
tag = token.ent_type_ or token.pos_ tag = token.ent_type_ or token.pos_
token_strings.append('%s|%s' % (text, tag)) token_strings.append('%s|%s' % (text, tag))