explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-03-03 19:08:06 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix HTML merger examples (see #2390)

Browse Source
This commit is contained in:
ines 2018-05-30 12:22:32 +02:00
parent 9732988951
commit 605c663a4c
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
website/usage/_linguistic-features/_rule-based-matching.jade
View File

@ -349,9 +349,10 @@ p
for match_id, start, end in matches:
spans.append(doc[start:end])
for span in spans:
span.merge(is_stop=True) # merge (and mark it as a stop word)
span.merge() # merge
for token in span:
token._.bad_html = True # mark token as bad HTML
doc.vocab[token.text].is_stop = True # mark lexeme as stop word
return doc
nlp = spacy.load('en_core_web_sm')