explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-10-31 16:07:41 +03:00
Code Issues Packages Projects Releases Wiki Activity

Update lexeme ranks for loaded vectors (#8640)

Browse Source 
Update the ranks for any lexemes that have been added to the vocab
before the vectors are added to the model.
This commit is contained in:
Adriane Boyd 2021-07-19 10:25:54 +02:00 committed by GitHub
parent e532c69475
commit 0e4b96c97e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/training/initialize.py
View File

@ -156,6 +156,8 @@ def load_vectors_into_model(
logger.warning(Warnings.W112.format(name=name)) logger.warning(Warnings.W112.format(name=name))
nlp.vocab.vectors = vectors_nlp.vocab.vectors nlp.vocab.vectors = vectors_nlp.vocab.vectors
for lex in nlp.vocab:
lex.rank = nlp.vocab.vectors.key2row.get(lex.orth, OOV_RANK)
if add_strings: if add_strings:
# I guess we should add the strings from the vectors_nlp model? # I guess we should add the strings from the vectors_nlp model?
# E.g. if someone does a similarity query, they might expect the strings. # E.g. if someone does a similarity query, they might expect the strings.