explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-07-23 14:39:52 +03:00
Code Issues Packages Projects Releases Wiki Activity

fix: match hyphenated words to lemmas in index_table (e.g. "co-authored" -> "co-author") (#13816)

Browse Source
This commit is contained in:
d0ngw 2025-05-27 07:20:26 +08:00 committed by GitHub
parent b205ff65e6
commit 46613e27cf
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
spacy/pipeline/lemmatizer.py
View File

@ -218,6 +218,9 @@ class Lemmatizer(Pipe):
if not form:
pass
elif form in index or not form.isalpha():
if form in index:
forms.insert(0, form)
else:
forms.append(form)
else:
oov_forms.append(form)