explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-07-11 08:42:28 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix PROB attr for OOV words

Browse Source
This commit is contained in:
Matthew Honnibal 2017-08-23 12:11:52 +02:00
parent 1c5c256e58
commit bb2541ffd3
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
spacy/lang/lex_attrs.py
View File

@ -137,6 +137,7 @@ LEX_ATTRS = {
attrs.IS_UPPER: lambda string: string.isupper(), attrs.IS_UPPER: lambda string: string.isupper(),
attrs.IS_STOP: lambda string: False, attrs.IS_STOP: lambda string: False,
attrs.IS_OOV: lambda string: True, attrs.IS_OOV: lambda string: True,
attrs.PROB: lambda string: -20.,
attrs.LIKE_EMAIL: like_email, attrs.LIKE_EMAIL: like_email,
attrs.LIKE_NUM: like_num, attrs.LIKE_NUM: like_num,
attrs.IS_PUNCT: is_punct, attrs.IS_PUNCT: is_punct,