spaCy/spacy
Adriane Boyd ad15499b3b
Fix get_loss for values outside of labels in senter (#5730)
* Fix get_loss for None alignments in senter

When converting the `sent_start` values back to `SentenceRecognizer`
labels, handle `None` alignments.

* Handle SENT_START as -1

Handle SENT_START as -1 (or -1 converted to uint64) by treating any
values other than 1 the same as 0 in `SentenceRecognizer.get_loss`.
2020-07-09 01:41:58 +02:00
..
cli batch_by_words by default 2020-07-08 21:37:06 +02:00
displacy unicode -> str consistency [ci skip] 2020-05-24 18:51:10 +02:00
gold Few more Example unit tests (#5720) 2020-07-07 18:46:00 +02:00
lang Tidy up and auto-format 2020-06-21 22:38:04 +02:00
matcher Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
ml Simplify PrecomputableAffine slightly 2020-07-07 17:22:47 +02:00
pipeline Fix get_loss for values outside of labels in senter (#5730) 2020-07-09 01:41:58 +02:00
syntax Improve cutting logic in parser 2020-07-08 11:27:54 +02:00
tests Fix get_loss for values outside of labels in senter (#5730) 2020-07-09 01:41:58 +02:00
tokens Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
__init__.pxd * Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags. 2014-10-24 02:23:42 +11:00
__init__.py Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
__main__.py Tidy up 2020-06-22 00:45:40 +02:00
about.py Deprecat model shortcuts and simplify download (#5722) 2020-07-08 14:00:07 +02:00
attrs.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
attrs.pyx Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
compat.py Merge branch 'develop' into refactor/remove-symlinks 2020-02-18 17:22:20 +01:00
errors.py Few more Example unit tests (#5720) 2020-07-07 18:46:00 +02:00
glossary.py unicode -> str consistency 2020-05-24 17:20:58 +02:00
gold.pyx Improve spacy.gold (no GoldParse, no json format!) (#5555) 2020-06-26 19:34:12 +02:00
kb.pxd Tidy up compiler flags and imports (#5071) 2020-03-02 11:48:10 +01:00
kb.pyx Merge branch 'develop' into master-tmp 2020-06-20 15:52:00 +02:00
language.py Remove auto 'set_annotation' in training to address GPU memory 2020-07-08 21:36:51 +02:00
lemmatizer.py Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
lexeme.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
lexeme.pyx Merge branch 'develop' into master-tmp 2020-06-20 15:52:00 +02:00
lookups.py Merge branch 'develop' into master-tmp 2020-06-03 14:36:59 +02:00
morphology.pxd Tidy up compiler flags and imports (#5071) 2020-03-02 11:48:10 +01:00
morphology.pyx Update get_loss for senter and morphologizer (#5724) 2020-07-08 13:59:28 +02:00
parts_of_speech.pxd Add support for Universal Dependencies v2.0 2017-03-03 13:17:34 +01:00
parts_of_speech.pyx Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00
pipe_analysis.py unicode -> str consistency 2020-05-24 17:20:58 +02:00
schemas.py Improve assets and DVC handling (#5719) 2020-07-07 20:51:50 +02:00
scorer.py Improve gold-standard alignment (#5711) 2020-07-06 17:39:31 +02:00
strings.pxd Tidy up compiler flags and imports (#5071) 2020-03-02 11:48:10 +01:00
strings.pyx unicode -> str consistency [ci skip] 2020-05-24 18:51:10 +02:00
structs.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
symbols.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
symbols.pyx Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
tokenizer.pxd Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
tokenizer.pyx Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
typedefs.pxd Update spaCy for thinc 8.0.0 (#4920) 2020-01-29 17:06:46 +01:00
typedefs.pyx Tidy up rest 2017-10-27 21:07:59 +02:00
util.py Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
vectors.pyx Merge branch 'develop' into master-tmp 2020-06-20 15:52:00 +02:00
vocab.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
vocab.pyx Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00