spaCy/spacy/training
Adriane Boyd 8b650f3a78 Modify setting missing and blocked entity tokens
In order to make it easier to construct `Doc` objects as training data,
modify how missing and blocked entity tokens are set to prioritize
setting `O` and missing entity tokens for training purposes over setting
blocked entity tokens.

* `Doc.ents` setter sets tokens outside entity spans to `O` regardless
of the current state of each token

* For `Doc.ents`, setting a span with a missing label sets the `ent_iob`
to missing instead of blocked

* `Doc.block_ents(spans)` marks spans as hard `O` for use with the
`EntityRecognizer`
2020-09-17 21:27:42 +02:00
..
converters Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
__init__.pxd Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
__init__.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
align.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
augment.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
batchers.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
corpus.py Update docs and consistency [ci skip] 2020-09-15 00:32:49 +02:00
example.pxd Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
example.pyx Modify setting missing and blocked entity tokens 2020-09-17 21:27:42 +02:00
gold_io.pyx Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
iob_utils.py Modify setting missing and blocked entity tokens 2020-09-17 21:27:42 +02:00
loggers.py fix wandb logger when calling multiple times from same script 2020-09-15 12:56:33 +02:00