spaCy/spacy/tokens
Adriane Boyd 8b650f3a78 Modify setting missing and blocked entity tokens
In order to make it easier to construct `Doc` objects as training data,
modify how missing and blocked entity tokens are set to prioritize
setting `O` and missing entity tokens for training purposes over setting
blocked entity tokens.

* `Doc.ents` setter sets tokens outside entity spans to `O` regardless
of the current state of each token

* For `Doc.ents`, setting a span with a missing label sets the `ent_iob`
to missing instead of blocked

* `Doc.block_ents(spans)` marks spans as hard `O` for use with the
`EntityRecognizer`
2020-09-17 21:27:42 +02:00
..
__init__.pxd * Break up tokens.pyx into tokens/doc.pyx, tokens/token.pyx, tokens/spans.pyx 2015-07-13 20:20:58 +02:00
__init__.py Modify morphology to support arbitrary features (#4932) 2020-01-23 22:01:54 +01:00
_retokenize.pyx Clean up spacy.tokens (#6046) 2020-09-16 20:32:38 +02:00
_serialize.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
doc.pxd Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
doc.pyx Modify setting missing and blocked entity tokens 2020-09-17 21:27:42 +02:00
morphanalysis.pxd Modify morphology to support arbitrary features (#4932) 2020-01-23 22:01:54 +01:00
morphanalysis.pyx Minor refactor for Morphology and MorphAnalysis (#5804) 2020-07-24 09:28:06 +02:00
span.pxd annotate kb_id through ents in doc 2019-03-22 11:36:44 +01:00
span.pyx Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
token.pxd Tidy up compiler flags and imports (#5071) 2020-03-02 11:48:10 +01:00
token.pyx Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
underscore.py Remove object subclassing 2020-07-12 14:03:23 +02:00