spaCy/spacy/tests/doc
Adriane Boyd 8b650f3a78 Modify setting missing and blocked entity tokens
In order to make it easier to construct `Doc` objects as training data,
modify how missing and blocked entity tokens are set to prioritize
setting `O` and missing entity tokens for training purposes over setting
blocked entity tokens.

* `Doc.ents` setter sets tokens outside entity spans to `O` regardless
of the current state of each token

* For `Doc.ents`, setting a span with a missing label sets the `ent_iob`
to missing instead of blocked

* `Doc.block_ents(spans)` marks spans as hard `O` for use with the
`EntityRecognizer`
2020-09-17 21:27:42 +02:00
..
__init__.py Revert #4334 2019-09-29 17:32:12 +02:00
test_add_entities.py Tidy up and auto-format [ci skip] 2020-09-13 10:55:36 +02:00
test_array.py Improve spacy.gold (no GoldParse, no json format!) (#5555) 2020-06-26 19:34:12 +02:00
test_creation.py Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
test_doc_api.py Modify setting missing and blocked entity tokens 2020-09-17 21:27:42 +02:00
test_morphanalysis.py Modify Token.morph to enable unsetting (#6043) 2020-09-13 14:06:07 +02:00
test_pickle_doc.py Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00
test_retokenize_merge.py Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
test_retokenize_split.py Add MORPH attr, add support in retokenizer (#4947) 2020-01-29 17:45:46 +01:00
test_span.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
test_to_json.py Add better schemas and validation using Pydantic (#4831) 2019-12-25 12:39:49 +01:00
test_token_api.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
test_underscore.py Merge branch 'master' into tmp/sync 2020-03-26 13:38:14 +01:00