spaCy/spacy/tests/pipeline
Adriane Boyd 7e4cd7575c
Refactor Docs.is_ flags (#6044)
* Refactor Docs.is_ flags

* Add derived `Doc.has_annotation` method

  * `Doc.has_annotation(attr)` returns `True` for partial annotation

  * `Doc.has_annotation(attr, require_complete=True)` returns `True` for
    complete annotation

* Add deprecation warnings to `is_tagged`, `is_parsed`, `is_sentenced`
and `is_nered`

* Add `Doc._get_array_attrs()`, which returns a full list of `Doc` attrs
for use with `Doc.to_array`, `Doc.to_bytes` and `Doc.from_docs`. The
list is the `DocBin` attributes list plus `SPACY` and `LENGTH`.

Notes on `Doc.has_annotation`:

* `HEAD` is converted to `DEP` because heads don't have an unset state

* Accept `IS_SENT_START` as a synonym of `SENT_START`

Additional changes:

* Add `NORM`, `ENT_ID` and `SENT_START` to default attributes for
`DocBin`

* In `Doc.from_array()` the presence of `DEP` causes `HEAD` to override
`SENT_START`

* In `Doc.from_array()` using `attrs` other than
`Doc._get_array_attrs()` (i.e., a user's custom list rather than our
default internal list) with both `HEAD` and `SENT_START` shows a warning
that `HEAD` will override `SENT_START`

* `set_children_from_heads` does not require dependency labels to set
sentence boundaries and sets `sent_start` for all non-sentence starts to
`-1`

* Fix call to set_children_form_heads

Co-authored-by: Matthew Honnibal <honnibal+gh@gmail.com>
2020-09-17 00:14:01 +02:00
..
__init__.py Revert #4334 2019-09-29 17:32:12 +02:00
test_analysis.py Simplify pipe analysis 2020-08-01 13:40:06 +02:00
test_attributeruler.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
test_entity_linker.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
test_entity_ruler.py Merge branch 'develop' into master-tmp 2020-09-04 13:15:36 +02:00
test_functions.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
test_lemmatizer.py registry.assets -> registry.misc 2020-09-03 17:31:14 +02:00
test_morphologizer.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
test_pipe_factories.py Remove extra pipe config values before merging 2020-09-15 14:24:17 +02:00
test_pipe_methods.py Use frozen list with custom errors 2020-08-29 15:20:11 +02:00
test_sentencizer.py Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
test_senter.py Tidy up and auto-format [ci skip] 2020-09-13 10:55:36 +02:00
test_tagger.py Renaming gold & annotation_setter (#6042) 2020-09-09 10:31:03 +02:00
test_textcat.py positive_label config for textcat (#6062) 2020-09-14 17:08:00 +02:00