spaCy/spacy/lang
Adriane Boyd 7e4cd7575c
Refactor Docs.is_ flags (#6044)
* Refactor Docs.is_ flags

* Add derived `Doc.has_annotation` method

  * `Doc.has_annotation(attr)` returns `True` for partial annotation

  * `Doc.has_annotation(attr, require_complete=True)` returns `True` for
    complete annotation

* Add deprecation warnings to `is_tagged`, `is_parsed`, `is_sentenced`
and `is_nered`

* Add `Doc._get_array_attrs()`, which returns a full list of `Doc` attrs
for use with `Doc.to_array`, `Doc.to_bytes` and `Doc.from_docs`. The
list is the `DocBin` attributes list plus `SPACY` and `LENGTH`.

Notes on `Doc.has_annotation`:

* `HEAD` is converted to `DEP` because heads don't have an unset state

* Accept `IS_SENT_START` as a synonym of `SENT_START`

Additional changes:

* Add `NORM`, `ENT_ID` and `SENT_START` to default attributes for
`DocBin`

* In `Doc.from_array()` the presence of `DEP` causes `HEAD` to override
`SENT_START`

* In `Doc.from_array()` using `attrs` other than
`Doc._get_array_attrs()` (i.e., a user's custom list rather than our
default internal list) with both `HEAD` and `SENT_START` shows a warning
that `HEAD` will override `SENT_START`

* `set_children_from_heads` does not require dependency labels to set
sentence boundaries and sets `sent_start` for all non-sentence starts to
`-1`

* Fix call to set_children_form_heads

Co-authored-by: Matthew Honnibal <honnibal+gh@gmail.com>
2020-09-17 00:14:01 +02:00
..
af Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
ar Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
bg Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
bn Set rule-based lemmatizers as default (#6076) 2020-09-16 17:37:29 +02:00
ca Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
cs Remove unicode declarations and update language data 2020-09-04 13:19:16 +02:00
da Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
de Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
el Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
en Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
es Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
et Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
eu Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
fa Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
fi Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
fr Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
ga Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
gu Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
he Remove unicode declarations and update language data 2020-09-04 13:19:16 +02:00
hi Merge branch 'develop' into master-tmp 2020-09-04 13:15:36 +02:00
hr Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
hu Fix Hungarian % tokenization (#6013) 2020-09-02 13:06:16 +02:00
hy Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
id Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
is Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
it Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
ja Merge branch 'develop' into master-tmp 2020-09-04 13:15:36 +02:00
kn Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
ko Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
lb Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
lij Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
lt Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
lv Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
ml Add missing lex_attr_getters (resolves #5806 ) 2020-07-25 12:55:18 +02:00
mr Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
nb Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
ne Remove unicode declarations and update language data 2020-09-04 13:19:16 +02:00
nl Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
pl Rename Polish lemmatizer method (#5960) 2020-08-25 00:22:27 +02:00
pt Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
ro Add missing lex_attr_getters (resolves #5806 ) 2020-07-25 12:55:18 +02:00
ru Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
sa Remove unicode declarations and update language data 2020-09-04 13:19:16 +02:00
si Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
sk Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
sl Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
sq Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
sr Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
sv Refactor Docs.is_ flags (#6044) 2020-09-17 00:14:01 +02:00
ta Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
te Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
th Use "raise ... from" in custom errors for better tracebacks 2020-08-05 23:53:21 +02:00
tl Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
tr Add missing lex_attr_getters (resolves #5806 ) 2020-07-25 12:55:18 +02:00
tt Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
uk Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
ur Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
vi Use "raise ... from" in custom errors for better tracebacks 2020-08-05 23:53:21 +02:00
xx Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
yo Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
zh Use "raise ... from" in custom errors for better tracebacks 2020-08-05 23:53:21 +02:00
__init__.py Remove imports in /lang/__init__.py 2017-05-08 23:58:07 +02:00
char_classes.py Merge branch 'master' into develop 2020-02-18 14:47:23 +01:00
lex_attrs.py Merge branch 'develop' into master-tmp 2020-09-04 13:15:36 +02:00
norm_exceptions.py Tidy up and auto-format 2020-02-18 15:38:18 +01:00
punctuation.py Simplify language data and revert detailed configs 2020-07-24 14:50:26 +02:00
tokenizer_exceptions.py Merge branch 'develop' into master-tmp 2020-09-04 13:15:36 +02:00