mirror of
https://github.com/explosion/spaCy.git
synced 2025-01-26 17:24:41 +03:00
d59f968d08
In the retokenizer, only reset sent starts (with `set_children_from_head`) if the doc is parsed. If there is no parse, merged tokens have the unset `token.is_sent_start == None` by default after retokenization. |
||
---|---|---|
.. | ||
__init__.py | ||
test_add_entities.py | ||
test_array.py | ||
test_creation.py | ||
test_doc_api.py | ||
test_graph.py | ||
test_morphanalysis.py | ||
test_pickle_doc.py | ||
test_retokenize_merge.py | ||
test_retokenize_split.py | ||
test_span.py | ||
test_to_json.py | ||
test_token_api.py | ||
test_underscore.py |