mirror of
https://github.com/explosion/spaCy.git
synced 2025-10-27 14:11:04 +03:00
In the retokenizer, only reset sent starts (with `set_children_from_head`) if the doc is parsed. If there is no parse, merged tokens have the unset `token.is_sent_start == None` by default after retokenization. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_add_entities.py | ||
| test_array.py | ||
| test_creation.py | ||
| test_doc_api.py | ||
| test_graph.py | ||
| test_morphanalysis.py | ||
| test_pickle_doc.py | ||
| test_retokenize_merge.py | ||
| test_retokenize_split.py | ||
| test_span.py | ||
| test_to_json.py | ||
| test_token_api.py | ||
| test_underscore.py | ||