mirror of
https://github.com/explosion/spaCy.git
synced 2025-11-15 07:15:52 +03:00
Instead of unsetting lemmas on retokenized tokens, set the default lemmas to: * merge: concatenate any existing lemmas with `SPACY` preserved * split: use the new `ORTH` values if lemmas were previously set, otherwise leave unset |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_add_entities.py | ||
| test_array.py | ||
| test_creation.py | ||
| test_doc_api.py | ||
| test_morphanalysis.py | ||
| test_pickle_doc.py | ||
| test_retokenize_merge.py | ||
| test_retokenize_split.py | ||
| test_span.py | ||
| test_to_json.py | ||
| test_token_api.py | ||
| test_underscore.py | ||