mirror of
https://github.com/explosion/spaCy.git
synced 2026-01-13 20:09:05 +03:00
This patch starts getting the StateC object ready to split tokens. The split function is implemented by pushing indices into the buffer that indicate an out-of-length token. Still todo: * Update the oracles * Update GoldParseC * Interpret the parse once it's complete * Add retokenizer.split() method |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_add_label.py | ||
| test_arc_eager_oracle.py | ||
| test_beam_parse.py | ||
| test_ner.py | ||
| test_neural_parser.py | ||
| test_nn_beam.py | ||
| test_nonproj.py | ||
| test_parse_navigate.py | ||
| test_parse.py | ||
| test_preset_sbd.py | ||
| test_space_attachment.py | ||
| test_split_word.py | ||
| test_to_from_bytes_disk.py | ||