mirror of
https://github.com/explosion/spaCy.git
synced 2025-01-12 18:26:30 +03:00
d61e742960
* Handle docs with no entities If a whole batch contains no entities it won't make it to the model, but it's possible for individual Docs to have no entities. Before this commit, those Docs would cause an error when attempting to concatenate arrays because the dimensions didn't match. It turns out the process of preparing the Ragged at the end of the span maker forward was a little different from list2ragged, which just uses the flatten function directly. Letting list2ragged do the conversion avoids the dimension issue. This did not come up before because in NEL demo projects it's typical for data with no entities to be discarded before it reaches the NEL component. This includes a simple direct test that shows the issue and checks it's resolved. It doesn't check if there are any downstream changes, so a more complete test could be added. A full run was tested by adding an example with no entities to the Emerson sample project. * Add a blank instance to default training data in tests Rather than adding a specific test, since not failing on instances with no entities is basic functionality, it makes sense to add it to the default set. * Fix without modifying architecture If the architecture is modified this would have to be a new version, but this change isn't big enough to merit that. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_analysis.py | ||
| test_annotates_on_update.py | ||
| test_attributeruler.py | ||
| test_edit_tree_lemmatizer.py | ||
| test_entity_linker.py | ||
| test_entity_ruler.py | ||
| test_functions.py | ||
| test_initialize.py | ||
| test_lemmatizer.py | ||
| test_models.py | ||
| test_morphologizer.py | ||
| test_pipe_factories.py | ||
| test_pipe_methods.py | ||
| test_sentencizer.py | ||
| test_senter.py | ||
| test_span_ruler.py | ||
| test_spancat.py | ||
| test_tagger.py | ||
| test_textcat.py | ||
| test_tok2vec.py | ||