mirror of
https://github.com/explosion/spaCy.git
synced 2024-09-21 03:19:13 +03:00
a322d6d5f2
* Add SpanRuler component Add a `SpanRuler` component similar to `EntityRuler` that saves a list of matched spans to `Doc.spans[spans_key]`. The matches from the token and phrase matchers are deduplicated and sorted before assignment but are not otherwise filtered. * Update spacy/pipeline/span_ruler.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Fix cast * Add self.key property * Use number of patterns as length * Remove patterns kwarg from init * Update spacy/tests/pipeline/test_span_ruler.py Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Add options for spans filter and setting to ents * Add `spans_filter` option as a registered function' * Make `spans_key` optional and if `None`, set to `doc.ents` instead of `doc.spans[spans_key]`. * Update and generalize tests * Add test for setting doc.ents, fix key property type * Fix typing * Allow independent doc.spans and doc.ents * If `spans_key` is set, set `doc.spans` with `spans_filter`. * If `annotate_ents` is set, set `doc.ents` with `ents_fitler`. * Use `util.filter_spans` by default as `ents_filter`. * Use a custom warning if the filter does not work for `doc.ents`. * Enable use of SpanC.id in Span * Support id in SpanRuler as Span.id * Update types * `id` can only be provided as string (already by `PatternType` definition) * Update all uses of Span.id/ent_id in Doc * Rename Span id kwarg to span_id * Update types and docs * Add ents filter to mimic EntityRuler overwrite_ents * Refactor `ents_filter` to take `entities, spans` args for more filtering options * Give registered filters more descriptive names * Allow registered `filter_spans` filter (`spacy.first_longest_spans_filter.v1`) to take any number of `Iterable[Span]` objects as args so it can be used for spans filter or ents filter * Implement future entity ruler as span ruler Implement a compatible `entity_ruler` as `future_entity_ruler` using `SpanRuler` as the underlying component: * Add `sort_key` and `sort_reverse` to allow the sorting behavior to be customized. (Necessary for the same sorting/filtering as in `EntityRuler`.) * Implement `overwrite_overlapping_ents_filter` and `preserve_existing_ents_filter` to support `EntityRuler.overwrite_ents` settings. * Add `remove_by_id` to support `EntityRuler.remove` functionality. * Refactor `entity_ruler` tests to parametrize all tests to test both `entity_ruler` and `future_entity_ruler` * Implement `SpanRuler.token_patterns` and `SpanRuler.phrase_patterns` properties. Additional changes: * Move all config settings to top-level attributes to avoid duplicating settings in the config vs. `span_ruler/cfg`. (Also avoids a lot of casting.) * Format * Fix filter make method name * Refactor to use same error for removing by label or ID * Also provide existing spans to spans filter * Support ids property * Remove token_patterns and phrase_patterns * Update docstrings * Add span ruler docs * Fix types * Apply suggestions from code review Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com> * Move sorting into filters * Check for all tokens in seen tokens in entity ruler filters * Remove registered sort key * Set Token.ent_id in a backwards-compatible way in Doc.set_ents * Remove sort options from API docs * Update docstrings * Rename entity ruler filters * Fix and parameterize scoring * Add id to Span API docs * Fix typo in API docs * Include explicit labeled=True for scorer Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
153 lines
6.8 KiB
JSON
153 lines
6.8 KiB
JSON
[
|
|
{
|
|
"section": "usage",
|
|
"items": [
|
|
{
|
|
"label": "Get started",
|
|
"items": [
|
|
{ "text": "Installation", "url": "/usage" },
|
|
{ "text": "Models & Languages", "url": "/usage/models" },
|
|
{ "text": "Facts & Figures", "url": "/usage/facts-figures" },
|
|
{ "text": "spaCy 101", "url": "/usage/spacy-101" },
|
|
{ "text": "New in v3.0", "url": "/usage/v3" },
|
|
{ "text": "New in v3.1", "url": "/usage/v3-1" },
|
|
{ "text": "New in v3.2", "url": "/usage/v3-2" },
|
|
{ "text": "New in v3.3", "url": "/usage/v3-3" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Guides",
|
|
"items": [
|
|
{ "text": "Linguistic Features", "url": "/usage/linguistic-features" },
|
|
{ "text": "Rule-based Matching", "url": "/usage/rule-based-matching" },
|
|
{ "text": "Processing Pipelines", "url": "/usage/processing-pipelines" },
|
|
{
|
|
"text": "Embeddings & Transformers",
|
|
"url": "/usage/embeddings-transformers",
|
|
"tag": "new"
|
|
},
|
|
{ "text": "Training Models", "url": "/usage/training", "tag": "new" },
|
|
{
|
|
"text": "Layers & Model Architectures",
|
|
"url": "/usage/layers-architectures",
|
|
"tag": "new"
|
|
},
|
|
{ "text": "spaCy Projects", "url": "/usage/projects", "tag": "new" },
|
|
{ "text": "Saving & Loading", "url": "/usage/saving-loading" },
|
|
{ "text": "Visualizers", "url": "/usage/visualizers" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Resources",
|
|
"items": [
|
|
{ "text": "Project Templates", "url": "https://github.com/explosion/projects" },
|
|
{ "text": "v2.x Documentation", "url": "https://v2.spacy.io" },
|
|
{
|
|
"text": "Custom Solutions",
|
|
"url": "https://explosion.ai/spacy-tailored-pipelines"
|
|
}
|
|
]
|
|
}
|
|
]
|
|
},
|
|
{
|
|
"section": "models",
|
|
"items": [
|
|
{
|
|
"label": "Models",
|
|
"items": [{ "text": "Overview", "url": "/models" }]
|
|
},
|
|
{
|
|
"label": "Trained Pipelines",
|
|
"items": []
|
|
}
|
|
]
|
|
},
|
|
{
|
|
"section": "api",
|
|
"items": [
|
|
{
|
|
"label": "Overview",
|
|
"items": [
|
|
{ "text": "Library Architecture", "url": "/api" },
|
|
{ "text": "Model Architectures", "url": "/api/architectures" },
|
|
{ "text": "Data Formats", "url": "/api/data-formats" },
|
|
{ "text": "Command Line", "url": "/api/cli" },
|
|
{ "text": "Functions", "url": "/api/top-level" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Containers",
|
|
"items": [
|
|
{ "text": "Doc", "url": "/api/doc" },
|
|
{ "text": "DocBin", "url": "/api/docbin" },
|
|
{ "text": "Example", "url": "/api/example" },
|
|
{ "text": "Language", "url": "/api/language" },
|
|
{ "text": "Lexeme", "url": "/api/lexeme" },
|
|
{ "text": "Span", "url": "/api/span" },
|
|
{ "text": "SpanGroup", "url": "/api/spangroup" },
|
|
{ "text": "Token", "url": "/api/token" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Pipeline",
|
|
"items": [
|
|
{ "text": "AttributeRuler", "url": "/api/attributeruler" },
|
|
{ "text": "DependencyParser", "url": "/api/dependencyparser" },
|
|
{ "text": "EditTreeLemmatizer", "url": "/api/edittreelemmatizer" },
|
|
{ "text": "EntityLinker", "url": "/api/entitylinker" },
|
|
{ "text": "EntityRecognizer", "url": "/api/entityrecognizer" },
|
|
{ "text": "EntityRuler", "url": "/api/entityruler" },
|
|
{ "text": "Lemmatizer", "url": "/api/lemmatizer" },
|
|
{ "text": "Morphologizer", "url": "/api/morphologizer" },
|
|
{ "text": "SentenceRecognizer", "url": "/api/sentencerecognizer" },
|
|
{ "text": "Sentencizer", "url": "/api/sentencizer" },
|
|
{ "text": "SpanCategorizer", "url": "/api/spancategorizer" },
|
|
{ "text": "SpanRuler", "url": "/api/spanruler" },
|
|
{ "text": "Tagger", "url": "/api/tagger" },
|
|
{ "text": "TextCategorizer", "url": "/api/textcategorizer" },
|
|
{ "text": "Tok2Vec", "url": "/api/tok2vec" },
|
|
{ "text": "Tokenizer", "url": "/api/tokenizer" },
|
|
{ "text": "TrainablePipe", "url": "/api/pipe" },
|
|
{ "text": "Transformer", "url": "/api/transformer" },
|
|
{ "text": "Other Functions", "url": "/api/pipeline-functions" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Matchers",
|
|
"items": [
|
|
{ "text": "DependencyMatcher", "url": "/api/dependencymatcher" },
|
|
{ "text": "Matcher", "url": "/api/matcher" },
|
|
{ "text": "PhraseMatcher", "url": "/api/phrasematcher" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Other",
|
|
"items": [
|
|
{ "text": "Corpus", "url": "/api/corpus" },
|
|
{ "text": "KnowledgeBase", "url": "/api/kb" },
|
|
{ "text": "Lookups", "url": "/api/lookups" },
|
|
{ "text": "MorphAnalysis", "url": "/api/morphology#morphanalysis" },
|
|
{ "text": "Morphology", "url": "/api/morphology" },
|
|
{ "text": "Scorer", "url": "/api/scorer" },
|
|
{ "text": "StringStore", "url": "/api/stringstore" },
|
|
{ "text": "Vectors", "url": "/api/vectors" },
|
|
{ "text": "Vocab", "url": "/api/vocab" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Cython",
|
|
"items": [
|
|
{ "text": "Architecture", "url": "/api/cython" },
|
|
{ "text": "Classes", "url": "/api/cython-classes" },
|
|
{ "text": "Structs", "url": "/api/cython-structs" }
|
|
]
|
|
},
|
|
{
|
|
"label": "Legacy",
|
|
"items": [{ "text": "Legacy functions", "url": "/api/legacy" }]
|
|
}
|
|
]
|
|
}
|
|
]
|