spaCy/website/docs/api/dependencymatcher.md
2020-08-17 16:45:24 +02:00

9.0 KiB

title teaser tag source
DependencyMatcher Match sequences of tokens, based on the dependency parse class spacy/matcher/dependencymatcher.pyx

The DependencyMatcher follows the same API as the Matcher and PhraseMatcher and lets you match on dependency trees using the Semgrex syntax. It requires a pretrained DependencyParser or other component that sets the Token.dep attribute.

Pattern format

### Example
[
  {
    "SPEC": {"NODE_NAME": "founded"},
    "PATTERN": {"ORTH": "founded"}
  },
  {
    "SPEC": {
      "NODE_NAME": "founder",
      "NBOR_RELOP": ">",
      "NBOR_NAME": "founded"
  },
    "PATTERN": {"DEP": "nsubj"}
  },
  {
    "SPEC": {
      "NODE_NAME": "object",
      "NBOR_RELOP": ">",
      "NBOR_NAME": "founded"
  },
    "PATTERN": {"DEP": "dobj"}
  }
]

A pattern added to the DependencyMatcher consists of a list of dictionaries, with each dictionary describing a node to match. Each pattern should have the following top-level keys:

Name Description
PATTERN The token attributes to match in the same format as patterns provided to the regular token-based Matcher. Dict[str, Any]
SPEC The relationships of the nodes in the subtree that should be matched. Dict[str, str]

The SPEC includes the following fields:

Name Description
NODE_NAME A unique name for this node to refer to it in other specs. str
NBOR_RELOP A Semgrex operator that describes how the two nodes are related. str
NBOR_NAME The unique name of the node that this node is connected to. str

DependencyMatcher.__init__

Create a rule-based DependencyMatcher.

Example

from spacy.matcher import DependencyMatcher
matcher = DependencyMatcher(nlp.vocab)
Name Description
vocab The vocabulary object, which must be shared with the documents the matcher will operate on. Vocab

DependencyMatcher._\call__

Find all token sequences matching the supplied patterns on the Doc or Span.

Example

from spacy.matcher import DependencyMatcher

matcher = DependencyMatcher(nlp.vocab)
pattern = [
    {"SPEC": {"NODE_NAME": "founded"}, "PATTERN": {"ORTH": "founded"}},
    {"SPEC": {"NODE_NAME": "founder", "NBOR_RELOP": ">", "NBOR_NAME": "founded"}, "PATTERN": {"DEP": "nsubj"}},
]
matcher.add("Founder", [pattern])
doc = nlp("Bill Gates founded Microsoft.")
matches = matcher(doc)
Name Description
doclike The Doc or Span to match over. Union[Doc, Span]
RETURNS A list of (match_id, start, end) tuples, describing the matches. A match tuple describes a span doc[start:end]. The match_id is the ID of the added match pattern. List[Tuple[int, int, int]]

DependencyMatcher.__len__

Get the number of rules (edges) added to the dependency matcher. Note that this only returns the number of rules (identical with the number of IDs), not the number of individual patterns.

Example

matcher = DependencyMatcher(nlp.vocab)
assert len(matcher) == 0
pattern = [
    {"SPEC": {"NODE_NAME": "founded"}, "PATTERN": {"ORTH": "founded"}},
    {"SPEC": {"NODE_NAME": "START_ENTITY", "NBOR_RELOP": ">", "NBOR_NAME": "founded"}, "PATTERN": {"DEP": "nsubj"}},
]
matcher.add("Rule", [pattern])
assert len(matcher) == 1
Name Description
RETURNS The number of rules. int

DependencyMatcher.__contains__

Check whether the matcher contains rules for a match ID.

Example

matcher = Matcher(nlp.vocab)
assert "Rule" not in matcher
matcher.add("Rule", [pattern])
assert "Rule" in matcher
Name Description
key The match ID. str
RETURNS Whether the matcher contains rules for this match ID. bool

DependencyMatcher.add

Add a rule to the matcher, consisting of an ID key, one or more patterns, and an optional callback function to act on the matches. The callback function will receive the arguments matcher, doc, i and matches. If a pattern already exists for the given ID, the patterns will be extended. An on_match callback will be overwritten.

Example

def on_match(matcher, doc, id, matches):
    print('Matched!', matches)

matcher = DependencyMatcher(nlp.vocab)
matcher.add("TEST_PATTERNS", patterns)
Name Description
match_id An ID for the thing you're matching. str
patterns list
keyword-only
on_match Callback function to act on matches. Takes the arguments matcher, doc, i and matches. Optional[CallableMatcher, Doc, int, List[tuple], Any

DependencyMatcher.remove

Remove a rule from the matcher. A KeyError is raised if the match ID does not exist.

Example

matcher.add("Rule", [pattern]])
assert "Rule" in matcher
matcher.remove("Rule")
assert "Rule" not in matcher
Name Description
key The ID of the match rule. str

DependencyMatcher.get

Retrieve the pattern stored for a key. Returns the rule as an (on_match, patterns) tuple containing the callback and available patterns.

Example

matcher.add("Rule", [pattern], on_match=on_match)
on_match, patterns = matcher.get("Rule")
Name Description
key The ID of the match rule. str
RETURNS The rule, as an (on_match, patterns) tuple. Tuple[Optional[Callable], List[List[dict]]]