mirror of
https://github.com/explosion/spaCy.git
synced 2024-12-29 11:26:28 +03:00
fix fn name: tokenizer.infixes_finditer -> tokenizer.infix_finditer (#7606)
This commit is contained in:
parent
4cb7125f7a
commit
24dd491b09
|
@ -962,7 +962,7 @@ domain. There are six things you may need to define:
|
|||
quotes, open brackets, etc.
|
||||
3. A function `suffix_search`, to handle **succeeding punctuation**, such as
|
||||
commas, periods, close quotes, etc.
|
||||
4. A function `infixes_finditer`, to handle non-whitespace separators, such as
|
||||
4. A function `infix_finditer`, to handle non-whitespace separators, such as
|
||||
hyphens etc.
|
||||
5. An optional boolean function `token_match` matching strings that should never
|
||||
be split, overriding the infix rules. Useful for things like numbers.
|
||||
|
|
Loading…
Reference in New Issue
Block a user