1
1
mirror of https://github.com/explosion/spaCy.git synced 2025-04-03 08:44:12 +03:00
spaCy/spacy/pipeline
adrianeboyd f2bfaa1b38 Filter subtoken matches in merge_subtokens() ()
The `Matcher` in `merge_subtokens()` returns all possible subsequences
of `subtok`, so for sequences of two or more subtoks it's necessary to
filter the matches so that the retokenizer is only merging the longest
matches with no overlapping spans.
2019-10-28 15:40:28 +01:00
..
__init__.py Merge changes from master 2019-08-21 14:18:52 +02:00
entityruler.py Component decorator and component analysis () 2019-10-27 13:35:49 +01:00
functions.py Filter subtoken matches in merge_subtokens() () 2019-10-28 15:40:28 +01:00
hooks.py Component decorator and component analysis () 2019-10-27 13:35:49 +01:00
morphologizer.pyx Component decorator and component analysis () 2019-10-27 13:35:49 +01:00
pipes.pyx Fix --gold-preproc train cli command () 2019-10-27 21:58:50 +01:00