adrianeboyd f2bfaa1b38 Filter subtoken matches in merge_subtokens() (#4539) ... The `Matcher` in `merge_subtokens()` returns all possible subsequences of `subtok`, so for sequences of two or more subtoks it's necessary to filter the matches so that the retokenizer is only merging the longest matches with no overlapping spans.		2019-10-28 15:40:28 +01:00
..
__init__.py	Merge changes from master	2019-08-21 14:18:52 +02:00
entityruler.py	Component decorator and component analysis (#4517)	2019-10-27 13:35:49 +01:00
functions.py	Filter subtoken matches in merge_subtokens() (#4539)	2019-10-28 15:40:28 +01:00
hooks.py	Component decorator and component analysis (#4517)	2019-10-27 13:35:49 +01:00
morphologizer.pyx	Component decorator and component analysis (#4517)	2019-10-27 13:35:49 +01:00
pipes.pyx	Fix --gold-preproc train cli command (#4392)	2019-10-27 21:58:50 +01:00