Adriane Boyd 0d9740e826 Replace PhraseMatcher with Aho-Corasick ...

Replace PhraseMatcher with the Aho-Corasick algorithm over numpy arrays
of the hash values for the relevant attribute. The implementation is
based on FlashText.

The speed should be similar to the previous PhraseMatcher. It is now
possible to easily remove match IDs and matches don't go missing with
large keyword lists / vocabularies.

Fixes #4308.

2019-09-19 16:49:05 +02:00

0 lines

Cython

Raw Blame History