Adriane Boyd 4f441dfa24 Fix infix as prefix in Tokenizer.explain (#10140) ... * Fix infix as prefix in Tokenizer.explain Update `Tokenizer.explain` to align with the `Tokenizer` algorithm: * skip infix matches that are prefixes in the current substring * Update tokenizer pseudocode in docs		2022-01-28 17:00:54 +01:00
..
api	Add ENT_IOB key to Matcher (#9649)	2022-01-20 13:18:39 +01:00
images	Update Prodigy project template for v1.11 [ci skip]	2021-08-12 13:46:20 +10:00
models	Various docs updates for v3.1 (#8406)	2021-06-21 09:33:50 +02:00
usage	Fix infix as prefix in Tokenizer.explain (#10140)	2022-01-28 17:00:54 +01:00
index.md	💫 Update website (#3285)	2019-02-17 19:31:19 +01:00
styleguide.md	Update styleguide [ci skip]	2020-09-14 11:25:57 +02:00